[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 496014153 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.002378] x2apic enabled [ 0.003009] Switched APIC routing to physical x2apic. [ 0.004015] kvm-guest: setup PV IPIs [ 0.006959] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.007021] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.008013] pid_max: default: 32768 minimum: 301 [ 0.009145] LSM: Security Framework initializing [ 0.010060] Yama: becoming mindful. [ 0.011046] SELinux: Initializing. [ 0.012106] *** VALIDATE selinux *** [ 0.019492] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.024332] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.025146] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.026129] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.027132] *** VALIDATE tmpfs *** [ 0.028439] *** VALIDATE proc *** [ 0.030104] *** VALIDATE cgroup *** [ 0.031013] *** VALIDATE cgroup2 *** [ 0.033079] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.034164] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.035010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.036032] Spectre V2 : User space: Vulnerable [ 0.037009] Speculative Store Bypass: Vulnerable [ 0.040152] debug: unmapping init [mem 0xffffffffb6e59000-0xffffffffb6e60fff] [ 0.043000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.043678] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.044027] ... version: 2 [ 0.045016] ... bit width: 48 [ 0.046013] ... generic registers: 4 [ 0.047014] ... value mask: 0000ffffffffffff [ 0.048015] ... max period: 00007fffffffffff [ 0.049016] ... fixed-purpose events: 3 [ 0.050014] ... event mask: 000000070000000f [ 0.051319] rcu: Hierarchical SRCU implementation. [ 0.053501] smp: Bringing up secondary CPUs ... [ 0.054606] x86: Booting SMP configuration: [ 0.055029] .... node #0, CPUs: #1 #2 #3 [ 0.058202] smp: Brought up 1 node, 4 CPUs [ 0.060013] smpboot: Max logical packages: 1 [ 0.061020] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.124225] node 0 deferred pages initialised in 61ms [ 0.126093] devtmpfs: initialized [ 0.127256] x86/mm: Memory block size: 128MB [ 0.129590] gcov: version magic: 0x41383552 [ 0.133310] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.136093] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.137226] pinctrl core: initialized pinctrl subsystem [ 0.139117] [ 0.139489] ************************************************************* [ 0.141013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.142007] ** ** [ 0.144009] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.145008] ** ** [ 0.147012] ** This means that this kernel is built to expose internal ** [ 0.148011] ** IOMMU data structures, which may compromise security on ** [ 0.150008] ** your system. ** [ 0.151008] ** ** [ 0.153011] ** If you see this message and you are not debugging the ** [ 0.154007] ** kernel, report this immediately to your vendor! ** [ 0.156010] ** ** [ 0.157006] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.159012] ************************************************************* [ 0.161633] NET: Registered protocol family 16 [ 0.163360] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.165051] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.167040] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.170105] cpuidle: using governor menu [ 0.171758] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.172804] PCI: Using configuration type 1 for base access [ 0.174138] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.183052] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.186020] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.189145] cryptd: max_cpu_qlen set to 1000 [ 0.192273] ACPI: Added _OSI(Module Device) [ 0.194017] ACPI: Added _OSI(Processor Device) [ 0.195016] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.197015] ACPI: Added _OSI(Processor Aggregator Device) [ 0.202120] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.209588] ACPI: Interpreter enabled [ 0.211068] ACPI: PM: (supports S0 S3 S4 S5) [ 0.213017] ACPI: Using IOAPIC for interrupt routing [ 0.216128] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.220275] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.227611] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.229034] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.232022] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.235097] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.241000] acpiphp: Slot [2] registered [ 0.242030] acpiphp: Slot [5] registered [ 0.244168] acpiphp: Slot [6] registered [ 0.246187] acpiphp: Slot [7] registered [ 0.247159] acpiphp: Slot [8] registered [ 0.249149] acpiphp: Slot [9] registered [ 0.250150] acpiphp: Slot [10] registered [ 0.253097] acpiphp: Slot [3] registered [ 0.254149] acpiphp: Slot [4] registered [ 0.256119] acpiphp: Slot [11] registered [ 0.258105] acpiphp: Slot [12] registered [ 0.259102] acpiphp: Slot [13] registered [ 0.261124] acpiphp: Slot [14] registered [ 0.262105] acpiphp: Slot [15] registered [ 0.264137] acpiphp: Slot [16] registered [ 0.266148] acpiphp: Slot [17] registered [ 0.267118] acpiphp: Slot [18] registered [ 0.269105] acpiphp: Slot [19] registered [ 0.271134] acpiphp: Slot [20] registered [ 0.272111] acpiphp: Slot [21] registered [ 0.274112] acpiphp: Slot [22] registered [ 0.275146] acpiphp: Slot [23] registered [ 0.277108] acpiphp: Slot [24] registered [ 0.279109] acpiphp: Slot [25] registered [ 0.280106] acpiphp: Slot [26] registered [ 0.282111] acpiphp: Slot [27] registered [ 0.283102] acpiphp: Slot [28] registered [ 0.285070] acpiphp: Slot [29] registered [ 0.286000] acpiphp: Slot [30] registered [ 0.286095] acpiphp: Slot [31] registered [ 0.288064] PCI host bridge to bus 0000:00 [ 0.289000] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.289000] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.291015] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.293014] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.295019] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.297027] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.299184] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.303174] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.306833] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.316850] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.321553] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.324015] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.325012] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.327015] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.330509] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.333827] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.336046] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.339714] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.344014] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.358016] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.361965] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.366885] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.373019] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.379019] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.395016] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.405000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.411015] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.417015] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.431017] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.439866] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.446015] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.459017] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.486018] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.496369] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.507015] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.513013] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.529026] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.541654] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.553019] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.568017] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.597019] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.628658] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.638019] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.647018] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.673020] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.687260] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.690430] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.693375] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.695454] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.698239] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.705048] iommu: Default domain type: Passthrough [ 0.706424] SCSI subsystem initialized [ 0.707140] ACPI: bus type USB registered [ 0.708119] usbcore: registered new interface driver usbfs [ 0.710094] usbcore: registered new interface driver hub [ 0.712104] usbcore: registered new device driver usb [ 0.714933] pps_core: LinuxPPS API ver. 1 registered [ 0.716010] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.719066] PTP clock support registered [ 0.722063] EDAC MC: Ver: 3.0.0 [ 0.724131] PCI: Using ACPI for IRQ routing [ 0.726883] NetLabel: Initializing [ 0.728011] NetLabel: domain hash size = 128 [ 0.730011] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.732113] NetLabel: unlabeled traffic allowed by default [ 0.734124] vgaarb: loaded [ 0.736271] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.738015] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.744484] clocksource: Switched to clocksource kvm-clock [ 0.850807] VFS: Disk quotas dquot_6.6.0 [ 0.852365] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.855082] *** VALIDATE ramfs *** [ 0.856288] *** VALIDATE hugetlbfs *** [ 0.857947] pnp: PnP ACPI init [ 0.860497] pnp: PnP ACPI: found 6 devices [ 0.875558] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.878982] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.881303] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.883601] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.886289] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.888729] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.891672] NET: Registered protocol family 2 [ 0.894265] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.899143] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.902521] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.907374] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.911067] TCP: Hash tables configured (established 65536 bind 65536) [ 0.914116] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.917592] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.920790] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.925380] NET: Registered protocol family 1 [ 0.928812] RPC: Registered named UNIX socket transport module. [ 0.931317] RPC: Registered udp transport module. [ 0.933061] RPC: Registered tcp transport module. [ 0.934617] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.936599] NET: Registered protocol family 44 [ 0.938326] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.940421] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.942588] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.944951] PCI: CLS 0 bytes, default 64 [ 0.947526] Unpacking initramfs... [ 2.322613] debug: unmapping init [mem 0xffff9185fcc54000-0xffff9185fffbffff] [ 2.325929] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.328233] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.331383] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.839987] Initialise system trusted keyrings [ 2.841837] Key type blacklist registered [ 2.843847] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.853028] zbud: loaded [ 2.856268] *** VALIDATE nfs *** [ 2.857561] *** VALIDATE nfs4 *** [ 2.859286] pstore: using deflate compression [ 2.865079] Platform Keyring initialized [ 2.959959] NET: Registered protocol family 38 [ 2.961192] Key type asymmetric registered [ 2.962347] Asymmetric key parser 'x509' registered [ 2.963695] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.965837] io scheduler mq-deadline registered [ 2.966954] io scheduler kyber registered [ 2.968128] io scheduler bfq registered [ 2.969541] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.971645] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.973446] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.975534] ACPI: Power Button [PWRF] [ 2.978946] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.985310] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.999561] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.013045] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.025522] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.049938] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.076424] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.081147] Non-volatile memory driver v1.3 [ 3.082415] Linux agpgart interface v0.103 [ 3.114481] virtio_blk virtio1: [vda] 144824 512-byte logical blocks (74.1 MB/70.7 MiB) [ 3.117697] vda: detected capacity change from 0 to 74149888 [ 3.133214] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.136469] vdb: detected capacity change from 0 to 1073741824 [ 3.149898] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.152343] vdc: detected capacity change from 0 to 2621440000 [ 3.167158] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.170147] vdd: detected capacity change from 0 to 2621440000 [ 3.195612] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.198319] vde: detected capacity change from 0 to 4294967296 [ 3.211926] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.214434] vdf: detected capacity change from 0 to 4294967296 [ 3.220428] libphy: Fixed MDIO Bus: probed [ 3.236273] usbcore: registered new interface driver usbserial_generic [ 3.239049] usbserial: USB Serial support registered for generic [ 3.241728] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.246327] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.248452] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.251406] mousedev: PS/2 mouse device common for all mice [ 3.254594] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.256648] rtc_cmos 00:05: RTC can wake from S4 [ 3.260384] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.265578] rtc_cmos 00:05: registered as rtc0 [ 3.265609] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.267499] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.274348] intel_pstate: CPU model not supported [ 3.277344] hid: raw HID events driver (C) Jiri Kosina [ 3.279654] usbcore: registered new interface driver usbhid [ 3.281526] usbhid: USB HID core driver [ 3.283049] drop_monitor: Initializing network drop monitor service [ 3.285657] Initializing XFRM netlink socket [ 3.287776] NET: Registered protocol family 10 [ 3.290479] Segment Routing with IPv6 [ 3.292107] NET: Registered protocol family 17 [ 3.294230] mpls_gso: MPLS GSO support [ 3.298690] RAS: Correctable Errors collector initialized. [ 3.300943] AVX version of gcm_enc/dec engaged. [ 3.302471] AES CTR mode by8 optimization enabled [ 3.392040] sched_clock: Marking stable (3392012842, 0)->(4307380466, -915367624) [ 3.397038] registered taskstats version 1 [ 3.399134] Loading compiled-in X.509 certificates [ 3.400766] zswap: loaded using pool lzo/zbud [ 3.426689] Key type big_key registered [ 3.437605] Key type encrypted registered [ 3.438827] ima: No TPM chip found, activating TPM-bypass! [ 3.440873] ima: Allocated hash algorithm: sha1 [ 3.442744] ima: No architecture policies found [ 3.444665] evm: Initialising EVM extended attributes: [ 3.446632] evm: security.selinux [ 3.448043] evm: security.ima [ 3.449229] evm: security.capability [ 3.450598] evm: HMAC attrs: 0x1 [ 3.454597] rtc_cmos 00:05: setting system clock to 2026-06-28 01:13:50 UTC (1782609230) [ 3.461304] debug: unmapping init [mem 0xffffffffb7e03000-0xffffffffb7ffffff] [ 3.464432] debug: unmapping init [mem 0xffffffffb6b82000-0xffffffffb6e58fff] [ 3.471118] Write protecting the kernel read-only data: 28672k [ 3.476592] debug: unmapping init [mem 0xffffffffb5203000-0xffffffffb53fffff] [ 3.478994] debug: unmapping init [mem 0xffffffffb5b14000-0xffffffffb5bfffff] [ 3.519890] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.525128] systemd[1]: Detected virtualization kvm. [ 3.526557] systemd[1]: Detected architecture x86-64. [ 3.527726] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.552810] systemd[1]: No hostname configured. [ 3.553979] systemd[1]: Set hostname to . [ 3.555192] random: systemd: uninitialized urandom read (16 bytes read) [ 3.556655] systemd[1]: Initializing machine ID from random generator. [ 3.598082] random: ln: uninitialized urandom read (6 bytes read) [ 3.704063] random: systemd: uninitialized urandom read (16 bytes read) [ 3.707346] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 3.714408] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 3.718384] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Started Memstrack Anylazing Service. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on udev Kernel Socket. Starting Apply Kernel Variables... [ OK ] Reached target Timers. [ OK ] Reached target Slices. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Reached target Paths. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.300624] device-mapper: uevent: version 1.0.3 [ 4.302646] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 4.948218] random: fast init done [ 4.952824] virtio_net virtio0 ens2: renamed from eth0 [ 5.012338] scsi host0: ata_piix [ 5.019783] scsi host1: ata_piix [ 5.021713] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.024286] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 8.677687] dracut-initqueue[583]: RTNETLINK answers: File exists [ 9.957369] random: crng init done [ 9.958891] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.298315] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Remote File Systems. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.406221] printk: systemd: 26 output lines suppressed due to ratelimiting [ 11.618496] SELinux: Disabled at runtime. [ 11.679724] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 11.688730] systemd[1]: Detected virtualization kvm. [ 11.691983] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.118446] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.121194] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.125337] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.129483] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.132046] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.138614] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.142808] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. Activating swap /dev/disk/by-label/SWAP... Mounting POSIX Message Queue File System... Mounting Huge Pages File System... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on initctl Compati[ 12.172766] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS bility Named Pipe. Mounting Kernel Debug File System... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on udev Kernel Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-serial\x2dgetty.slice. Starting Create list of required st…ce nodes for the current kernel... Starting Apply Kernel Variables... Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-getty.slice. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting udev Coldplug all Devices... [ OK ] Started Journal Service. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Flush Journal to Persistent Storage. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Mounted /mnt. [ 12.495686] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Coldplug all Devices. [ OK ] Started udev Kernel Device Manager. [ 12.724614] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 12.764735] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 12.883164] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 12.894577] EDAC sbridge: Ver: 1.1.2 [ 14.257799] Key type dns_resolver registered [ 14.519349] NFS: Registering the id_resolver key type [ 14.521820] Key type id_resolver registered [ 14.523567] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Mark the need to relabel after reboot... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started D-Bus System Message Bus. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... Starting Login Service... Starting Network Manager... [ OK ] Reached target sshd-keygen.target. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg149-server login: [ 62.948325] hrtimer: interrupt took 3385204 ns [ 65.723720] libcfs: loading out-of-tree module taints kernel. [ 65.812120] Key type ._llcrypt registered [ 65.816942] Key type .llcrypt registered [ 65.963412] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 85.033468] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 86.543395] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 86.567455] alg: No test for adler32 (adler32-zlib) [ 87.982320] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 88.880202] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 90.769897] Key type lgssc registered [ 93.217428] Lustre: Echo OBD driver; http://www.lustre.org/ [ 113.576549] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 158.569785] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 171.164059] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 171.195257] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 172.448453] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 172.493674] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 172.643359] Lustre: lustre-MDT0000: new disk, initializing [ 172.752731] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 172.787105] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 177.461803] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 191.022057] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 191.147502] Lustre: 6515:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 191.189465] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 191.193694] Lustre: Skipped 1 previous similar message [ 191.303882] Lustre: lustre-MDT0001: new disk, initializing [ 191.401669] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 191.466304] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 191.472633] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 195.612535] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 200.679660] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 211.229368] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 211.534769] Lustre: lustre-OST0000: new disk, initializing [ 211.539349] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 211.547230] Lustre: 8455:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 211.659590] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 218.468800] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 218.691855] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 218.715583] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 218.839473] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 233.662391] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 233.877714] Lustre: lustre-OST0001: new disk, initializing [ 233.881390] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 233.886904] Lustre: 9527:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 233.953768] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 239.601601] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 242.246702] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 242.258801] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 242.306476] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 252.168841] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 262.581627] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 269.889676] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing check_logdir /tmp/testlogs/ [ 276.155085] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing yml_node [ 280.716594] Lustre: DEBUG MARKER: Client: 2.17.54.105 [ 283.071694] Lustre: DEBUG MARKER: MDS: 2.17.54.105 [ 285.783436] Lustre: DEBUG MARKER: OSS: 2.17.54.105 [ 287.643709] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Sat Jun 27 21:18:33 EDT 2026 [ 306.174707] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 307.912795] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 329.185178] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 329.188223] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 329.236188] Lustre: Skipped 1 previous similar message [ 329.278765] Lustre: Skipped 3 previous similar messages [ 333.148373] Lustre: server umount lustre-MDT0000 complete [ 336.622687] LustreError: 6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782609563 with bad export cookie 2673497152918632802 [ 336.625931] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 336.630328] LustreError: 6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 339.431849] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 339.433738] LustreError: 6524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 339.438808] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 339.442237] Lustre: Skipped 3 previous similar messages [ 339.458715] LustreError: 6524:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 341.477843] LustreError: 6523:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 341.477990] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 341.498432] LustreError: 6523:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 341.502484] Lustre: Skipped 2 previous similar messages [ 343.343307] Lustre: server umount lustre-MDT0001 complete [ 347.717187] Lustre: server umount lustre-OST0000 complete [ 351.751500] Lustre: server umount lustre-OST0001 complete [ 358.512523] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 367.799280] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 408.067848] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 408.370660] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 408.407524] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 408.489675] Lustre: lustre-MDT0000: new disk, initializing [ 408.570752] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 408.584775] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 413.726525] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 426.300793] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 426.508178] Lustre: 15084:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 426.625403] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 426.629780] Lustre: Skipped 1 previous similar message [ 426.715944] Lustre: lustre-MDT0001: new disk, initializing [ 426.817446] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 426.858377] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 426.879532] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 432.539837] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 444.056708] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 450.168062] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 457.495406] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 457.909480] Lustre: lustre-OST0000: new disk, initializing [ 457.918590] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 457.938732] Lustre: 17052:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 458.087735] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 459.419297] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 459.433291] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 459.601596] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 464.457220] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 474.975668] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 479.478583] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 479.701387] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 484.673810] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 484.887895] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 490.471499] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 490.475789] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 490.495612] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 490.520066] Lustre: Skipped 1 previous similar message [ 492.961699] Lustre: server umount lustre-OST0000 complete [ 498.658226] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 498.678676] LustreError: Skipped 1 previous similar message [ 498.682678] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 498.700974] Lustre: Skipped 1 previous similar message [ 498.705861] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 504.048519] Lustre: server umount lustre-MDT0000 complete [ 505.827828] LustreError: 15089:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 505.857865] LustreError: 15089:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 508.819904] LustreError: 15074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782609735 with bad export cookie 2673497152918634335 [ 508.823424] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 508.835542] LustreError: 15074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 509.242893] Lustre: server umount lustre-MDT0001 complete [ 514.445781] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 21:22:19 (1782609739) [ 521.627341] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 522.121345] LustreError: 19318:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 522.207718] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 526.768686] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 527.331617] LustreError: 19319:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 537.569145] LustreError: 19318:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 537.600820] LustreError: 19318:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 538.122913] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 543.377685] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 551.635536] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 557.676272] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 563.829914] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 571.642437] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 580.353432] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 587.835556] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 594.914934] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 594.922079] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 594.931815] Lustre: Skipped 1 previous similar message [ 594.936409] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 594.940330] Lustre: Skipped 2 previous similar messages [ 609.255501] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 609.415523] Lustre: server umount lustre-MDT0000 complete [ 614.370885] LustreError: 19318:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 614.408496] LustreError: 19318:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 614.930552] LustreError: 19298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782609841 with bad export cookie 2673497152918635217 [ 614.945613] LustreError: 19298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 614.950550] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 615.344286] Lustre: server umount lustre-MDT0001 complete [ 630.389173] Lustre: server umount lustre-OST0000 complete [ 651.625956] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 661.324847] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 661.776802] LustreError: 23703:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 661.837825] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 661.840495] Lustre: Skipped 2 previous similar messages [ 666.295958] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 674.966531] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 679.985724] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 683.114435] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 691.512238] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 698.443747] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 708.719860] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 708.928204] Lustre: lustre-OST0001: new disk, initializing [ 708.932506] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 708.938512] Lustre: 26018:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 710.644857] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 710.653836] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 710.786115] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 716.430710] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 727.197199] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 731.776371] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 746.472149] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 746.490679] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 746.515000] Lustre: Skipped 5 previous similar messages [ 746.544604] Lustre: Skipped 12 previous similar messages [ 751.946641] Lustre: server umount lustre-MDT0000 complete [ 756.582217] LustreError: 23684:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782609983 with bad export cookie 2673497152918636064 [ 756.610042] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 756.616680] LustreError: 23684:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 756.706107] LustreError: 23700:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 756.723177] LustreError: 23700:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 757.064889] Lustre: server umount lustre-MDT0001 complete [ 762.023850] Lustre: server umount lustre-OST0000 complete [ 766.932048] Lustre: server umount lustre-OST0001 complete [ 786.058847] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 797.627361] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 798.021017] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 798.026400] Lustre: Skipped 3 previous similar messages [ 802.838498] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 812.202320] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 817.375452] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 820.842704] Lustre: 30185:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 828.919294] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 835.603898] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 845.499832] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 852.111599] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 860.309570] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 864.610932] Lustre: 32064:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 873.953820] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 873.964777] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 873.979553] Lustre: Skipped 2 previous similar messages [ 874.004816] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 874.014188] Lustre: Skipped 6 previous similar messages [ 878.401905] Lustre: server umount lustre-MDT0000 complete [ 884.191415] LustreError: 29020:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782610111 with bad export cookie 2673497152918637359 [ 884.195166] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 884.212929] LustreError: 29020:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 884.588658] Lustre: server umount lustre-MDT0001 complete [ 899.316891] Lustre: server umount lustre-OST0000 complete [ 901.984260] Lustre: 3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782610113/real 1782610113] req@ffff91865eebbb80 x1869201345391232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782610129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 903.515034] Lustre: server umount lustre-OST0001 complete [ 914.434164] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 21:28:59 (1782610139) [ 949.131907] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 961.184406] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 961.511136] LustreError: 34869:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 961.526963] LustreError: 34869:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 10 previous similar messages [ 966.341528] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 976.186229] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 982.047571] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 985.202324] Lustre: 36017:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 994.843897] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1003.420368] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1014.841533] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1022.117119] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1031.157988] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1035.380033] Lustre: 37899:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1043.426185] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1043.436050] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1043.451305] Lustre: Skipped 4 previous similar messages [ 1043.462518] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1043.468485] Lustre: Skipped 4 previous similar messages [ 1048.075246] Lustre: server umount lustre-MDT0000 complete [ 1052.587178] LustreError: 34850:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782610279 with bad export cookie 2673497152918638465 [ 1052.596036] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1052.596730] LustreError: 34850:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1053.024660] Lustre: server umount lustre-MDT0001 complete [ 1068.653708] Lustre: server umount lustre-OST0000 complete [ 1072.608112] Lustre: 3653:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782610283/real 1782610283] req@ffff918547ba0700 x1869201345444608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782610299 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1073.633578] Lustre: 3650:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782610284/real 1782610284] req@ffff918547b83100 x1869201345444864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782610300 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1073.832306] Lustre: server umount lustre-OST0001 complete [ 1086.690809] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 21:31:51 (1782610311) [ 1107.883611] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 1120.719129] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1121.390506] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1121.393174] Lustre: Skipped 7 previous similar messages [ 1125.957891] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1136.737963] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1142.231632] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1145.510822] Lustre: 41192:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1153.088264] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1160.647420] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1169.968280] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1176.867303] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1186.279415] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1190.670870] Lustre: 43067:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1191.789168] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1191.799840] Lustre: Skipped 1 previous similar message [ 1194.924368] Lustre: lustre-MDT0000: Not available for connect from 192.168.201.49@tcp (stopping) [ 1194.927337] Lustre: Skipped 4 previous similar messages [ 1196.004633] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1196.026544] Lustre: Skipped 5 previous similar messages [ 1201.416642] Lustre: server umount lustre-MDT0000 complete [ 1205.723358] LustreError: 40023:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782610432 with bad export cookie 2673497152918639571 [ 1205.734171] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1205.744037] LustreError: 40023:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1212.421324] Lustre: server umount lustre-MDT0001 complete [ 1222.138094] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1231.184292] LustreError: 41555:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1231.210074] LustreError: 41555:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 28 previous similar messages [ 1235.640802] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1240.563422] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1245.132615] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1250.670351] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1250.808933] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1250.835884] Lustre: Skipped 1 previous similar message [ 1258.739390] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1260.712298] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1268.601612] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1270.802150] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1281.957302] Lustre: server umount lustre-MDT0000 complete [ 1285.886843] LustreError: 40792:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782610512 with bad export cookie 2673497152918640663 [ 1285.889945] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1285.902202] LustreError: 40792:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1286.191187] Lustre: server umount lustre-MDT0001 complete [ 1301.021725] Lustre: server umount lustre-OST0000 complete [ 1301.987538] Lustre: 3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782610513/real 1782610513] req@ffff91854781ca80 x1869201345534720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782610529 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1305.815707] Lustre: server umount lustre-OST0001 complete [ 1315.385362] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 21:35:40 (1782610540) [ 1334.937246] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 1346.771698] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1352.186440] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1362.030959] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1368.008969] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1371.317449] Lustre: 48830:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1378.161579] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1385.256659] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1394.608766] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1400.874399] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1408.036807] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1413.061949] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1428.962047] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1428.972803] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1428.992144] Lustre: Skipped 9 previous similar messages [ 1442.272183] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1442.553610] Lustre: server umount lustre-MDT0000 complete [ 1446.571912] LustreError: 47657:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782610673 with bad export cookie 2673497152918641482 [ 1446.583621] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1446.917471] Lustre: server umount lustre-MDT0001 complete [ 1461.894554] Lustre: server umount lustre-OST0000 complete [ 1476.016762] Lustre: server umount lustre-OST0001 complete [ 1488.134423] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 21:38:33 (1782610713) [ 1490.978516] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1493.527704] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 21:38:38 (1782610718) [ 1505.355670] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 1516.354740] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 1544.738428] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1545.011709] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1545.019471] Lustre: Skipped 1 previous similar message [ 1545.043257] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1545.153887] Lustre: lustre-MDT0000: new disk, initializing [ 1545.274976] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1549.235970] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1559.587344] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1566.917360] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1567.190268] Lustre: lustre-OST0000: new disk, initializing [ 1567.194832] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1567.203054] Lustre: Skipped 1 previous similar message [ 1567.209946] Lustre: 54912:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1568.379478] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1568.393856] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1568.439147] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1573.700130] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1583.191075] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1585.677879] Lustre: DEBUG MARKER: create test files [ 1629.684897] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1629.692162] Lustre: Skipped 35 previous similar messages [ 1633.397585] Lustre: server umount lustre-OST0000 complete [ 1639.053370] Lustre: server umount lustre-MDT0000 complete [ 1654.401514] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 1657.802891] Key type lgssc unregistered [ 1658.106406] LNet: 56551:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1658.115984] LNetError: 56551:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1659.175070] LNet: Removed LNI 192.168.201.149@tcp [ 1660.356183] Key type .llcrypt unregistered [ 1660.360868] Key type ._llcrypt unregistered [ 1691.285842] Key type ._llcrypt registered [ 1691.287874] Key type .llcrypt registered [ 1691.447192] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 1693.701726] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1693.767869] alg: No test for adler32 (adler32-zlib) [ 1694.930926] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 1695.202580] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 1696.912611] Key type lgssc registered [ 1698.669716] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1708.607785] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1708.631685] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1710.175031] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1715.650673] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1725.870606] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1734.146534] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1734.569313] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1735.608369] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:101 to 0x240000400:129) [ 1735.758467] Lustre: 59287:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1735.777721] Lustre: 59287:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1735.785632] Lustre: 59287:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1735.800940] Lustre: 59287:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1735.813089] Lustre: 59287:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1735.826686] Lustre: 59287:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1741.742760] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1750.398651] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1756.651726] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1763.826617] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1771.758376] Lustre: server umount lustre-OST0000 complete [ 1786.068902] Lustre: server umount lustre-MDT0000 complete [ 1798.875717] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 1802.778512] Key type lgssc unregistered [ 1803.164618] LNet: 60896:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1803.183515] LNetError: 60896:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1804.263056] LNet: Removed LNI 192.168.201.149@tcp [ 1805.688253] Key type .llcrypt unregistered [ 1805.691268] Key type ._llcrypt unregistered [ 1837.938992] Key type ._llcrypt registered [ 1837.941628] Key type .llcrypt registered [ 1838.076766] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 1839.287643] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1839.343917] alg: No test for adler32 (adler32-zlib) [ 1840.497187] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 1840.784346] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 1842.482103] Key type lgssc registered [ 1843.661810] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1851.728560] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1851.768585] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1853.268890] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1858.275797] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1867.335396] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1874.396807] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1874.815273] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1878.904774] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1879.089845] Lustre: 63733:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1879.106958] Lustre: 63733:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1879.123900] Lustre: 63733:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1879.138778] Lustre: 63733:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1879.146605] Lustre: 63733:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1879.160811] Lustre: 63733:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1883.055530] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 1892.547767] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1901.066295] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1914.850218] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1914.860844] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1914.868265] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1917.221094] Lustre: server umount lustre-OST0000 complete [ 1922.502169] Lustre: server umount lustre-MDT0000 complete [ 1935.556820] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 1939.756690] Key type lgssc unregistered [ 1940.042631] LNet: 65292:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1940.066506] LNetError: 65292:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1940.098734] LNet: Removed LNI 192.168.201.149@tcp [ 1941.537775] Key type .llcrypt unregistered [ 1941.544156] Key type ._llcrypt unregistered [ 1965.592474] Key type ._llcrypt registered [ 1965.597280] Key type .llcrypt registered [ 1965.745182] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 1986.648750] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 1987.793989] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1987.899240] alg: No test for adler32 (adler32-zlib) [ 1988.998678] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 1989.234354] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 1990.904188] Key type lgssc registered [ 1992.509677] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2032.743803] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2032.791678] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2034.083771] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2034.118719] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2034.204761] Lustre: lustre-MDT0000: new disk, initializing [ 2034.309623] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2034.338509] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2039.250652] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2051.067639] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2051.209860] Lustre: 68448:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2051.264487] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2051.269458] Lustre: Skipped 1 previous similar message [ 2051.340591] Lustre: lustre-MDT0001: new disk, initializing [ 2051.431143] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2051.483681] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2051.499491] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2056.125052] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2067.020484] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2074.887299] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2083.724674] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2084.216975] Lustre: lustre-OST0000: new disk, initializing [ 2084.226732] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2084.237801] Lustre: 70417:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2084.355788] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2092.099074] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2092.111477] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2092.312909] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2092.571590] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2104.710876] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2111.106600] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2111.359828] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2118.146930] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2118.485342] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2123.239049] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2123.250397] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2123.286178] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2127.480597] Lustre: server umount lustre-OST0000 complete [ 2133.474274] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2133.478936] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2133.485950] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2133.485958] Lustre: Skipped 1 previous similar message [ 2133.502417] Lustre: Skipped 2 previous similar messages [ 2133.518125] LustreError: Skipped 1 previous similar message [ 2138.957541] Lustre: server umount lustre-MDT0000 complete [ 2143.717091] LustreError: 68460:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2143.737894] LustreError: 68460:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2143.930890] LustreError: 68439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782611370 with bad export cookie 10777243406609539691 [ 2143.932148] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2143.944695] LustreError: 68439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2144.334550] Lustre: server umount lustre-MDT0001 complete [ 2155.374459] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 21:49:40 (1782611380) [ 2169.935967] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 2216.198226] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 2228.749341] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 2270.117198] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2270.398911] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2270.429610] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2270.547962] Lustre: lustre-MDT0000: new disk, initializing [ 2270.669979] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2270.699866] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2276.403704] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2286.949156] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2287.107837] Lustre: 76461:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2287.172374] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2287.180291] Lustre: Skipped 1 previous similar message [ 2287.283729] Lustre: lustre-MDT0001: new disk, initializing [ 2287.370647] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2287.411455] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2287.418626] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2291.528433] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2302.309945] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2310.113087] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2318.840659] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2319.164574] Lustre: lustre-OST0000: new disk, initializing [ 2319.170403] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2319.178491] Lustre: 78432:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2319.264608] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2324.539629] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2324.550853] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2324.644607] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2325.471653] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2335.507683] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2340.175390] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2340.375067] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2345.311832] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2345.541363] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2350.562438] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2350.566229] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2350.577610] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2350.577618] Lustre: Skipped 1 previous similar message [ 2350.613606] Lustre: Skipped 1 previous similar message [ 2354.004987] Lustre: server umount lustre-OST0000 complete [ 2359.266268] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2359.274880] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2359.291644] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2359.298225] Lustre: Skipped 1 previous similar message [ 2365.924977] LustreError: 76475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2365.954866] LustreError: 76475:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2366.231669] Lustre: server umount lustre-MDT0000 complete [ 2369.616699] LustreError: 76455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782611596 with bad export cookie 10777243406609540573 [ 2369.632190] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2369.955359] Lustre: server umount lustre-MDT0001 complete [ 2379.137803] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 21:53:24 (1782611604) [ 2386.583468] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2387.063370] LustreError: 80843:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2387.156404] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2392.226241] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2392.548220] LustreError: 80844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2397.675352] LustreError: 80843:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2401.737107] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2406.752876] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2416.588552] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2423.438888] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2433.248756] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2433.842419] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2433.845323] Lustre: Skipped 1 previous similar message [ 2443.998644] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2453.338798] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2458.169487] Lustre: 83517:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 6d07a424-1b2f-43c9-918a-39744817e338 at adminstrative request [ 2462.723804] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2462.746091] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2472.940783] Lustre: MGS: Client 6d07a424-1b2f-43c9-918a-39744817e338 (at 0@lo) reconnecting [ 2472.953051] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x959075c72ce1e948 to 0x959075c72ce1ebef [ 2472.970490] Lustre: MGC192.168.201.149@tcp: Connection restored to 0@lo (at 0@lo) [ 2497.714787] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2497.950841] Lustre: lustre-OST0001: new disk, initializing [ 2497.955291] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2497.962056] Lustre: 83911:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2498.130338] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2504.428351] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2504.450996] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2504.558897] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2505.724247] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2516.392552] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2525.175558] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2525.175872] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2525.190650] LustreError: Skipped 1 previous similar message [ 2525.191468] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2525.191473] Lustre: Skipped 2 previous similar messages [ 2525.230224] Lustre: Skipped 2 previous similar messages [ 2526.429719] Lustre: server umount lustre-OST0001 complete [ 2530.285326] LustreError: 82667:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2530.315519] LustreError: 82667:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2533.345623] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2533.350777] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2533.371165] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2533.379792] Lustre: Skipped 1 previous similar message [ 2537.335780] Lustre: server umount lustre-OST0000 complete [ 2550.755744] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2550.758700] Lustre: Skipped 6 previous similar messages [ 2556.384464] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2556.601396] Lustre: server umount lustre-MDT0000 complete [ 2559.978721] LustreError: 81578:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2560.009418] LustreError: 81578:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2560.755839] LustreError: 80824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782611787 with bad export cookie 10777243406609542127 [ 2560.759113] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2560.775665] LustreError: 80824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 2561.457650] Lustre: server umount lustre-MDT0001 complete [ 2572.225979] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 21:56:37 (1782611797) [ 2574.079609] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2576.315907] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 21:56:41 (1782611801) [ 2578.487242] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2580.583464] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 21:56:46 (1782611806) [ 2582.748752] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2585.382046] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 21:56:50 (1782611810) [ 2587.779253] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2589.950325] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 21:56:55 (1782611815) [ 2592.138271] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2599.139379] loop: module loaded [ 2599.155298] loop0: detected capacity change from 0 to 4294967296 [ 2599.218183] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2601.034962] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2604.420371] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2608.614859] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2636.988361] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2637.073335] LustreError: 88039:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2637.083938] LustreError: 88039:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2637.100685] LustreError: 88039:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2637.113303] LustreError: 88039:0:(super25.c:185:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2659.024800] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 2671.300053] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 2714.621741] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2714.861984] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2714.891614] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2714.991667] Lustre: lustre-MDT0000: new disk, initializing [ 2715.068907] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2715.092179] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2719.854716] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2731.554051] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2731.716303] Lustre: 90907:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2732.116386] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2737.668901] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2748.894556] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2755.817538] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2764.019953] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2764.442298] Lustre: 92875:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2771.873704] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2772.606811] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2772.730152] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2782.510034] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2787.921987] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2788.128261] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2793.386227] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2793.622138] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2798.570304] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2798.578573] LustreError: Skipped 2 previous similar messages [ 2798.582187] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2798.588276] Lustre: Skipped 3 previous similar messages [ 2798.593397] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2798.604123] Lustre: Skipped 3 previous similar messages [ 2810.336271] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2810.654725] Lustre: server umount lustre-OST0000 complete [ 2820.804436] Lustre: server umount lustre-MDT0000 complete [ 2824.052539] LustreError: 90899:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782612051 with bad export cookie 10777243406609542743 [ 2824.059853] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2824.066836] LustreError: 90899:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2824.431287] Lustre: server umount lustre-MDT0001 complete [ 2833.432641] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 22:00:58 (1782612058) [ 2841.430700] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2842.126276] LustreError: 95304:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2847.200870] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2857.661700] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2862.372143] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2870.919661] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2879.428306] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2889.075976] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2896.124350] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2906.250429] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2911.756918] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2913.240742] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 1 sec [ 2919.145983] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2919.426725] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2926.779452] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2927.057452] Lustre: lustre-OST0001: new disk, initializing [ 2927.060222] Lustre: Skipped 2 previous similar messages [ 2927.065465] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2927.072251] Lustre: Skipped 3 previous similar messages [ 2927.076305] Lustre: 98685:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2933.365780] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2933.379789] Lustre: Skipped 2 previous similar messages [ 2933.384721] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2933.497060] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2934.456848] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 2944.382293] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2949.752252] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2950.044249] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2955.295774] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2955.438483] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2976.572613] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3007.026679] Lustre: Failing over lustre-MDT0000 [ 3007.608157] Lustre: server umount lustre-MDT0000 complete [ 3008.928577] LustreError: 95300:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.49@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3008.950061] LustreError: 95300:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3010.533715] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3010.546649] Lustre: Skipped 6 previous similar messages [ 3027.424115] Lustre: 66669:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782612237/real 1782612237] req@0000000092a206f9 x1869203338722304/t0(0) o400->MGC192.168.201.149@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1782612253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3027.446122] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3030.914093] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 3030.917536] LDISKFS-fs (dm-0): recovery complete [ 3030.930661] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3037.889056] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 3037.893756] Lustre: Skipped 6 previous similar messages [ 3037.939006] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3039.627327] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3039.631820] Lustre: 100093:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3041.788988] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3043.313397] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3043.321118] Lustre: 96032:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3043.333114] Lustre: 96032:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 1 previous similar message [ 3043.430552] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3043.747440] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3044.092082] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3044.100431] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 3044.424185] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3044.433522] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 3044.439766] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3044.459123] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 7 previous similar messages [ 3045.105639] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3045.118855] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 2 previous similar messages [ 3045.440758] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3045.456517] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 2 previous similar messages [ 3046.728854] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3046.748743] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 6 previous similar messages [ 3047.402833] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3047.418922] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 3047.744657] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3047.748106] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 3050.930422] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3050.950114] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 12 previous similar messages [ 3051.593366] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3051.601109] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 3051.921550] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3051.930421] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 3058.931643] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3058.958662] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 24 previous similar messages [ 3059.600138] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3059.623992] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 24 previous similar messages [ 3059.952099] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3059.954743] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 24 previous similar messages [ 3075.226545] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3075.247642] Lustre: 101536:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 50 previous similar messages [ 3075.889304] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3075.909974] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 50 previous similar messages [ 3076.241138] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3076.252130] LustreError: 101536:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 50 previous similar messages [ 3099.129578] Lustre: 101536:0:(ldlm_lib.c:2380:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 3099.135301] Lustre: 101536:0:(ldlm_lib.c:2390:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 3099.154047] Lustre: 101536:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client e14f4086-dfa2-4a8b-a5b0-6e07c5c8b64f@192.168.201.49@tcp [ 3099.169941] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 3099.180257] Lustre: 101536:0:(ldlm_lib.c:1900:abort_req_replay_queue()) @@@ aborted: req@000000005c927941 x1869203317526528/t0(8589934771) o101->e14f4086-dfa2-4a8b-a5b0-6e07c5c8b64f@192.168.201.49@tcp:711/0 lens 592/0 e 0 to 0 dl 1782612336 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 3099.233631] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 3099.254323] Lustre: lustre-MDT0000: Denying connection for new client e14f4086-dfa2-4a8b-a5b0-6e07c5c8b64f (at 192.168.201.49@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 3099.280444] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 3099.337216] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 3099.339247] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3099.377477] Lustre: Skipped 2 previous similar messages [ 3099.408055] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:78 to 0x280000401:577) [ 3099.418318] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:545) [ 3114.980483] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3114.998946] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3115.008880] Lustre: Skipped 1 previous similar message [ 3115.020919] Lustre: Skipped 7 previous similar messages [ 3129.312122] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3129.443387] Lustre: server umount lustre-OST0000 complete [ 3133.414542] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3133.437616] LustreError: Skipped 2 previous similar messages [ 3139.456986] Lustre: server umount lustre-OST0001 complete [ 3150.822376] LustreError: 95305:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3150.848841] LustreError: 95305:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 45 previous similar messages [ 3150.932562] Lustre: server umount lustre-MDT0000 complete [ 3155.422380] LustreError: 95286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782612382 with bad export cookie 10777243406609593962 [ 3155.444362] LustreError: 95286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3155.444711] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3155.735079] Lustre: server umount lustre-MDT0001 complete [ 3166.327616] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 22:06:31 (1782612391) [ 3174.449684] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3174.460277] Lustre: *** cfs_fail_loc=197, val=0*** [ 3190.114385] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3195.234554] LustreError: 103511:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.149@tcp: failed processing log, type 4: rc = -110 [ 3200.370563] Lustre: *** cfs_fail_loc=197, val=0*** [ 3200.373273] Lustre: Skipped 65 previous similar messages [ 3227.631328] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3235.224048] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3237.204325] Lustre: server umount lustre-OST0000 complete [ 3247.045532] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 22:07:52 (1782612472) [ 3269.447304] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3274.750339] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3284.072297] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3288.077061] LustreError: 105161:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3288.091226] LustreError: 105161:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3288.107777] LustreError: 105161:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 18, retries 0, failed: rc = -5 [ 3288.445958] Lustre: server umount lustre-MDT0000 complete [ 3321.434883] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 3333.028919] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 3371.785094] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3372.035065] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3372.054888] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3372.109930] Lustre: lustre-MDT0000: new disk, initializing [ 3372.185695] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3376.697711] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3387.530828] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3387.768651] Lustre: 109336:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3388.184907] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3393.622322] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3404.987664] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3411.503752] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3418.587457] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3418.920714] Lustre: 111303:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3425.524228] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3428.127694] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3435.865529] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3441.772166] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3441.994471] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3446.302025] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3446.630217] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3448.804153] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3448.813671] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3448.829707] Lustre: Skipped 4 previous similar messages [ 3448.842406] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3448.847040] LustreError: Skipped 1 previous similar message [ 3448.866407] Lustre: Skipped 10 previous similar messages [ 3463.136258] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3463.502467] Lustre: server umount lustre-OST0000 complete [ 3482.081121] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3482.570459] Lustre: server umount lustre-MDT0000 complete [ 3484.647323] LustreError: 110498:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3484.669614] LustreError: 110498:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 3486.818990] LustreError: 109329:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782612713 with bad export cookie 10777243406609604553 [ 3486.826429] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3486.835170] LustreError: 109329:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3487.219521] Lustre: server umount lustre-MDT0001 complete [ 3496.917563] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 22:12:02 (1782612722) [ 3507.257844] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 3509.871623] Key type lgssc unregistered [ 3510.116663] LNet: 113794:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3510.131265] LNetError: 113794:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3510.147108] LNet: Removed LNI 192.168.201.149@tcp [ 3511.022527] Key type .llcrypt unregistered [ 3511.028985] Key type ._llcrypt unregistered [ 3527.615930] Key type ._llcrypt registered [ 3527.618375] Key type .llcrypt registered [ 3527.700631] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 3542.083609] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 3543.493929] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3543.588932] alg: No test for adler32 (adler32-zlib) [ 3544.621503] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 3544.830548] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 3546.505422] Key type lgssc registered [ 3547.390054] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3592.007744] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3592.034838] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3593.348825] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3593.376513] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3593.466731] Lustre: lustre-MDT0000: new disk, initializing [ 3593.529597] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3593.538451] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3598.604391] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3609.764916] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3610.031411] Lustre: lustre-OST0000: new disk, initializing [ 3610.034886] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3610.039256] Lustre: Skipped 1 previous similar message [ 3610.047360] Lustre: 117967:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3610.116614] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3616.635403] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3617.872338] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3617.884845] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3617.908579] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3626.798751] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3626.972359] Lustre: lustre-OST0001: new disk, initializing [ 3626.975135] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3626.979896] Lustre: 118832:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3627.054228] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3633.581711] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3636.454741] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3636.468803] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3636.497509] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3646.953328] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3646.968359] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3646.972811] Lustre: Skipped 1 previous similar message [ 3648.988200] Lustre: server umount lustre-MDT0000 complete [ 3656.137673] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3661.018208] LustreError: 117153:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782612888 with bad export cookie 16005537070494153850 [ 3661.048740] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3661.142039] Lustre: server umount lustre-OST0000 complete [ 3666.398410] Lustre: server umount lustre-OST0001 complete [ 3676.686668] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 22:15:02 (1782612902) [ 3688.271403] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 3712.341335] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 22:15:37 (1782612937) [ 3751.100109] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 3762.327846] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 3802.077587] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3802.352345] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3802.417795] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3802.567303] Lustre: lustre-MDT0000: new disk, initializing [ 3802.720623] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3802.739138] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3808.537875] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3819.808507] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3819.934368] Lustre: 125582:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3819.996726] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3819.999996] Lustre: Skipped 1 previous similar message [ 3820.066787] Lustre: lustre-MDT0001: new disk, initializing [ 3820.137852] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3820.173392] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3820.185508] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3825.025375] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3834.911371] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3841.197694] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3847.617221] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3847.943830] Lustre: lustre-OST0000: new disk, initializing [ 3847.948647] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3847.954060] Lustre: 127551:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3848.031649] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3854.880744] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3855.980104] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3855.999826] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3856.221369] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3865.940161] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3871.308340] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3871.617380] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3877.064719] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3877.247764] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3881.974527] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3881.975316] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3882.010780] Lustre: Skipped 1 previous similar message [ 3882.011562] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3885.833812] Lustre: server umount lustre-OST0000 complete [ 3891.682460] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3891.695468] LustreError: Skipped 1 previous similar message [ 3891.703854] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3891.717154] Lustre: Skipped 1 previous similar message [ 3891.725251] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3891.729112] Lustre: Skipped 1 previous similar message [ 3896.256931] Lustre: server umount lustre-MDT0000 complete [ 3900.227172] LustreError: 125575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782613127 with bad export cookie 16005537070494155075 [ 3900.228492] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3900.253509] LustreError: 125575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 3900.661932] Lustre: server umount lustre-MDT0001 complete [ 3910.976651] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 22:18:56 (1782613136) [ 3917.922531] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3918.441690] LustreError: 129965:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3918.466056] LustreError: 129965:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3918.514225] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3923.396733] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3923.961662] LustreError: 129966:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3928.099573] LustreError: 129965:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3933.166688] LustreError: 129966:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3934.969406] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3941.731801] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3951.009818] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3957.855556] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3966.111606] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3966.535472] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3966.541587] Lustre: Skipped 1 previous similar message [ 3973.470848] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 3981.929537] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3997.436961] Lustre: *** cfs_fail_loc=159, val=0*** [ 4012.988457] Lustre: lustre-MDT0000: Client 9ed6771e-e9cf-4791-b3e4-e02e6363671c (at 192.168.201.49@tcp) reconnecting [ 4014.307686] Lustre: *** cfs_fail_loc=159, val=0*** [ 4014.314300] Lustre: Skipped 5 previous similar messages [ 4030.909480] Lustre: lustre-MDT0000: Client 9ed6771e-e9cf-4791-b3e4-e02e6363671c (at 192.168.201.49@tcp) reconnecting [ 4048.353738] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4048.363333] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4048.370097] Lustre: Skipped 1 previous similar message [ 4048.374769] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4048.379061] Lustre: Skipped 2 previous similar messages [ 4053.903345] Lustre: server umount lustre-OST0000 complete [ 4058.595082] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4058.606455] LustreError: Skipped 1 previous similar message [ 4058.613262] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4058.629887] Lustre: Skipped 1 previous similar message [ 4058.639194] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4058.646119] Lustre: Skipped 2 previous similar messages [ 4064.931192] Lustre: server umount lustre-MDT0000 complete [ 4068.803330] LustreError: 129947:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782613295 with bad export cookie 16005537070494155950 [ 4068.810960] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4069.384098] Lustre: server umount lustre-MDT0001 complete [ 4083.175725] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 4085.694302] Key type lgssc unregistered [ 4086.081643] LNet: 133763:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4086.087434] LNetError: 133763:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4086.107253] LNet: Removed LNI 192.168.201.149@tcp [ 4086.939371] Key type .llcrypt unregistered [ 4086.944658] Key type ._llcrypt unregistered [ 4113.024339] Key type ._llcrypt registered [ 4113.026668] Key type .llcrypt registered [ 4113.113376] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 4114.442311] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4114.460102] alg: No test for adler32 (adler32-zlib) [ 4115.560541] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 4115.918497] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 4117.632166] Key type lgssc registered [ 4118.762316] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4125.424376] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4125.437986] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4126.886417] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4131.622737] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4136.420646] LustreError: 135179:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4136.444173] LustreError: 135179:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4141.182946] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4141.765663] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4147.219985] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4155.826129] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4162.733222] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4169.807076] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4170.029146] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4171.080047] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 4176.446850] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4185.155897] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4196.446768] Lustre: *** cfs_fail_loc=159, val=0*** [ 4212.688378] Lustre: lustre-MDT0000: Client e487dd3b-d229-4b9b-9cc2-8b9df1933450 (at 192.168.201.49@tcp) reconnecting [ 4216.159309] Lustre: *** cfs_fail_loc=159, val=0*** [ 4232.661248] Lustre: lustre-MDT0001: Client e487dd3b-d229-4b9b-9cc2-8b9df1933450 (at 192.168.201.49@tcp) reconnecting [ 4234.546037] Lustre: *** cfs_fail_loc=159, val=0*** [ 4234.552264] Lustre: Skipped 3 previous similar messages [ 4250.052282] Lustre: lustre-MDT0001: Client e487dd3b-d229-4b9b-9cc2-8b9df1933450 (at 192.168.201.49@tcp) reconnecting [ 4266.591804] Lustre: 138246:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4269.866287] Lustre: *** cfs_fail_loc=159, val=0*** [ 4269.869445] Lustre: Skipped 4 previous similar messages [ 4285.371199] Lustre: lustre-MDT0000: Client a67579d5-05e8-4f3d-b57c-009b516ad667 (at 192.168.201.49@tcp) reconnecting [ 4286.897540] Lustre: *** cfs_fail_loc=159, val=0*** [ 4286.899266] Lustre: Skipped 14 previous similar messages [ 4302.271382] Lustre: lustre-MDT0000: Client a67579d5-05e8-4f3d-b57c-009b516ad667 (at 192.168.201.49@tcp) reconnecting [ 4304.120240] Lustre: 138536:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4314.593797] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4314.599482] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4314.603429] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4314.607179] LustreError: Skipped 5 previous similar messages [ 4314.633948] Lustre: Skipped 1 previous similar message [ 4316.127601] Lustre: server umount lustre-OST0000 complete [ 4320.620131] Lustre: server umount lustre-MDT0000 complete [ 4320.736846] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4320.752516] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4320.767627] LustreError: 137935:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4324.846841] LustreError: 137936:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4324.848113] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4324.980065] LustreError: 135161:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782613552 with bad export cookie 125855809124298603 [ 4324.992356] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4325.325820] Lustre: server umount lustre-MDT0001 complete [ 4339.548645] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 4342.497957] Key type lgssc unregistered [ 4342.848659] LNet: 139586:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4342.858246] LNetError: 139586:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4342.882664] LNet: Removed LNI 192.168.201.149@tcp [ 4344.193396] Key type .llcrypt unregistered [ 4344.195641] Key type ._llcrypt unregistered [ 4371.667524] Key type ._llcrypt registered [ 4371.669672] Key type .llcrypt registered [ 4371.760461] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 4373.022386] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4373.075168] alg: No test for adler32 (adler32-zlib) [ 4374.222834] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 4374.393867] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 4376.048182] Key type lgssc registered [ 4377.123531] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4385.208372] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4385.236971] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4386.744675] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4391.779922] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4396.011647] LustreError: 141004:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4396.037631] LustreError: 141004:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4401.127612] LustreError: 141005:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4401.488233] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4401.907206] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4407.906827] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4417.321642] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4424.322541] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4432.845274] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4433.270182] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4441.828595] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4446.595773] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4451.999210] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4456.867639] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4462.544659] Lustre: 143590:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4466.437307] Lustre: 143638:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4468.542547] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4469.807977] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4474.372657] Lustre: 143784:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4475.077477] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4475.962859] Lustre: 143883:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4482.532152] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4482.555299] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4482.576150] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4482.593465] Lustre: Skipped 1 previous similar message [ 4485.342264] Lustre: server umount lustre-OST0000 complete [ 4489.186675] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4489.201324] LustreError: Skipped 1 previous similar message [ 4489.212693] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4489.235971] Lustre: Skipped 1 previous similar message [ 4489.240456] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4492.770668] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4492.791655] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4495.311192] Lustre: server umount lustre-MDT0000 complete [ 4497.892928] LustreError: 143021:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4497.915040] LustreError: 143021:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4499.556930] LustreError: 140987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782613726 with bad export cookie 2191697960691392154 [ 4499.563943] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4499.575023] LustreError: 140987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4499.986655] Lustre: server umount lustre-MDT0001 complete [ 4510.801442] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 4513.451983] Key type lgssc unregistered [ 4513.766258] LNet: 144945:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4513.780816] LNetError: 144945:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4514.790281] LNet: Removed LNI 192.168.201.149@tcp [ 4515.806768] Key type .llcrypt unregistered [ 4515.811429] Key type ._llcrypt unregistered [ 4541.402930] Key type ._llcrypt registered [ 4541.405906] Key type .llcrypt registered [ 4541.581462] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 4542.629253] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4542.676770] alg: No test for adler32 (adler32-zlib) [ 4543.837473] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 4544.238896] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 4546.008407] Key type lgssc registered [ 4547.413899] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4556.174765] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4556.199278] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4557.804830] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4562.903487] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4567.013572] LustreError: 146361:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4567.040616] LustreError: 146361:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4571.849140] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4572.231272] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4577.826825] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4587.866987] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4596.027701] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4604.915848] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4605.578717] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4614.688565] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4617.850884] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4622.798948] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4627.072049] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4633.476729] Lustre: *** cfs_fail_loc=159, val=0*** [ 4633.493741] Lustre: Skipped 1 previous similar message [ 4649.946194] Lustre: lustre-MDT0000: Client e2aaa568-b3b4-4774-b8e8-7f725b228434 (at 192.168.201.49@tcp) reconnecting [ 4668.385687] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4668.388338] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4668.399172] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4668.417463] Lustre: Skipped 1 previous similar message [ 4668.452161] Lustre: Skipped 1 previous similar message [ 4673.442515] Lustre: server umount lustre-OST0000 complete [ 4678.626300] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4678.641801] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4678.647391] Lustre: Skipped 1 previous similar message [ 4678.674314] Lustre: Skipped 1 previous similar message [ 4683.749984] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4683.772172] Lustre: Skipped 1 previous similar message [ 4684.860638] Lustre: server umount lustre-MDT0000 complete [ 4688.866267] LustreError: 148907:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4688.887760] LustreError: 148907:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4689.042306] LustreError: 146342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782613916 with bad export cookie 15305031045855159442 [ 4689.047024] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4689.049362] LustreError: 146342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4689.482929] Lustre: server umount lustre-MDT0001 complete [ 4701.339369] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 4704.341591] Key type lgssc unregistered [ 4704.628986] LNet: 150033:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4704.635446] LNetError: 150033:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4704.649853] LNet: Removed LNI 192.168.201.149@tcp [ 4705.567372] Key type .llcrypt unregistered [ 4705.572833] Key type ._llcrypt unregistered [ 4734.145357] Key type ._llcrypt registered [ 4734.147182] Key type .llcrypt registered [ 4734.270295] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 4735.885859] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4736.089782] alg: No test for adler32 (adler32-zlib) [ 4737.133251] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 4737.444250] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 4739.136159] Key type lgssc registered [ 4740.510035] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4749.577833] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4749.620882] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4751.341947] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4756.146916] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4761.576489] LustreError: 151449:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4761.596393] LustreError: 151449:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4766.667033] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4766.694595] LustreError: 151448:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4767.407634] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4772.833486] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4781.314142] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4787.677320] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4795.856323] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4796.256101] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4797.313372] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4803.127464] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 4811.244747] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4813.686857] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4838.289368] Lustre: lustre-MDT0001: evicting 62c7fd35-663c-4493-9515-2506638a98d6 (at 192.168.201.49@tcp) by administrative request [ 4838.299957] Lustre: Skipped 1 previous similar message [ 4869.106173] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4869.130709] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4869.164929] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4870.114808] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4870.118650] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4870.124414] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4874.615913] Lustre: server umount lustre-OST0000 complete [ 4879.846765] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4879.856615] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4879.876780] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4879.881258] Lustre: Skipped 1 previous similar message [ 4885.359871] Lustre: server umount lustre-MDT0000 complete [ 4885.474051] LustreError: 152180:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4885.495984] LustreError: 152180:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4889.333664] LustreError: 152190:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782614116 with bad export cookie 17973512955700427649 [ 4889.339323] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4889.346477] LustreError: 152190:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4889.670583] Lustre: server umount lustre-MDT0001 complete [ 4901.163817] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 4904.108909] Key type lgssc unregistered [ 4904.476692] LNet: 155521:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4904.494286] LNetError: 155521:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4904.518291] LNet: Removed LNI 192.168.201.149@tcp [ 4905.410097] Key type .llcrypt unregistered [ 4905.411937] Key type ._llcrypt unregistered [ 4987.017151] Key type ._llcrypt registered [ 4987.019357] Key type .llcrypt registered [ 4987.096211] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 4988.126611] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4988.217066] alg: No test for adler32 (adler32-zlib) [ 4989.435674] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 4989.793555] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 4991.513740] Key type lgssc registered [ 4992.731928] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5001.205028] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5001.227854] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5003.091990] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5010.037473] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5013.475219] LustreError: 158009:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5013.512126] LustreError: 158009:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5018.607289] LustreError: 158010:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5023.174772] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5023.998382] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5030.419948] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5042.041131] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5049.087968] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5057.234405] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5057.562454] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5064.247288] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5068.812578] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 5073.215970] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5073.997203] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 5089.252982] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5089.253955] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5089.265281] LustreError: Skipped 1 previous similar message [ 5089.266134] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5089.297085] Lustre: Skipped 1 previous similar message [ 5093.279358] Lustre: server umount lustre-OST0000 complete [ 5099.491367] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5099.502217] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5099.509770] Lustre: Skipped 1 previous similar message [ 5099.531344] Lustre: Skipped 2 previous similar messages [ 5104.610387] LustreError: 158010:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5104.629020] LustreError: 158010:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5105.639863] Lustre: server umount lustre-MDT0000 complete [ 5109.731030] LustreError: 158742:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5109.746823] LustreError: 158742:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5110.357059] LustreError: 157990:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782614337 with bad export cookie 4393897753730634725 [ 5110.364568] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5110.371704] LustreError: 157990:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5110.846567] Lustre: server umount lustre-MDT0001 complete [ 5125.006882] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 5127.813516] Key type lgssc unregistered [ 5128.138680] LNet: 161574:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5128.149802] LNetError: 161574:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5128.171884] LNet: Removed LNI 192.168.201.149@tcp [ 5129.191107] Key type .llcrypt unregistered [ 5129.196652] Key type ._llcrypt unregistered [ 5156.591251] Key type ._llcrypt registered [ 5156.593745] Key type .llcrypt registered [ 5156.745357] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 5158.386560] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5158.460392] alg: No test for adler32 (adler32-zlib) [ 5159.772711] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 5160.181195] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 5161.920220] Key type lgssc registered [ 5163.178674] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5184.360950] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 22:40:08 (1782614408) [ 5205.444353] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 5218.323681] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 5265.102936] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5265.149089] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5266.529827] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5266.560814] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5266.621657] Lustre: lustre-MDT0000: new disk, initializing [ 5266.747306] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5266.786463] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5272.197195] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5285.432476] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5285.540417] Lustre: 165842:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5285.598842] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5285.602785] Lustre: Skipped 1 previous similar message [ 5285.661640] Lustre: lustre-MDT0001: new disk, initializing [ 5285.746662] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5285.775188] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5285.791966] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5290.235809] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5300.256793] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5307.419596] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5316.921058] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5317.351358] Lustre: lustre-OST0000: new disk, initializing [ 5317.366509] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5317.380909] Lustre: 167812:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5317.601593] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5324.316705] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5324.328307] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5324.468746] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5325.546957] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5336.264789] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5349.859173] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5349.868363] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5349.883537] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5350.372366] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5350.417292] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5350.425763] Lustre: Skipped 1 previous similar message [ 5352.689245] Lustre: server umount lustre-OST0000 complete [ 5357.537906] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5357.548721] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5357.561409] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5360.616135] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5360.620404] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5363.869321] Lustre: server umount lustre-MDT0000 complete [ 5368.065661] LustreError: 166637:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782614595 with bad export cookie 9636350954040625631 [ 5368.067609] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5368.082721] LustreError: 166637:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5368.512229] Lustre: server umount lustre-MDT0001 complete [ 5381.831826] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 5385.585668] Key type lgssc unregistered [ 5385.907296] LNet: 169716:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5385.925463] LNetError: 169716:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5385.987237] LNet: Removed LNI 192.168.201.149@tcp [ 5387.218963] Key type .llcrypt unregistered [ 5387.221362] Key type ._llcrypt unregistered [ 5416.881664] Key type ._llcrypt registered [ 5416.885509] Key type .llcrypt registered [ 5416.975329] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 5418.341040] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5418.410064] alg: No test for adler32 (adler32-zlib) [ 5419.494612] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 5419.773900] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 5421.440137] Key type lgssc registered [ 5422.945551] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5431.683362] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5431.716505] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5433.298214] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5439.076074] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5443.564022] LustreError: 171134:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5443.582716] LustreError: 171134:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5448.678608] LustreError: 171133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5450.261314] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5451.071722] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5456.394869] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5464.827752] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5471.402301] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5478.286973] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5478.718609] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5479.758589] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5485.561615] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 5493.315671] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5500.962981] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5500.990239] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5501.004761] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5501.010718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.027789] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5502.041947] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5502.057714] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5502.069751] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5502.075264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.087124] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5503.056154] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5503.073782] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5503.085160] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5503.093857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.104743] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5504.162836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.170576] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5505.177957] Lustre: Skipped 1 previous similar message [ 5505.191888] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5505.214549] Lustre: Skipped 1 previous similar message [ 5505.221024] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5505.226914] Lustre: Skipped 1 previous similar message [ 5505.233207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.241372] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5505.254783] Lustre: Skipped 1 previous similar message [ 5506.124237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.109020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5508.025657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.061117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.987282] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5509.995385] Lustre: Skipped 4 previous similar messages [ 5510.013947] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5510.022660] Lustre: Skipped 4 previous similar messages [ 5510.026190] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5510.030699] Lustre: Skipped 4 previous similar messages [ 5510.033911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.047198] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5510.055875] Lustre: Skipped 4 previous similar messages [ 5511.256759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.283176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.051835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.961666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.823837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.929990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.836942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.729689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.611418] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5518.616130] Lustre: Skipped 8 previous similar messages [ 5518.629663] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5518.637927] Lustre: Skipped 8 previous similar messages [ 5518.641266] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5518.645986] Lustre: Skipped 8 previous similar messages [ 5518.647709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.654820] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5518.657722] Lustre: Skipped 8 previous similar messages [ 5519.595072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.611549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.622865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.469469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.477805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.456856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.181440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.036681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.891356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.652717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.691963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.673164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5530.638578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.598948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.609989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.498267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5534.537493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.385235] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5535.390487] Lustre: Skipped 17 previous similar messages [ 5535.412463] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5535.422412] Lustre: Skipped 17 previous similar messages [ 5535.429514] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5535.440196] Lustre: Skipped 17 previous similar messages [ 5535.446388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.456463] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5535.459341] Lustre: Skipped 17 previous similar messages [ 5536.411515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.345472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5538.284113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.356784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.315146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5541.362068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.581672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.791869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.946705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.124787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.203889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.229928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.238397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.143788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.122391] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5551.134605] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5551.138076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.017495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.120204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.202904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.135254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.263848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.584240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.733631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.753621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.919911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.208452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.424993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.618733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.570871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.316906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.169072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.061411] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5568.065489] Lustre: Skipped 30 previous similar messages [ 5568.089869] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5568.098698] Lustre: Skipped 30 previous similar messages [ 5568.101291] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5568.103549] Lustre: Skipped 30 previous similar messages [ 5568.108613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.116029] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5568.118269] Lustre: Skipped 30 previous similar messages [ 5569.273566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.175978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.251221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.095899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.342898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.200051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.306662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.235691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.341699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.341609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.349927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.346060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.265329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.233233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.104694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.999582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.997928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.132136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.272649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.258918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.360126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.291627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.312610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.245492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.551295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.775824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.972748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.140955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.322369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.259088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.353224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.266589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.340076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.646743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.796970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.886473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.827185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.815702] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5607.840042] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5607.848573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.212865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.353628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.269786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.140615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.164223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.180748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.249500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.310429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.180657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.254936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.315524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.314608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.643797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.592522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.728175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.620754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.923440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.954065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.971054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.967762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.925574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.929651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.931723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.938808] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5632.952724] Lustre: Skipped 61 previous similar messages [ 5632.991767] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5633.014348] Lustre: Skipped 61 previous similar messages [ 5633.030441] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5633.040735] Lustre: Skipped 61 previous similar messages [ 5633.053861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.068885] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5633.079928] Lustre: Skipped 61 previous similar messages [ 5633.955811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.145114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.110507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.950144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.996688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.881367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.974636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.062791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.870648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.787398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.741072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.852268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.671357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.544716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.512201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.428547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.432155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.466395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.665241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.557541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.643561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.498432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.472312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.479918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5657.530542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.490612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.459423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.555385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.368930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.366609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.509292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.513147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.653348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.779850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5667.872469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.050215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.039850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.226893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.485222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.534674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.033254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5676.320756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.289099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.309077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.522298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.918678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5682.239765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.078218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.578032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.783033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.151168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.434526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.607521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.899189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.244345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5694.322037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.557123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.919526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.286948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.576588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.834665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.032228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.484777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.881730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.279844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5707.285829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.391809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.379990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5710.271841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5711.359604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.566937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.713518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.747277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5715.978758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.115416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5718.337824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.332630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.464188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.257637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.406702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.396480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.535926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.321549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5726.422371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.525322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.425539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.346607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.369830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.526427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.599795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5733.746981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.893898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.929122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.922627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.837967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.900328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.763289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5740.678680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.618027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.773944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5743.895605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.894553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.922049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.988299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.990952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.990467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.988970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5750.873813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.708272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5753.020289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5754.153955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5755.167227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.155640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5757.449906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5758.445674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5759.465705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5760.532387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.617638] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5761.623198] Lustre: Skipped 117 previous similar messages [ 5761.638597] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5761.653380] Lustre: Skipped 117 previous similar messages [ 5761.660613] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5761.671474] Lustre: Skipped 117 previous similar messages [ 5761.676862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.691299] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5761.694164] Lustre: Skipped 117 previous similar messages [ 5762.516834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5763.536525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5764.363488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5765.729153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5767.192393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5768.768191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.038517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.266771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5772.342488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5773.283840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.324230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5775.444391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5776.509879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.614985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.616895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.509583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5780.435791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5781.355401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5782.295157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5783.124991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5784.134388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5785.158530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.225939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.590743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5788.889228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5789.778899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5790.837382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5791.722654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5792.693279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.531769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.646569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5795.640070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5796.715760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5797.602913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.718577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5799.671573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.787636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.136676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5803.140694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.149690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.046487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.915142] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5805.925310] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5805.934781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.835501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5807.971709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.176651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.244976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.195798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.203799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.328760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5814.358214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.479080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5816.807477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.002734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.449809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5820.435968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.822417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.170315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.228284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.255566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.548271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5827.645831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.842260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.341512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.739206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.158648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.322376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5835.937352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5837.261293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5838.470483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5839.542983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5840.476945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.575332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.652734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5843.559861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.487447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.326291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.311830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.256168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.562120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5850.032216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5851.271710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.521872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.669315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.707103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5855.758673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.002065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.967593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5858.828325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.891369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5860.887469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5861.888944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.978381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5863.992722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.908728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5866.353960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5867.616430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5868.695793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5869.820218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.875373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5871.896288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.823484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5873.961271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.827216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5875.787353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5876.715475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.981301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5879.271958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5880.232240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.270151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5882.119739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5883.241918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5884.308518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.533429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5886.656795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5887.993937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5889.050177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5890.361470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5891.630528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5892.620041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5893.722240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5894.573900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.740877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.797726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.016319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.320974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5900.473990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5901.775354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5902.752450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5904.349977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5905.633173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5906.870248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5908.090832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5909.026825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.189076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5911.137544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5912.343133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5913.343226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5914.665566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5915.664417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5916.985521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5918.540315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5920.137820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5921.222610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5922.235147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5923.552868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5924.704950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5925.846672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5927.112712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.518322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.721792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.109980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5932.336361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.338360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5934.652239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5935.605887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5937.103544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.258396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5939.472862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5940.565751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5941.818296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.834531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5943.869523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5944.923240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5946.097254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.348806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.301253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5949.504122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5950.283788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5951.373472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5952.538664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5953.668578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5954.861399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5955.993259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.932168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5958.067955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.116583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5960.171973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.466876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5962.665555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.695470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.740047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.824734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.975636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.170446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.222802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5970.436328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5971.725976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5972.803955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.923961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5975.015540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.113296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.241758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5978.243961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5979.565106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.862195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.887795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5982.905334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.814726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.919054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.020420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.988146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.303750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5989.303592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.417360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5991.718398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.853163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.036563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5995.070754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.386792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5997.700602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.922836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.396474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.925182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6003.433728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.774804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6006.443257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.766625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6008.669502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.836614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.662842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.574685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.428768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6013.575488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6014.403179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.550981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.562920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.632247] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6017.641306] Lustre: Skipped 226 previous similar messages [ 6017.660678] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6017.674764] Lustre: Skipped 226 previous similar messages [ 6017.683202] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6017.687905] Lustre: Skipped 226 previous similar messages [ 6017.691337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.700851] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6017.705758] Lustre: Skipped 226 previous similar messages [ 6018.410610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6019.433539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.916590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.955717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.783504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.151960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.133917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.174707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.369463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6028.546908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.635711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6030.828599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6032.043095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6033.320738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.727826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6035.801195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.838836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.736101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6038.969096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6040.223765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.320329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.568135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6043.690200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.815525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6045.856662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6047.383621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.786656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.669762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6050.828410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.816162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6052.993407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.283408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6055.370984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6056.379485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6057.397319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.405754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6059.690407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.831064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.782473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.746909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6063.780814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6065.069222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.197805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6067.164438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.461277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6069.398740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.718234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.746452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6072.997926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.443447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6075.667165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6076.865805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6077.793424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6079.047229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6080.301492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6081.365357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.334861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6083.433300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6084.543933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.639669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6086.621421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.691548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6088.975392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.413869] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6090.425200] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6090.439482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.696856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6092.703591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6093.808339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.940319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.251980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6097.522332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.756123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.004647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6101.256569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6102.630254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.992449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.269726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.467515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.609022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6108.559586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.596423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6110.713513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.742603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.914558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.089322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.153569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6116.356643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.477601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.379177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.574388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6120.552098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.723940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.765681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.836726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6124.817298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.842873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6126.850106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.808313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6128.724025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.650995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6130.775378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.939024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6132.891592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6133.958225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6135.023651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6136.144544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6137.357297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6138.570693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6139.694588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6140.775769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6141.643235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6142.499792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6143.310145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6144.209349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6145.179382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6146.285877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6147.612368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6148.662331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.648753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6150.704249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6151.902757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6153.078348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6154.277557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.223592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6156.445361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6157.454230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.755347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6159.609580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6160.735116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.136766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.363130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6164.266294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6165.348759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.497835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6167.467454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6168.531756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6169.563572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6170.413669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.621442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.140282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6174.249065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6175.796895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6176.984922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6178.455995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6179.799703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6180.970840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6181.948572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6183.382668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6184.638836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6185.511777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6186.860644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6188.177654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6189.409909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6190.806504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6191.952809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6192.999761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6194.365259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6195.457217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6196.509719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6197.474635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6198.466423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6199.239130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6200.258596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6201.469847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6202.492687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6203.488238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6204.656194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6205.872964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6206.865145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6207.834271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6208.605508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6209.674625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6210.799568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6211.915732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6213.045574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6214.049324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6215.001158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6216.169696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6217.195807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6218.428396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6219.489144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6220.554405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6221.461344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6222.751122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6223.806590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6224.769202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6225.931392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6226.998939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.250890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6229.435938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6230.712624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6232.127603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6233.311134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6234.359710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6235.663371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6236.648742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6238.022238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6239.046839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6240.083561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6240.869906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6241.819296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6242.917742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6243.969802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6245.171837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6246.194229] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6246.211400] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6246.241341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6247.520653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6248.501580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6249.766055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6250.477712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6251.796785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6252.846925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6253.836536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6255.130235] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6255.145383] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6255.147207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6256.260567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6257.175625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6258.202644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6259.250335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6260.365073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6261.415388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6262.618245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6263.687451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6264.618772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6265.465766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6266.612544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6267.513740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6268.534236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6269.663946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6270.757725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6271.874203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6273.017935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6274.133485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6275.425902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6276.373459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6277.411461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6278.386306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6279.890206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6281.052898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6282.503121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6283.737108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6285.147986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6286.554299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6287.708463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6289.143661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6290.380960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6291.796370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6292.888324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6294.208702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6295.469133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6296.535211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6297.688448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6298.969303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6300.323395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6301.771237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6303.019976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6304.322968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6305.508139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6306.736062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6307.926974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6309.338895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6310.698993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6312.111578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6313.137234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6314.216710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6315.334081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6316.537794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6317.874915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6319.295090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6320.657707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6322.063681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6323.184428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6324.443061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6325.731362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6326.799219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6327.894245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6328.939765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6330.211308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6331.652088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6332.892373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6334.454141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6335.976742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6337.277471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6338.622276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6339.759062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6340.894057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6341.992960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6343.174815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6344.077159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6345.179579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6346.121709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6347.058636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6348.280986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6349.371420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6350.455901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6351.547879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6352.504095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6353.421526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6354.390812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6355.319654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6356.328310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6357.388146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6358.131337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6359.330236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6360.283307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6361.096880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6362.210902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6363.131633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6364.218441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6365.246201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6366.520586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6367.537529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6368.684995] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6368.700516] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6368.702601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6369.927256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6371.036763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6372.243568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6373.621503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6374.639419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6375.632917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6376.995496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6378.043504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6379.168054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6380.302228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6381.639243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6382.912955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6384.330811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6385.695185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6387.127193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6388.184712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6389.588784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6391.074819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6391.930907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6392.927591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6393.898191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6395.101641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6396.188824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6397.734952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6399.021784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6400.343958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6401.473722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6402.798784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6404.061907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6405.159225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6406.570871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6407.865501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6409.200120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6410.461504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6412.024066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6413.177158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6414.387782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6415.666210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6417.066908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6418.752451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6419.862110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6421.305246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6422.599710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6423.901155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6425.504085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6426.582829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6427.868979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6428.937897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6429.889113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6431.040975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6431.977741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6433.140785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6434.111837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6435.333888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6436.250592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6437.132337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6438.381427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6439.590772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6440.641967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6441.498567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6442.349356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6443.254129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6444.099713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6444.952217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6446.143729] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6446.152683] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 1 previous similar message [ 6446.160547] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6446.170427] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) Skipped 1 previous similar message [ 6446.178515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6447.136860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6448.070128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6448.850941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6449.905644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6450.829720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6451.850300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6452.672900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6453.766634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6454.745378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6455.749827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6456.940328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6457.992442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6459.195402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6459.995791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6461.087756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6462.076086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6463.308230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6464.304422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6465.352645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6466.424082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6467.736114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6469.094739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6470.320207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6471.508555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6472.926764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6473.993351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6474.954620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6476.016883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6477.087962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6478.318556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6479.286767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6480.430057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6481.419037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6482.596631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6483.834670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6484.995028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6485.991896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6487.241247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6488.147613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6489.102891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6490.063889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6491.123693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6491.972435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6492.974300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6493.974496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6494.958613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6495.830443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6496.788829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6497.877551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6498.776852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6499.858726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6500.828502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6501.761091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6502.603049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6503.638315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6504.566707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6505.670604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6507.053302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6508.031144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6509.443316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6510.713208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6511.858659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6512.840329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6514.040443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6515.035263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6516.065621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6516.922309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6517.977875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6518.892698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6519.975890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6520.835141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6521.896053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6522.887622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6523.861820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6524.879603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6525.874669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6526.955266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6528.076037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6529.272574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6530.353787] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6530.364101] Lustre: Skipped 454 previous similar messages [ 6530.397812] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6530.421904] Lustre: Skipped 454 previous similar messages [ 6530.441481] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6530.459173] Lustre: Skipped 454 previous similar messages [ 6530.475095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6530.495627] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6530.517787] Lustre: Skipped 454 previous similar messages [ 6531.401176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6532.413531] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6532.426812] LustreError: 171153:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6532.440563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6533.433475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6534.444168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6535.409340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6536.454513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6537.528032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6538.682914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6539.649687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6540.614334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6541.577924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6542.575716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6543.487821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6544.485515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6545.230440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6546.208855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6547.138955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6548.091944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6549.181201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6550.177694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6551.121712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6551.903175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6552.893838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6553.862836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6554.858713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6555.707271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6556.469373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6557.410624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6558.375220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6559.595945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6560.607035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6561.621335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6562.400992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6563.421890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6564.410196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6565.257737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6566.349471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6567.425888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6568.421763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6569.471509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6570.535821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6571.516979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6572.468554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6573.446914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6574.526169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6575.461470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6576.428506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6577.476551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6578.346894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6579.187669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6580.160644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6580.959778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6581.748456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6582.504985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6583.377763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6584.216347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6585.023593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6585.727383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6586.648047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6587.497635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6588.339327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6589.278991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6590.145563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6590.979909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6591.820126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6592.784591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6593.627599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6594.581162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6595.415523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6596.426959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7006.062439] LustreError: 204914:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 7006.073331] LustreError: 171153:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 7625.185882] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7625.191490] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7625.198174] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7625.204224] Lustre: Skipped 71 previous similar messages [ 7625.212895] Lustre: Skipped 1 previous similar message [ 7627.428743] Lustre: server umount lustre-OST0000 complete [ 7632.353298] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7632.373086] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7635.426946] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7635.431590] Lustre: Skipped 1 previous similar message [ 7637.676441] Lustre: server umount lustre-MDT0000 complete [ 7640.547242] LustreError: 171128:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7640.567913] LustreError: 171128:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7641.706026] LustreError: 171115:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782616868 with bad export cookie 13486318073213276375 [ 7641.715967] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7642.441471] Lustre: server umount lustre-MDT0001 complete [ 7653.866489] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 7657.247849] Key type lgssc unregistered [ 7657.724853] LNet: 226429:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7657.740045] LNetError: 226429:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7657.794641] LNet: Removed LNI 192.168.201.149@tcp [ 7658.935436] Key type .llcrypt unregistered [ 7658.939625] Key type ._llcrypt unregistered [ 7686.263186] Key type ._llcrypt registered [ 7686.265968] Key type .llcrypt registered [ 7686.385370] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 7687.255565] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7687.265529] alg: No test for adler32 (adler32-zlib) [ 7688.452522] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 7688.699645] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 7690.416160] Key type lgssc registered [ 7691.543922] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7700.052135] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7700.084432] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7701.597965] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7705.987740] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7711.717316] LustreError: 227844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7711.756538] LustreError: 227844:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7715.489065] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7715.936109] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7719.860379] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7726.473952] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7731.764783] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7737.679313] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7737.999473] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7743.397619] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7746.278141] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 7750.764400] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7756.263878] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 7757.714675] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7757.724225] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 7757.730854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7757.740954] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7757.746038] LustreError: 227864:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 7760.865093] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7760.874554] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7760.890225] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7761.903744] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7761.913446] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7763.886584] Lustre: lustre-OST0000: Not available for connect from 192.168.201.49@tcp (stopping) [ 7763.897584] Lustre: Skipped 1 previous similar message [ 7765.735130] Lustre: server umount lustre-OST0000 complete [ 7777.818424] LustreError: 227864:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 7800.041822] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7800.468024] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7802.537133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7802.558207] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7806.380300] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7812.775616] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7812.792690] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 7814.127825] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7815.778989] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 7821.617219] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9a1988e12000.ost_server_uuid 50 [ 7823.506187] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9a1988e12000.ost_server_uuid in FULL state after 0 sec [ 7828.454554] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7828.479905] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7828.480168] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7828.483123] Lustre: Skipped 1 previous similar message [ 7828.506075] Lustre: Skipped 1 previous similar message [ 7830.233149] Lustre: server umount lustre-OST0000 complete [ 7838.691974] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7838.703653] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7838.713582] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7838.719143] Lustre: Skipped 1 previous similar message [ 7840.321889] Lustre: server umount lustre-MDT0000 complete [ 7843.811080] LustreError: 227844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7843.839541] LustreError: 227844:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7844.021488] LustreError: 227824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782617071 with bad export cookie 5421305093474685251 [ 7844.030346] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7844.454411] Lustre: server umount lustre-MDT0001 complete [ 7856.746676] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 7859.932460] Key type lgssc unregistered [ 7860.265932] LNet: 233051:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7860.278796] LNetError: 233051:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7860.290954] LNet: Removed LNI 192.168.201.149@tcp [ 7861.404163] Key type .llcrypt unregistered [ 7861.406467] Key type ._llcrypt unregistered [ 7890.516717] Key type ._llcrypt registered [ 7890.518017] Key type .llcrypt registered [ 7890.638319] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 7891.375551] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7891.512358] alg: No test for adler32 (adler32-zlib) [ 7892.681337] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 7893.022396] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 7894.712195] Key type lgssc registered [ 7895.914538] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7904.926819] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7904.974574] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7906.602790] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7911.798419] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7916.013518] LustreError: 234778:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7916.049567] LustreError: 234778:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7921.124378] LustreError: 234777:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7922.079067] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7922.521565] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7927.570689] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7930.701823] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7938.732415] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7939.197276] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7947.737625] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7951.482803] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 7958.662788] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7958.896960] Lustre: lustre-OST0001: new disk, initializing [ 7958.902050] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7958.909870] Lustre: 237095:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7959.052163] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7966.008766] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 7967.920344] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7967.928925] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7968.040085] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7977.829560] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7983.670067] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7998.955118] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7998.970163] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7998.975166] Lustre: Skipped 1 previous similar message [ 7998.986212] Lustre: Skipped 3 previous similar messages [ 8004.087458] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8004.095192] Lustre: Skipped 3 previous similar messages [ 8004.610412] Lustre: server umount lustre-MDT0000 complete [ 8008.805719] LustreError: 237105:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782617235 with bad export cookie 16539026228454950195 [ 8008.811158] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8008.820031] LustreError: 237105:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8009.188509] Lustre: server umount lustre-MDT0001 complete [ 8022.198678] Lustre: server umount lustre-OST0000 complete [ 8025.320553] Lustre: 234041:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782617236/real 1782617236] req@ffff9185687cbb80 x1869209529325952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782617252 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8025.341950] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8025.350184] Lustre: Skipped 2 previous similar messages [ 8027.511753] Lustre: server umount lustre-OST0001 complete [ 8049.911626] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 8060.717694] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8061.066963] LustreError: 240205:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8061.119501] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8065.359134] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8066.536799] LustreError: 240206:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8071.662607] LustreError: 240205:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8073.159341] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8073.481383] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8077.569204] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8080.579257] Lustre: 241347:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8086.228449] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8092.501743] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8098.800809] LustreError: 241700:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8098.808821] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 8101.074095] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8101.279461] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8101.283993] Lustre: Skipped 1 previous similar message [ 8106.427104] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 8106.445917] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 8106.827666] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8113.203153] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8115.834698] Lustre: 243216:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8124.849263] Lustre: server umount mylustre-MDT0000 complete [ 8124.899308] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8124.906931] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8124.926363] LustreError: 240205:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8126.950835] Lustre: mylustre-MDT0000-lwp-OST0000: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8126.971979] Lustre: Skipped 2 previous similar messages [ 8127.729457] LustreError: 240182:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782617354 with bad export cookie 16539026228454953051 [ 8127.736825] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8127.740474] LustreError: 240182:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8132.084126] Lustre: mylustre-MDT0001-lwp-OST0000: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8132.095582] Lustre: mylustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8134.085187] Lustre: server umount mylustre-MDT0001 complete [ 8137.699334] Lustre: server umount mylustre-OST0000 complete [ 8141.471675] Lustre: server umount mylustre-OST0001 complete [ 8160.753704] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 8169.659728] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8169.969683] LustreError: 245525:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8169.986093] LustreError: 245525:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 8170.037539] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8174.449878] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8182.520169] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8188.242633] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8191.550981] Lustre: 246667:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8197.936623] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8204.726481] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8208.582013] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 8214.707840] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8216.031282] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 8216.043869] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:65) [ 8221.476959] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8228.719863] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8232.079301] Lustre: 248539:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8241.638947] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8241.650119] Lustre: Skipped 1 previous similar message [ 8241.654349] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 8241.667546] Lustre: Skipped 4 previous similar messages [ 8246.201676] Lustre: server umount tfs-MDT0000 complete [ 8246.767477] LustreError: 248502:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8246.801740] LustreError: 248502:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 8250.299649] LustreError: 245501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782617477 with bad export cookie 16539026228454955235 [ 8250.302451] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8250.315573] LustreError: 245501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8250.643373] Lustre: server umount tfs-MDT0001 complete [ 8264.254715] Lustre: server umount tfs-OST0000 complete [ 8267.232419] Lustre: 234043:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782617478/real 1782617478] req@ffff918561332a00 x1869209529434368/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782617494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8267.254546] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8267.261658] Lustre: Skipped 3 previous similar messages [ 8268.073523] Lustre: server umount tfs-OST0001 complete [ 8290.331327] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 8302.749332] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8303.690423] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8303.701198] Lustre: Skipped 3 previous similar messages [ 8309.393607] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8320.387172] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8327.090277] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8330.507604] Lustre: 251934:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8337.288136] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8345.523856] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8345.942046] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 8348.027627] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 8356.160329] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8361.999080] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:97) [ 8362.771058] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8370.526694] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8374.224504] Lustre: 253804:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8382.993970] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 23:33:27 (1782617607) [ 8402.913471] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8402.926387] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8402.944271] Lustre: Skipped 2 previous similar messages [ 8402.946948] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8405.498785] Lustre: server umount lustre-MDT0000 complete [ 8408.037430] LustreError: 251524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8408.053817] LustreError: 251524:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 12 previous similar messages [ 8409.755875] LustreError: 250766:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782617636 with bad export cookie 16539026228454957153 [ 8409.760766] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8409.780197] LustreError: 250766:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8413.159677] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8413.167513] Lustre: Skipped 4 previous similar messages [ 8416.272737] Lustre: server umount lustre-MDT0001 complete [ 8426.521881] Lustre: server umount lustre-OST0000 complete [ 8436.931462] Lustre: server umount lustre-OST0001 complete [ 8445.071945] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 8456.043725] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 8491.974104] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 8491.974104] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 8491.974104] [ 8492.004233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 8492.270391] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8492.302250] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8492.398061] Lustre: lustre-MDT0000: new disk, initializing [ 8492.489317] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8492.496230] Lustre: Skipped 3 previous similar messages [ 8492.509571] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8496.944731] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8506.415288] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 8506.415288] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 8506.415288] [ 8506.448301] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 8506.620095] Lustre: 256989:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8506.706824] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8506.711131] Lustre: Skipped 1 previous similar message [ 8506.801138] Lustre: lustre-MDT0001: new disk, initializing [ 8506.920919] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8506.934883] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8511.671099] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8522.681845] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8522.972224] Lustre: lustre-OST0000: new disk, initializing [ 8522.980060] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8522.990757] Lustre: 258571:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8524.856561] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8524.863963] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8524.966146] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8529.517579] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8540.920036] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8541.127933] Lustre: lustre-OST0001: new disk, initializing [ 8541.131414] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8541.137333] Lustre: 259442:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8542.311796] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8542.325934] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8542.446349] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8547.655159] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8558.462754] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 23:36:24 (1782617784) [ 8573.869742] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 23:36:39 (1782617799) [ 8591.841924] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8591.844223] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8591.863112] LustreError: Skipped 1 previous similar message [ 8591.865233] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8591.865242] Lustre: Skipped 2 previous similar messages [ 8591.908335] Lustre: Skipped 4 previous similar messages [ 8595.233730] Lustre: server umount lustre-OST0000 complete [ 8604.130636] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8605.658230] Lustre: server umount lustre-MDT0000 complete [ 8610.350297] LustreError: 257785:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782617837 with bad export cookie 16539026228454958931 [ 8610.358446] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8610.370503] LustreError: 257785:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8616.893653] Lustre: server umount lustre-MDT0001 complete [ 8629.265821] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 8642.533973] Lustre: server umount lustre-OST0001 complete [ 8649.690162] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 8669.524219] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 8705.415557] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8705.713348] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8705.751968] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8705.856652] Lustre: lustre-MDT0000: new disk, initializing [ 8705.979859] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8710.564943] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8720.778847] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8721.034733] Lustre: 264001:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8721.393385] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8726.012697] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8736.705152] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8742.216567] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8750.395059] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8750.856966] Lustre: lustre-OST0000: new disk, initializing [ 8750.860895] Lustre: Skipped 1 previous similar message [ 8750.870528] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8750.877597] Lustre: Skipped 2 previous similar messages [ 8750.893829] Lustre: 265967:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8751.047681] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8751.068497] Lustre: Skipped 5 previous similar messages [ 8752.580312] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8752.599306] Lustre: Skipped 1 previous similar message [ 8752.601962] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8752.821592] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8759.809630] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8771.103347] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8778.222097] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8778.225781] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8778.238577] Lustre: Skipped 4 previous similar messages [ 8778.245751] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8778.245760] Lustre: Skipped 8 previous similar messages [ 8783.334435] LustreError: 265950:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8783.376714] LustreError: 265950:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 14 previous similar messages [ 8783.619428] Lustre: server umount lustre-OST0000 complete [ 8787.937785] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8793.812296] Lustre: server umount lustre-MDT0000 complete [ 8797.440598] LustreError: 263992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782618024 with bad export cookie 16539026228454960401 [ 8797.448301] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8797.457346] LustreError: 263992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8797.795836] Lustre: server umount lustre-MDT0001 complete [ 8808.910884] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 8811.435862] Key type lgssc unregistered [ 8811.756248] LNet: 267728:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8811.772220] LNetError: 267728:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8811.806583] LNet: Removed LNI 192.168.201.149@tcp [ 8812.967332] Key type .llcrypt unregistered [ 8812.977204] Key type ._llcrypt unregistered [ 8840.497848] Key type ._llcrypt registered [ 8840.500262] Key type .llcrypt registered [ 8840.590356] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 8841.696466] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8841.814620] alg: No test for adler32 (adler32-zlib) [ 8843.019326] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 8843.288739] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 8845.064593] Key type lgssc registered [ 8846.485121] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8856.201942] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8856.220308] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8857.556876] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8862.177769] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8867.814940] LustreError: 269193:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8867.830491] LustreError: 269193:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8872.206270] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8872.597078] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8878.633637] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8887.402736] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8895.258120] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8903.555963] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8903.938394] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8910.770882] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 8918.706680] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8919.659385] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 8922.594238] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8922.613338] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8923.563084] Lustre: server umount lustre-OST0000 complete [ 8927.721867] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8927.730454] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8927.736715] Lustre: Skipped 1 previous similar message [ 8932.833755] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8932.848964] Lustre: Skipped 1 previous similar message [ 8933.382850] Lustre: server umount lustre-MDT0000 complete [ 8936.877813] LustreError: 269173:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782618163 with bad export cookie 15979297311907627154 [ 8936.891764] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8937.162485] Lustre: server umount lustre-MDT0001 complete [ 8949.483450] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 8954.044045] Key type lgssc unregistered [ 8954.560210] LNet: 272775:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8954.595160] LNetError: 272775:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8954.619331] LNet: Removed LNI 192.168.201.149@tcp [ 8956.139165] Key type .llcrypt unregistered [ 8956.141270] Key type ._llcrypt unregistered [ 8974.685742] Key type ._llcrypt registered [ 8974.687669] Key type .llcrypt registered [ 8974.762772] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 8975.787949] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8975.831097] alg: No test for adler32 (adler32-zlib) [ 8976.861806] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 8977.085851] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 8978.729865] Key type lgssc registered [ 8980.381202] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8991.662248] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8991.686878] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9007.329079] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 9012.448310] LustreError: 273972:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.149@tcp: failed processing log, type 4: rc = -110 [ 9039.136195] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9045.052223] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9052.185061] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9054.274423] Lustre: server umount lustre-OST0000 complete [ 9070.938564] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 9074.204753] Key type lgssc unregistered [ 9074.447894] LNet: 275604:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9074.462432] LNetError: 275604:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9074.484968] LNet: Removed LNI 192.168.201.149@tcp [ 9075.778474] Key type .llcrypt unregistered [ 9075.780746] Key type ._llcrypt unregistered [ 9117.477964] Key type ._llcrypt registered [ 9117.486432] Key type .llcrypt registered [ 9117.636590] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 9118.944491] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9118.977509] alg: No test for adler32 (adler32-zlib) [ 9120.066822] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 9120.332687] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 9122.032945] Key type lgssc registered [ 9123.133667] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9137.417086] loop0: detected capacity change from 0 to 204800000 [ 9137.684762] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9137.697780] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9138.081132] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9139.307559] loop0: detected capacity change from 0 to 204800000 [ 9139.665898] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9139.679885] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9140.203864] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9141.294339] loop0: detected capacity change from 0 to 204800000 [ 9141.495455] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9141.505460] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9141.643648] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9143.512244] loop0: detected capacity change from 0 to 204800000 [ 9143.828441] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9143.846596] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9144.003538] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9145.421557] loop0: detected capacity change from 0 to 204800000 [ 9145.472408] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9149.849234] loop0: detected capacity change from 0 to 204800000 [ 9149.875024] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9154.818412] loop0: detected capacity change from 0 to 204800000 [ 9154.850161] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9158.954284] loop0: detected capacity change from 0 to 204800000 [ 9159.003322] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9164.162488] loop0: detected capacity change from 0 to 204800000 [ 9164.280541] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9164.348612] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9164.536552] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9164.552874] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 9164.572782] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 9164.586068] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9164.611796] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 9164.629739] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9164.647686] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9164.661368] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 9164.671831] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 9164.689527] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 9164.700927] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 9164.708671] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 9164.719965] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 9164.730254] Lustre: 279018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 9171.883397] Lustre: server umount MGS complete [ 9173.119560] loop0: detected capacity change from 0 to 204800000 [ 9173.235278] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9173.878728] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9173.973670] Lustre: lustre-MDT0000: Aborting client recovery [ 9175.028981] loop1: detected capacity change from 0 to 204800000 [ 9175.220309] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9175.406366] Lustre: 279448:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9175.462172] Lustre: 279448:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9175.487652] Lustre: 279448:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 9175.516165] Lustre: 279448:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 9175.535455] Lustre: 279448:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9175.566737] Lustre: 279448:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 9175.580985] Lustre: 279448:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9175.652114] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9175.813333] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9175.866803] Lustre: lustre-MDT0001: Aborting client recovery [ 9177.355037] loop2: detected capacity change from 0 to 204800000 [ 9177.587855] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9177.758523] Lustre: 279527:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9177.777354] Lustre: 279527:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9177.804411] Lustre: 279527:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9177.835015] Lustre: 279527:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9177.864663] Lustre: 279527:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9177.894974] Lustre: 279527:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9177.919758] Lustre: 279527:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9178.123128] Lustre: Found index 0 for lustre-OST0000, updating log [ 9178.191876] Lustre: 279546:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9178.287967] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9178.343158] Lustre: lustre-OST0000: Aborting recovery [ 9179.423763] loop3: detected capacity change from 0 to 204800000 [ 9179.590296] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9179.736712] Lustre: 279611:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9179.764139] Lustre: 279611:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9179.786424] Lustre: 279611:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9179.808802] Lustre: 279611:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9179.825234] Lustre: 279611:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9179.839972] Lustre: 279611:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9179.865201] Lustre: 279611:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9179.908466] Lustre: Found index 1 for lustre-OST0001, updating log [ 9179.947584] Lustre: 279616:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9180.036948] Lustre: lustre-OST0001: Aborting recovery [ 9180.065140] LustreError: 279392:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -108 [ 9183.095237] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9183.111620] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9183.160534] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 9183.162388] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 9185.124461] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 9185.128951] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 9189.269485] LustreError: 279359:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 3916us: rc = -2 [ 9189.778229] LustreError: 279357:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 776us: rc = -2 [ 9189.793373] LustreError: 279357:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 15 previous similar messages [ 9205.743659] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9205.745652] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9205.768478] Lustre: Skipped 2 previous similar messages [ 9205.777340] Lustre: Skipped 3 previous similar messages [ 9209.497625] Lustre: server umount lustre-MDT0000 complete [ 9210.357102] LustreError: 279343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782618437 with bad export cookie 3347716671291324361 [ 9210.376540] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9210.851090] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9210.855386] LustreError: 279883:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9210.855530] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9210.868898] Lustre: Skipped 2 previous similar messages [ 9210.906396] LustreError: 279883:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9215.971345] LustreError: 279626:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9215.972569] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9215.991796] LustreError: 279626:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9216.008410] Lustre: Skipped 2 previous similar messages [ 9216.843373] Lustre: server umount lustre-MDT0001 complete [ 9223.908676] Lustre: server umount lustre-OST0000 complete [ 9231.321973] Lustre: server umount lustre-OST0001 complete [ 9239.715233] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 23:47:45 (1782618465) [ 9267.488516] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 9277.715831] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 9318.487729] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9318.876083] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9318.905954] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9318.977206] Lustre: lustre-MDT0000: new disk, initializing [ 9319.052581] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9319.064063] Lustre: Skipped 1 previous similar message [ 9319.080533] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9323.618554] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9335.628980] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9335.825662] Lustre: 283683:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9335.888721] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9335.891535] Lustre: Skipped 1 previous similar message [ 9335.969826] Lustre: lustre-MDT0001: new disk, initializing [ 9336.086233] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9336.149313] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9336.164369] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9340.902214] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9351.864158] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9359.365988] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9369.013593] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9369.375951] Lustre: lustre-OST0000: new disk, initializing [ 9369.381454] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9369.394406] Lustre: 285652:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9369.512852] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9377.973991] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9379.528702] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9379.552714] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9379.802364] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9388.603136] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9394.041901] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9408.773106] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9421.230396] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9431.374194] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 9477.096131] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9477.096850] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9477.106307] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9477.108087] Lustre: Skipped 1 previous similar message [ 9482.213107] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9482.248043] Lustre: Skipped 2 previous similar messages [ 9487.331114] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9487.675973] Lustre: server umount lustre-OST0000 complete [ 9492.451438] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9492.453525] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9492.473684] Lustre: Skipped 1 previous similar message [ 9492.488936] Lustre: Skipped 3 previous similar messages [ 9506.273054] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9506.495529] Lustre: server umount lustre-MDT0000 complete [ 9507.813945] LustreError: 283689:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9507.835327] LustreError: 283689:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9510.723289] LustreError: 287299:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782618737 with bad export cookie 3347716671291327063 [ 9510.726062] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9510.736268] LustreError: 287299:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 9511.192471] Lustre: server umount lustre-MDT0001 complete [ 9519.972920] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9524.209303] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9528.986861] Lustre: server umount MGS complete [ 9539.420984] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9539.904561] LustreError: 289717:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9539.913864] LustreError: 289730:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9539.993718] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9544.206902] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9545.197400] LustreError: 289718:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9552.978826] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9557.736345] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9565.757330] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9571.435040] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9578.553399] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9578.917078] LustreError: 291539:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9578.941798] LustreError: 291539:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9579.091757] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9579.095655] Lustre: Skipped 1 previous similar message [ 9586.044189] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9592.867470] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9625.058985] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9625.065779] LustreError: Skipped 1 previous similar message [ 9625.068623] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9625.078310] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9625.085736] Lustre: Skipped 4 previous similar messages [ 9626.084482] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9627.701419] Lustre: server umount lustre-OST0000 complete [ 9635.307559] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9635.316355] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9635.323747] Lustre: Skipped 1 previous similar message [ 9637.913506] Lustre: server umount lustre-MDT0000 complete [ 9641.449175] LustreError: 289713:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9641.472917] LustreError: 289713:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9641.661558] LustreError: 289698:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782618868 with bad export cookie 3347716671291328904 [ 9641.667683] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9641.679225] LustreError: 289698:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9642.111104] Lustre: server umount lustre-MDT0001 complete [ 9653.528953] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [ 9657.237886] Key type lgssc unregistered [ 9657.506649] LNet: 293660:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9657.526823] LNetError: 293660:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9658.609913] LNet: Removed LNI 192.168.201.149@tcp [ 9659.834813] Key type .llcrypt unregistered [ 9659.838995] Key type ._llcrypt unregistered [ 9699.593968] Key type ._llcrypt registered [ 9699.596232] Key type .llcrypt registered [ 9699.718833] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [ 9718.870522] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [ 9720.448629] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9720.634632] alg: No test for adler32 (adler32-zlib) [ 9721.733934] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [ 9722.038580] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [ 9723.760477] Key type lgssc registered [ 9724.936815] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9765.475229] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9765.495847] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9766.914847] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9766.956911] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9767.038345] Lustre: lustre-MDT0000: new disk, initializing [ 9767.103729] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9767.128575] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9772.735091] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9786.462760] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9786.632289] Lustre: 297621:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9786.731883] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9786.743105] Lustre: Skipped 1 previous similar message [ 9786.898921] Lustre: lustre-MDT0001: new disk, initializing [ 9787.056323] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9787.093583] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9787.109712] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9792.440389] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9803.158381] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9809.842931] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9818.166379] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9818.550664] Lustre: lustre-OST0000: new disk, initializing [ 9818.555921] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9818.563900] Lustre: 299591:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9818.698061] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9825.331817] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9826.935701] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9826.949605] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9827.125260] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9835.752627] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9842.313962] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9852.155599] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9855.942780] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9862.883507] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 9909.217976] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9909.221125] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9909.230594] LustreError: Skipped 1 previous similar message [ 9909.233320] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9909.245032] Lustre: Skipped 1 previous similar message [ 9914.342357] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9914.361496] Lustre: Skipped 2 previous similar messages [ 9915.427990] Lustre: server umount lustre-OST0000 complete [ 9919.459850] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9919.470903] Lustre: Skipped 1 previous similar message [ 9919.473352] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9919.485744] Lustre: Skipped 1 previous similar message [ 9924.584438] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9924.591121] Lustre: Skipped 1 previous similar message [ 9925.748424] Lustre: server umount lustre-MDT0000 complete [ 9930.332571] LustreError: 299590:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782619157 with bad export cookie 6832323024736440789 [ 9930.343281] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9930.788227] Lustre: server umount lustre-MDT0001 complete [ 9940.162832] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9945.490603] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9950.871655] Lustre: server umount MGS complete [ 9966.711657] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9967.178645] LustreError: 303360:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9967.210025] LustreError: 303360:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9967.242780] LustreError: 303373:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9967.326118] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9972.293967] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9972.707816] LustreError: 303361:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9977.853182] LustreError: 303360:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9982.954751] LustreError: 303361:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9983.604892] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9984.153572] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9989.985983] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [ 9998.513814] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10005.144708] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10014.122934] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10014.484461] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10022.693295] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [10029.995315] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10071.011750] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10071.034251] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10071.064682] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10073.057894] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10073.079249] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10077.091473] Lustre: server umount lustre-OST0000 complete [10081.249398] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10081.254788] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10081.276917] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10081.284085] Lustre: Skipped 2 previous similar messages [10087.894751] Lustre: server umount lustre-MDT0000 complete [10088.417103] LustreError: 303361:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10088.463520] LustreError: 303361:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10092.810989] LustreError: 303342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782619319 with bad export cookie 6832323024736442644 [10092.820504] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10092.836108] LustreError: 303342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 7 previous similar messages [10093.507675] Lustre: server umount lustre-MDT0001 complete [10107.107515] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [10110.898415] Key type lgssc unregistered [10111.219560] LNet: 307344:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10111.226327] LNetError: 307344:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [10111.244076] LNet: Removed LNI 192.168.201.149@tcp [10112.370534] Key type .llcrypt unregistered [10112.372228] Key type ._llcrypt unregistered [10137.491221] Key type ._llcrypt registered [10137.502495] Key type .llcrypt registered [10137.707287] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [10152.410530] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [10153.327822] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10153.487958] alg: No test for adler32 (adler32-zlib) [10154.591778] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [10154.866235] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [10156.536196] Key type lgssc registered [10157.983993] Lustre: Echo OBD driver; http://www.lustre.org/ [10182.895276] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [10198.472922] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10198.490655] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10199.830199] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10199.847174] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10199.928478] Lustre: lustre-MDT0000: new disk, initializing [10200.031983] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10200.047231] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10205.571616] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [10218.866598] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10219.345241] Lustre: lustre-OST0000: new disk, initializing [10219.348959] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10219.354373] Lustre: Skipped 1 previous similar message [10219.359237] Lustre: 311397:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10219.446485] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10227.629712] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [10228.415297] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [10228.445583] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [10228.488802] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [10994.607541] Lustre: server umount lustre-MDT0000 complete [10998.854247] LustreError: 310583:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782620225 with bad export cookie 8012776508276540253 [10998.868432] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11008.780518] Lustre: server umount lustre-OST0000 complete [11036.374859] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [11048.171830] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [11085.764504] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11086.041913] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11086.072807] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11086.150585] Lustre: lustre-MDT0000: new disk, initializing [11086.250850] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11086.270805] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11091.202929] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11101.833919] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11101.948277] Lustre: 315720:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11101.998378] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11102.003847] Lustre: Skipped 1 previous similar message [11102.085764] Lustre: lustre-MDT0001: new disk, initializing [11102.200865] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11102.242906] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11102.257227] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11106.718636] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11115.734324] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11120.193160] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11126.698163] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11126.893947] Lustre: lustre-OST0000: new disk, initializing [11126.896373] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11126.900216] Lustre: 317689:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11126.972053] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11133.028437] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11133.525882] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11133.530681] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11133.576488] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11141.711869] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11146.621872] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11146.868119] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11151.033331] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11151.208521] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11154.402385] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11154.415714] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11154.431975] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11159.289741] Lustre: server umount lustre-OST0000 complete [11163.617630] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11163.624795] LustreError: Skipped 1 previous similar message [11163.626732] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11163.636378] Lustre: Skipped 1 previous similar message [11163.639565] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11163.642229] Lustre: Skipped 1 previous similar message [11164.642386] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11164.645885] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11164.676977] Lustre: Skipped 1 previous similar message [11168.971160] Lustre: server umount lustre-MDT0000 complete [11172.401576] LustreError: 315714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782620399 with bad export cookie 8012776508279481072 [11172.425311] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11172.425391] LustreError: 315714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11172.816549] Lustre: server umount lustre-MDT0001 complete [11176.002954] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [11177.738947] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 00:20:03 (1782620403) [11184.270738] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11184.735419] LustreError: 319999:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11184.758391] LustreError: 319999:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11184.829237] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11188.915410] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11190.243830] LustreError: 320000:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11194.339156] LustreError: 319999:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11196.093542] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11196.617073] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11200.221484] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11206.639591] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11211.612581] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11217.242647] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11217.518618] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11222.926904] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11229.072586] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11234.226574] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11234.380316] Lustre: lustre-OST0001: new disk, initializing [11234.384590] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [11234.389903] Lustre: 322834:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11234.475029] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11239.902810] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11241.569105] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [11241.580133] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [11241.624375] LustreError: 323295:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11242.664971] LustreError: 323295:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11242.692431] LustreError: 323295:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [11243.684700] LustreError: 323299:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11245.731795] LustreError: 323299:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11245.744354] LustreError: 323299:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [11248.447682] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11248.645537] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11249.892732] LustreError: 323299:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11249.909635] LustreError: 323299:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 8 previous similar messages [11253.615565] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9a19b6b0b000.ost_server_uuid 50 [11254.821951] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9a19b6b0b000.ost_server_uuid in FULL state after 0 sec [11258.164875] LustreError: 323299:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11258.176886] LustreError: 323299:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 14 previous similar messages [11258.810813] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9a19b6b0b000.ost_server_uuid 50 [11259.900973] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9a19b6b0b000.ost_server_uuid in FULL state after 0 sec [11261.312903] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [11275.182137] Lustre: lustre-OST0001: Not available for connect from 192.168.201.49@tcp (stopping) [11276.773351] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11276.780841] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11276.801771] Lustre: Skipped 1 previous similar message [11280.031220] Lustre: server umount lustre-OST0001 complete [11280.264413] LustreError: 324365:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.201.49@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11286.497106] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11286.504164] LustreError: Skipped 2 previous similar messages [11286.507421] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11286.515611] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11286.517473] Lustre: Skipped 4 previous similar messages [11288.042627] LustreError: 321820:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11288.052758] LustreError: 321820:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11291.276585] Lustre: server umount lustre-OST0000 complete [11298.275949] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11298.286981] Lustre: Skipped 1 previous similar message [11298.295627] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11298.302301] Lustre: Skipped 3 previous similar messages [11301.403039] Lustre: server umount lustre-MDT0000 complete [11303.410244] LustreError: 320000:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11303.428989] LustreError: 320000:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [11304.821173] LustreError: 319981:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782620531 with bad export cookie 8012776508279481954 [11304.827315] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11304.829642] LustreError: 319981:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11305.203780] Lustre: server umount lustre-MDT0001 complete [11315.540436] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [11318.263666] Key type lgssc unregistered [11318.598300] LNet: 325519:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11318.604395] LNetError: 325519:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [11318.620797] LNet: Removed LNI 192.168.201.149@tcp [11319.541055] Key type .llcrypt unregistered [11319.546880] Key type ._llcrypt unregistered [11340.797597] Key type ._llcrypt registered [11340.800185] Key type .llcrypt registered [11340.897802] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [11341.789203] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11341.913289] alg: No test for adler32 (adler32-zlib) [11342.986381] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [11343.189217] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [11344.824250] Key type lgssc registered [11345.697385] Lustre: Echo OBD driver; http://www.lustre.org/ [11351.782263] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11351.794271] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11353.248262] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11356.427748] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11361.478584] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11363.813105] LustreError: 326947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11363.820694] LustreError: 326947:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11365.661889] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11365.895337] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11368.666905] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11375.319421] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11375.559666] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11378.667521] LustreError: 328843:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11378.693469] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [11380.453434] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11383.785726] LustreError: 328845:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11386.309977] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11388.906219] LustreError: 328625:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11391.595156] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11391.764588] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11396.446059] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11397.122437] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [11402.338191] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [11408.830774] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [11408.983287] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11504.614521] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11504.621417] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11504.621471] LustreError: Skipped 1 previous similar message [11504.631670] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11508.380198] Lustre: server umount lustre-OST0001 complete [11509.740340] LustreError: 328626:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11509.765078] LustreError: 328626:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11513.826639] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11513.840537] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11513.860375] Lustre: Skipped 1 previous similar message [11513.874361] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11513.886746] Lustre: Skipped 1 previous similar message [11514.852567] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11519.264921] Lustre: server umount lustre-OST0000 complete [11524.580034] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11524.590426] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11524.613452] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11524.621196] Lustre: Skipped 2 previous similar messages [11528.676247] Lustre: server umount lustre-MDT0000 complete [11530.209595] LustreError: 328293:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11530.228643] LustreError: 328293:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11531.442644] LustreError: 330629:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782620758 with bad export cookie 3362055105494398377 [11531.447416] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11531.453474] LustreError: 330629:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11531.662909] Lustre: server umount lustre-MDT0001 complete [11539.487677] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [11541.885190] Key type lgssc unregistered [11542.147381] LNet: 331883:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11542.151869] LNetError: 331883:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [11542.159887] LNet: Removed LNI 192.168.201.149@tcp [11542.862273] Key type .llcrypt unregistered [11542.864611] Key type ._llcrypt unregistered [11576.125533] Key type ._llcrypt registered [11576.127686] Key type .llcrypt registered [11576.248680] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [11577.111753] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11577.226323] alg: No test for adler32 (adler32-zlib) [11578.334481] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [11578.587470] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [11580.272579] Key type lgssc registered [11581.275816] Lustre: Echo OBD driver; http://www.lustre.org/ [11588.688274] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11588.701827] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11590.027910] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11593.232485] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11600.354411] LustreError: 334149:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11600.372523] LustreError: 334149:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11600.499141] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11600.817829] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11604.143960] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11606.526397] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [11611.084438] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11611.353795] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11615.451325] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11615.468797] LustreError: 335636:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11615.484037] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [11620.851102] LustreError: 335636:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11622.419950] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11622.581228] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11625.667964] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [11627.274090] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11634.014292] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11642.675982] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [11651.558269] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11651.560677] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11651.575616] Lustre: Skipped 3 previous similar messages [11651.591521] Lustre: Skipped 3 previous similar messages [11656.678622] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11656.682957] Lustre: Skipped 3 previous similar messages [11657.257931] Lustre: server umount lustre-MDT0000 complete [11660.160286] LustreError: 334130:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782620887 with bad export cookie 6533049670955716971 [11660.160932] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11660.169289] LustreError: 334130:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [11660.547218] Lustre: server umount lustre-MDT0001 complete [11673.816041] Lustre: server umount lustre-OST0000 complete [11686.710685] Lustre: server umount lustre-OST0001 complete [11697.952268] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [11705.994851] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11706.318365] LustreError: 339411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11706.381230] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11709.438965] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11711.462797] LustreError: 339412:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11715.863498] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11716.112513] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11719.078747] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11721.251432] Lustre: 340552:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [11725.849235] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11727.210908] LustreError: 340905:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11730.410505] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11732.333447] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [11736.884807] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11737.070257] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11737.075510] Lustre: Skipped 1 previous similar message [11741.810445] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11742.206694] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [11747.772661] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11750.792217] Lustre: 342421:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [11757.028170] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11757.031696] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11757.037851] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11760.002358] Lustre: server umount lustre-MDT0000 complete [11762.476327] LustreError: 339391:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782620989 with bad export cookie 6533049670955718672 [11762.485980] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11762.665610] Lustre: server umount lustre-MDT0001 complete [11775.472041] Lustre: server umount lustre-OST0000 complete [11778.001911] Lustre: 333414:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782620989/real 1782620989] req@ffff91855c645500 x1869213393324416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782621005 ref 1 fl Rpc:EXNQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [11788.448427] Lustre: server umount lustre-OST0001 complete [11791.264327] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [11792.521729] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [11793.556320] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 00:30:19 (1782621019) [11809.087184] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [11815.306539] loop0: detected capacity change from 0 to 1099511627776 [11815.616928] SGI XFS with ACLs, security attributes, quota, no debug enabled [11815.628329] *** VALIDATE xfs *** [11815.637952] XFS (loop0): Mounting V5 Filesystem [11815.653688] XFS (loop0): Ending clean mount [11816.540151] loop1: detected capacity change from 0 to 18691697672192 [11878.161302] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [11885.432746] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [11911.895449] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11912.074145] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11912.097500] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11912.159121] Lustre: lustre-MDT0000: new disk, initializing [11912.220575] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11912.235066] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11915.936790] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11924.514367] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11924.677943] Lustre: 347544:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11924.736877] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11924.740362] Lustre: Skipped 1 previous similar message [11924.805413] Lustre: lustre-MDT0001: new disk, initializing [11924.919129] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11924.936592] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11928.642921] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11936.160593] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11940.027298] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11945.312375] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11945.515862] Lustre: lustre-OST0000: new disk, initializing [11945.519212] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11945.524112] Lustre: 349515:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11947.595749] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11947.615515] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11947.760020] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11951.164257] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [11959.258356] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11962.979326] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11963.121184] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11966.695240] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11966.872442] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11968.481554] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11968.483708] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11968.489354] LustreError: Skipped 1 previous similar message [11968.490714] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11968.504357] Lustre: Skipped 4 previous similar messages [11968.510263] Lustre: Skipped 3 previous similar messages [11973.618306] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11973.626478] Lustre: Skipped 2 previous similar messages [11974.482932] Lustre: server umount lustre-OST0000 complete [11978.722750] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11983.848179] LustreError: 347557:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11983.856635] LustreError: 347557:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11983.924070] Lustre: server umount lustre-MDT0000 complete [11986.801526] LustreError: 347538:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782621213 with bad export cookie 6533049670955720219 [11986.806579] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11986.810736] LustreError: 347538:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [11987.109223] Lustre: server umount lustre-MDT0001 complete [11993.479867] XFS (loop0): Unmounting Filesystem [11997.160177] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 00:33:43 (1782621223) [12002.765764] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12003.222142] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12003.226995] Lustre: Skipped 2 previous similar messages [12006.782771] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12015.068565] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12019.510878] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12024.996964] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12029.195562] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12034.496818] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12039.051640] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12045.001897] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12058.612940] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12058.615397] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12058.615662] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [12058.622231] Lustre: Skipped 2 previous similar messages [12058.630703] Lustre: Skipped 2 previous similar messages [12063.187212] Lustre: server umount lustre-OST0000 complete [12066.785292] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12066.793981] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12072.419824] Lustre: server umount lustre-MDT0000 complete [12073.955550] LustreError: 352074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12073.964413] LustreError: 352074:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [12075.040246] LustreError: 352053:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782621302 with bad export cookie 6533049670955721101 [12075.041648] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12075.047849] LustreError: 352053:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [12075.260881] Lustre: server umount lustre-MDT0001 complete [12081.704780] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [12083.466584] Key type lgssc unregistered [12083.667418] LNet: 355700:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12083.672117] LNetError: 355700:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [12083.680586] LNet: Removed LNI 192.168.201.149@tcp [12084.283151] Key type .llcrypt unregistered [12084.285247] Key type ._llcrypt unregistered [12101.610943] Key type ._llcrypt registered [12101.615898] Key type .llcrypt registered [12101.693204] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [12102.432865] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12102.445992] alg: No test for adler32 (adler32-zlib) [12103.405282] Lustre: Lustre: Build Version: 2.17.54_105_g3b83550 [12103.559085] LNet: Added LNI 192.168.201.149@tcp [8/256/0/180] [12105.192466] Key type lgssc registered [12105.852929] Lustre: Echo OBD driver; http://www.lustre.org/ [12110.450184] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [12110.464090] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12111.722160] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12114.218446] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12119.274726] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12119.505528] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12122.134774] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12126.532914] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12129.825350] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12133.803709] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12133.981128] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12137.439820] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12141.554933] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12152.290060] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12152.295808] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12152.302742] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12154.255092] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.49@tcp (stopping) [12154.853470] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12157.256946] Lustre: server umount lustre-MDT0001 complete [12159.366791] LustreError: 357241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.49@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12159.381357] LustreError: 357241:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [12159.976027] LustreError: 357242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12159.991381] LustreError: 357242:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [12163.420129] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12163.489271] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12163.490958] Lustre: Found index 1 for lustre-MDT0001, updating log [12163.512071] Lustre: 357234:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12163.712483] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12166.555213] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12169.205536] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12169.216659] LustreError: 360841:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12169.225984] LustreError: 360841:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12169.233767] LustreError: 357236:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12169.267887] LustreError: 360844:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.149@tcp: cfg command failed: rc = -17 [12169.274813] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [12169.274813] [12471.265648] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12471.266484] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12471.268489] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12471.271500] Lustre: Skipped 1 previous similar message [12471.272977] Lustre: Skipped 2 previous similar messages [12475.141764] Lustre: server umount lustre-MDT0001 complete [12476.393590] LustreError: 357242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12476.402097] LustreError: 357242:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [12480.600519] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12480.660970] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12480.664163] Lustre: Found index 1 for lustre-MDT0001, updating log [12480.689177] Lustre: 357234:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12480.883358] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12483.373666] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12486.121509] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12486.634174] LustreError: 371666:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12486.639339] LustreError: 371666:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12486.646190] LustreError: 357236:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12486.650139] LustreError: 357236:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12486.686827] LustreError: 371671:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [12486.696098] LustreError: 371671:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [12486.699193] LustreError: 371671:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.149@tcp: cfg command failed: rc = -17 [12486.705593] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.201.149@tcp [12486.705593] [12788.194314] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12788.195343] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12788.203948] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12788.206115] Lustre: Skipped 3 previous similar messages [12792.407989] Lustre: server umount lustre-MDT0001 complete [12793.314153] LustreError: 357972:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12793.321087] LustreError: 357972:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [12796.735929] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12796.783917] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12796.786913] Lustre: Found index 1 for lustre-MDT0001, updating log [12796.804031] Lustre: 357232:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12796.925342] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [12798.353991] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [12802.021831] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12805.607569] LustreError: 383351:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12805.614524] LustreError: 383351:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12805.621435] LustreError: 357236:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12805.624536] LustreError: 357236:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12805.644548] LustreError: 383354:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [12805.650882] LustreError: 383354:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.149@tcp: cfg command failed: rc = -114 [12805.654971] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [12805.654971] [13114.339036] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13114.340207] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [13114.343365] Lustre: Skipped 3 previous similar messages [13114.345411] Lustre: Skipped 2 previous similar messages [13114.346922] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [13124.577349] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [13124.579603] Lustre: Skipped 5 previous similar messages [13127.136120] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [13127.196713] Lustre: server umount lustre-MDT0000 complete [13128.397217] LustreError: 357225:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782622355 with bad export cookie 7353536588215510062 [13128.400121] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [13128.401436] LustreError: 357225:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [13129.696852] LustreError: 370156:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [13129.697141] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13129.703482] LustreError: 370156:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [13134.616701] Lustre: server umount lustre-MDT0001 complete [13136.123557] Lustre: server umount lustre-OST0000 complete [13139.198141] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [13142.477907] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [13154.611229] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 00:53:01 (1782622381) [13156.866611] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13156.945457] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [13156.956156] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [13156.990204] Lustre: lustre-MDT0000: new disk, initializing [13157.011473] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [13157.018675] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [13158.343503] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [13162.598305] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [13162.640827] Lustre: 397512:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [13162.662912] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [13162.664782] Lustre: Skipped 1 previous similar message [13162.696286] Lustre: lustre-MDT0001: new disk, initializing [13162.723638] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [13162.734581] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [13162.737760] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [13164.058817] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [13167.621764] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [13169.284085] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [13171.389925] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [13171.478135] Lustre: lustre-OST0000: new disk, initializing [13171.479748] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [13171.481929] Lustre: 399481:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [13171.505124] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [13172.278061] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [13172.281414] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [13172.310504] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [13173.217605] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_default_debug -1 all [13176.842728] Lustre: DEBUG MARKER: oleg149-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [13182.433867] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [13182.436167] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [13182.438040] Lustre: Skipped 2 previous similar messages [13182.439864] Lustre: Skipped 3 previous similar messages [13185.624537] Lustre: server umount lustre-MDT0000 complete [13186.844324] LustreError: 397507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782622413 with bad export cookie 7353536588215512015 [13186.846056] LustreError: 398322:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [13186.847173] LustreError: MGC192.168.201.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [13186.855091] LustreError: 397507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [13186.968249] Lustre: server umount lustre-MDT0001 complete [13198.427709] Lustre: server umount lustre-OST0000 complete [13207.552557] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing set_hostid [13210.747390] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing load_modules_local [13221.181339] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 12933 sec ========= 00:54:07 (1782622447) [13221.745770] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 00:54:08 (1782622448) === [13223.042635] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 00:54:09 (1782622449) === [13236.809091] Lustre: DEBUG MARKER: oleg149-server.virtnet: executing unload_modules_local [13237.836796] Key type lgssc unregistered [13237.962508] LNet: 405848:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13237.965074] LNetError: 405848:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [13237.971369] LNet: Removed LNI 192.168.201.149@tcp [13238.297679] Key type .llcrypt unregistered [13238.298979] Key type ._llcrypt unregistered