[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 491591568 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2448MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524588K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001009] APIC: Switch to symmetric I/O mode setup [ 0.002326] x2apic enabled [ 0.003005] Switched APIC routing to physical x2apic. [ 0.004016] kvm-guest: setup PV IPIs [ 0.006970] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.007020] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.008009] pid_max: default: 32768 minimum: 301 [ 0.009129] LSM: Security Framework initializing [ 0.010039] Yama: becoming mindful. [ 0.011041] SELinux: Initializing. [ 0.012080] *** VALIDATE selinux *** [ 0.019757] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.024708] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.025149] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.027085] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028180] *** VALIDATE tmpfs *** [ 0.030372] *** VALIDATE proc *** [ 0.031259] *** VALIDATE cgroup *** [ 0.032011] *** VALIDATE cgroup2 *** [ 0.033287] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.034179] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.036014] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.037053] Spectre V2 : User space: Vulnerable [ 0.038007] Speculative Store Bypass: Vulnerable [ 0.041571] debug: unmapping init [mem 0xffffffffa9859000-0xffffffffa9860fff] [ 0.044217] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.045754] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.046034] ... version: 2 [ 0.047019] ... bit width: 48 [ 0.048015] ... generic registers: 4 [ 0.049012] ... value mask: 0000ffffffffffff [ 0.050015] ... max period: 00007fffffffffff [ 0.051019] ... fixed-purpose events: 3 [ 0.052012] ... event mask: 000000070000000f [ 0.054271] rcu: Hierarchical SRCU implementation. [ 0.056708] smp: Bringing up secondary CPUs ... [ 0.057680] x86: Booting SMP configuration: [ 0.058033] .... node #0, CPUs: #1 #2 #3 [ 0.061352] smp: Brought up 1 node, 4 CPUs [ 0.063011] smpboot: Max logical packages: 1 [ 0.064020] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.213936] node 0 deferred pages initialised in 147ms [ 0.217228] devtmpfs: initialized [ 0.218202] x86/mm: Memory block size: 128MB [ 0.220760] gcov: version magic: 0x41383552 [ 0.221759] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.225115] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.228410] pinctrl core: initialized pinctrl subsystem [ 0.230120] [ 0.230458] ************************************************************* [ 0.231010] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.234010] ** ** [ 0.235009] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.237009] ** ** [ 0.238007] ** This means that this kernel is built to expose internal ** [ 0.240010] ** IOMMU data structures, which may compromise security on ** [ 0.241010] ** your system. ** [ 0.244022] ** ** [ 0.247016] ** If you see this message and you are not debugging the ** [ 0.249010] ** kernel, report this immediately to your vendor! ** [ 0.251014] ** ** [ 0.253013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.256017] ************************************************************* [ 0.258796] NET: Registered protocol family 16 [ 0.260413] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.262064] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.265065] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.269033] cpuidle: using governor menu [ 0.271000] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.274678] PCI: Using configuration type 1 for base access [ 0.276147] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.284199] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.287099] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.292213] cryptd: max_cpu_qlen set to 1000 [ 0.296315] ACPI: Added _OSI(Module Device) [ 0.298017] ACPI: Added _OSI(Processor Device) [ 0.300019] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.301015] ACPI: Added _OSI(Processor Aggregator Device) [ 0.305000] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.313863] ACPI: Interpreter enabled [ 0.315073] ACPI: PM: (supports S0 S3 S4 S5) [ 0.316017] ACPI: Using IOAPIC for interrupt routing [ 0.318129] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.322305] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.332929] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.335048] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.337024] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.341099] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.346281] acpiphp: Slot [2] registered [ 0.347137] acpiphp: Slot [5] registered [ 0.349150] acpiphp: Slot [6] registered [ 0.350111] acpiphp: Slot [7] registered [ 0.352274] acpiphp: Slot [8] registered [ 0.354312] acpiphp: Slot [9] registered [ 0.356242] acpiphp: Slot [10] registered [ 0.357101] acpiphp: Slot [3] registered [ 0.358090] acpiphp: Slot [4] registered [ 0.359124] acpiphp: Slot [11] registered [ 0.361076] acpiphp: Slot [12] registered [ 0.362094] acpiphp: Slot [13] registered [ 0.364110] acpiphp: Slot [14] registered [ 0.365062] acpiphp: Slot [15] registered [ 0.367076] acpiphp: Slot [16] registered [ 0.368074] acpiphp: Slot [17] registered [ 0.369075] acpiphp: Slot [18] registered [ 0.369950] acpiphp: Slot [19] registered [ 0.370067] acpiphp: Slot [20] registered [ 0.371056] acpiphp: Slot [21] registered [ 0.372069] acpiphp: Slot [22] registered [ 0.374090] acpiphp: Slot [23] registered [ 0.375127] acpiphp: Slot [24] registered [ 0.376103] acpiphp: Slot [25] registered [ 0.378066] acpiphp: Slot [26] registered [ 0.379054] acpiphp: Slot [27] registered [ 0.380058] acpiphp: Slot [28] registered [ 0.381027] acpiphp: Slot [29] registered [ 0.382083] acpiphp: Slot [30] registered [ 0.383143] acpiphp: Slot [31] registered [ 0.385071] PCI host bridge to bus 0000:00 [ 0.386022] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.389025] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.392029] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.394026] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.397034] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.400032] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.402189] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.404214] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.407615] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.417019] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.423027] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.425026] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.426016] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.429023] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.433008] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.436157] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.439039] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.441882] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.449017] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.461984] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.467016] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.474227] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.480019] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.486015] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.503019] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.514451] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.520000] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.524019] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.540033] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.549523] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.557019] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.564016] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.578025] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.592000] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.597000] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.604019] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.622017] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.637274] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.643017] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.654018] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.675018] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.685399] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.693020] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.702018] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.718017] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.729789] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.731385] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.734361] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.737425] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.739258] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.745050] iommu: Default domain type: Passthrough [ 0.746529] SCSI subsystem initialized [ 0.747219] ACPI: bus type USB registered [ 0.748167] usbcore: registered new interface driver usbfs [ 0.749177] usbcore: registered new interface driver hub [ 0.750000] usbcore: registered new device driver usb [ 0.753217] pps_core: LinuxPPS API ver. 1 registered [ 0.754012] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.757084] PTP clock support registered [ 0.759177] EDAC MC: Ver: 3.0.0 [ 0.761123] PCI: Using ACPI for IRQ routing [ 0.762584] NetLabel: Initializing [ 0.764013] NetLabel: domain hash size = 128 [ 0.765008] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.767108] NetLabel: unlabeled traffic allowed by default [ 0.769125] vgaarb: loaded [ 0.771362] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.773016] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.779004] clocksource: Switched to clocksource kvm-clock [ 0.876843] VFS: Disk quotas dquot_6.6.0 [ 0.878506] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.881038] *** VALIDATE ramfs *** [ 0.881913] *** VALIDATE hugetlbfs *** [ 0.883102] pnp: PnP ACPI init [ 0.885156] pnp: PnP ACPI: found 6 devices [ 0.902264] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.905116] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.907335] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.909132] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.911237] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.913312] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.915988] NET: Registered protocol family 2 [ 0.918345] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.923259] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.926887] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.931109] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.934737] TCP: Hash tables configured (established 65536 bind 65536) [ 0.937682] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.940745] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.943471] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.946787] NET: Registered protocol family 1 [ 0.948779] RPC: Registered named UNIX socket transport module. [ 0.950841] RPC: Registered udp transport module. [ 0.952782] RPC: Registered tcp transport module. [ 0.954271] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.955735] NET: Registered protocol family 44 [ 0.957383] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.960080] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.962465] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.965274] PCI: CLS 0 bytes, default 64 [ 0.966821] Unpacking initramfs... [ 2.302745] debug: unmapping init [mem 0xffff8af3fcc54000-0xffff8af3fffbffff] [ 2.306218] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.308232] software IO TLB: mapped [mem 0x00000000b8c54000-0x00000000bcc54000] (64MB) [ 2.311163] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.806077] Initialise system trusted keyrings [ 2.807685] Key type blacklist registered [ 2.809616] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.820317] zbud: loaded [ 2.823586] *** VALIDATE nfs *** [ 2.824443] *** VALIDATE nfs4 *** [ 2.825964] pstore: using deflate compression [ 2.828703] Platform Keyring initialized [ 2.933607] NET: Registered protocol family 38 [ 2.935592] Key type asymmetric registered [ 2.937455] Asymmetric key parser 'x509' registered [ 2.939117] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.942155] io scheduler mq-deadline registered [ 2.943814] io scheduler kyber registered [ 2.945568] io scheduler bfq registered [ 2.947429] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.950561] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.952970] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.956148] ACPI: Power Button [PWRF] [ 2.962049] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.969108] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.982355] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 2.989804] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.006263] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.033446] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.061164] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.066132] Non-volatile memory driver v1.3 [ 3.068313] Linux agpgart interface v0.103 [ 3.098722] virtio_blk virtio1: [vda] 136600 512-byte logical blocks (69.9 MB/66.7 MiB) [ 3.103235] vda: detected capacity change from 0 to 69939200 [ 3.118292] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.121397] vdb: detected capacity change from 0 to 1073741824 [ 3.135811] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.138048] vdc: detected capacity change from 0 to 2621440000 [ 3.151284] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.154343] vdd: detected capacity change from 0 to 2621440000 [ 3.170020] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.173476] vde: detected capacity change from 0 to 4294967296 [ 3.190122] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.193306] vdf: detected capacity change from 0 to 4294967296 [ 3.204071] libphy: Fixed MDIO Bus: probed [ 3.209971] usbcore: registered new interface driver usbserial_generic [ 3.212709] usbserial: USB Serial support registered for generic [ 3.215253] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.219944] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.221159] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.222846] mousedev: PS/2 mouse device common for all mice [ 3.224917] rtc_cmos 00:05: RTC can wake from S4 [ 3.227573] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.231303] rtc_cmos 00:05: registered as rtc0 [ 3.234129] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.235049] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.239309] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.241681] intel_pstate: CPU model not supported [ 3.248828] hid: raw HID events driver (C) Jiri Kosina [ 3.250577] usbcore: registered new interface driver usbhid [ 3.252284] usbhid: USB HID core driver [ 3.253891] drop_monitor: Initializing network drop monitor service [ 3.256062] Initializing XFRM netlink socket [ 3.257926] NET: Registered protocol family 10 [ 3.261279] Segment Routing with IPv6 [ 3.262857] NET: Registered protocol family 17 [ 3.265693] mpls_gso: MPLS GSO support [ 3.270838] RAS: Correctable Errors collector initialized. [ 3.273174] AVX version of gcm_enc/dec engaged. [ 3.274969] AES CTR mode by8 optimization enabled [ 3.352083] sched_clock: Marking stable (3352035576, 0)->(4175267112, -823231536) [ 3.355509] registered taskstats version 1 [ 3.358896] Loading compiled-in X.509 certificates [ 3.360827] zswap: loaded using pool lzo/zbud [ 3.384131] Key type big_key registered [ 3.396429] Key type encrypted registered [ 3.398150] ima: No TPM chip found, activating TPM-bypass! [ 3.400015] ima: Allocated hash algorithm: sha1 [ 3.401800] ima: No architecture policies found [ 3.403264] evm: Initialising EVM extended attributes: [ 3.405821] evm: security.selinux [ 3.406652] evm: security.ima [ 3.407475] evm: security.capability [ 3.408839] evm: HMAC attrs: 0x1 [ 3.411415] rtc_cmos 00:05: setting system clock to 2026-06-12 03:00:11 UTC (1781233211) [ 3.417852] debug: unmapping init [mem 0xffffffffaa803000-0xffffffffaa9fffff] [ 3.421166] debug: unmapping init [mem 0xffffffffa9582000-0xffffffffa9858fff] [ 3.427103] Write protecting the kernel read-only data: 28672k [ 3.430087] debug: unmapping init [mem 0xffffffffa7c03000-0xffffffffa7dfffff] [ 3.433041] debug: unmapping init [mem 0xffffffffa8514000-0xffffffffa85fffff] [ 3.486910] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.496412] systemd[1]: Detected virtualization kvm. [ 3.498471] systemd[1]: Detected architecture x86-64. [ 3.500608] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.527024] systemd[1]: No hostname configured. [ 3.529019] systemd[1]: Set hostname to . [ 3.531167] random: systemd: uninitialized urandom read (16 bytes read) [ 3.533753] systemd[1]: Initializing machine ID from random generator. [ 3.575020] random: ln: uninitialized urandom read (6 bytes read) [ 3.651263] random: systemd: uninitialized urandom read (16 bytes read) [ 3.653460] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 3.657248] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 3.660529] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. Starting Setup Virtual Console... Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. Starting Apply Kernel Variables... [ OK ] Reached target Swap. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Local Encrypted Volumes. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.241172] device-mapper: uevent: version 1.0.3 [ 4.243341] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook...[ 4.962566] random: fast init done [ 4.972852] virtio_net virtio0 ens2: renamed from eth0 [ 5.039286] scsi host0: ata_piix [ 5.046780] scsi host1: ata_piix [ 5.048920] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.052082] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 8.733624] dracut-initqueue[582]: RTNETLINK answers: File exists [ 9.914189] random: crng init done [ 9.916055] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 10.310941] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.413412] printk: systemd: 26 output lines suppressed due to ratelimiting [ 11.647909] SELinux: Disabled at runtime. [ 11.708110] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 11.717560] systemd[1]: Detected virtualization kvm. [ 11.719345] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.206430] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.211862] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.217666] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.222304] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.226567] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.233658] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.249639] systemd[1]: Listening on Process Core Dump Socket. [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Created slice system-sshd\x2dkeygen.slice. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice User and Session Slice. Starting Remount Root and Kernel File Systems... Mounting Kernel Debug File System... [ OK ] Listening on initctl Compatibility Named Pipe. Starting Create list of required st…ce nodes for the current kernel... [ 12.302164] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Dispatch Password Requests to Console Directory Watch. Mounting Huge Pages File System... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting Apply Kernel Variables... [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Created slice system-getty.slice. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on udev Kernel Socket. Mounting POSIX Message Queue File System... [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Reached target Slices. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted Huge Pages File System. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted POSIX Message Queue File System. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ OK ] Started udev Coldplug all Devices. [ 12.636426] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 12.863026] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 12.913284] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.029676] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.038368] EDAC sbridge: Ver: 1.1.2 [ 14.970191] Key type dns_resolver registered [ 15.312994] NFS: Registering the id_resolver key type [ 15.315133] Key type id_resolver registered [ 15.316613] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Mark the need to relabel after reboot... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started D-Bus System Message Bus. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Login Service... Starting Network Manager... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg640-server login: [ 45.578105] libcfs: loading out-of-tree module taints kernel. [ 45.600131] Key type ._llcrypt registered [ 45.602333] Key type .llcrypt registered [ 45.664565] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 56.339808] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 57.146825] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 57.155716] alg: No test for adler32 (adler32-zlib) [ 58.248289] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 58.683064] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 60.375847] Key type lgssc registered [ 61.296400] Lustre: Echo OBD driver; http://www.lustre.org/ [ 71.009083] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 85.486451] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 91.893686] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 91.923564] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 93.074607] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 93.094946] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 93.148353] Lustre: lustre-MDT0000: new disk, initializing [ 93.223312] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 93.237194] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 95.107349] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 97.956368] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 102.773637] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 102.907442] Lustre: lustre-OST0000: new disk, initializing [ 102.909650] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 102.912938] Lustre: Skipped 1 previous similar message [ 102.916307] Lustre: 6915:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 102.943051] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 106.082581] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 106.573598] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 106.579104] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 106.606906] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 114.372259] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 114.467684] Lustre: lustre-OST0001: new disk, initializing [ 114.470939] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 114.474531] Lustre: 7960:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 114.511343] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 116.559343] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 116.565134] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 116.584173] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 118.064657] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 125.733140] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 132.181658] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 135.497368] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing check_logdir /tmp/testlogs/ [ 137.989183] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing yml_node [ 140.102246] Lustre: DEBUG MARKER: Client: 2.17.53.83 [ 141.433205] Lustre: DEBUG MARKER: MDS: 2.17.53.83 [ 142.767768] Lustre: DEBUG MARKER: OSS: 2.17.53.83 [ 143.717519] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Jun 11 23:02:31 EDT 2026 [ 153.382281] Lustre: DEBUG MARKER: excepting tests: 55 63 67 32newtarball [ 154.162218] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 167.907990] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 167.918991] Lustre: Skipped 1 previous similar message [ 167.919167] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 167.928213] Lustre: Skipped 1 previous similar message [ 173.026557] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 173.031045] Lustre: Skipped 1 previous similar message [ 178.152913] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 178.159694] Lustre: Skipped 1 previous similar message [ 181.215158] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 181.392228] Lustre: server umount lustre-MDT0000 complete [ 183.655160] LustreError: 5917:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781233391 with bad export cookie 6304042894897507148 [ 183.656597] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 183.662576] LustreError: 5917:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 183.727443] Lustre: server umount lustre-OST0000 complete [ 185.794097] Lustre: server umount lustre-OST0001 complete [ 189.402340] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 193.983924] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 209.357776] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 209.492736] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 209.520788] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 209.570651] Lustre: lustre-MDT0000: new disk, initializing [ 209.631170] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 209.649886] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 211.845529] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 216.350761] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 220.320163] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 220.491638] Lustre: lustre-OST0000: new disk, initializing [ 220.494666] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 220.497595] Lustre: Skipped 1 previous similar message [ 220.500926] Lustre: 13876:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 220.548806] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 221.943988] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 221.952375] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 221.981504] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 224.531494] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 229.679692] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 232.390962] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 232.531937] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 237.540143] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 237.543095] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 237.555517] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 239.853468] Lustre: server umount lustre-OST0000 complete [ 242.438816] Lustre: server umount lustre-MDT0000 complete [ 244.587940] Lustre: DEBUG MARKER: == conf-sanity test 33a: Mount ost with a large index number ========================================================== 23:04:12 (1781233452) [ 245.991100] Lustre: DEBUG MARKER: SKIP: conf-sanity test_33a mixed loopback and real device not working [ 246.829718] Lustre: DEBUG MARKER: == conf-sanity test 33b: Drop cancel during umount ======= 23:04:14 (1781233454) [ 250.945484] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 251.288199] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 253.537493] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 256.638269] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 260.521849] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 263.954805] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 266.958397] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 272.354426] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 272.354913] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 272.362819] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 277.188623] Lustre: server umount lustre-OST0000 complete [ 279.294842] Lustre: server umount lustre-MDT0000 complete [ 284.449283] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 286.025503] Key type lgssc unregistered [ 286.216760] LNet: 17853:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 286.224789] LNetError: 17853:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 286.241746] LNet: Removed LNI 192.168.206.140@tcp [ 286.802220] Key type .llcrypt unregistered [ 286.803859] Key type ._llcrypt unregistered [ 298.650310] Key type ._llcrypt registered [ 298.651806] Key type .llcrypt registered [ 298.695234] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 299.093517] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 299.113171] alg: No test for adler32 (adler32-zlib) [ 300.043395] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 300.172743] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 301.791186] Key type lgssc registered [ 302.438092] Lustre: Echo OBD driver; http://www.lustre.org/ [ 306.721853] loop: module loaded [ 306.771634] loop0: detected capacity change from 0 to 204800000 [ 306.901480] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 306.911673] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 307.089831] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 310.566358] loop0: detected capacity change from 0 to 204800000 [ 310.663405] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 310.670917] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 310.678105] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 313.806931] loop0: detected capacity change from 0 to 204800000 [ 316.977911] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 316.988653] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 318.123398] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 318.171592] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 318.225864] Lustre: lustre-MDT0000: new disk, initializing [ 318.291886] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 318.304211] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 320.322487] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 325.278288] loop1: detected capacity change from 0 to 204800000 [ 328.209742] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 328.381458] Lustre: lustre-OST07c6: new disk, initializing [ 328.385980] Lustre: srv-lustre-OST07c6: No data found on store. Initialize space. [ 328.388593] Lustre: Skipped 1 previous similar message [ 328.392492] Lustre: 20980:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 328.434238] Lustre: lustre-OST07c6: Imperative Recovery not enabled, recovery window 60-180 [ 331.207931] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 333.322633] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:7c6:ost [ 333.329823] Lustre: cli-lustre-OST07c6-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:7c6:ost] [ 333.351521] Lustre: lustre-OST07c6-osc-MDT0000: update sequence from 0x107c60000 to 0x240000400 [ 334.853702] Lustre: 20013:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 254 < left 264, rollback = 2 [ 334.858592] Lustre: 20013:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/2, destroy: 0/0/0 [ 334.861938] Lustre: 20013:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 [ 334.867058] Lustre: 20013:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 [ 334.872283] Lustre: 20013:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/4, delete: 0/0/0 [ 334.876177] Lustre: 20013:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 [ 349.469208] Lustre: 19986:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 250 < left 278, rollback = 2 [ 349.473836] Lustre: 19986:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 [ 349.477385] Lustre: 19986:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 [ 349.480394] Lustre: 19986:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 4/150/4 [ 349.484831] Lustre: 19986:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 [ 349.488290] Lustre: 19986:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 353.254962] Lustre: 19986:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 [ 353.260113] Lustre: 19986:0:(osd_internal.h:1461:osd_trans_exec_op()) Skipped 1 previous similar message [ 353.264568] Lustre: 19986:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 [ 353.268309] Lustre: 19986:0:(osd_handler.c:2090:osd_trans_dump_creds()) Skipped 1 previous similar message [ 353.273212] Lustre: 19986:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 [ 353.277850] Lustre: 19986:0:(osd_handler.c:2097:osd_trans_dump_creds()) Skipped 1 previous similar message [ 353.283485] Lustre: 19986:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 4/150/0 [ 353.288066] Lustre: 19986:0:(osd_handler.c:2107:osd_trans_dump_creds()) Skipped 1 previous similar message [ 353.291899] Lustre: 19986:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 [ 353.295897] Lustre: 19986:0:(osd_handler.c:2114:osd_trans_dump_creds()) Skipped 1 previous similar message [ 353.300159] Lustre: 19986:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 353.304139] Lustre: 19986:0:(osd_handler.c:2121:osd_trans_dump_creds()) Skipped 1 previous similar message [ 356.385667] Lustre: 19985:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 278, rollback = 2 [ 356.391298] Lustre: 19985:0:(osd_internal.h:1461:osd_trans_exec_op()) Skipped 1 previous similar message [ 356.395868] Lustre: 19985:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 [ 356.399593] Lustre: 19985:0:(osd_handler.c:2090:osd_trans_dump_creds()) Skipped 1 previous similar message [ 356.402869] Lustre: 19985:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 [ 356.407343] Lustre: 19985:0:(osd_handler.c:2097:osd_trans_dump_creds()) Skipped 1 previous similar message [ 356.412315] Lustre: 19985:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 4/150/0 [ 356.418332] Lustre: 19985:0:(osd_handler.c:2107:osd_trans_dump_creds()) Skipped 1 previous similar message [ 356.422735] Lustre: 19985:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 [ 356.426481] Lustre: 19985:0:(osd_handler.c:2114:osd_trans_dump_creds()) Skipped 1 previous similar message [ 356.430192] Lustre: 19985:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 356.433603] Lustre: 19985:0:(osd_handler.c:2121:osd_trans_dump_creds()) Skipped 1 previous similar message [ 363.237472] Lustre: 19986:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 278, rollback = 2 [ 363.245330] Lustre: 19986:0:(osd_internal.h:1461:osd_trans_exec_op()) Skipped 3 previous similar messages [ 363.251192] Lustre: 19986:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 [ 363.255073] Lustre: 19986:0:(osd_handler.c:2090:osd_trans_dump_creds()) Skipped 3 previous similar messages [ 363.259102] Lustre: 19986:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 [ 363.262090] Lustre: 19986:0:(osd_handler.c:2097:osd_trans_dump_creds()) Skipped 3 previous similar messages [ 363.265044] Lustre: 19986:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 4/150/2 [ 363.267630] Lustre: 19986:0:(osd_handler.c:2107:osd_trans_dump_creds()) Skipped 3 previous similar messages [ 363.271085] Lustre: 19986:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 [ 363.275628] Lustre: 19986:0:(osd_handler.c:2114:osd_trans_dump_creds()) Skipped 3 previous similar messages [ 363.278317] Lustre: 19986:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 363.282012] Lustre: 19986:0:(osd_handler.c:2121:osd_trans_dump_creds()) Skipped 3 previous similar messages [ 373.789300] Lustre: 19986:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 278, rollback = 2 [ 373.796312] Lustre: 19986:0:(osd_internal.h:1461:osd_trans_exec_op()) Skipped 5 previous similar messages [ 373.799782] Lustre: 19986:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 [ 373.804478] Lustre: 19986:0:(osd_handler.c:2090:osd_trans_dump_creds()) Skipped 5 previous similar messages [ 373.808096] Lustre: 19986:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 [ 373.811385] Lustre: 19986:0:(osd_handler.c:2097:osd_trans_dump_creds()) Skipped 5 previous similar messages [ 373.815855] Lustre: 19986:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 4/150/2 [ 373.820230] Lustre: 19986:0:(osd_handler.c:2107:osd_trans_dump_creds()) Skipped 5 previous similar messages [ 373.824079] Lustre: 19986:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 [ 373.828292] Lustre: 19986:0:(osd_handler.c:2114:osd_trans_dump_creds()) Skipped 5 previous similar messages [ 373.831388] Lustre: 19986:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 373.838318] Lustre: 19986:0:(osd_handler.c:2121:osd_trans_dump_creds()) Skipped 5 previous similar messages [ 420.323402] Lustre: lustre-OST07c6-osc-MDT0000: Connection to lustre-OST07c6 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 420.336455] Lustre: lustre-OST07c6: Not available for connect from 0@lo (stopping) [ 421.600943] Lustre: server umount lustre-OST07c6 complete [ 426.239754] Lustre: server umount lustre-MDT0000 complete [ 433.674727] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 434.952960] Key type lgssc unregistered [ 435.105543] LNet: 23524:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 435.109619] LNetError: 23524:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 435.117458] LNet: Removed LNI 192.168.206.140@tcp [ 435.527292] Key type .llcrypt unregistered [ 435.529860] Key type ._llcrypt unregistered [ 444.246263] Key type ._llcrypt registered [ 444.247804] Key type .llcrypt registered [ 444.295538] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 444.779593] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 444.818050] alg: No test for adler32 (adler32-zlib) [ 445.746488] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 445.867078] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 447.487231] Key type lgssc registered [ 448.053354] Lustre: Echo OBD driver; http://www.lustre.org/ [ 451.800324] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 451.812316] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 453.048591] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 454.967220] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 457.969944] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 461.333146] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 461.516148] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 463.593057] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) [ 464.207922] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 466.930276] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 477.155820] LustreError: lustre-OST0000-osc-MDT0000: operation ost_setattr to node 0@lo failed: rc = -107 [ 477.156031] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 477.158337] LustreError: Skipped 1 previous similar message [ 477.163780] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 479.200216] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 481.185178] Lustre: server umount lustre-OST0000 complete [ 482.985731] Lustre: server umount lustre-MDT0000 complete [ 487.461586] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 488.711209] Key type lgssc unregistered [ 488.867966] LNet: 27125:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 488.873228] LNetError: 27125:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 488.883615] LNet: Removed LNI 192.168.206.140@tcp [ 489.259344] Key type .llcrypt unregistered [ 489.261195] Key type ._llcrypt unregistered [ 498.294799] Key type ._llcrypt registered [ 498.296065] Key type .llcrypt registered [ 498.342464] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 498.831528] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 498.839319] alg: No test for adler32 (adler32-zlib) [ 499.735368] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 499.859874] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 501.471209] Key type lgssc registered [ 501.943294] Lustre: Echo OBD driver; http://www.lustre.org/ [ 505.561392] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 505.573841] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 506.851568] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 508.768900] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 511.423629] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 514.846184] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 515.012303] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 516.070368] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:67 to 0x240000400:97) [ 517.752616] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 520.293689] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 528.951243] Lustre: server umount lustre-OST0000 complete [ 540.216555] Lustre: server umount lustre-MDT0000 complete [ 544.590832] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 545.887149] Key type lgssc unregistered [ 546.041722] LNet: 30530:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 546.050947] LNetError: 30530:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 546.063832] LNet: Removed LNI 192.168.206.140@tcp [ 546.445305] Key type .llcrypt unregistered [ 546.447308] Key type ._llcrypt unregistered [ 556.981515] Key type ._llcrypt registered [ 556.983365] Key type .llcrypt registered [ 557.031525] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 557.466821] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 557.506915] alg: No test for adler32 (adler32-zlib) [ 558.405469] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 558.532522] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 560.143388] Key type lgssc registered [ 560.634366] Lustre: Echo OBD driver; http://www.lustre.org/ [ 564.169712] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 564.180051] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 565.445147] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 567.302969] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 569.758626] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 572.820172] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 572.991199] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 575.081173] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) [ 575.632333] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 578.166469] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 584.516037] Lustre: lustre-MDT0000: Not available for connect from 192.168.206.40@tcp (stopping) [ 585.696650] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 585.703524] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 588.001504] Lustre: server umount lustre-MDT0000 complete [ 599.170844] LustreError: 31887:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 192.168.206.40@tcp arrived at 1781233807 with bad export cookie 17131026032163804293 [ 599.178013] LustreError: 31887:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 600.380500] LustreError: 31886:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781233808 with bad export cookie 17131026032163803726 [ 600.383293] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 600.387848] LustreError: 31886:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 606.521146] Lustre: server umount lustre-OST0000 complete [ 612.843597] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 614.318673] Key type lgssc unregistered [ 614.513435] LNet: 34256:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 614.517940] LNetError: 34256:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 614.527620] LNet: Removed LNI 192.168.206.140@tcp [ 614.955156] Key type .llcrypt unregistered [ 614.957415] Key type ._llcrypt unregistered [ 626.589448] Key type ._llcrypt registered [ 626.591040] Key type .llcrypt registered [ 626.643475] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 627.112674] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 627.176228] alg: No test for adler32 (adler32-zlib) [ 628.074624] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 628.209333] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 629.823158] Key type lgssc registered [ 630.508967] Lustre: Echo OBD driver; http://www.lustre.org/ [ 634.379799] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 634.389389] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 635.643307] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 637.391693] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 640.196092] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 643.644245] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 643.832969] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 645.867919] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:131 to 0x240000400:161) [ 646.976769] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 650.405610] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 656.352671] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 656.352726] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 656.364626] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 658.248296] Lustre: lustre-OST0000: Not available for connect from 192.168.206.40@tcp (stopping) [ 661.472495] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 661.547161] Lustre: server umount lustre-OST0000 complete [ 681.814884] Lustre: server umount lustre-MDT0000 complete [ 686.863851] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 688.415150] Key type lgssc unregistered [ 688.580227] LNet: 37981:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 688.584743] LNetError: 37981:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 688.596736] LNet: Removed LNI 192.168.206.140@tcp [ 689.044993] Key type .llcrypt unregistered [ 689.049117] Key type ._llcrypt unregistered [ 700.936841] Key type ._llcrypt registered [ 700.938418] Key type .llcrypt registered [ 701.001946] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 701.456897] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 701.497768] alg: No test for adler32 (adler32-zlib) [ 702.376714] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 702.479540] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 704.079690] Key type lgssc registered [ 704.634363] Lustre: Echo OBD driver; http://www.lustre.org/ [ 708.711908] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 708.722650] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 709.957275] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 711.873732] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 714.511730] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 717.998753] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 718.213622] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 720.297178] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:163 to 0x240000400:193) [ 721.141229] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 723.991885] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 728.519657] Lustre: DEBUG MARKER: Set up a fake failnode for the MDS [ 730.373897] Lustre: DEBUG MARKER: Wait for RECONNECT_INTERVAL seconds (10s) [ 741.538202] Lustre: DEBUG MARKER: conf-sanity.sh test_35a 2026-06-1123h12m28s [ 742.386482] Lustre: DEBUG MARKER: Stopping the MDT: lustre-MDT0000 [ 745.952346] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 745.963394] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 746.824025] Lustre: lustre-MDT0000: Not available for connect from 192.168.206.40@tcp (stopping) [ 747.895962] Lustre: lustre-MDT0000: Not available for connect from 192.168.206.40@tcp (stopping) [ 747.901777] Lustre: Skipped 1 previous similar message [ 749.726241] Lustre: server umount lustre-MDT0000 complete [ 751.463500] Lustre: DEBUG MARKER: Restarting the MDT: lustre-MDT0000 [ 754.635404] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 754.714526] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 754.898920] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 754.928897] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:163 to 0x240000400:225) [ 756.816719] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 758.533947] Lustre: DEBUG MARKER: Wait for df (30885) ... [ 759.397582] Lustre: DEBUG MARKER: done [ 764.390033] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 764.399075] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 767.264553] Lustre: server umount lustre-OST0000 complete [ 769.559175] Lustre: server umount lustre-MDT0000 complete [ 774.565614] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 775.965658] Key type lgssc unregistered [ 776.127502] LNet: 42909:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 776.131684] LNetError: 42909:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 776.139615] LNet: Removed LNI 192.168.206.140@tcp [ 776.552931] Key type .llcrypt unregistered [ 776.554840] Key type ._llcrypt unregistered [ 793.472366] Key type ._llcrypt registered [ 793.473912] Key type .llcrypt registered [ 793.540041] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 794.074236] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 794.139367] alg: No test for adler32 (adler32-zlib) [ 795.121390] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 795.298381] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 796.911179] Key type lgssc registered [ 797.633811] Lustre: Echo OBD driver; http://www.lustre.org/ [ 802.207478] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 802.219849] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 803.401979] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 803.419865] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 803.523410] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 806.111683] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 809.488262] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 813.301856] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 813.424233] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 813.492268] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 813.536708] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 816.640286] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 818.665160] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:163 to 0x240000400:257) [ 819.900707] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 825.131915] Lustre: DEBUG MARKER: conf-sanity.sh test_35b 2026-06-1123h13m52s [ 825.987795] Lustre: DEBUG MARKER: Set up a fake failnode for the MDS [ 829.697872] Lustre: DEBUG MARKER: Injecting EBUSY on MDS [ 830.904943] Lustre: DEBUG MARKER: Creating a test file and stat it [ 830.924378] LustreError: 44881:0:(mdt_handler.c:2347:mdt_getattr_name_lock()) cfs_fail_timeout id 136 sleeping for 40000ms [ 851.281802] Lustre: lustre-MDT0000: Client e896545a-2eab-45ba-bb16-91c8a3245f2b (at 192.168.206.40@tcp) reconnecting [ 870.975107] LustreError: 44881:0:(mdt_handler.c:2347:mdt_getattr_name_lock()) cfs_fail_timeout id 136 awake [ 871.979525] Lustre: DEBUG MARKER: Stop injecting EBUSY on MDS [ 873.201845] Lustre: DEBUG MARKER: done [ 877.028327] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 877.033082] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 877.040759] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 880.096653] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 881.761123] Lustre: server umount lustre-OST0000 complete [ 883.720176] Lustre: server umount lustre-MDT0000 complete [ 889.275104] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 890.700018] Key type lgssc unregistered [ 890.869812] LNet: 47828:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 890.876363] LNetError: 47828:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 890.884596] LNet: Removed LNI 192.168.206.140@tcp [ 891.314226] Key type .llcrypt unregistered [ 891.315862] Key type ._llcrypt unregistered [ 910.890887] Key type ._llcrypt registered [ 910.893048] Key type .llcrypt registered [ 910.950667] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 911.337235] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 911.348049] alg: No test for adler32 (adler32-zlib) [ 912.233287] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 912.340289] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 913.951418] Key type lgssc registered [ 914.495473] Lustre: Echo OBD driver; http://www.lustre.org/ [ 916.078131] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 916.087409] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 917.230043] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 917.246614] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 917.358617] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 917.840174] Lustre: Failing over lustre-MDT0000 [ 918.002824] Lustre: server umount lustre-MDT0000 complete [ 921.169491] Lustre: DEBUG MARKER: == conf-sanity test 38: MDS recreates missing lov_objid file from OST data ========================================================== 23:15:28 (1781234128) [ 924.380410] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 924.636070] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 926.498241] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 929.077655] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 932.354136] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 932.453269] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 932.540681] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 935.457372] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 938.106573] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 940.042826] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:259 to 0x240000400:289) [ 946.685589] Lustre: DEBUG MARKER: copying 10 files to /mnt/lustre/d38.conf-sanity [ 950.240584] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 950.247478] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 955.363922] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 955.793301] Lustre: server umount lustre-MDT0000 complete [ 957.428641] Lustre: DEBUG MARKER: delete lov_objid file on MDS [ 959.842410] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 964.319567] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 964.414894] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 964.654276] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 964.722219] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000401 [ 966.709362] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 969.326087] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 978.450817] Lustre: server umount lustre-MDT0000 complete [ 981.492363] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 986.214259] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 986.280309] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 986.479114] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 986.509499] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000401:3 to 0x240000401:33) [ 988.744387] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 991.395197] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1000.271551] Lustre: server umount lustre-MDT0000 complete [ 1003.827072] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 1005.574274] Lustre: DEBUG MARKER: files compared the same [ 1006.553473] LustreError: 54864:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781234214 with bad export cookie 14254891433328119705 [ 1006.558721] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1006.563092] LustreError: 54864:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1006.669148] Lustre: server umount lustre-OST0000 complete [ 1013.286055] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1014.628490] Key type lgssc unregistered [ 1014.793724] LNet: 56145:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1014.797587] LNetError: 56145:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1014.806618] LNet: Removed LNI 192.168.206.140@tcp [ 1015.214969] Key type .llcrypt unregistered [ 1015.217403] Key type ._llcrypt unregistered [ 1027.282427] Key type ._llcrypt registered [ 1027.283899] Key type .llcrypt registered [ 1027.334796] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1027.955077] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1027.965336] alg: No test for adler32 (adler32-zlib) [ 1028.864402] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1028.970594] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1030.578156] Key type lgssc registered [ 1031.261598] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1035.374292] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1035.388024] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1036.661053] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1038.773673] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug +malloc all [ 1041.644344] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1044.979675] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1045.111181] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1046.121855] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000401:35 to 0x240000401:65) [ 1047.709584] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug +malloc all [ 1050.215280] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1056.737359] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1056.737428] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1056.747350] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1060.587555] Lustre: server umount lustre-OST0000 complete [ 1062.498380] Lustre: server umount lustre-MDT0000 complete [ 1067.076413] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1068.306412] Key type lgssc unregistered [ 1068.449520] LNet: 59694:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1068.452633] LNetError: 59694:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1068.461347] LNet: Removed LNI 192.168.206.140@tcp [ 1068.832993] Key type .llcrypt unregistered [ 1068.838897] Key type ._llcrypt unregistered [ 1079.249494] Key type ._llcrypt registered [ 1079.251307] Key type .llcrypt registered [ 1079.297903] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1079.695803] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1079.733343] alg: No test for adler32 (adler32-zlib) [ 1080.665867] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1080.787766] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1082.391798] Key type lgssc registered [ 1083.024687] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1087.113938] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1087.142799] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1102.624538] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1107.743221] LustreError: 61042:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.206.140@tcp: failed processing log, type 4: rc = -110 [ 1134.367320] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1136.679522] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1138.846363] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1142.038210] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1142.107148] Lustre: *** cfs_fail_loc=706, val=0*** [ 1142.275093] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1142.308767] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000401:35 to 0x240000401:97) [ 1144.266069] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1146.682894] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1152.480883] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1152.480898] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1152.486732] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1153.696981] Lustre: server umount lustre-OST0000 complete [ 1155.425627] Lustre: server umount lustre-MDT0000 complete [ 1160.068738] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1161.453484] Key type lgssc unregistered [ 1161.610653] LNet: 63294:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1161.614782] LNetError: 63294:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1162.666413] LNet: Removed LNI 192.168.206.140@tcp [ 1163.063365] Key type .llcrypt unregistered [ 1163.065764] Key type ._llcrypt unregistered [ 1175.111985] Key type ._llcrypt registered [ 1175.113238] Key type .llcrypt registered [ 1175.173924] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1175.576793] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1175.622524] alg: No test for adler32 (adler32-zlib) [ 1176.545704] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1176.665175] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1178.271166] Key type lgssc registered [ 1178.800702] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1182.394368] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1182.413880] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1185.189202] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1188.673429] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1188.866361] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1191.506182] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1195.263586] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1195.269512] Lustre: MGS: Client 196b1d6e-dff0-480c-9dd0-017e05a21618 (at 0@lo) reconnecting [ 1195.443964] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1195.483881] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000401:35 to 0x240000401:129) [ 1197.171239] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1208.801606] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1208.809450] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1211.937521] Lustre: server umount lustre-OST0000 complete [ 1213.697174] Lustre: server umount lustre-MDT0000 complete [ 1215.427317] Lustre: server umount MGS complete [ 1219.379758] Lustre: DEBUG MARKER: == conf-sanity test 41b: mount mds with --nosvc and --nomgs on first mount ========================================================== 23:20:27 (1781234427) [ 1220.751287] hrtimer: interrupt took 5134331 ns [ 1230.105202] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 1233.934240] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1247.008530] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1249.014092] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1254.410086] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1254.550874] Lustre: lustre-OST0000: new disk, initializing [ 1254.553847] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1254.558983] Lustre: 70764:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1254.594428] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1257.246374] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1260.999204] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1263.860938] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1263.870385] Lustre: MGS: Client 3c497f3a-4c7f-4642-af83-6da5b7faca19 (at 0@lo) reconnecting [ 1263.945546] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1263.953657] LustreError: 70057:0:(mgs_handler.c:244:mgs_revoke_lock()) MGS: can't take cfg lock for 0x65727473756c/0x0 : rc = -11 [ 1263.969158] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1264.009171] Lustre: lustre-MDT0000: new disk, initializing [ 1264.059941] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1264.072247] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1264.120585] Lustre: srv-lustre-OST0000: Waiting to contact MDT0000 to allocate super-sequence: rc = -115 [ 1265.183762] Lustre: 71715:0:(client.c:1638:after_reply()) @@@ resending request on EINPROGRESS req@0000000080765ec0 x1867759625455872/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1781234489 ref 2 fl Rpc:RQU/202/0 rc 0/-115 job:'' uid:0 gid:0 projid:4294967295 [ 1265.730500] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1274.277092] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1274.281115] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1274.299424] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1289.186666] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1289.194595] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1292.645507] Lustre: server umount lustre-OST0000 complete [ 1300.668360] Lustre: server umount lustre-MDT0000 complete [ 1302.740228] Lustre: server umount MGS complete [ 1307.441082] Lustre: DEBUG MARKER: == conf-sanity test 41c: concurrent mounts of MDT/OST should all fail but one ========================================================== 23:21:55 (1781234515) [ 1315.332579] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1316.688322] Key type lgssc unregistered [ 1316.824609] LNet: 73671:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1316.838178] LNetError: 73671:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1316.851490] LNet: Removed LNI 192.168.206.140@tcp [ 1317.311564] Key type .llcrypt unregistered [ 1317.313541] Key type ._llcrypt unregistered [ 1325.399364] Key type ._llcrypt registered [ 1325.400847] Key type .llcrypt registered [ 1325.455483] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1325.951078] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1325.962708] alg: No test for adler32 (adler32-zlib) [ 1326.844781] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1326.980176] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1328.591388] Key type lgssc registered [ 1329.058728] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1332.447426] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1332.460665] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1333.688587] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1335.277055] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1337.560349] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1340.271075] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1340.399212] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1342.739456] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1343.463085] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:3 to 0x240000400:65) [ 1344.972359] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1351.070237] Lustre: server umount lustre-OST0000 complete [ 1363.533180] Lustre: server umount lustre-MDT0000 complete [ 1368.468748] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1369.827611] Key type lgssc unregistered [ 1369.968668] LNet: 77028:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1369.972869] LNetError: 77028:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1369.986404] LNet: Removed LNI 192.168.206.140@tcp [ 1370.362901] Key type .llcrypt unregistered [ 1370.364937] Key type ._llcrypt unregistered [ 1378.200538] Key type ._llcrypt registered [ 1378.202577] Key type .llcrypt registered [ 1378.260567] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1378.686044] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1378.764689] alg: No test for adler32 (adler32-zlib) [ 1379.666565] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1379.785467] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1381.392165] Key type lgssc registered [ 1381.911453] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1384.605713] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1384.607103] LustreError: 78069:0:(tgt_mount.c:2522:server_fill_super()) cfs_race id 716 sleeping [ 1384.609993] Lustre: Skipped 1 previous similar message [ 1384.610055] LustreError: 78070:0:(tgt_mount.c:2522:server_fill_super()) cfs_fail_race id 716 waking [ 1384.617254] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1384.619038] LustreError: 78069:0:(tgt_mount.c:2522:server_fill_super()) cfs_fail_race id 716 awake: rc=5000 [ 1384.619067] LustreError: 78069:0:(tgt_mount.c:2534:server_fill_super()) Unable to start osd on /dev/mapper/mds1_flakey: -114 [ 1384.636582] LustreError: 78069:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -114 [ 1385.883180] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1387.575705] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing lsmod [ 1388.905519] LustreError: 78543:0:(tgt_mount.c:2522:server_fill_super()) cfs_race id 716 sleeping [ 1388.916883] LustreError: 78546:0:(tgt_mount.c:2522:server_fill_super()) cfs_fail_race id 716 waking [ 1388.920353] LustreError: 78543:0:(tgt_mount.c:2522:server_fill_super()) cfs_fail_race id 716 awake: rc=4989 [ 1388.924939] LustreError: 78543:0:(tgt_mount.c:2534:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -114 [ 1388.930470] LustreError: 78543:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -114 [ 1388.932873] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1389.082423] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1390.342551] Lustre: server umount lustre-MDT0000 complete [ 1392.028872] LustreError: 78085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781234600 with bad export cookie 3085174253718175490 [ 1392.034162] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1402.399503] Lustre: server umount lustre-OST0000 complete [ 1406.186177] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1406.378171] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1408.136985] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1410.593985] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1413.805212] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1413.967796] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1416.039324] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:3 to 0x240000400:97) [ 1416.772550] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1419.611349] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1426.404316] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1426.405077] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1426.414345] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1428.758261] Lustre: server umount lustre-OST0000 complete [ 1430.583950] Lustre: server umount lustre-MDT0000 complete [ 1435.169340] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1436.415435] Key type lgssc unregistered [ 1436.558649] LNet: 81578:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1436.562687] LNetError: 81578:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1436.571339] LNet: Removed LNI 192.168.206.140@tcp [ 1436.944492] Key type .llcrypt unregistered [ 1436.946090] Key type ._llcrypt unregistered [ 1447.570822] Key type ._llcrypt registered [ 1447.573634] Key type .llcrypt registered [ 1447.631878] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1448.032906] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1448.045141] alg: No test for adler32 (adler32-zlib) [ 1448.941234] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1449.047262] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1450.639170] Key type lgssc registered [ 1451.232925] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1454.628194] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1454.638280] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1455.920496] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1457.760743] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1460.419973] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1463.707867] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1463.907754] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1464.939151] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) [ 1466.688432] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1469.291458] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1473.789058] Lustre: Setting parameter lustre-client.llite.some_wrong_param=10 in log lustre-client [ 1475.544297] Lustre: Modifying parameter lustre-client.llite.some_wrong_param=20 in log lustre-client [ 1480.673881] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1480.674299] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1480.683698] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1483.300747] Lustre: server umount lustre-OST0000 complete [ 1485.289931] Lustre: server umount lustre-MDT0000 complete [ 1490.495636] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1491.802577] Key type lgssc unregistered [ 1491.948741] LNet: 85246:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1491.955181] LNetError: 85246:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1491.962496] LNet: Removed LNI 192.168.206.140@tcp [ 1492.322408] Key type .llcrypt unregistered [ 1492.324399] Key type ._llcrypt unregistered [ 1500.641228] Key type ._llcrypt registered [ 1500.643715] Key type .llcrypt registered [ 1500.708478] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1501.095848] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1501.145815] alg: No test for adler32 (adler32-zlib) [ 1502.045740] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1502.184081] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1503.799113] Key type lgssc registered [ 1504.363670] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1508.101582] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1508.114925] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1509.355545] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1511.427843] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1514.090226] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1517.315678] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1517.500860] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1519.591397] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:131 to 0x240000400:161) [ 1520.269848] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1523.086136] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1529.827552] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1529.827751] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1529.842700] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1533.610116] Lustre: server umount lustre-OST0000 complete [ 1535.840623] Lustre: server umount lustre-MDT0000 complete [ 1541.155979] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1542.622241] Key type lgssc unregistered [ 1542.782519] LNet: 88600:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1542.789669] LNetError: 88600:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1542.798269] LNet: Removed LNI 192.168.206.140@tcp [ 1543.214959] Key type .llcrypt unregistered [ 1543.217217] Key type ._llcrypt unregistered [ 1554.853703] Key type ._llcrypt registered [ 1554.855316] Key type .llcrypt registered [ 1554.914785] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1555.368510] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1555.414239] alg: No test for adler32 (adler32-zlib) [ 1556.296616] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1556.411323] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1558.001215] Key type lgssc registered [ 1558.576556] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1562.595928] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1562.616327] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1563.869097] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1565.942734] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1568.508126] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1571.829335] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1572.043260] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1573.097883] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:163 to 0x240000400:193) [ 1575.191549] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1577.771539] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1582.817426] Lustre: Setting parameter lustre-MDT0000.mdt.root_squash=0:0 in log lustre-MDT0000 [ 1584.599904] Lustre: Setting parameter lustre-MDT0000.mdt.nosquash_nids=NONE in log lustre-MDT0000 [ 1584.604450] Lustre: Skipped 1 previous similar message [ 1584.674845] Lustre: lustre-MDT0000: root_squash is set to 0:0 [ 1584.698545] Lustre: lustre-MDT0000: nosquash_nids is cleared [ 1586.850576] Lustre: Modifying parameter lustre-MDT0000.mdt.root_squash=500:500 in log lustre-MDT0000 [ 1586.853649] Lustre: Skipped 1 previous similar message [ 1594.896650] Lustre: lustre-MDT0000: root_squash is set to 500:500 [ 1598.866295] Lustre: Modifying parameter lustre-MDT0000.mdt.nosquash_nids=2@gni 0@lo 192.168.206.40@tcp 192.168.0.[2,10]@tcp in log lustre-MDT0000 [ 1598.873198] Lustre: Skipped 1 previous similar message [ 1602.332149] Lustre: lustre-MDT0000: nosquash_nids set to 2@gni 0@lo 192.168.206.40@tcp 192.168.0.[2,10]@tcp [ 1608.588683] Lustre: Modifying parameter lustre-MDT0000.mdt.nosquash_nids=192.168.206.40/24@tcp in log lustre-MDT0000 [ 1608.594700] Lustre: Skipped 1 previous similar message [ 1611.872449] Lustre: lustre-MDT0000: nosquash_nids set to 192.168.206.40/24@tcp [ 1624.034734] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 1624.038448] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1624.045295] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1626.659742] Lustre: server umount lustre-OST0000 complete [ 1628.712784] Lustre: server umount lustre-MDT0000 complete [ 1633.819894] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1635.240273] Key type lgssc unregistered [ 1635.413454] LNet: 93635:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1635.421130] LNetError: 93635:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1635.433210] LNet: Removed LNI 192.168.206.140@tcp [ 1635.905171] Key type .llcrypt unregistered [ 1635.907066] Key type ._llcrypt unregistered [ 1649.095916] Key type ._llcrypt registered [ 1649.098863] Key type .llcrypt registered [ 1649.163871] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1649.722658] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1649.744687] alg: No test for adler32 (adler32-zlib) [ 1650.667203] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1650.790934] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1652.415495] Key type lgssc registered [ 1653.008482] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1657.119209] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1657.131390] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1658.388835] Lustre: lustre-MDT0000: root_squash is set to 500:500 [ 1658.406439] Lustre: lustre-MDT0000: nosquash_nids set to 192.168.206.40/24@tcp [ 1658.408596] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1660.618964] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1663.363820] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1666.897942] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1667.091710] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1668.138614] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:201 to 0x240000400:225) [ 1670.140619] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1672.956637] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1681.386760] Lustre: server umount lustre-OST0000 complete [ 1693.763951] Lustre: server umount lustre-MDT0000 complete [ 1698.229968] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1699.474897] Key type lgssc unregistered [ 1699.641968] LNet: 97386:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1699.646320] LNetError: 97386:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1699.658868] LNet: Removed LNI 192.168.206.140@tcp [ 1700.052545] Key type .llcrypt unregistered [ 1700.055040] Key type ._llcrypt unregistered [ 1710.933933] Key type ._llcrypt registered [ 1710.935737] Key type .llcrypt registered [ 1710.992683] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 1718.422791] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1718.945691] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1718.967415] alg: No test for adler32 (adler32-zlib) [ 1719.848833] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1719.955019] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1721.560559] Key type lgssc registered [ 1722.102585] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1736.289523] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1736.298564] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1737.423593] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1737.448828] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1737.490150] Lustre: lustre-MDT0000: new disk, initializing [ 1737.538296] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1737.550329] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1739.650163] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1744.350497] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1748.170931] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1748.349236] Lustre: lustre-OST0000: new disk, initializing [ 1748.351554] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1748.354499] Lustre: Skipped 1 previous similar message [ 1748.358139] Lustre: 101194:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1748.412578] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1750.077119] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1750.087678] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1750.119499] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1751.797277] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1755.780260] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1758.082706] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1758.186227] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1760.224424] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1760.230408] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1760.241187] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1765.345139] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1765.414934] Lustre: server umount lustre-OST0000 complete [ 1767.490505] Lustre: server umount lustre-MDT0000 complete [ 1771.527092] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1771.831089] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1773.751394] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1776.488561] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1780.025229] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1780.211182] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1782.925956] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1785.151294] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1787.038570] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1787.136409] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1791.646669] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1791.739435] Lustre: lustre-OST0001: new disk, initializing [ 1791.742117] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1791.746119] Lustre: 104751:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1791.785577] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1794.430250] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1798.530857] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1799.707756] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1799.711388] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1799.725372] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1800.706258] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 1802.383586] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9f93480c4800.ost_server_uuid 50 [ 1803.186705] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9f93480c4800.ost_server_uuid in FULL state after 0 sec [ 1809.891442] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1809.895474] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1809.902882] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1812.161538] Lustre: server umount lustre-OST0001 complete [ 1815.008965] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1815.017829] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1820.129471] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1820.129597] LustreError: 103604:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1820.139080] LustreError: 103604:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 1825.251867] LustreError: 103740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1828.319119] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1828.379581] Lustre: server umount lustre-OST0000 complete [ 1830.220274] Lustre: server umount lustre-MDT0000 complete [ 1837.855229] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1839.235635] Key type lgssc unregistered [ 1839.404921] LNet: 106994:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1839.410471] LNetError: 106994:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1839.420666] LNet: Removed LNI 192.168.206.140@tcp [ 1839.907961] Key type .llcrypt unregistered [ 1839.909992] Key type ._llcrypt unregistered [ 1855.953645] Key type ._llcrypt registered [ 1855.955147] Key type .llcrypt registered [ 1855.994405] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 1864.112520] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1864.774315] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1864.791068] alg: No test for adler32 (adler32-zlib) [ 1865.726331] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1865.900829] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1867.519160] Key type lgssc registered [ 1868.195580] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1882.501766] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1882.518653] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1883.645467] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1883.664894] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1883.711503] Lustre: lustre-MDT0000: new disk, initializing [ 1883.778993] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1883.789670] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1885.806786] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1890.026851] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1893.260928] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1893.412762] Lustre: lustre-OST0000: new disk, initializing [ 1893.416152] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1893.419461] Lustre: Skipped 1 previous similar message [ 1893.422481] Lustre: 111354:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1893.457990] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1896.058449] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1900.220564] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1900.586446] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1900.593701] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1900.612928] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1903.674585] Lustre: Failing over lustre-OST0000 [ 1903.781936] Lustre: server umount lustre-OST0000 complete [ 1918.752683] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1918.937187] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1918.944333] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1918.962264] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1920.991634] Lustre: 108962:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1781235113/real 1781235113] req@000000008dffdf71 x1867760347917568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 1 dl 1781235129 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1922.542032] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1923.039125] Lustre: 108959:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1781235115/real 1781235115] req@000000006a9c64d0 x1867760347917952/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 1 dl 1781235131 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1923.406140] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1924.089409] Lustre: lustre-OST0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. [ 1924.092525] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 1925.036495] Lustre: Failing over lustre-MDT0000 [ 1925.226516] Lustre: server umount lustre-MDT0000 complete [ 1939.864882] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1939.960619] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1940.143735] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1940.179166] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1940.215456] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1942.137673] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 1943.398210] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects [ 1943.416431] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. [ 1943.441988] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:3 to 0x240000400:33) [ 1945.311153] Lustre: 108960:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1781235137/real 1781235137] req@000000008a404312 x1867760347924096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1781235153 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1945.573075] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1950.689434] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1950.689653] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1950.702442] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1952.357746] Lustre: server umount lustre-OST0000 complete [ 1954.519301] Lustre: server umount lustre-MDT0000 complete [ 1960.035055] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 1961.401685] Key type lgssc unregistered [ 1961.563181] LNet: 114632:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1961.568919] LNetError: 114632:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1961.581888] LNet: Removed LNI 192.168.206.140@tcp [ 1961.985153] Key type .llcrypt unregistered [ 1961.986879] Key type ._llcrypt unregistered [ 1985.968798] Key type ._llcrypt registered [ 1985.969913] Key type .llcrypt registered [ 1986.015773] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 1986.417383] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1986.458087] alg: No test for adler32 (adler32-zlib) [ 1987.355717] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 1987.454892] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 1989.063228] Key type lgssc registered [ 1989.598025] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1993.493859] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1993.515580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1994.738838] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1996.538156] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2000.407374] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2002.881442] Lustre: server umount lustre-MDT0000 complete [ 2008.106131] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 2011.635366] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2024.052637] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2024.169769] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2024.191293] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2024.236729] Lustre: lustre-MDT0000: new disk, initializing [ 2024.276192] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2024.285622] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2025.828730] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2029.519841] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2032.571320] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2032.702580] Lustre: lustre-OST0000: new disk, initializing [ 2032.705534] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2032.708693] Lustre: Skipped 1 previous similar message [ 2032.711913] Lustre: 119777:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2032.759241] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2035.321381] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2035.332760] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2035.337123] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2035.351650] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2038.898491] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2041.065690] Lustre: DEBUG MARKER: SKIP: conf-sanity test_47b Can not create symlink /usr/sbin/lctl [ 2041.868806] Lustre: DEBUG MARKER: == conf-sanity test 48: too many acls on file ============ 23:34:09 (1781235249) [ 2173.921406] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2173.927223] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2179.039799] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2184.160199] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2187.231132] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2187.325457] Lustre: server umount lustre-MDT0000 complete [ 2189.059741] LustreError: 118884:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781235397 with bad export cookie 8477428114266805567 [ 2189.060541] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2189.064691] LustreError: 118884:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2195.190702] Lustre: server umount lustre-OST0000 complete [ 2200.073833] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 2204.969784] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2217.461419] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2217.576634] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2217.595717] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2217.649126] Lustre: lustre-MDT0000: new disk, initializing [ 2217.687550] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2217.699371] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2219.374936] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2223.292196] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2226.429745] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2226.568113] Lustre: lustre-OST0000: new disk, initializing [ 2226.570176] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2226.573140] Lustre: Skipped 1 previous similar message [ 2226.576203] Lustre: 124681:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2226.618955] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2229.199537] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2231.839120] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2231.844954] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2231.866406] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2233.298876] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2235.435360] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2235.552294] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2236.896177] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2236.897138] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2236.909537] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2238.629577] Lustre: server umount lustre-OST0000 complete [ 2240.478754] Lustre: server umount lustre-MDT0000 complete [ 2244.441444] Lustre: DEBUG MARKER: == conf-sanity test 49a: check PARAM_SYS_LDLM_TIMEOUT option of mkfs.lustre ========================================================== 23:37:32 (1781235452) [ 2250.317371] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 2254.248198] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2268.997216] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2269.131885] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2269.157134] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2269.208810] Lustre: lustre-MDT0000: new disk, initializing [ 2269.255888] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2269.268407] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2271.150630] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2275.374140] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2278.735707] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2278.900290] Lustre: lustre-OST0000: new disk, initializing [ 2278.903592] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2278.906504] Lustre: Skipped 1 previous similar message [ 2278.909644] Lustre: 129269:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2282.029828] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2282.337882] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2282.345270] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2282.362038] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2286.010152] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2292.707579] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2292.713184] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2292.721910] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2295.261741] Lustre: server umount lustre-OST0000 complete [ 2297.222691] Lustre: server umount lustre-MDT0000 complete [ 2301.415610] Lustre: DEBUG MARKER: == conf-sanity test 49b: check PARAM_SYS_LDLM_TIMEOUT option of mkfs.lustre ========================================================== 23:38:29 (1781235509) [ 2307.829711] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 2311.623946] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2323.510798] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2323.613284] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2323.628345] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2323.670882] Lustre: lustre-MDT0000: new disk, initializing [ 2323.708558] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2323.712368] Lustre: Skipped 1 previous similar message [ 2323.722616] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2325.422806] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2329.412064] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2332.660060] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2332.816634] Lustre: 133697:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2335.435988] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2338.846144] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2338.863315] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2339.290895] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2343.905909] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2343.909782] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2343.916278] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2348.697088] Lustre: server umount lustre-OST0000 complete [ 2350.636428] Lustre: server umount lustre-MDT0000 complete [ 2355.815286] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 2357.296380] Key type lgssc unregistered [ 2357.471090] LNet: 135214:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2357.477226] LNetError: 135214:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2357.492622] LNet: Removed LNI 192.168.206.140@tcp [ 2357.974287] Key type .llcrypt unregistered [ 2357.976593] Key type ._llcrypt unregistered [ 2369.485211] Key type ._llcrypt registered [ 2369.489722] Key type .llcrypt registered [ 2369.551473] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2369.963390] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2370.001106] alg: No test for adler32 (adler32-zlib) [ 2370.900797] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 2370.999832] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 2372.607157] Key type lgssc registered [ 2373.153539] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2376.810474] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2376.823057] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2378.077744] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2379.931638] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2382.740697] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2386.019851] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2386.189720] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2388.266641] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:3 to 0x240000400:33) [ 2389.078823] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2391.830910] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2408.929657] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2408.929891] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2408.936814] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2412.248260] Lustre: server umount lustre-OST0000 complete [ 2413.993638] Lustre: server umount lustre-MDT0000 complete [ 2418.382478] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 2419.690231] Key type lgssc unregistered [ 2419.836840] LNet: 138789:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2419.840957] LNetError: 138789:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2419.851379] LNet: Removed LNI 192.168.206.140@tcp [ 2420.221600] Key type .llcrypt unregistered [ 2420.223496] Key type ._llcrypt unregistered [ 2431.110726] Key type ._llcrypt registered [ 2431.113423] Key type .llcrypt registered [ 2431.183095] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2431.593671] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2431.601486] alg: No test for adler32 (adler32-zlib) [ 2432.495722] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 2432.606859] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 2434.207158] Key type lgssc registered [ 2434.716351] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2438.217327] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2438.227489] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2439.488904] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2441.230653] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2443.747524] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2446.625699] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2446.819681] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2449.349884] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2449.896357] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) [ 2451.722580] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2458.951708] Lustre: lustre-OST0000: Not available for connect from 192.168.206.40@tcp (stopping) [ 2460.128652] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2460.132955] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2460.138939] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2462.296464] Lustre: server umount lustre-OST0000 complete [ 2464.772610] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state DISCONN osc.lustre-OST0000-osc-ffff9f9347504800.ost_server_uuid 50 [ 2465.455396] Lustre: DEBUG MARKER: OSCs should all be DISCONN [ 2482.960759] Lustre: server umount lustre-MDT0000 complete [ 2487.121953] Lustre: DEBUG MARKER: == conf-sanity test 50c: lazystatfs one server down ====== 23:41:34 (1781235694) [ 2490.227510] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2490.470121] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2492.062868] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2494.176714] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2496.866152] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2497.001956] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2499.083139] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2500.069976] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:67 to 0x240000400:97) [ 2501.208360] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2503.991169] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2504.088536] Lustre: lustre-OST0001: new disk, initializing [ 2504.091096] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2504.095784] Lustre: 144345:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2504.133618] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2506.356474] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2509.961473] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2510.346733] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2510.351671] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2510.366126] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2515.265509] Lustre: lustre-OST0000: Not available for connect from 192.168.206.40@tcp (stopping) [ 2515.426330] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2515.426346] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2517.112442] Lustre: server umount lustre-OST0000 complete [ 2519.617314] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state DISCONN os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2519.708851] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in DISCONN state after 0 sec [ 2525.496435] LustreError: 143906:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.206.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2525.505228] LustreError: 143906:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2530.785304] LustreError: 143906:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2530.786555] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2530.787265] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2530.800608] LustreError: 143906:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2530.814734] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2530.827201] Lustre: Skipped 1 previous similar message [ 2535.905463] LustreError: 143444:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2535.906311] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2536.611139] Lustre: server umount lustre-OST0001 complete [ 2538.536392] Lustre: server umount lustre-MDT0000 complete [ 2548.350365] Lustre: DEBUG MARKER: == conf-sanity test 50d: lazystatfs client/server conn race ========================================================== 23:42:36 (1781235756) [ 2552.016504] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2552.161432] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 2552.186671] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2552.327652] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2554.607683] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2557.578463] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2561.404898] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2561.519455] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 2564.956327] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2568.034513] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2569.736621] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) [ 2571.426205] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2571.490859] Lustre: MGS: Regenerating lustre-OST0001 log by user request: rc = 0 [ 2571.587993] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2571.592956] Lustre: Skipped 1 previous similar message [ 2574.075308] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2576.361500] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2578.934159] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2578.945655] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2583.505889] Lustre: server umount lustre-OST0000 complete [ 2584.034339] LustreError: 147768:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2589.153875] LustreError: 149316:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2589.165684] LustreError: 149316:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2599.392263] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2599.395167] LustreError: 147766:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2599.396300] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2599.396928] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2599.396932] Lustre: Skipped 1 previous similar message [ 2599.422717] LustreError: 147766:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 2600.935620] Lustre: server umount lustre-OST0001 complete [ 2602.914230] Lustre: server umount lustre-MDT0000 complete [ 2612.235716] Lustre: DEBUG MARKER: == conf-sanity test 50e: normal statfs all servers down == 23:43:40 (1781235820) [ 2618.705668] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 2623.122856] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2636.906046] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2637.019350] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2637.037184] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2637.081250] Lustre: lustre-MDT0000: new disk, initializing [ 2637.127837] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2637.138859] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2638.907798] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2642.797104] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2645.947425] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2646.061755] Lustre: lustre-OST0000: new disk, initializing [ 2646.063737] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2646.066439] Lustre: Skipped 1 previous similar message [ 2646.069546] Lustre: 153769:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2648.615036] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2652.630357] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2654.378150] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2655.249746] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2655.259766] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2655.278882] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2655.558625] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 1 sec [ 2660.322982] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2660.328725] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2660.337793] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2662.635094] Lustre: server umount lustre-OST0000 complete [ 2664.750754] Lustre: server umount lustre-MDT0000 complete [ 2669.366525] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2671.894655] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2674.719095] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2678.421366] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2681.381750] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2684.450966] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2686.609261] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2686.711375] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2690.016813] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2690.016938] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2693.800181] Lustre: server umount lustre-OST0000 complete [ 2696.458207] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state DISCONN os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2721.461386] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2721.594053] LustreError: 157786:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.206.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2721.664438] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2721.670267] Lustre: Skipped 3 previous similar messages [ 2724.653816] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2727.484133] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2728.339207] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 2730.977228] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2730.984053] Lustre: Skipped 1 previous similar message [ 2736.023423] Lustre: server umount lustre-OST0000 complete [ 2738.089178] Lustre: server umount lustre-MDT0000 complete [ 2742.467792] Lustre: DEBUG MARKER: == conf-sanity test 50f: normal statfs one server in down ========================================================== 23:45:50 (1781235950) [ 2745.524687] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2747.500304] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2750.532247] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2754.487147] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2757.774402] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2760.751972] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2763.004043] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2763.138736] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2766.743857] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2766.840389] Lustre: lustre-OST0001: new disk, initializing [ 2766.843825] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2766.849170] Lustre: 161287:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2768.550526] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2768.559668] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2768.575969] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2769.826572] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2773.750144] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2775.675315] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2775.770399] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2779.107601] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2779.109503] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2782.729400] Lustre: server umount lustre-OST0001 complete [ 2784.226552] LustreError: 160142:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2785.598157] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state DISCONN os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2785.703113] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in DISCONN state after 0 sec [ 2810.215519] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2812.666725] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2814.838557] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2815.458837] LustreError: lustre-OST0001-osc-MDT0000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. [ 2815.464305] Lustre: lustre-OST0001-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2815.551635] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 2818.435592] Lustre: server umount lustre-OST0001 complete [ 2820.578415] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2837.076705] Lustre: server umount lustre-OST0000 complete [ 2844.849080] Lustre: server umount lustre-MDT0000 complete [ 2852.220948] Lustre: DEBUG MARKER: == conf-sanity test 50g: deactivated OST should not cause panic ========================================================== 23:47:40 (1781236060) [ 2855.053864] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2855.201126] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 2855.219501] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2855.317654] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2855.322089] Lustre: Skipped 4 previous similar messages [ 2857.022862] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2859.678043] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2862.876560] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2862.987100] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 2865.781798] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2868.482830] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2873.033474] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2873.077808] Lustre: MGS: Regenerating lustre-OST0001 log by user request: rc = 0 [ 2875.701742] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2878.563253] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2880.363126] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 1 sec [ 2882.245824] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2882.350132] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2883.946394] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9f9347501000.ost_server_uuid 50 [ 2884.669876] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9f9347501000.ost_server_uuid in FULL state after 0 sec [ 2885.153556] Lustre: Permanently deactivating lustre-OST0001 [ 2885.159467] Lustre: Setting parameter lustre-OST0001-osc.osc.active=0 in log lustre-client [ 2886.524632] Lustre: Permanently reactivating lustre-OST0001 [ 2892.258850] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2892.261449] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2892.262153] LustreError: Skipped 1 previous similar message [ 2892.269751] Lustre: Skipped 2 previous similar messages [ 2892.273306] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2892.276493] Lustre: Skipped 4 previous similar messages [ 2894.397189] Lustre: server umount lustre-OST0001 complete [ 2897.376965] LustreError: 166133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2897.385495] LustreError: 166133:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 14 previous similar messages [ 2902.294890] Lustre: server umount lustre-OST0000 complete [ 2903.983434] Lustre: server umount lustre-MDT0000 complete [ 2912.383874] Lustre: DEBUG MARKER: == conf-sanity test 50h: LU-642: activate deactivated OST ========================================================== 23:48:40 (1781236120) [ 2915.789704] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2915.941551] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 2915.959963] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2915.966164] Lustre: Skipped 3 previous similar messages [ 2917.811475] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2920.188055] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2923.258727] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2923.357262] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 2923.370774] Lustre: Permanently deactivating lustre-OST0000 [ 2925.240892] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2925.247611] LustreError: 170998:0:(osp_precreate.c:970:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: cannot cleanup orphans: rc = -5 [ 2925.250325] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) [ 2925.936556] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2928.200275] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2931.179415] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2933.786461] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 2934.220600] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) [ 2936.099176] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2936.846487] Lustre: Permanently reactivating lustre-OST0000 [ 2936.853076] Lustre: Modifying parameter lustre-OST0000-osc.osc.active=1 in log lustre-client [ 2936.855509] Lustre: Skipped 2 previous similar messages [ 2939.980241] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2939.989191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.995713] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2939.997589] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) [ 2956.932491] Lustre: server umount lustre-OST0001 complete [ 2964.698421] Lustre: server umount lustre-OST0000 complete [ 2966.354631] Lustre: server umount lustre-MDT0000 complete [ 2970.548655] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 2971.814917] Key type lgssc unregistered [ 2971.965725] LNet: 173324:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2971.969623] LNetError: 173324:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2971.978508] LNet: Removed LNI 192.168.206.140@tcp [ 2972.320159] Key type .llcrypt unregistered [ 2972.321931] Key type ._llcrypt unregistered [ 2982.483294] Key type ._llcrypt registered [ 2982.485879] Key type .llcrypt registered [ 2982.530962] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 2989.660241] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 2990.130991] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2990.150167] alg: No test for adler32 (adler32-zlib) [ 2991.028258] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 2991.135101] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 2992.727241] Key type lgssc registered [ 2993.215577] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3005.600331] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3005.619601] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3006.750868] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3006.773040] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3006.815069] Lustre: lustre-MDT0000: new disk, initializing [ 3006.858541] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3006.868576] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3008.597783] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3012.239661] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3015.004977] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3015.124024] Lustre: lustre-OST0000: new disk, initializing [ 3015.126779] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3015.130380] Lustre: Skipped 1 previous similar message [ 3015.134081] Lustre: 177184:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3015.167816] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3017.239138] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3017.243325] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3017.261698] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3017.621650] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3021.781920] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3023.743762] LustreError: 176305:0:(mdt_handler.c:3266:mdt_reint_internal()) cfs_fail_timeout id 142 sleeping for 10000ms [ 3028.728331] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3028.816131] Lustre: lustre-OST0001: new disk, initializing [ 3028.818902] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3028.822808] Lustre: 178176:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3028.875282] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3031.249761] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3033.839123] LustreError: 176305:0:(mdt_handler.c:3266:mdt_reint_internal()) cfs_fail_timeout id 142 awake [ 3033.853121] LustreError: 178184:0:(mdt_handler.c:3266:mdt_reint_internal()) cfs_fail_timeout id 142 sleeping for 10000ms [ 3035.157597] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 3035.906315] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 3038.757978] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3038.762299] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3038.777439] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3043.951130] LustreError: 178184:0:(mdt_handler.c:3266:mdt_reint_internal()) cfs_fail_timeout id 142 awake [ 3048.930655] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3048.931085] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3048.941817] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 3054.049018] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 3059.167698] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3059.169759] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 3059.204873] Lustre: server umount lustre-OST0001 complete [ 3069.409667] LustreError: 177456:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3069.419115] LustreError: 177456:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3073.505205] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3073.509176] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3073.517070] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3074.537108] LustreError: 177456:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3079.649889] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3079.650344] LustreError: 177456:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3079.655483] Lustre: Skipped 1 previous similar message [ 3084.768988] LustreError: 177165:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3086.303218] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3086.382397] Lustre: server umount lustre-OST0000 complete [ 3094.479192] Lustre: server umount lustre-MDT0000 complete [ 3099.297379] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3100.690853] Key type lgssc unregistered [ 3100.831471] LNet: 179872:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3100.836681] LNetError: 179872:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3100.845410] LNet: Removed LNI 192.168.206.140@tcp [ 3101.222599] Key type .llcrypt unregistered [ 3101.224159] Key type ._llcrypt unregistered [ 3116.866728] Key type ._llcrypt registered [ 3116.869879] Key type .llcrypt registered [ 3116.916780] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3117.262871] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3117.290376] alg: No test for adler32 (adler32-zlib) [ 3118.191981] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3118.320592] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3119.911198] Key type lgssc registered [ 3120.358901] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3123.878313] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3123.894108] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3125.044828] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 3125.060641] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3125.137838] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3126.986281] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3129.446632] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3132.341723] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3132.450440] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 3132.530768] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3135.088440] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3137.036671] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:4 to 0x240000400:33) [ 3137.495461] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3183.073368] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3183.073663] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3183.084048] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3185.698685] Lustre: server umount lustre-OST0000 complete [ 3187.332726] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: (null) [ 3192.076753] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3192.213760] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3194.368450] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3196.495464] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3203.489988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3203.495250] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3234.273803] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3234.273884] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3234.285622] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3236.539194] Lustre: server umount lustre-OST0000 complete [ 3238.654077] Lustre: server umount lustre-MDT0000 complete [ 3244.033523] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3245.578972] Key type lgssc unregistered [ 3245.737666] LNet: 185767:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3245.748927] LNetError: 185767:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3246.821325] LNet: Removed LNI 192.168.206.140@tcp [ 3247.250976] Key type .llcrypt unregistered [ 3247.253174] Key type ._llcrypt unregistered [ 3257.887239] Key type ._llcrypt registered [ 3257.888462] Key type .llcrypt registered [ 3257.931248] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3258.313616] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3258.355635] alg: No test for adler32 (adler32-zlib) [ 3259.228857] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3259.325777] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3260.919202] Key type lgssc registered [ 3261.393946] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3264.996335] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3265.016469] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3266.322246] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3268.144147] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3270.486469] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3273.175794] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3273.324268] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3275.654362] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3276.392387] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:42 to 0x240000400:65) [ 3277.976829] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3292.129966] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3292.131453] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3292.138446] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3296.157640] Lustre: server umount lustre-OST0000 complete [ 3298.093270] Lustre: server umount lustre-MDT0000 complete [ 3302.405162] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3303.701054] Key type lgssc unregistered [ 3303.841473] LNet: 190088:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3303.846465] LNetError: 190088:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3303.856657] LNet: Removed LNI 192.168.206.140@tcp [ 3304.216675] Key type .llcrypt unregistered [ 3304.218758] Key type ._llcrypt unregistered [ 3312.069975] Key type ._llcrypt registered [ 3312.071392] Key type .llcrypt registered [ 3312.122975] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3312.570270] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3312.580326] alg: No test for adler32 (adler32-zlib) [ 3313.481653] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3313.597439] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3315.215327] Key type lgssc registered [ 3315.758112] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3319.111521] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3319.123561] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3320.384524] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3321.913944] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3323.981608] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3326.430349] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3326.594566] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3328.788448] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3330.724648] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:67 to 0x240000400:97) [ 3330.811464] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3336.161222] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3336.162243] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3336.171932] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3341.280491] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3341.912217] Lustre: server umount lustre-OST0000 complete [ 3343.630739] Lustre: server umount lustre-MDT0000 complete [ 3348.095059] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3349.403824] Key type lgssc unregistered [ 3349.567863] LNet: 193587:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3349.572867] LNetError: 193587:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3349.584517] LNet: Removed LNI 192.168.206.140@tcp [ 3349.933281] Key type .llcrypt unregistered [ 3349.934605] Key type ._llcrypt unregistered [ 3359.859256] Key type ._llcrypt registered [ 3359.861088] Key type .llcrypt registered [ 3359.912035] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3360.313459] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3360.343761] alg: No test for adler32 (adler32-zlib) [ 3361.224350] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3361.325965] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3362.927198] Key type lgssc registered [ 3363.387687] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3366.692765] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3366.708293] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3367.951089] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3369.661276] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3372.025925] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3375.045032] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3375.210184] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3377.805260] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3378.281401] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) [ 3380.240178] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3393.947589] Lustre: server umount lustre-OST0000 complete [ 3405.352820] Lustre: server umount lustre-MDT0000 complete [ 3409.725150] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3410.929163] Key type lgssc unregistered [ 3411.072559] LNet: 197906:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3411.076465] LNetError: 197906:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3411.085957] LNet: Removed LNI 192.168.206.140@tcp [ 3411.457725] Key type .llcrypt unregistered [ 3411.459562] Key type ._llcrypt unregistered [ 3418.997637] Key type ._llcrypt registered [ 3418.998957] Key type .llcrypt registered [ 3419.045986] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3419.415509] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3419.425089] alg: No test for adler32 (adler32-zlib) [ 3420.305204] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3420.415434] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3422.023127] Key type lgssc registered [ 3422.518520] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3425.912426] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3425.920956] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3427.134394] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3428.570328] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3430.476912] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3433.043840] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3433.172803] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3435.134014] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3437.095984] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3437.286919] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:131 to 0x240000400:161) [ 3447.777916] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3447.782192] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3447.790441] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3449.899602] Lustre: server umount lustre-OST0000 complete [ 3453.875375] Lustre: server umount lustre-MDT0000 complete [ 3458.638720] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3459.895944] Key type lgssc unregistered [ 3460.046866] LNet: 201446:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3460.054215] LNetError: 201446:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3460.067658] LNet: Removed LNI 192.168.206.140@tcp [ 3460.431393] Key type .llcrypt unregistered [ 3460.433758] Key type ._llcrypt unregistered [ 3465.091881] Key type ._llcrypt registered [ 3465.093537] Key type .llcrypt registered [ 3465.150261] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing run_llverdev /dev/mapper/ost1_flakey -p [ 3471.104280] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 3477.403806] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3477.879294] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3477.887293] alg: No test for adler32 (adler32-zlib) [ 3478.748860] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3478.845678] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3480.431222] Key type lgssc registered [ 3480.837981] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3492.826220] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3492.837080] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3493.965652] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3493.982865] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3494.024134] Lustre: lustre-MDT0000: new disk, initializing [ 3494.075035] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3494.084635] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3495.992776] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3499.762618] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3502.430135] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3502.550735] Lustre: lustre-OST0000: new disk, initializing [ 3502.552707] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3502.555476] Lustre: Skipped 1 previous similar message [ 3502.559424] Lustre: 205391:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3502.596123] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3503.127358] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3503.131719] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3503.146522] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3504.937874] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3508.500213] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3510.256143] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3510.354605] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3513.255320] Lustre: server umount lustre-OST0000 complete [ 3524.145527] Lustre: server umount lustre-MDT0000 complete [ 3527.607704] Lustre: DEBUG MARKER: == conf-sanity test 54b: test llverfs and partial verify of filesystem ========================================================== 23:58:55 (1781236735) [ 3530.369818] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3530.597935] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3532.283060] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3534.657928] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3537.728291] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3537.906279] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3540.491974] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3542.869426] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3550.177608] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3550.178230] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3550.187970] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3553.238304] Lustre: server umount lustre-OST0000 complete [ 3554.894544] Lustre: server umount lustre-MDT0000 complete [ 3559.096556] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3560.290573] Key type lgssc unregistered [ 3560.432610] LNet: 209370:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3560.436435] LNetError: 209370:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3560.448590] LNet: Removed LNI 192.168.206.140@tcp [ 3560.799253] Key type .llcrypt unregistered [ 3560.800940] Key type ._llcrypt unregistered [ 3569.408955] Key type ._llcrypt registered [ 3569.411790] Key type .llcrypt registered [ 3569.456221] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 3576.292768] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3576.827718] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3576.843343] alg: No test for adler32 (adler32-zlib) [ 3577.729390] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3577.831832] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3579.431242] Key type lgssc registered [ 3579.913609] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3595.853029] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3595.873974] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3596.988073] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3597.004410] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3597.052378] Lustre: lustre-MDT0000: new disk, initializing [ 3597.092258] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3597.101801] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3598.839614] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3602.606330] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3605.780091] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3605.927745] Lustre: lustre-OST2710: new disk, initializing [ 3605.929887] Lustre: srv-lustre-OST2710: No data found on store. Initialize space. [ 3605.932148] Lustre: Skipped 1 previous similar message [ 3605.935622] Lustre: 213607:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3605.973897] Lustre: lustre-OST2710: Imperative Recovery not enabled, recovery window 60-180 [ 3606.147225] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:2710:ost [ 3606.155044] Lustre: cli-lustre-OST2710-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:2710:ost] [ 3606.176750] Lustre: lustre-OST2710-osc-MDT0000: update sequence from 0x127100000 to 0x240000400 [ 3609.153958] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3613.280922] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST2710-osc-[-0-9a-f]*.ost_server_uuid [ 3616.488420] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3616.579229] Lustre: lustre-OST03e8: new disk, initializing [ 3616.581858] Lustre: srv-lustre-OST03e8: No data found on store. Initialize space. [ 3616.587427] Lustre: 214551:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3616.627565] Lustre: lustre-OST03e8: Imperative Recovery not enabled, recovery window 60-180 [ 3619.252201] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3621.748193] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST03e8-osc-[-0-9a-f]*.ost_server_uuid [ 3625.173593] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST2710-osc-MDT0000.ost_server_uuid 50 [ 3625.277516] Lustre: DEBUG MARKER: os[cp].lustre-OST2710-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3625.500413] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:3e8:ost [ 3625.505866] Lustre: cli-lustre-OST03e8-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:3e8:ost] [ 3625.519084] Lustre: lustre-OST03e8-osc-MDT0000: update sequence from 0x103e80000 to 0x280000400 [ 3627.094878] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST03e8-osc-MDT0000.ost_server_uuid 50 [ 3627.199944] Lustre: DEBUG MARKER: os[cp].lustre-OST03e8-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3630.561405] Lustre: lustre-MDT0000-lwp-OST03e8: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3630.565431] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3630.570141] Lustre: Skipped 1 previous similar message [ 3630.576874] Lustre: Skipped 1 previous similar message [ 3635.080100] Lustre: server umount lustre-MDT0000 complete [ 3636.776231] LustreError: 212714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781236844 with bad export cookie 13040572669939469456 [ 3636.778313] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3636.781181] LustreError: 212714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3636.824717] Lustre: server umount lustre-OST2710 complete [ 3638.454814] Lustre: server umount lustre-OST03e8 complete [ 3644.976423] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 3649.249208] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3661.390134] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3661.512136] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3661.527947] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3661.567943] Lustre: lustre-MDT0000: new disk, initializing [ 3661.609151] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3661.618230] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3663.165155] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3666.846337] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3669.580161] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3669.692131] Lustre: lustre-OST0000: new disk, initializing [ 3669.694893] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3669.697215] Lustre: Skipped 1 previous similar message [ 3669.700302] Lustre: 219353:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3669.725029] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3670.213301] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3670.217591] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3670.227568] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3671.825629] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3675.184467] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3676.674525] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3676.781442] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3680.737685] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3680.738082] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3680.747578] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3683.660131] Lustre: server umount lustre-OST0000 complete [ 3685.188041] Lustre: server umount lustre-MDT0000 complete [ 3688.501200] Lustre: DEBUG MARKER: == conf-sanity test 56b: test target_obd correctness with nonconsecutive MDTs ========================================================== 00:01:36 (1781236896) [ 3689.102086] Lustre: DEBUG MARKER: SKIP: conf-sanity test_56b needs >= 3 MDTs [ 3689.736236] Lustre: DEBUG MARKER: == conf-sanity test 57a: initial registration from failnode should fail (should return errs) ========================================================== 00:01:37 (1781236897) [ 3690.856777] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3700.332978] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3700.464927] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 3700.475988] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3700.542550] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3702.226072] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3719.331121] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3719.413442] Lustre: Denying initial registration attempt from nid 192.168.206.140@tcp, specified as failover [ 3719.418308] LustreError: lustre-OST0000: the MGS refuses to allow this server to start: rc = -99. Please see messages on the MGS. [ 3719.423172] LustreError: 223092:0:(tgt_mount.c:2566:server_fill_super()) Unable to start targets: -99 [ 3719.426750] LustreError: 223092:0:(tgt_mount.c:2084:server_put_super()) no obd lustre-OST0000 [ 3719.429371] LustreError: 223092:0:(tgt_mount.c:116:server_deregister_mount()) lustre-OST0000 not registered [ 3719.457990] Lustre: server umount lustre-OST0000 complete [ 3719.461128] LustreError: 223092:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -99 [ 3722.239702] Lustre: server umount lustre-MDT0000 complete [ 3726.383925] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3727.572156] Key type lgssc unregistered [ 3727.726688] LNet: 223993:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3727.730902] LNetError: 223993:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3727.738395] LNet: Removed LNI 192.168.206.140@tcp [ 3728.084850] Key type .llcrypt unregistered [ 3728.087596] Key type ._llcrypt unregistered [ 3732.157728] Key type ._llcrypt registered [ 3732.159079] Key type .llcrypt registered [ 3732.200958] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3732.559086] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3732.603796] alg: No test for adler32 (adler32-zlib) [ 3733.501401] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3733.600349] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3735.191197] Key type lgssc registered [ 3735.688860] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3760.488199] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3764.095092] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3764.106732] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3765.241594] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 3765.255401] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3765.338163] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3766.884676] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3768.935233] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3784.550868] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3784.648969] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 3784.721790] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3786.978120] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3789.163423] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3790.025221] Lustre: server umount lustre-OST0000 complete [ 3791.590192] Lustre: server umount lustre-MDT0000 complete [ 3795.414922] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3796.560913] Key type lgssc unregistered [ 3796.695431] LNet: 228695:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3796.700356] LNetError: 228695:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3796.713805] LNet: Removed LNI 192.168.206.140@tcp [ 3797.020661] Key type .llcrypt unregistered [ 3797.022310] Key type ._llcrypt unregistered [ 3807.500616] Key type ._llcrypt registered [ 3807.502035] Key type .llcrypt registered [ 3807.548779] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3807.894634] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3807.903310] alg: No test for adler32 (adler32-zlib) [ 3808.806837] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3808.911539] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3810.511814] Key type lgssc registered [ 3810.984663] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3814.456402] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3814.466625] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3815.703380] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3817.354528] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3819.561220] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3824.612489] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3824.786741] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3827.645852] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3830.124085] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3836.095762] Lustre: server umount lustre-MDT0000 complete [ 3838.864492] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3842.697099] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3842.770730] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3842.912174] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3842.943384] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3842.987035] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:134 to 0x240000400:161) [ 3844.729784] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3847.008096] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3847.683795] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 3848.164245] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 3853.280965] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3853.281738] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3853.288091] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3855.526476] Lustre: server umount lustre-OST0000 complete [ 3857.575175] Lustre: server umount lustre-MDT0000 complete [ 3862.033087] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3863.339488] Key type lgssc unregistered [ 3863.512848] LNet: 233700:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3863.519415] LNetError: 233700:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3863.529607] LNet: Removed LNI 192.168.206.140@tcp [ 3863.911353] Key type .llcrypt unregistered [ 3863.912915] Key type ._llcrypt unregistered [ 3874.435145] Key type ._llcrypt registered [ 3874.436433] Key type .llcrypt registered [ 3874.484212] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3874.903495] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3874.946162] alg: No test for adler32 (adler32-zlib) [ 3875.859414] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3875.964740] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3877.567207] Key type lgssc registered [ 3878.116464] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3881.943887] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3881.960100] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3883.199466] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3885.011749] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3887.302042] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3888.775481] Lustre: server umount lustre-MDT0000 complete [ 3895.241719] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3895.381369] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 3895.395883] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3895.491548] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3897.122612] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3899.403908] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3904.484741] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3904.569124] LustreError: lustre-OST0000 claims to have registered, but this MGS does not know about it, preventing registration. [ 3904.573938] LustreError: lustre-OST0000: the MGS refuses to allow this server to start: rc = -2. Please see messages on the MGS. [ 3904.578112] LustreError: 237295:0:(tgt_mount.c:2566:server_fill_super()) Unable to start targets: -2 [ 3904.581615] LustreError: 237295:0:(tgt_mount.c:2084:server_put_super()) no obd lustre-OST0000 [ 3904.584357] LustreError: 237295:0:(tgt_mount.c:116:server_deregister_mount()) lustre-OST0000 not registered [ 3904.620957] Lustre: server umount lustre-OST0000 complete [ 3904.623055] LustreError: 237295:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -2 [ 3909.934844] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3910.032968] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 3910.107428] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3912.390580] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3914.744504] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3918.258126] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3918.301249] Lustre: MGS: Regenerating lustre-OST0001 log by user request: rc = 0 [ 3918.335383] Lustre: lustre-OST0001: new disk, initializing [ 3918.337450] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3918.339985] Lustre: 238709:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3918.380166] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3919.378721] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:134 to 0x240000400:193) [ 3919.400921] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3919.407412] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3919.423026] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3920.998582] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 3923.159313] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 3924.452818] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3924.452974] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3924.459309] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 3926.478615] Lustre: server umount lustre-OST0001 complete [ 3929.570118] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3929.571356] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3929.580182] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3934.688770] LustreError: 237760:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3934.689043] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3934.700152] LustreError: 237760:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3939.807937] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3939.809314] LustreError: 237761:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3942.367077] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3942.443628] Lustre: server umount lustre-OST0000 complete [ 3944.440979] Lustre: server umount lustre-MDT0000 complete [ 3949.140678] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 3950.490846] Key type lgssc unregistered [ 3950.631520] LNet: 240329:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3950.636165] LNetError: 240329:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3950.649346] LNet: Removed LNI 192.168.206.140@tcp [ 3951.014396] Key type .llcrypt unregistered [ 3951.016250] Key type ._llcrypt unregistered [ 3979.983069] Key type ._llcrypt registered [ 3979.984604] Key type .llcrypt registered [ 3980.032775] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 3986.885931] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 3987.445271] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3987.492426] alg: No test for adler32 (adler32-zlib) [ 3988.377778] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 3988.496294] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 3990.095189] Key type lgssc registered [ 3990.584036] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4002.606842] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4002.617927] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4003.740939] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4003.757044] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4003.795037] Lustre: lustre-MDT0000: new disk, initializing [ 4003.830553] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4003.843417] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4005.474241] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4008.803164] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4011.267274] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4011.377572] Lustre: lustre-OST0000: new disk, initializing [ 4011.379429] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4011.381919] Lustre: Skipped 1 previous similar message [ 4011.384517] Lustre: 245106:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4011.413811] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4013.382115] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4013.387487] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4013.398384] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4013.548831] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4016.885451] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4018.463130] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4018.554847] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4023.776132] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4023.780264] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4023.788898] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4025.449476] Lustre: server umount lustre-OST0000 complete [ 4027.231496] Lustre: server umount lustre-MDT0000 complete [ 4030.841420] Lustre: DEBUG MARKER: == conf-sanity test 60b: check mkfs.lustre MDT default features ========================================================== 00:07:18 (1781237238) [ 4034.041735] Lustre: DEBUG MARKER: == conf-sanity test 61a: large xattr ===================== 00:07:21 (1781237241) [ 4037.516308] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4037.755626] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4039.266965] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4041.369563] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4044.147282] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4044.327588] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4046.763076] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4049.139361] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4054.767576] Lustre: DEBUG MARKER: save large xattr of 65536 bytes on trusted.big on /mnt/lustre/f61a.conf-sanity [ 4055.483868] Lustre: DEBUG MARKER: shrink value of trusted.big on /mnt/lustre/f61a.conf-sanity [ 4056.142926] Lustre: DEBUG MARKER: grow value of trusted.big on /mnt/lustre/f61a.conf-sanity [ 4056.802024] Lustre: DEBUG MARKER: check value of trusted.big on /mnt/lustre/f61a.conf-sanity after remounting MDS [ 4057.559733] Lustre: Failing over lustre-MDT0000 [ 4057.568851] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4057.575530] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4057.796218] Lustre: server umount lustre-MDT0000 complete [ 4071.481989] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4071.563085] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4071.748173] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4071.773228] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 4072.259306] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects [ 4072.276883] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. [ 4072.296118] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) [ 4073.451920] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4077.228748] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4077.927597] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 4078.053841] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 4080.051503] Lustre: DEBUG MARKER: remove large xattr trusted.big from /mnt/lustre/f61a.conf-sanity [ 4080.906456] Lustre: Failing over lustre-MDT0000 [ 4081.136599] Lustre: server umount lustre-MDT0000 complete [ 4094.479379] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4094.553607] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4094.674039] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4094.694551] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4094.717337] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 4096.168296] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4097.883182] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects [ 4097.906224] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. [ 4097.930401] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:97) [ 4099.359509] Lustre: 242711:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1781237291/real 1781237291] req@0000000097f375ab x1867762574063360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1781237307 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4099.854212] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4100.067738] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 4100.550908] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 4104.161170] Lustre: 242713:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1781237296/real 1781237296] req@000000002e49026e x1867762574063616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1781237312 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4105.184397] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4105.194845] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4109.279281] Lustre: 242710:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1781237301/real 1781237301] req@000000003d8d2680 x1867762574063872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1781237317 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4109.381556] Lustre: server umount lustre-MDT0000 complete [ 4111.075717] LustreError: 248751:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781237319 with bad export cookie 8304250938137720895 [ 4111.078365] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4111.081057] LustreError: 248751:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4111.161840] Lustre: server umount lustre-OST0000 complete [ 4116.574802] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4116.818096] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4118.387215] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4120.593911] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4123.638961] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4126.295392] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4126.888056] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:129) [ 4128.703372] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4132.320527] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4132.321056] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4132.329667] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4136.273551] Lustre: server umount lustre-OST0000 complete [ 4137.877881] Lustre: server umount lustre-MDT0000 complete [ 4141.680981] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 4142.781229] Key type lgssc unregistered [ 4142.923341] LNet: 254113:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4142.926289] LNetError: 254113:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4142.934296] LNet: Removed LNI 192.168.206.140@tcp [ 4143.254902] Key type .llcrypt unregistered [ 4143.256493] Key type ._llcrypt unregistered [ 4154.320969] Key type ._llcrypt registered [ 4154.322607] Key type .llcrypt registered [ 4154.364311] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 4154.707886] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4154.758029] alg: No test for adler32 (adler32-zlib) [ 4155.635743] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 4155.733434] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 4157.327185] Key type lgssc registered [ 4157.800828] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4161.193896] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4161.205930] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4162.462993] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4164.204969] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4166.454539] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4169.752324] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4169.929988] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4172.006937] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:161) [ 4172.885469] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4175.415898] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4182.496203] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4182.503972] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4187.616527] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4188.218857] Lustre: server umount lustre-MDT0000 complete [ 4189.626415] LustreError: 255569:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781237397 with bad export cookie 6497998075971396908 [ 4189.628587] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4189.632291] LustreError: 255569:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4189.701573] Lustre: server umount lustre-OST0000 complete [ 4195.107677] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4195.361407] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4196.859323] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4199.032458] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4202.063786] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4202.235700] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4204.942554] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4205.285314] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:163 to 0x240000400:193) [ 4207.400606] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4215.776221] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4215.781573] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4220.804593] Lustre: server umount lustre-MDT0000 complete [ 4222.374882] LustreError: 257937:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781237430 with bad export cookie 6497998075971397706 [ 4222.377814] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4222.381070] LustreError: 257937:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4222.455824] Lustre: server umount lustre-OST0000 complete [ 4227.942932] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4228.161631] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4229.821260] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4232.236642] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4235.446329] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4238.383288] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4238.698307] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:163 to 0x240000400:225) [ 4241.050697] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4243.937070] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4243.942795] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4243.948602] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4249.049371] Lustre: server umount lustre-OST0000 complete [ 4250.853568] Lustre: server umount lustre-MDT0000 complete [ 4255.252106] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 4256.575917] Key type lgssc unregistered [ 4256.733215] LNet: 262598:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4256.740310] LNetError: 262598:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4256.753798] LNet: Removed LNI 192.168.206.140@tcp [ 4257.179376] Key type .llcrypt unregistered [ 4257.181175] Key type ._llcrypt unregistered [ 4269.592654] Key type ._llcrypt registered [ 4269.593944] Key type .llcrypt registered [ 4269.649610] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 4270.095629] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4270.135528] alg: No test for adler32 (adler32-zlib) [ 4271.029058] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 4271.142229] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 4272.743675] Key type lgssc registered [ 4273.329241] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4277.101741] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4277.109370] LDISKFS-fs (dm-0): mounted filesystem without journal. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4277.114347] LustreError: 263996:0:(osd_handler.c:8551:osd_mount()) lustre-MDT0000-osd: device /dev/mapper/mds1_flakey is mounted w/o journal [ 4277.125131] LustreError: 263996:0:(obd_config.c:845:class_setup()) setup lustre-MDT0000-osd failed (-22) [ 4277.128150] LustreError: 263996:0:(obd_mount.c:250:lustre_start_simple()) lustre-MDT0000-osd setup error -22 [ 4277.131723] LustreError: 263996:0:(tgt_mount.c:2534:server_fill_super()) Unable to start osd on /dev/mapper/mds1_flakey: -22 [ 4277.135716] LustreError: 263996:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -22 [ 4281.087455] LDISKFS-fs (dm-1): mounted filesystem without journal. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4281.094649] LustreError: 264394:0:(osd_handler.c:8551:osd_mount()) lustre-OST0000-osd: device /dev/mapper/ost1_flakey is mounted w/o journal [ 4281.108292] LustreError: 264394:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-22) [ 4281.112482] LustreError: 264394:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -22 [ 4281.116606] LustreError: 264394:0:(tgt_mount.c:2534:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -22 [ 4281.122965] LustreError: 264394:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -22 [ 4288.804685] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 4290.025724] Key type lgssc unregistered [ 4290.177502] LNet: 265227:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4290.180935] LNetError: 265227:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4290.187370] LNet: Removed LNI 192.168.206.140@tcp [ 4290.507509] Key type .llcrypt unregistered [ 4290.509594] Key type ._llcrypt unregistered [ 4297.197312] Key type ._llcrypt registered [ 4297.198663] Key type .llcrypt registered [ 4297.251801] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 4304.356090] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 4304.793261] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4304.844301] alg: No test for adler32 (adler32-zlib) [ 4305.715221] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 4305.813200] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 4307.407155] Key type lgssc registered [ 4307.840262] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4320.334053] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4320.345657] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4321.461344] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4321.476854] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4321.518338] Lustre: lustre-MDT0000: new disk, initializing [ 4321.562376] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4321.573593] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4323.770969] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4327.944108] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4331.409374] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4331.538595] Lustre: lustre-OST0000: new disk, initializing [ 4331.541105] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4331.544256] Lustre: Skipped 1 previous similar message [ 4331.547020] Lustre: 268806:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4331.584527] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4334.384775] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4335.509797] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4335.514153] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4335.536507] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4338.629294] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4340.878718] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4340.987536] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4345.831057] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4345.835933] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4345.846522] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4347.999078] Lustre: server umount lustre-OST0000 complete [ 4349.778050] Lustre: server umount lustre-MDT0000 complete [ 4353.496350] Lustre: DEBUG MARKER: SKIP: conf-sanity test_63 skipping excluded test 63 [ 4354.255333] Lustre: DEBUG MARKER: == conf-sanity test 64: check lfs df --lazy ============== 00:12:42 (1781237562) [ 4357.023059] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4357.267489] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4358.936764] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4361.078162] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4363.789794] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4363.932916] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4366.106543] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4368.361242] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4371.068655] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4371.139144] Lustre: lustre-OST0001: new disk, initializing [ 4371.141259] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4371.143946] Lustre: 272359:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4371.175200] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4373.449404] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4377.057366] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 4380.159411] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4383.551480] Lustre: lustre-OST0001: Not available for connect from 192.168.206.40@tcp (stopping) [ 4385.209768] Lustre: server umount lustre-OST0001 complete [ 4390.370166] LustreError: 271460:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4390.378894] LustreError: 271460:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4395.490905] LustreError: 273047:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4398.048034] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4398.051728] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4398.058275] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4400.609181] LustreError: 271458:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4405.729888] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4405.730933] LustreError: 271458:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4405.732670] Lustre: Skipped 1 previous similar message [ 4410.848952] LustreError: 271461:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4411.871139] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4411.936872] Lustre: server umount lustre-OST0000 complete [ 4419.844782] Lustre: server umount lustre-MDT0000 complete [ 4423.976347] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 4425.105893] Key type lgssc unregistered [ 4425.233368] LNet: 274007:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4425.236901] LNetError: 274007:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4425.248624] LNet: Removed LNI 192.168.206.140@tcp [ 4425.564707] Key type .llcrypt unregistered [ 4425.566588] Key type ._llcrypt unregistered [ 4443.544108] Key type ._llcrypt registered [ 4443.545634] Key type .llcrypt registered [ 4443.587825] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 4443.942763] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4443.949959] alg: No test for adler32 (adler32-zlib) [ 4444.825367] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 4444.925035] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 4446.519189] Key type lgssc registered [ 4446.998416] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4450.526563] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4450.537750] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4451.661454] Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0 [ 4451.672987] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4451.768356] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4453.417230] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4455.669916] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4456.663114] Lustre: server umount lustre-MDT0000 complete [ 4460.396267] Lustre: DEBUG MARKER: == conf-sanity test 66: replace nids ===================== 00:14:28 (1781237668) [ 4463.121237] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4463.327075] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4464.945453] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4467.158942] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4470.056393] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4470.147521] Lustre: MGS: Regenerating lustre-OST0000 log by user request: rc = 0 [ 4470.225847] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4472.577257] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4474.915713] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4479.054256] Lustre: Permanently deactivating lustre-OST0000 [ 4479.061519] Lustre: Setting parameter lustre-OST0000-osc.osc.active=0 in log lustre-client [ 4480.313895] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4481.214828] LustreError: 279385:0:(mgs_llog.c:2031:only_mgs_is_running()) MGS: node 0@lo still connected during replace_nids connect_flags:a000011001002060 [ 4481.219962] LustreError: 279385:0:(mgs_llog.c:2086:mgs_replace_nids()) Only MGS is allowed to be started [ 4481.223571] LustreError: 279385:0:(mgs_handler.c:1244:mgs_iocontrol()) MGS: error replacing NIDs for 'lustre-OST0000': rc = -115 [ 4482.377900] LustreError: 279433:0:(mgs_llog.c:2086:mgs_replace_nids()) Only MGS is allowed to be started [ 4482.381776] LustreError: 279433:0:(mgs_handler.c:1244:mgs_iocontrol()) MGS: error replacing NIDs for 'lustre-OST0000': rc = -115 [ 4489.372853] Lustre: server umount lustre-OST0000 complete [ 4490.542860] LustreError: 279683:0:(mgs_llog.c:2086:mgs_replace_nids()) Only MGS is allowed to be started [ 4490.547950] LustreError: 279683:0:(mgs_handler.c:1244:mgs_iocontrol()) MGS: error replacing NIDs for 'lustre-OST0000': rc = -115 [ 4501.026672] Lustre: server umount lustre-MDT0000 complete [ 4504.727199] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4506.427137] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4507.525974] LustreError: 280621:0:(mgs_handler.c:1244:mgs_iocontrol()) MGS: error replacing NIDs for 'lustre-WRONG0000': rc = -6 [ 4510.206394] Lustre: 280959:0:(mgs_llog.c:1798:mgs_replace_nids_handler()) Previous failover is deleted, but new one is not set. This means you configure system without failover or passed wrong replace_nids command parameters. Device lustre-MDT0000, passed nids 192.168.206.140@tcp [ 4511.114025] Lustre: server umount MGS complete [ 4514.665358] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4514.870399] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4514.892256] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4516.519365] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4518.670377] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4519.468387] Lustre: Permanently reactivating lustre-OST0000 [ 4519.473860] Lustre: Modifying parameter lustre-OST0000-osc.osc.active=1 in log lustre-client [ 4519.477375] Lustre: Skipped 1 previous similar message [ 4528.333603] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4528.499239] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4531.103331] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4533.663541] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4550.112901] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4550.120202] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4550.120416] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4552.626272] Lustre: server umount lustre-OST0000 complete [ 4554.595099] Lustre: server umount lustre-MDT0000 complete [ 4558.937788] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 4560.162883] Key type lgssc unregistered [ 4560.308145] LNet: 284070:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4560.313202] LNetError: 284070:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4560.328129] LNet: Removed LNI 192.168.206.140@tcp [ 4560.706552] Key type .llcrypt unregistered [ 4560.708308] Key type ._llcrypt unregistered [ 4566.920687] Key type ._llcrypt registered [ 4566.922640] Key type .llcrypt registered [ 4566.965663] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 4573.705109] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 4574.059669] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4574.089081] alg: No test for adler32 (adler32-zlib) [ 4574.975090] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 4575.072732] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 4576.663199] Key type lgssc registered [ 4577.134431] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4589.005626] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4589.016056] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4590.136891] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4590.155112] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4590.200716] Lustre: lustre-MDT0000: new disk, initializing [ 4590.241746] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4590.251848] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4591.871556] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4595.681052] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4598.748409] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4598.879632] Lustre: lustre-OST0000: new disk, initializing [ 4598.882330] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4598.885150] Lustre: Skipped 1 previous similar message [ 4598.888610] Lustre: 287637:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4598.923715] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4601.641920] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4605.479950] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4606.988548] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4606.995555] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4607.011779] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4607.137095] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4607.227948] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4612.064844] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4612.070054] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4612.077642] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4614.163794] Lustre: server umount lustre-OST0000 complete [ 4615.836218] Lustre: server umount lustre-MDT0000 complete [ 4619.404970] Lustre: DEBUG MARKER: SKIP: conf-sanity test_67 skipping excluded test 67 [ 4620.071962] Lustre: DEBUG MARKER: == conf-sanity test 68: be able to reserve specific sequences in FLDB ========================================================== 00:17:07 (1781237827) [ 4623.149796] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4623.407437] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4625.211283] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4627.753136] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4630.914905] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4631.066842] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4633.269389] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4635.730098] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4636.574326] Lustre: ctl-lustre-MDT0000: [0x0000000280000400-0x00000002c0000400]:0:mdt sequences allocated: rc = 0 [ 4638.312320] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:0:mdt [ 4643.297811] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4643.305785] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4643.309320] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4646.777510] Lustre: server umount lustre-OST0000 complete [ 4648.995570] Lustre: server umount lustre-MDT0000 complete [ 4654.441118] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 4655.931466] Key type lgssc unregistered [ 4656.102925] LNet: 291854:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4656.110411] LNetError: 291854:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4656.120299] LNet: Removed LNI 192.168.206.140@tcp [ 4656.561041] Key type .llcrypt unregistered [ 4656.562849] Key type ._llcrypt unregistered [ 4681.532769] Key type ._llcrypt registered [ 4681.534560] Key type .llcrypt registered [ 4681.587833] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 4681.725507] Key type .llcrypt unregistered [ 4681.727218] Key type ._llcrypt unregistered [ 4689.266136] Key type ._llcrypt registered [ 4689.267869] Key type .llcrypt registered [ 4689.316845] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 4689.827464] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4689.839775] alg: No test for adler32 (adler32-zlib) [ 4690.720063] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 4690.819504] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 4692.423332] Key type lgssc registered [ 4693.031227] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4702.279502] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4702.289744] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4703.411630] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4703.434587] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4703.490427] Lustre: lustre-MDT0000: new disk, initializing [ 4703.545621] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4703.557186] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4705.397981] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4709.218214] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4712.038604] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4712.146591] Lustre: lustre-OST0000: new disk, initializing [ 4712.149253] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4712.151711] Lustre: Skipped 1 previous similar message [ 4712.154370] Lustre: 296169:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4712.183319] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4714.411931] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4718.304160] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4721.691696] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4721.697034] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4721.713479] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4726.752492] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4726.759153] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4731.877399] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4732.366757] Lustre: server umount lustre-MDT0000 complete [ 4734.059377] LustreError: 295275:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1781237942 with bad export cookie 10463887114685579099 [ 4734.062037] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4734.065856] LustreError: 295275:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4734.143189] Lustre: server umount lustre-OST0000 complete [ 4738.781513] Lustre: DEBUG MARKER: == conf-sanity test 73a: failnode to update from mountdata properly ========================================================== 00:19:06 (1781237946) [ 4742.173328] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4742.434680] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4744.244362] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4746.741310] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4762.915768] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4763.020203] Lustre: Found index 0 for lustre-OST0000, updating log [ 4763.105414] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4765.602883] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 4767.206773] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:5 to 0x240000400:33) [ 4767.823344] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4772.321229] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4772.321971] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4772.332455] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4775.391591] Lustre: server umount lustre-OST0000 complete [ 4788.867853] Lustre: server umount lustre-MDT0000 complete [ 4792.949249] Lustre: DEBUG MARKER: == conf-sanity test 73b: Large failnode NID list in mountdata ========================================================== 00:20:00 (1781238000) [ 4827.039444] LNet: 1 local NIs in recovery (showing 1): 192.168.206.140@tcp [ 5381.073370] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5381.311696] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5383.046731] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5385.397249] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5401.635858] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5401.761225] Lustre: Found index 0 for lustre-OST0000, updating log [ 5401.869447] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5404.146661] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5406.369691] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5407.221329] Lustre: server umount lustre-OST0000 complete [ 5408.962579] Lustre: server umount lustre-MDT0000 complete [ 5426.173362] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 5429.732745] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 5440.415409] LNet: 1 local NIs in recovery (showing 1): 192.168.206.140@tcp [ 5441.429326] Lustre: DEBUG MARKER: == conf-sanity test 73c: Server mount doesn't fail with > 32 nets ========================================================== 00:30:49 (1781238649) [ 5447.315539] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 5448.642925] Key type lgssc unregistered [ 5464.162737] LNet: 307590:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5464.171664] LNetError: 307590:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5530.726590] LNet: Removed LNI 192.168.206.140@tcp [ 5531.095050] Key type .llcrypt unregistered [ 5531.097329] Key type ._llcrypt unregistered [ 5538.420615] Key type ._llcrypt registered [ 5538.422339] Key type .llcrypt registered [ 5538.469534] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 5538.830678] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5538.861394] alg: No test for adler32 (adler32-zlib) [ 5539.771788] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 5539.880790] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 5541.479196] Key type lgssc registered [ 5541.939636] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5544.142118] LNet: Added LNI 192.168.206.140@tcp100 [8/256/0/180] [ 5544.534580] LNet: Added LNI 192.168.206.140@tcp101 [8/256/0/180] [ 5544.997340] LNet: Added LNI 192.168.206.140@tcp102 [8/256/0/180] [ 5545.454260] LNet: Added LNI 192.168.206.140@tcp103 [8/256/0/180] [ 5545.873369] LNet: Added LNI 192.168.206.140@tcp104 [8/256/0/180] [ 5546.250730] LNet: Added LNI 192.168.206.140@tcp105 [8/256/0/180] [ 5546.629825] LNet: Added LNI 192.168.206.140@tcp106 [8/256/0/180] [ 5547.043340] LNet: Added LNI 192.168.206.140@tcp107 [8/256/0/180] [ 5547.444176] LNet: Added LNI 192.168.206.140@tcp108 [8/256/0/180] [ 5547.825888] LNet: Added LNI 192.168.206.140@tcp109 [8/256/0/180] [ 5548.248287] LNet: Added LNI 192.168.206.140@tcp110 [8/256/0/180] [ 5548.703897] LNet: Added LNI 192.168.206.140@tcp111 [8/256/0/180] [ 5549.158140] LNet: Added LNI 192.168.206.140@tcp112 [8/256/0/180] [ 5549.615508] LNet: Added LNI 192.168.206.140@tcp113 [8/256/0/180] [ 5550.089611] LNet: Added LNI 192.168.206.140@tcp114 [8/256/0/180] [ 5550.499399] LNet: Added LNI 192.168.206.140@tcp115 [8/256/0/180] [ 5550.960306] LNet: Added LNI 192.168.206.140@tcp116 [8/256/0/180] [ 5551.382900] LNet: Added LNI 192.168.206.140@tcp117 [8/256/0/180] [ 5551.832619] LNet: Added LNI 192.168.206.140@tcp118 [8/256/0/180] [ 5552.304680] LNet: Added LNI 192.168.206.140@tcp119 [8/256/0/180] [ 5552.738495] LNet: Added LNI 192.168.206.140@tcp120 [8/256/0/180] [ 5553.146118] LNet: Added LNI 192.168.206.140@tcp121 [8/256/0/180] [ 5553.630898] LNet: Added LNI 192.168.206.140@tcp122 [8/256/0/180] [ 5554.084539] LNet: Added LNI 192.168.206.140@tcp123 [8/256/0/180] [ 5554.513758] LNet: Added LNI 192.168.206.140@tcp124 [8/256/0/180] [ 5554.937545] LNet: Added LNI 192.168.206.140@tcp125 [8/256/0/180] [ 5555.369124] LNet: Added LNI 192.168.206.140@tcp126 [8/256/0/180] [ 5555.853807] LNet: Added LNI 192.168.206.140@tcp127 [8/256/0/180] [ 5556.318411] LNet: Added LNI 192.168.206.140@tcp128 [8/256/0/180] [ 5556.802901] LNet: Added LNI 192.168.206.140@tcp129 [8/256/0/180] [ 5557.307767] LNet: Added LNI 192.168.206.140@tcp130 [8/256/0/180] [ 5557.768925] LNet: Added LNI 192.168.206.140@tcp131 [8/256/0/180] [ 5558.207979] LNet: Added LNI 192.168.206.140@tcp132 [8/256/0/180] [ 5558.693739] LNet: Added LNI 192.168.206.140@tcp133 [8/256/0/180] [ 5559.167064] LNet: Added LNI 192.168.206.140@tcp134 [8/256/0/180] [ 5559.598730] LNet: Added LNI 192.168.206.140@tcp135 [8/256/0/180] [ 5562.962194] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5562.982564] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5564.052728] Lustre: 310572:0:(lustre_peer.c:105:class_add_uuid()) 192.168.206.140@tcp: can't add NID 192.168.206.140@tcp130: rc = -75 [ 5564.144365] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5564.167153] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5564.213510] Lustre: lustre-MDT0000: new disk, initializing [ 5564.261479] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5564.274868] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5566.223116] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5570.257282] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5573.773400] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5573.900763] Lustre: lustre-OST0000: new disk, initializing [ 5573.903159] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5573.905912] Lustre: Skipped 1 previous similar message [ 5573.910527] Lustre: 311479:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5573.959393] Lustre: 311484:0:(lustre_peer.c:105:class_add_uuid()) 192.168.206.140@tcp: can't add NID 192.168.206.140@tcp130: rc = -75 [ 5573.962988] Lustre: 311484:0:(lustre_peer.c:105:class_add_uuid()) Skipped 11 previous similar messages [ 5573.982493] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5576.585489] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5579.266058] Lustre: 311984:0:(lustre_peer.c:105:class_add_uuid()) 192.168.206.140@tcp: can't add NID 192.168.206.140@tcp130: rc = -75 [ 5579.271150] Lustre: 311984:0:(lustre_peer.c:105:class_add_uuid()) Skipped 5 previous similar messages [ 5579.311511] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 5579.318106] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 5579.336096] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 5580.508199] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5584.353743] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5584.355954] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5584.368815] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5585.726664] Lustre: server umount lustre-OST0000 complete [ 5587.397727] Lustre: server umount lustre-MDT0000 complete [ 5591.706029] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 5593.030976] Key type lgssc unregistered [ 5593.213078] LNet: 313049:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5593.216443] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5593.218879] LNet: Removed LNI 192.168.206.140@tcp [ 5594.271271] LNet: Removed LNI 192.168.206.140@tcp100 [ 5594.273483] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5594.276787] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Skipped 1 previous similar message [ 5594.283497] LNet: Removed LNI 192.168.206.140@tcp101 [ 5595.295462] LNet: Removed LNI 192.168.206.140@tcp102 [ 5595.297835] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5595.306070] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Skipped 1 previous similar message [ 5595.315399] LNet: Removed LNI 192.168.206.140@tcp103 [ 5596.319201] LNet: Removed LNI 192.168.206.140@tcp104 [ 5597.343158] LNet: Removed LNI 192.168.206.140@tcp105 [ 5597.345214] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5597.348182] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Skipped 2 previous similar messages [ 5597.354018] LNet: Removed LNI 192.168.206.140@tcp106 [ 5598.367234] LNet: Removed LNI 192.168.206.140@tcp107 [ 5599.391238] LNet: Removed LNI 192.168.206.140@tcp108 [ 5600.415245] LNet: Removed LNI 192.168.206.140@tcp109 [ 5601.439139] LNet: Removed LNI 192.168.206.140@tcp110 [ 5601.441258] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5601.445090] LNetError: 313049:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Skipped 4 previous similar messages [ 5601.448321] LNet: Removed LNI 192.168.206.140@tcp111 [ 5601.450218] LNet: Removed LNI 192.168.206.140@tcp112 [ 5601.451968] LNet: Removed LNI 192.168.206.140@tcp113 [ 5601.453647] LNet: Removed LNI 192.168.206.140@tcp114 [ 5601.455577] LNet: Removed LNI 192.168.206.140@tcp115 [ 5601.457269] LNet: Removed LNI 192.168.206.140@tcp116 [ 5601.458687] LNet: Removed LNI 192.168.206.140@tcp117 [ 5601.460408] LNet: Removed LNI 192.168.206.140@tcp118 [ 5601.461919] LNet: Removed LNI 192.168.206.140@tcp119 [ 5601.463490] LNet: Removed LNI 192.168.206.140@tcp120 [ 5601.464816] LNet: Removed LNI 192.168.206.140@tcp121 [ 5601.466382] LNet: Removed LNI 192.168.206.140@tcp122 [ 5601.467863] LNet: Removed LNI 192.168.206.140@tcp123 [ 5601.469826] LNet: Removed LNI 192.168.206.140@tcp124 [ 5601.471923] LNet: Removed LNI 192.168.206.140@tcp125 [ 5601.473914] LNet: Removed LNI 192.168.206.140@tcp126 [ 5601.475596] LNet: Removed LNI 192.168.206.140@tcp127 [ 5601.476771] LNet: Removed LNI 192.168.206.140@tcp128 [ 5601.478084] LNet: Removed LNI 192.168.206.140@tcp129 [ 5601.479364] LNet: Removed LNI 192.168.206.140@tcp130 [ 5601.481239] LNet: Removed LNI 192.168.206.140@tcp131 [ 5601.483235] LNet: Removed LNI 192.168.206.140@tcp132 [ 5601.484487] LNet: Removed LNI 192.168.206.140@tcp133 [ 5601.486214] LNet: Removed LNI 192.168.206.140@tcp134 [ 5601.494884] LNet: Removed LNI 192.168.206.140@tcp135 [ 5601.806223] Key type .llcrypt unregistered [ 5601.807639] Key type ._llcrypt unregistered [ 5609.566332] Key type ._llcrypt registered [ 5609.569989] Key type .llcrypt registered [ 5609.617719] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 5616.520866] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 5617.040837] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5617.060327] alg: No test for adler32 (adler32-zlib) [ 5617.950285] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 5618.051755] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 5619.647131] Key type lgssc registered [ 5620.070455] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5631.700441] Lustre: DEBUG MARKER: == conf-sanity test 73e: Mount client with dynamic server NIDs ========================================================== 00:33:59 (1781238839) [ 5638.373198] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 5639.758905] Key type lgssc unregistered [ 5639.932938] LNet: 316488:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5639.937870] LNetError: 316488:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5639.949585] LNet: Removed LNI 192.168.206.140@tcp [ 5640.336193] Key type .llcrypt unregistered [ 5640.338405] Key type ._llcrypt unregistered [ 5648.250838] Key type ._llcrypt registered [ 5648.252127] Key type .llcrypt registered [ 5648.306615] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 5648.792393] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5648.809238] alg: No test for adler32 (adler32-zlib) [ 5649.701083] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 5649.802883] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 5651.399781] Key type lgssc registered [ 5651.873277] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5656.045290] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5656.057437] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5657.176645] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5657.205275] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5657.244961] Lustre: lustre-MDT0000: new disk, initializing [ 5657.283308] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5657.292682] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5659.115187] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5662.910358] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5665.676824] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5665.793135] Lustre: lustre-OST0000: new disk, initializing [ 5665.795600] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5665.798720] Lustre: Skipped 1 previous similar message [ 5665.802148] Lustre: 318544:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5665.839671] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5668.481205] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5670.921968] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 5670.926633] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 5670.939631] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 5672.362682] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5674.044276] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing lnet_if_list [ 5676.145666] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp10 --if ens2 [ 5676.161065] LNet: Added LNI 192.168.206.140@tcp10 [8/256/0/180] [ 5678.628736] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp11 --if ens2 [ 5678.644487] LNet: Added LNI 192.168.206.140@tcp11 [8/256/0/180] [ 5680.278230] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp12 --if ens2 [ 5680.296261] LNet: Added LNI 192.168.206.140@tcp12 [8/256/0/180] [ 5682.074923] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp13 --if ens2 [ 5682.088439] LNet: Added LNI 192.168.206.140@tcp13 [8/256/0/180] [ 5683.927246] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp14 --if ens2 [ 5683.941767] LNet: Added LNI 192.168.206.140@tcp14 [8/256/0/180] [ 5685.700663] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp15 --if ens2 [ 5685.714178] LNet: Added LNI 192.168.206.140@tcp15 [8/256/0/180] [ 5687.508745] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp16 --if ens2 [ 5687.526635] LNet: Added LNI 192.168.206.140@tcp16 [8/256/0/180] [ 5689.448315] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp17 --if ens2 [ 5689.467566] LNet: Added LNI 192.168.206.140@tcp17 [8/256/0/180] [ 5691.506220] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp18 --if ens2 [ 5691.522981] LNet: Added LNI 192.168.206.140@tcp18 [8/256/0/180] [ 5693.664332] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp19 --if ens2 [ 5693.689036] LNet: Added LNI 192.168.206.140@tcp19 [8/256/0/180] [ 5695.786839] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp20 --if ens2 [ 5695.800836] LNet: Added LNI 192.168.206.140@tcp20 [8/256/0/180] [ 5697.955677] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp21 --if ens2 [ 5697.970645] LNet: Added LNI 192.168.206.140@tcp21 [8/256/0/180] [ 5699.975318] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp22 --if ens2 [ 5699.992101] LNet: Added LNI 192.168.206.140@tcp22 [8/256/0/180] [ 5702.038748] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp23 --if ens2 [ 5702.053498] LNet: Added LNI 192.168.206.140@tcp23 [8/256/0/180] [ 5704.129580] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp24 --if ens2 [ 5704.143467] LNet: Added LNI 192.168.206.140@tcp24 [8/256/0/180] [ 5706.381542] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp25 --if ens2 [ 5706.396926] LNet: Added LNI 192.168.206.140@tcp25 [8/256/0/180] [ 5708.730325] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp26 --if ens2 [ 5708.746883] LNet: Added LNI 192.168.206.140@tcp26 [8/256/0/180] [ 5711.093019] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp27 --if ens2 [ 5711.113361] LNet: Added LNI 192.168.206.140@tcp27 [8/256/0/180] [ 5713.458419] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp28 --if ens2 [ 5713.472486] LNet: Added LNI 192.168.206.140@tcp28 [8/256/0/180] [ 5715.877563] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp29 --if ens2 [ 5715.893674] LNet: Added LNI 192.168.206.140@tcp29 [8/256/0/180] [ 5718.495787] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp30 --if ens2 [ 5718.509834] LNet: Added LNI 192.168.206.140@tcp30 [8/256/0/180] [ 5721.057370] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp31 --if ens2 [ 5721.079951] LNet: Added LNI 192.168.206.140@tcp31 [8/256/0/180] [ 5723.735551] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp32 --if ens2 [ 5723.750216] LNet: Added LNI 192.168.206.140@tcp32 [8/256/0/180] [ 5726.330231] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp33 --if ens2 [ 5726.345148] LNet: Added LNI 192.168.206.140@tcp33 [8/256/0/180] [ 5728.927940] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp34 --if ens2 [ 5728.943503] LNet: Added LNI 192.168.206.140@tcp34 [8/256/0/180] [ 5731.472576] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp35 --if ens2 [ 5731.487688] LNet: Added LNI 192.168.206.140@tcp35 [8/256/0/180] [ 5734.122414] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp36 --if ens2 [ 5734.138811] LNet: Added LNI 192.168.206.140@tcp36 [8/256/0/180] [ 5736.857472] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp37 --if ens2 [ 5736.872126] LNet: Added LNI 192.168.206.140@tcp37 [8/256/0/180] [ 5739.569669] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp38 --if ens2 [ 5739.585748] LNet: Added LNI 192.168.206.140@tcp38 [8/256/0/180] [ 5742.337137] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp39 --if ens2 [ 5742.355331] LNet: Added LNI 192.168.206.140@tcp39 [8/256/0/180] [ 5745.221797] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp40 --if ens2 [ 5745.236220] LNet: Added LNI 192.168.206.140@tcp40 [8/256/0/180] [ 5748.025681] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp41 --if ens2 [ 5748.038457] LNet: Added LNI 192.168.206.140@tcp41 [8/256/0/180] [ 5750.967248] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp42 --if ens2 [ 5750.982374] LNet: Added LNI 192.168.206.140@tcp42 [8/256/0/180] [ 5753.901336] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp43 --if ens2 [ 5753.916301] LNet: Added LNI 192.168.206.140@tcp43 [8/256/0/180] [ 5756.811470] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp44 --if ens2 [ 5756.825297] LNet: Added LNI 192.168.206.140@tcp44 [8/256/0/180] [ 5759.902818] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp45 --if ens2 [ 5759.917507] LNet: Added LNI 192.168.206.140@tcp45 [8/256/0/180] [ 5762.835377] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp46 --if ens2 [ 5762.849347] LNet: Added LNI 192.168.206.140@tcp46 [8/256/0/180] [ 5765.922381] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp47 --if ens2 [ 5765.935935] LNet: Added LNI 192.168.206.140@tcp47 [8/256/0/180] [ 5769.181236] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp48 --if ens2 [ 5769.204626] LNet: Added LNI 192.168.206.140@tcp48 [8/256/0/180] [ 5772.322981] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp49 --if ens2 [ 5772.338711] LNet: Added LNI 192.168.206.140@tcp49 [8/256/0/180] [ 5775.514595] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp50 --if ens2 [ 5775.528410] LNet: Added LNI 192.168.206.140@tcp50 [8/256/0/180] [ 5788.641053] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5788.646450] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5790.220818] Lustre: server umount lustre-MDT0000 complete [ 5799.043256] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 5802.697947] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5802.746463] LustreError: MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5802.889723] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5804.485065] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5806.763218] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5808.034918] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5818.339280] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5818.339369] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5818.346073] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5821.725518] Lustre: server umount lustre-OST0000 complete [ 5823.393919] Lustre: server umount lustre-MDT0000 complete [ 5827.922408] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 5829.137219] Key type lgssc unregistered [ 5829.320917] LNet: 343216:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5829.324764] LNetError: 343216:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5829.328198] LNet: Removed LNI 192.168.206.140@tcp [ 5829.330289] LNet: Removed LNI 192.168.206.140@tcp10 [ 5829.332552] LNet: Removed LNI 192.168.206.140@tcp11 [ 5829.334803] LNet: Removed LNI 192.168.206.140@tcp12 [ 5829.337254] LNet: Removed LNI 192.168.206.140@tcp13 [ 5829.339649] LNet: Removed LNI 192.168.206.140@tcp14 [ 5829.342218] LNet: Removed LNI 192.168.206.140@tcp15 [ 5829.344810] LNet: Removed LNI 192.168.206.140@tcp16 [ 5829.347566] LNet: Removed LNI 192.168.206.140@tcp17 [ 5829.349466] LNet: Removed LNI 192.168.206.140@tcp18 [ 5829.351623] LNet: Removed LNI 192.168.206.140@tcp19 [ 5829.353396] LNet: Removed LNI 192.168.206.140@tcp20 [ 5829.354820] LNet: Removed LNI 192.168.206.140@tcp21 [ 5829.356541] LNet: Removed LNI 192.168.206.140@tcp22 [ 5829.358950] LNet: Removed LNI 192.168.206.140@tcp23 [ 5829.361184] LNet: Removed LNI 192.168.206.140@tcp24 [ 5829.363319] LNet: Removed LNI 192.168.206.140@tcp25 [ 5829.365185] LNet: Removed LNI 192.168.206.140@tcp26 [ 5829.367116] LNet: Removed LNI 192.168.206.140@tcp27 [ 5829.369469] LNet: Removed LNI 192.168.206.140@tcp28 [ 5829.372155] LNet: Removed LNI 192.168.206.140@tcp29 [ 5829.373969] LNet: Removed LNI 192.168.206.140@tcp30 [ 5829.376115] LNet: Removed LNI 192.168.206.140@tcp31 [ 5829.377934] LNet: Removed LNI 192.168.206.140@tcp32 [ 5829.379714] LNet: Removed LNI 192.168.206.140@tcp33 [ 5829.381362] LNet: Removed LNI 192.168.206.140@tcp34 [ 5829.384326] LNet: Removed LNI 192.168.206.140@tcp35 [ 5829.387589] LNet: Removed LNI 192.168.206.140@tcp36 [ 5829.390773] LNet: Removed LNI 192.168.206.140@tcp37 [ 5829.394492] LNet: Removed LNI 192.168.206.140@tcp38 [ 5829.396986] LNet: Removed LNI 192.168.206.140@tcp39 [ 5829.399356] LNet: Removed LNI 192.168.206.140@tcp40 [ 5829.401899] LNet: Removed LNI 192.168.206.140@tcp41 [ 5829.403745] LNet: Removed LNI 192.168.206.140@tcp42 [ 5829.405550] LNet: Removed LNI 192.168.206.140@tcp43 [ 5829.407440] LNet: Removed LNI 192.168.206.140@tcp44 [ 5829.409402] LNet: Removed LNI 192.168.206.140@tcp45 [ 5829.411775] LNet: Removed LNI 192.168.206.140@tcp46 [ 5829.414492] LNet: Removed LNI 192.168.206.140@tcp47 [ 5829.416388] LNet: Removed LNI 192.168.206.140@tcp48 [ 5829.417809] LNet: Removed LNI 192.168.206.140@tcp49 [ 5829.424355] LNet: Removed LNI 192.168.206.140@tcp50 [ 5829.738426] Key type .llcrypt unregistered [ 5829.740655] Key type ._llcrypt unregistered [ 5837.284647] Key type ._llcrypt registered [ 5837.286393] Key type .llcrypt registered [ 5837.351976] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 5845.256499] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 5845.782455] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5845.804318] alg: No test for adler32 (adler32-zlib) [ 5846.710515] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 5846.831051] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 5848.423717] Key type lgssc registered [ 5848.901037] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5862.646272] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5862.662215] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5863.783311] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5863.805051] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5863.849113] Lustre: lustre-MDT0000: new disk, initializing [ 5863.888688] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5863.901129] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5865.590959] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5869.484672] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5872.935412] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5873.027888] Lustre: *** cfs_fail_loc=90f, val=0*** [ 5873.058534] Lustre: lustre-OST0000: new disk, initializing [ 5873.061324] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5873.064363] Lustre: Skipped 1 previous similar message [ 5873.066986] Lustre: 346875:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5873.102510] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5875.461201] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5879.525141] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5880.388193] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 5880.393544] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 5880.413383] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 5885.408992] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5885.409457] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5885.424178] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5888.995440] Lustre: server umount lustre-OST0000 complete [ 5890.687589] Lustre: server umount lustre-MDT0000 complete [ 5895.338855] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 5896.660238] Key type lgssc unregistered [ 5896.808580] LNet: 348439:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5896.812114] LNetError: 348439:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5896.825619] LNet: Removed LNI 192.168.206.140@tcp [ 5897.192430] Key type .llcrypt unregistered [ 5897.193841] Key type ._llcrypt unregistered [ 5905.903803] Key type ._llcrypt registered [ 5905.905394] Key type .llcrypt registered [ 5905.949654] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 5906.300828] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5906.362210] alg: No test for adler32 (adler32-zlib) [ 5907.228936] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 5907.316508] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 5908.903227] Key type lgssc registered [ 5909.325564] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5912.436791] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5912.445592] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5913.644927] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5915.229533] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5917.479953] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5920.248753] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5920.439277] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5922.770093] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5925.137926] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5930.532218] loop0: detected capacity change from 0 to 204800000 [ 5930.660981] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5930.665934] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5930.671729] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5933.259627] loop0: detected capacity change from 0 to 204800000 [ 5933.333510] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5933.341293] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5933.348425] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5935.437461] loop0: detected capacity change from 0 to 204800000 [ 5937.767740] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5937.832380] Lustre: fs15246-OST0000: new disk, initializing [ 5937.834627] Lustre: srv-fs15246-OST0000: No data found on store. Initialize space. [ 5937.838426] Lustre: 352124:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5937.863575] Lustre: fs15246-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5940.220730] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5944.969458] loop1: detected capacity change from 0 to 204800000 [ 5947.601291] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5947.682593] Lustre: Setting parameter fs15246-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log fs15246-MDT0000 [ 5947.719904] Lustre: ctl-fs15246-MDT0000: No data found on store. Initialize space. [ 5947.766568] Lustre: fs15246-MDT0000: new disk, initializing [ 5947.855500] Lustre: fs15246-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5947.870467] Lustre: ctl-fs15246-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5947.925824] Lustre: srv-fs15246-OST0000: Waiting to contact MDT0000 to allocate super-sequence: rc = -115 [ 5948.959969] Lustre: 353227:0:(client.c:1638:after_reply()) @@@ resending request on EINPROGRESS req@0000000018011280 x1867764586267136/t0(0) o700->fs15246-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1781239173 ref 2 fl Rpc:RQU/202/0 rc 0/-115 job:'' uid:0 gid:0 projid:4294967295 [ 5949.775541] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 5958.050471] Lustre: ctl-fs15246-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 5958.055206] Lustre: cli-fs15246-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 5958.068317] Lustre: fs15246-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 5961.698351] Lustre: fs15246-MDT0000-lwp-OST0000: Connection to fs15246-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5961.705448] Lustre: fs15246-MDT0000: Not available for connect from 0@lo (stopping) [ 5966.323794] Lustre: server umount fs15246-MDT0000 complete [ 5970.467832] Lustre: server umount fs15246-OST0000 complete [ 5975.009784] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5975.016059] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5975.022916] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5977.057781] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5982.178729] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5987.297426] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5989.343513] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5989.401995] Lustre: server umount lustre-OST0000 complete [ 5990.950149] Lustre: server umount lustre-MDT0000 complete [ 5995.192219] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 5996.387170] Key type lgssc unregistered [ 5996.531572] LNet: 356088:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5996.535689] LNetError: 356088:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5996.542744] LNet: Removed LNI 192.168.206.140@tcp [ 5996.892296] Key type .llcrypt unregistered [ 5996.895183] Key type ._llcrypt unregistered [ 6005.518050] Key type ._llcrypt registered [ 6005.520021] Key type .llcrypt registered [ 6005.562098] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 6005.992386] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6006.041630] alg: No test for adler32 (adler32-zlib) [ 6006.943305] Lustre: Lustre: Build Version: 2.17.53_83_gc434fe8 [ 6007.076195] LNet: Added LNI 192.168.206.140@tcp [8/256/0/180] [ 6008.680219] Key type lgssc registered [ 6009.183283] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6023.947692] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 6028.403678] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 6040.558270] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6040.568519] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6041.673518] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6041.689325] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6041.730529] Lustre: lustre-MDT0000: new disk, initializing [ 6041.784127] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6041.792859] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6043.290219] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 6047.109392] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6050.022038] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6050.153462] Lustre: lustre-OST0000: new disk, initializing [ 6050.156588] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6050.159103] Lustre: Skipped 1 previous similar message [ 6050.161955] Lustre: 360943:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6050.202401] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6052.571832] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug -1 all [ 6056.246061] Lustre: DEBUG MARKER: oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6057.488923] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6057.493847] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6057.509715] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6058.131833] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6058.234866] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6062.561317] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6062.561694] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6062.570994] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6065.183551] Lustre: server umount lustre-OST0000 complete [ 6067.047759] Lustre: server umount lustre-MDT0000 complete [ 6076.844630] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing set_hostid [ 6080.957325] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local [ 6092.567641] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 5948 sec ========== 00:41:40 (1781239300) [ 6093.453863] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 00:41:41 (1781239301) === [ 6095.175245] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 00:41:42 (1781239302) === [ 6110.190661] Lustre: DEBUG MARKER: oleg640-server.virtnet: executing unload_modules_local [ 6111.480724] Key type lgssc unregistered [ 6111.672228] LNet: 366103:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6111.677581] LNetError: 366103:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6111.690959] LNet: Removed LNI 192.168.206.140@tcp [ 6112.106885] Key type .llcrypt unregistered [ 6112.109249] Key type ._llcrypt unregistered