[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-2.fc40 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 455761525 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f53f0-0x000f53ff] [ 0.000000] BRK [0x26201000, 0x26201fff] PGTABLE [ 0.000000] BRK [0x26202000, 0x26202fff] PGTABLE [ 0.000000] BRK [0x26203000, 0x26203fff] PGTABLE [ 0.000000] BRK [0x26204000, 0x26204fff] PGTABLE [ 0.000000] BRK [0x26205000, 0x26205fff] PGTABLE [ 0.000000] BRK [0x26206000, 0x26206fff] PGTABLE [ 0.000000] BRK [0x26207000, 0x26207fff] PGTABLE [ 0.000000] BRK [0x26208000, 0x26208fff] PGTABLE [ 0.000000] BRK [0x26209000, 0x26209fff] PGTABLE [ 0.000000] BRK [0x2620a000, 0x2620afff] PGTABLE [ 0.000000] BRK [0x2620b000, 0x2620bfff] PGTABLE [ 0.000000] BRK [0x2620c000, 0x2620cfff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F5200 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE1D87 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE1C23 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 001BE3 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE1C97 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE1D27 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE1D5F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe1c23-0xbffe1c96] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1c22] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe1c97-0xbffe1d26] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe1d27-0xbffe1d5e] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe1d5f-0xbffe1d86] [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] On node 0 totalpages: 1076588 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 158 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782286 pages, LIFO batch:63 [ 0.000000] Normal zone: 4536 pages used for memmap [ 0.000000] Normal zone: 290304 pages, LIFO batch:63 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] pcpu-alloc: s221184 r8192 d28672 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001000] hpet clockevent registered [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.003183] x2apic enabled [ 0.004006] Switched APIC routing to physical x2apic. [ 0.005010] kvm-guest: setup PV IPIs [ 0.008000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008017] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009019] pid_max: default: 32768 minimum: 301 [ 0.012077] LSM: Security Framework initializing [ 0.013044] Yama: becoming mindful. [ 0.014034] SELinux: Initializing. [ 0.015064] *** VALIDATE selinux *** [ 0.022280] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.026604] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.028113] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029066] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030084] *** VALIDATE tmpfs *** [ 0.032116] *** VALIDATE proc *** [ 0.033226] *** VALIDATE cgroup *** [ 0.034005] *** VALIDATE cgroup2 *** [ 0.036195] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037124] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.038005] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.039023] Spectre V2 : User space: Vulnerable [ 0.040017] Speculative Store Bypass: Vulnerable [ 0.042776] debug: unmapping init [mem 0xffffffffb5e59000-0xffffffffb5e60fff] [ 0.044890] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.045665] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.046021] ... version: 2 [ 0.047011] ... bit width: 48 [ 0.047992] ... generic registers: 4 [ 0.048010] ... value mask: 0000ffffffffffff [ 0.049010] ... max period: 00007fffffffffff [ 0.050008] ... fixed-purpose events: 3 [ 0.051007] ... event mask: 000000070000000f [ 0.053198] rcu: Hierarchical SRCU implementation. [ 0.055415] smp: Bringing up secondary CPUs ... [ 0.056502] x86: Booting SMP configuration: [ 0.057015] .... node #0, CPUs: #1 #2 #3 [ 0.060270] smp: Brought up 1 node, 4 CPUs [ 0.062007] smpboot: Max logical packages: 1 [ 0.063013] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.271340] node 0 deferred pages initialised in 207ms [ 0.274602] devtmpfs: initialized [ 0.275206] x86/mm: Memory block size: 128MB [ 0.277562] gcov: version magic: 0x41383552 [ 0.279208] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.283140] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.285404] pinctrl core: initialized pinctrl subsystem [ 0.287704] ************************************************************* [ 0.289011] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.291014] ** ** [ 0.294013] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.295008] ** ** [ 0.297009] ** This means that this kernel is built to expose internal ** [ 0.298010] ** IOMMU data structures, which may compromise security on ** [ 0.301013] ** your system. ** [ 0.302010] ** ** [ 0.304014] ** If you see this message and you are not debugging the ** [ 0.307009] ** kernel, report this immediately to your vendor! ** [ 0.309005] ** ** [ 0.311009] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.312008] ************************************************************* [ 0.314564] NET: Registered protocol family 16 [ 0.316407] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.318044] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.320048] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.323194] cpuidle: using governor menu [ 0.324531] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.326746] PCI: Using configuration type 1 for base access [ 0.329167] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.336111] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.338010] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.341201] cryptd: max_cpu_qlen set to 1000 [ 0.343237] ACPI: Added _OSI(Module Device) [ 0.345010] ACPI: Added _OSI(Processor Device) [ 0.346009] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.347008] ACPI: Added _OSI(Processor Aggregator Device) [ 0.349821] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.355470] ACPI: Interpreter enabled [ 0.357073] ACPI: PM: (supports S0 S3 S4 S5) [ 0.359015] ACPI: Using IOAPIC for interrupt routing [ 0.360139] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.363405] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.372381] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.374051] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.377029] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.380097] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.385489] acpiphp: Slot [2] registered [ 0.387183] acpiphp: Slot [5] registered [ 0.389186] acpiphp: Slot [6] registered [ 0.390127] acpiphp: Slot [7] registered [ 0.391156] acpiphp: Slot [8] registered [ 0.393150] acpiphp: Slot [9] registered [ 0.394154] acpiphp: Slot [10] registered [ 0.396168] acpiphp: Slot [3] registered [ 0.397166] acpiphp: Slot [4] registered [ 0.399122] acpiphp: Slot [11] registered [ 0.401156] acpiphp: Slot [12] registered [ 0.402128] acpiphp: Slot [13] registered [ 0.404059] acpiphp: Slot [14] registered [ 0.405050] acpiphp: Slot [15] registered [ 0.406054] acpiphp: Slot [16] registered [ 0.407042] acpiphp: Slot [17] registered [ 0.408069] acpiphp: Slot [18] registered [ 0.410083] acpiphp: Slot [19] registered [ 0.411051] acpiphp: Slot [20] registered [ 0.411888] acpiphp: Slot [21] registered [ 0.413079] acpiphp: Slot [22] registered [ 0.414096] acpiphp: Slot [23] registered [ 0.415049] acpiphp: Slot [24] registered [ 0.416045] acpiphp: Slot [25] registered [ 0.418073] acpiphp: Slot [26] registered [ 0.419071] acpiphp: Slot [27] registered [ 0.420081] acpiphp: Slot [28] registered [ 0.422079] acpiphp: Slot [29] registered [ 0.423094] acpiphp: Slot [30] registered [ 0.424098] acpiphp: Slot [31] registered [ 0.426079] PCI host bridge to bus 0000:00 [ 0.427014] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.429017] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.431020] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.434022] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.436019] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 0.439032] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.441193] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.444010] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.447100] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.455739] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.459626] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.461012] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.464017] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.466014] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.467825] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.470793] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.474057] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.476853] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.482026] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.494997] pci 0000:00:02.0: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref] [ 0.498863] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.505274] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.508015] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.515018] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.531027] pci 0000:00:05.0: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref] [ 0.541362] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.546024] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.552015] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.570024] pci 0000:00:06.0: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref] [ 0.578445] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.584011] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.591017] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.605017] pci 0000:00:07.0: reg 0x20: [mem 0x38000000c000-0x38000000ffff 64bit pref] [ 0.614304] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.625017] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.630016] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.643034] pci 0000:00:08.0: reg 0x20: [mem 0x380000010000-0x380000013fff 64bit pref] [ 0.653515] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.659010] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.663012] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.679018] pci 0000:00:09.0: reg 0x20: [mem 0x380000014000-0x380000017fff 64bit pref] [ 0.687062] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.693011] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.698013] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.709017] pci 0000:00:0a.0: reg 0x20: [mem 0x380000018000-0x38000001bfff 64bit pref] [ 0.718479] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.722410] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.724382] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.727307] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.729227] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.737042] iommu: Default domain type: Passthrough [ 0.738450] SCSI subsystem initialized [ 0.740114] ACPI: bus type USB registered [ 0.741072] usbcore: registered new interface driver usbfs [ 0.743051] usbcore: registered new interface driver hub [ 0.744074] usbcore: registered new device driver usb [ 0.746111] pps_core: LinuxPPS API ver. 1 registered [ 0.747008] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.750063] PTP clock support registered [ 0.752136] EDAC MC: Ver: 3.0.0 [ 0.753551] PCI: Using ACPI for IRQ routing [ 0.755018] PCI: pci_cache_line_size set to 64 bytes [ 0.755288] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 0.755301] e820: reserve RAM buffer [mem 0xbffce000-0xbfffffff] [ 0.755306] e820: reserve RAM buffer [mem 0x146e00000-0x147ffffff] [ 0.756152] NetLabel: Initializing [ 0.757011] NetLabel: domain hash size = 128 [ 0.759013] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.760095] NetLabel: unlabeled traffic allowed by default [ 0.763044] vgaarb: loaded [ 0.764445] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.766012] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.773304] clocksource: Switched to clocksource kvm-clock [ 0.878345] VFS: Disk quotas dquot_6.6.0 [ 0.879609] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.881697] *** VALIDATE ramfs *** [ 0.882757] *** VALIDATE hugetlbfs *** [ 0.884351] pnp: PnP ACPI init [ 0.885719] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 0.885805] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 0.885834] pnp 00:02: [dma 2] [ 0.885881] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 0.885964] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.886052] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.886118] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.886691] pnp: PnP ACPI: found 6 devices [ 0.903455] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.906482] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.908397] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.910396] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.912955] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.915240] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x38007fffffff window] [ 0.917864] NET: Registered protocol family 2 [ 0.920485] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.924959] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.928689] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.933462] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.936888] TCP: Hash tables configured (established 65536 bind 65536) [ 0.939496] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.941714] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.944611] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.947395] NET: Registered protocol family 1 [ 0.949848] RPC: Registered named UNIX socket transport module. [ 0.951676] RPC: Registered udp transport module. [ 0.953129] RPC: Registered tcp transport module. [ 0.954657] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.956935] NET: Registered protocol family 44 [ 0.958967] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.960803] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.962501] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.964581] PCI: CLS 0 bytes, default 64 [ 0.966078] Unpacking initramfs... [ 2.326804] debug: unmapping init [mem 0xffff9e2a7cc54000-0xffff9e2a7ffbffff] [ 2.332188] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.334471] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.337321] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.812919] Initialise system trusted keyrings [ 2.814069] Key type blacklist registered [ 2.815412] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.823376] zbud: loaded [ 2.826063] *** VALIDATE nfs *** [ 2.827336] *** VALIDATE nfs4 *** [ 2.828510] pstore: using deflate compression [ 2.830330] Platform Keyring initialized [ 2.912766] NET: Registered protocol family 38 [ 2.914471] Key type asymmetric registered [ 2.915755] Asymmetric key parser 'x509' registered [ 2.917611] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.919726] io scheduler mq-deadline registered [ 2.921102] io scheduler kyber registered [ 2.922900] io scheduler bfq registered [ 2.924786] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.927114] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.929018] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.930768] ACPI: Power Button [PWRF] [ 3.015438] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.100849] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.256488] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.333720] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.493124] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.518957] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.548032] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.552356] Non-volatile memory driver v1.3 [ 3.553714] Linux agpgart interface v0.103 [ 3.580628] virtio_blk virtio1: [vda] 133608 512-byte logical blocks (68.4 MB/65.2 MiB) [ 3.583196] vda: detected capacity change from 0 to 68407296 [ 3.596160] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.598581] vdb: detected capacity change from 0 to 1073741824 [ 3.612175] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.614390] vdc: detected capacity change from 0 to 2621440000 [ 3.628761] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.631512] vdd: detected capacity change from 0 to 2621440000 [ 3.645182] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.647651] vde: detected capacity change from 0 to 4294967296 [ 3.661337] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.664594] vdf: detected capacity change from 0 to 4294967296 [ 3.671055] libphy: Fixed MDIO Bus: probed [ 3.676061] usbcore: registered new interface driver usbserial_generic [ 3.678107] usbserial: USB Serial support registered for generic [ 3.680475] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.683260] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.685142] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.686904] mousedev: PS/2 mouse device common for all mice [ 3.689306] rtc_cmos 00:05: RTC can wake from S4 [ 3.692044] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.693586] rtc_cmos 00:05: registered as rtc0 [ 3.697969] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.698324] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.700223] intel_pstate: CPU model not supported [ 3.704621] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.707956] hid: raw HID events driver (C) Jiri Kosina [ 3.709436] usbcore: registered new interface driver usbhid [ 3.710889] usbhid: USB HID core driver [ 3.712035] drop_monitor: Initializing network drop monitor service [ 3.713671] Initializing XFRM netlink socket [ 3.714879] NET: Registered protocol family 10 [ 3.717065] Segment Routing with IPv6 [ 3.718102] NET: Registered protocol family 17 [ 3.719873] mpls_gso: MPLS GSO support [ 3.720868] start plist test [ 3.723238] end plist test [ 3.724693] RAS: Correctable Errors collector initialized. [ 3.726615] AVX version of gcm_enc/dec engaged. [ 3.728042] AES CTR mode by8 optimization enabled [ 3.785259] sched_clock: Marking stable (3785226874, 0)->(4622451255, -837224381) [ 3.788557] registered taskstats version 1 [ 3.789817] Loading compiled-in X.509 certificates [ 3.791567] zswap: loaded using pool lzo/zbud [ 3.811517] Key type big_key registered [ 3.821069] Key type encrypted registered [ 3.822619] ima: No TPM chip found, activating TPM-bypass! [ 3.824482] ima: Allocated hash algorithm: sha1 [ 3.825893] ima: No architecture policies found [ 3.827363] evm: Initialising EVM extended attributes: [ 3.829147] evm: security.selinux [ 3.830328] evm: security.ima [ 3.831303] evm: security.capability [ 3.832668] evm: HMAC attrs: 0x1 [ 3.834628] rtc_cmos 00:05: setting system clock to 2025-11-01 02:10:16 UTC (1761963016) [ 3.839592] debug: unmapping init [mem 0xffffffffb6e03000-0xffffffffb6ffffff] [ 3.841941] debug: unmapping init [mem 0xffffffffb5b82000-0xffffffffb5e58fff] [ 3.853126] Write protecting the kernel read-only data: 28672k [ 3.856713] debug: unmapping init [mem 0xffffffffb4203000-0xffffffffb43fffff] [ 3.859397] debug: unmapping init [mem 0xffffffffb4b14000-0xffffffffb4bfffff] [ 3.890565] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.899815] systemd[1]: Detected virtualization kvm. [ 3.901840] systemd[1]: Detected architecture x86-64. [ 3.903904] systemd[1]: Running in initial RAM disk. [ 3.934465] systemd[1]: No hostname configured. [ 3.935434] systemd[1]: Set hostname to . [ 3.936938] random: systemd: uninitialized urandom read (16 bytes read) [ 3.938820] systemd[1]: Initializing machine ID from random generator. [ 3.978871] random: ln: uninitialized urandom read (6 bytes read) [ 4.064319] random: systemd: uninitialized urandom read (16 bytes read) [ 4.066839] systemd[1]: Reached target Initrd Root Device. [ 4.071629] systemd[1]: Listening on Journal Socket (/dev/log). [ 4.076118] systemd[1]: Reached target Slices. [ 4.641665] device-mapper: uevent: version 1.0.3 [ 4.643622] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ 5.270850] random: fast init done [ 5.303571] libata version 3.00 loaded. [ 5.305722] virtio_net virtio0 ens2: renamed from eth0 [ 5.306262] ata_piix 0000:00:01.1: version 2.13 [ 5.359164] scsi host0: ata_piix [ 5.368334] scsi host1: ata_piix [ 5.370228] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.371705] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 10.336972] random: crng init done [ 10.338388] random: 7 urandom warning(s) missed due to ratelimiting [ 10.677642] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 11.727696] printk: systemd: 26 output lines suppressed due to ratelimiting [ 11.939521] SELinux: Disabled at runtime. [ 11.997030] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 12.005490] systemd[1]: Detected virtualization kvm. [ 12.007469] systemd[1]: Detected architecture x86-64. [ 12.421409] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.423971] systemd[1]: Stopped Switch Root. [ 12.427647] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.431312] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.433959] systemd[1]: Stopped Journal Service. [ 12.442520] systemd[1]: Starting Journal Service... [ 12.446514] systemd[1]: Stopped target Switch Root. [ 12.537468] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 12.901675] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 13.324590] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.325194] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.436392] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.447986] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 13.448058] EDAC sbridge: Ver: 1.1.2 [ 14.865923] Key type dns_resolver registered [ 15.164891] NFS: Registering the id_resolver key type [ 15.166549] Key type id_resolver registered [ 15.167771] Key type id_legacy registered [ 37.565399] libcfs: loading out-of-tree module taints kernel. [ 37.577452] Key type ._llcrypt registered [ 37.578805] Key type .llcrypt registered [ 37.607567] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_hostid [ 45.086354] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local [ 45.800305] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 45.809738] alg: No test for adler32 (adler32-zlib) [ 46.795205] Lustre: Lustre: Build Version: 2.16.59_55_g8497249 [ 47.087337] LNet: Added LNI 192.168.201.131@tcp [8/256/0/180] [ 48.703216] Key type lgssc registered [ 49.274385] Lustre: Echo OBD driver; http://www.lustre.org/ [ 55.645908] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 56.284467] LDISKFS-fs (vdc): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 59.308732] LDISKFS-fs (vdd): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 61.811624] LDISKFS-fs (vde): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 64.338918] LDISKFS-fs (vdf): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 69.832580] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local [ 74.378659] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 74.398726] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 74.404732] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 75.516176] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 75.528511] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 75.571551] Lustre: lustre-MDT0000: new disk, initializing [ 75.600516] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 75.607104] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 77.010660] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 82.584761] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 82.616075] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 82.648934] Lustre: 6462:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 82.659089] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 82.661395] Lustre: Skipped 1 previous similar message [ 82.702195] Lustre: lustre-MDT0001: new disk, initializing [ 82.728892] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 82.739814] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 82.743290] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 84.063699] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 86.351908] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 89.635668] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 89.662032] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 89.752941] Lustre: lustre-OST0000: new disk, initializing [ 89.755731] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 89.775586] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 91.728131] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 94.700460] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 94.702516] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 94.727831] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 97.480582] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 97.500513] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 97.530650] Lustre: lustre-OST0001: new disk, initializing [ 97.532168] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 97.549798] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 99.521943] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 101.866970] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 101.869510] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 101.887270] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 105.438754] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 109.104283] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 116.031670] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing check_logdir /tmp/testlogs/ [ 117.529364] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing yml_node [ 119.400560] Lustre: DEBUG MARKER: Client: 2.16.59.55 [ 120.460564] Lustre: DEBUG MARKER: MDS: 2.16.59.55 [ 121.420963] Lustre: DEBUG MARKER: OSS: 2.16.59.55 [ 122.005550] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity ============----- Fri Oct 31 22:12:13 EDT 2025 [ 128.483628] Lustre: DEBUG MARKER: - need MDS1_VERSION <= 2.14.55-100-g8a84c7f9c7 (34618167 <= 34486116) for LU-14927, skip 0f [ 129.035930] Lustre: DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34618167 < 34486116) for LU-14927, skip 0f [ 129.598090] Lustre: DEBUG MARKER: excepting tests: 225 255 256 400a 42a 42c 42b 118c 118d 407 119i 817 411a [ 130.155774] Lustre: DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 [ 130.814314] Lustre: DEBUG MARKER: === sanity: start setup 22:12:22 (1761963142) === [ 132.210654] Lustre: DEBUG MARKER: oleg131-client.virtnet: executing check_config_client /mnt/lustre [ 138.932507] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 140.228930] Lustre: 13237:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 141.422754] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 143.456547] Lustre: DEBUG MARKER: === sanity: finish setup 22:12:35 (1761963155) === [ 147.433599] Lustre: DEBUG MARKER: == sanity test 200: OST pools ============================ 22:12:39 (1761963159) [ 166.090855] Lustre: DEBUG MARKER: == sanity test 204a: Print default stripe attributes ===== 22:12:57 (1761963177) [ 168.814630] Lustre: DEBUG MARKER: == sanity test 204b: Print default stripe size and offset ========================================================== 22:13:00 (1761963180) [ 171.220698] Lustre: DEBUG MARKER: == sanity test 204c: Print default stripe count and offset ========================================================== 22:13:02 (1761963182) [ 173.746637] Lustre: DEBUG MARKER: == sanity test 204d: Print default stripe count and size ========================================================== 22:13:05 (1761963185) [ 176.174175] Lustre: DEBUG MARKER: == sanity test 204e: Print raw stripe attributes ========= 22:13:07 (1761963187) [ 178.585684] Lustre: DEBUG MARKER: == sanity test 204f: Print raw stripe size and offset ==== 22:13:10 (1761963190) [ 181.108646] Lustre: DEBUG MARKER: == sanity test 204g: Print raw stripe count and offset === 22:13:12 (1761963192) [ 183.651553] Lustre: DEBUG MARKER: == sanity test 204h: Print raw stripe count and size ===== 22:13:15 (1761963195) [ 186.347257] Lustre: DEBUG MARKER: == sanity test 205a: Verify job stats ==================== 22:13:17 (1761963197) [ 190.003583] Lustre: lustre-MDD0000: changelog on [ 190.927214] Lustre: lustre-MDD0001: changelog on [ 192.113265] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 1 /mnt/lustre/d205a.sanity [ 192.690890] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.26682 [ 193.648739] Lustre: DEBUG MARKER: Test: rmdir /mnt/lustre/d205a.sanity [ 194.259318] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.rmdir.25333 [ 195.261614] Lustre: DEBUG MARKER: Test: lfs mkdir -i 1 /mnt/lustre/d205a.sanity.remote [ 195.919122] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.17694 [ 196.893709] Lustre: DEBUG MARKER: Test: mknod /mnt/lustre/f205a.sanity c 1 3 [ 197.535085] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.mknod.17198 [ 198.571206] Lustre: DEBUG MARKER: Test: rm -f /mnt/lustre/f205a.sanity [ 199.235244] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.rm.4803 [ 200.217141] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/f205a.sanity [ 200.861339] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.21094 [ 201.846678] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 202.438486] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.touch.22700 [ 203.698478] Lustre: DEBUG MARKER: Test: dd if=/dev/zero of=/mnt/lustre/f205a.sanity bs=1M count=1 oflag=sync [ 204.268982] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.dd.8285 [ 205.218979] Lustre: DEBUG MARKER: Test: dd if=/mnt/lustre/f205a.sanity of=/dev/null bs=1M count=1 iflag=direct [ 205.789285] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.dd.16658 [ 206.631574] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/tests/truncate /mnt/lustre/f205a.sanity 0 [ 207.133925] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.truncate.1330 [ 208.268566] Lustre: DEBUG MARKER: Test: mv -f /mnt/lustre/f205a.sanity /mnt/lustre/d205a.sanity.rename [ 208.812243] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.mv.6337 [ 209.669442] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 1 /mnt/lustre/d205a.sanity.expire [ 210.201828] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.13754 [ 214.134266] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 214.665103] Lustre: DEBUG MARKER: Using JobID environment USER=S.root.touch.0.oleg131-client.v [ 215.597300] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 216.152841] Lustre: DEBUG MARKER: Using JobID environment USER=S.root.touch.0.oleg131-client.E [ 217.042760] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 217.577283] Lustre: DEBUG MARKER: Using JobID environment session=S.root.touch.0.oleg131-client.v [ 220.601852] Lustre: lustre-MDD0001: changelog off [ 221.523134] Lustre: lustre-MDD0000: changelog off [ 224.920632] Lustre: DEBUG MARKER: == sanity test 205b: Verify job stats jobid and output format ========================================================== 22:13:56 (1761963236) [ 229.196364] Lustre: DEBUG MARKER: == sanity test 205c: Verify client stats format ========== 22:14:00 (1761963240) [ 231.457286] Lustre: DEBUG MARKER: == sanity test 205d: verify the format of some stats files ========================================================== 22:14:03 (1761963243) [ 236.244848] Lustre: DEBUG MARKER: == sanity test 205e: verify the output of lljobstat ====== 22:14:07 (1761963247) [ 241.759633] Lustre: DEBUG MARKER: == sanity test 205f: verify qos_ost_weights YAML format == 22:14:13 (1761963253) [ 244.700300] Lustre: DEBUG MARKER: == sanity test 205g: stress test for job_stats procfile == 22:14:16 (1761963256) [ 339.768920] Lustre: DEBUG MARKER: == sanity test 205h: check jobid xattr is stored correctly ========================================================== 22:15:51 (1761963351) [ 344.563212] Lustre: DEBUG MARKER: == sanity test 205i: check job_xattr parameter accepts and rejects values correctly ========================================================== 22:15:56 (1761963356) [ 349.550847] Lustre: DEBUG MARKER: == sanity test 205k: Verify '?' operator on job stats ==== 22:16:01 (1761963361) [ 353.161260] Lustre: DEBUG MARKER: == sanity test 205l: Verify job stats can scale ========== 22:16:04 (1761963364) [ 397.901431] Lustre: DEBUG MARKER: == sanity test 205m: Test width parsing of job_stats ===== 22:16:49 (1761963409) [ 404.199181] Lustre: DEBUG MARKER: == sanity test 206: fail lov_init_raid0() doesn't lbug === 22:16:55 (1761963415) [ 406.496814] Lustre: DEBUG MARKER: == sanity test 207a: can refresh layout at glimpse ======= 22:16:58 (1761963418) [ 408.808954] Lustre: DEBUG MARKER: == sanity test 207b: can refresh layout at open ========== 22:17:00 (1761963420) [ 411.202758] Lustre: DEBUG MARKER: == sanity test 208: Exclusive open ======================= 22:17:02 (1761963422) [ 417.984127] Lustre: Failing over lustre-MDT0000 [ 418.308753] LustreError: 55420:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 418.339441] Lustre: server umount lustre-MDT0000 complete [ 419.295918] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 419.299555] Lustre: Skipped 3 previous similar messages [ 424.415640] LustreError: 7403:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 424.420653] LustreError: 7403:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 425.911481] LustreError: 6467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 429.535877] LustreError: 7403:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 429.541287] LustreError: 7403:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 431.498461] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 431.541712] LustreError: MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 431.622871] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 433.190103] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 436.151967] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 436.711552] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 436.722640] Lustre: lustre-MDT0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. [ 436.743652] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:9 to 0x2c0000401:33) [ 436.743663] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:20 to 0x280000401:65) [ 438.052826] Lustre: DEBUG MARKER: oleg131-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 438.634265] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 442.654820] Lustre: Failing over lustre-MDT0000 [ 442.955875] LustreError: 56450:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 442.957795] LustreError: 56450:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 442.987058] Lustre: server umount lustre-MDT0000 complete [ 446.400914] LustreError: 6467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 446.407602] LustreError: 6467:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 446.949097] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 446.951950] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 446.954938] Lustre: Skipped 3 previous similar messages [ 451.510977] LustreError: 6467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 451.517442] LustreError: 6467:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 455.846510] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 455.885208] LustreError: MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 455.986924] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 456.632090] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 457.326603] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 461.286812] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 461.288358] Lustre: Skipped 3 previous similar messages [ 461.295716] Lustre: lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. [ 461.311913] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:9 to 0x2c0000401:65) [ 461.311925] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:20 to 0x280000401:97) [ 462.422954] Lustre: DEBUG MARKER: oleg131-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 462.937949] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 466.545250] Lustre: DEBUG MARKER: == sanity test 209: read-only open/close requests should be freed promptly ========================================================== 22:17:58 (1761963478) [ 477.106406] Lustre: DEBUG MARKER: == sanity test 210: lfs getstripe does not break leases == 22:18:08 (1761963488) [ 481.484294] Lustre: DEBUG MARKER: == sanity test 212: Sendfile test ====================================================================================================== 22:18:13 (1761963493) [ 484.933996] Lustre: DEBUG MARKER: == sanity test 213: OSC lock completion and cancel race don't crash - bug 18829 ========================================================== 22:18:16 (1761963496) [ 497.831325] Lustre: DEBUG MARKER: == sanity test 214: hash-indexed directory test - bug 20133 ========================================================== 22:18:29 (1761963509) [ 511.046448] Lustre: DEBUG MARKER: == sanity test 215: lnet exists and has proper content - bugs 18102, 21079, 21517 ========================================================== 22:18:42 (1761963522) [ 513.582963] Lustre: DEBUG MARKER: == sanity test 216: check lockless direct write updates file size and kms correctly ========================================================== 22:18:45 (1761963525) [ 520.623080] Lustre: DEBUG MARKER: == sanity test 217: check lctl ping for hostnames with embedded hyphen ('-') ========================================================== 22:18:52 (1761963532) [ 523.635024] Lustre: DEBUG MARKER: == sanity test 218: parallel read and truncate should not deadlock ========================================================== 22:18:55 (1761963535) [ 524.152028] Lustre: DEBUG MARKER: creating a 10 Mb file [ 539.949516] Lustre: DEBUG MARKER: starting reads [ 540.601357] Lustre: DEBUG MARKER: truncating the file [ 541.634062] Lustre: DEBUG MARKER: killing dd [ 542.247339] Lustre: DEBUG MARKER: removing the temporary file [ 544.570179] Lustre: DEBUG MARKER: == sanity test 219: LU-394: Write partial won't cause uncontiguous pages vec at LND ========================================================== 22:19:16 (1761963556) [ 547.038721] Lustre: DEBUG MARKER: == sanity test 220: preallocated MDS objects still used if ENOSPC from OST ========================================================== 22:19:18 (1761963558) [ 550.368051] Lustre: *** cfs_fail_loc=229, val=0*** [ 552.415860] Lustre: *** cfs_fail_loc=229, val=1*** [ 553.443666] Lustre: *** cfs_fail_loc=229, val=1*** [ 553.445347] Lustre: Skipped 2 previous similar messages [ 560.311705] Lustre: DEBUG MARKER: == sanity test 221: make sure fault and truncate race to not cause OOM ========================================================== 22:19:32 (1761963572) [ 564.391899] Lustre: DEBUG MARKER: == sanity test 222a: AGL for ls should not trigger CLIO lock failure ========================================================== 22:19:36 (1761963576) [ 567.226331] Lustre: DEBUG MARKER: == sanity test 222b: AGL for rmdir should not trigger CLIO lock failure ========================================================== 22:19:38 (1761963578) [ 569.885302] Lustre: DEBUG MARKER: == sanity test 223: osc reenqueue if without AGL lock granted ================================================================================= 22:19:41 (1761963581) [ 572.562766] Lustre: DEBUG MARKER: == sanity test 224a: Don't panic on bulk IO failure ====== 22:19:44 (1761963584) [ 572.671070] Lustre: lustre-OST0001: Client 1de13e73-d352-4740-abbc-35af6cf920e8 (at 192.168.201.31@tcp) reconnecting [ 576.407122] Lustre: DEBUG MARKER: == sanity test 224b: Don't panic on bulk IO failure ====== 22:19:48 (1761963588) [ 578.116369] LustreError: 60047:0:(tgt_handler.c:2588:tgt_brw_read()) cfs_fail_timeout id 515 sleeping for 3000ms [ 581.135145] LustreError: 60047:0:(tgt_handler.c:2588:tgt_brw_read()) cfs_fail_timeout id 515 awake [ 584.494117] Lustre: DEBUG MARKER: == sanity test 224c: Don't hang if one of md lost during large bulk RPC ========================================================== 22:19:56 (1761963596) [ 591.090513] Lustre: *** cfs_fail_loc=520, val=57344*** [ 591.110269] LNet: *** cfs_fail_loc=e000, val=2147483648*** [ 596.426427] Lustre: lustre-OST0000: Client 1de13e73-d352-4740-abbc-35af6cf920e8 (at 192.168.201.31@tcp) reconnecting [ 604.743036] Lustre: DEBUG MARKER: == sanity test 224d: Don't corrupt data on bulk IO timeout ========================================================== 22:20:16 (1761963616) [ 606.492063] LustreError: 60047:0:(tgt_handler.c:2588:tgt_brw_read()) cfs_fail_timeout id 515 sleeping for 22000ms [ 626.054796] Lustre: lustre-OST0000: Client 1de13e73-d352-4740-abbc-35af6cf920e8 (at 192.168.201.31@tcp) reconnecting [ 627.815163] LustreError: 60047:0:(tgt_handler.c:2588:tgt_brw_read()) cfs_fail_timeout interrupted [ 627.818159] LustreError: 60047:0:(ldlm_lib.c:3554:target_bulk_io()) @@@ bulk READ failed: rc = -107 req@ffff9e29c5ec9c00 x1847552173108608/t0(0) o3->1de13e73-d352-4740-abbc-35af6cf920e8@192.168.201.31@tcp:0/0 lens 488/440 e 0 to 0 dl 1761963639 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 [ 627.828059] Lustre: 60047:0:(service.c:2560:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (20/1s); client may timeout req@ffff9e29c5ec9c00 x1847552173108608/t0(0) o3->1de13e73-d352-4740-abbc-35af6cf920e8@192.168.201.31@tcp:0/0 lens 488/440 e 0 to 0 dl 1761963639 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 [ 631.370535] Lustre: DEBUG MARKER: SKIP: sanity test_225a skipping excluded test 225a (base 225) [ 632.104462] Lustre: DEBUG MARKER: SKIP: sanity test_225b skipping excluded test 225b (base 225) [ 632.845606] Lustre: DEBUG MARKER: == sanity test 226a: call path2fid and fid2path on files of all type ========================================================== 22:20:44 (1761963644) [ 636.016976] Lustre: DEBUG MARKER: == sanity test 226b: call path2fid and fid2path on files of all type under remote dir ========================================================== 22:20:47 (1761963647) [ 638.952764] Lustre: DEBUG MARKER: == sanity test 226c: call path2fid and fid2path under remote dir with subdir mount ========================================================== 22:20:50 (1761963650) [ 642.106342] Lustre: DEBUG MARKER: == sanity test 226d: verify fid2path with -n and -fn option ========================================================== 22:20:53 (1761963653) [ 644.924757] Lustre: DEBUG MARKER: == sanity test 226e: Verify path2fid -0 option with newline and space ========================================================== 22:20:56 (1761963656) [ 647.776298] Lustre: DEBUG MARKER: == sanity test 227: running truncated executable does not cause OOM ========================================================== 22:20:59 (1761963659) [ 650.660735] Lustre: DEBUG MARKER: == sanity test 228a: try to reuse idle OI blocks ========= 22:21:02 (1761963662) [ 712.928680] Lustre: DEBUG MARKER: == sanity test 228b: idle OI blocks can be reused after MDT restart ========================================================== 22:22:04 (1761963724) [ 756.393611] Lustre: Failing over lustre-MDT0000 [ 756.670338] LustreError: 66956:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 756.672978] LustreError: 66956:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 756.719332] Lustre: server umount lustre-MDT0000 complete [ 757.181239] LustreError: 57735:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 757.185835] LustreError: 57735:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 758.240738] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 758.243726] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 760.666294] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 760.902345] LustreError: MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 761.276440] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 761.330791] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 762.295152] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 762.594467] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 766.442499] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 766.444205] Lustre: Skipped 3 previous similar messages [ 766.459284] Lustre: lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 766.478706] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6311 to 0x280000401:6337) [ 766.479982] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6244 to 0x2c0000401:6273) [ 780.655120] Lustre: DEBUG MARKER: == sanity test 228c: NOT shrink the last entry in OI index node to recycle idle leaf ========================================================== 22:23:12 (1761963792) [ 883.299353] Lustre: DEBUG MARKER: == sanity test 229: getstripe/stat/rm/attr changes work on released files ========================================================== 22:24:54 (1761963894) [ 885.896457] Lustre: DEBUG MARKER: == sanity test 230a: Create remote directory and files under the remote directory ========================================================== 22:24:57 (1761963897) [ 888.844749] Lustre: DEBUG MARKER: == sanity test 230b: migrate directory =================== 22:25:00 (1761963900) [ 909.286865] Lustre: DEBUG MARKER: == sanity test 230c: check directory accessiblity if migration failed ========================================================== 22:25:20 (1761963920) [ 910.140631] Lustre: *** cfs_fail_loc=1801, val=0*** [ 910.141951] LustreError: 53564:0:(mdt_reint.c:2564:mdt_reint_migrate()) lustre-MDT0000: migrate [0x240000406:0x567f:0x0]/f1 failed: rc = -5 [ 910.714450] LustreError: 53564:0:(mdd_dir.c:4746:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 [ 910.722770] LustreError: 53564:0:(mdt_reint.c:2564:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2000013a1:0x2fe9:0x0]/migrate_dir failed: rc = -1 [ 912.454870] Lustre: 53564:0:(mdd_dir.c:4825:mdd_migrate_object()) lustre-MDD0001: [0x240000400:0x13:0x0]/foo is open, migrate only dentry [ 915.855060] Lustre: DEBUG MARKER: SKIP: sanity test_230d skipping SLOW test 230d [ 916.529858] Lustre: DEBUG MARKER: == sanity test 230e: migrate mulitple local link files === 22:25:28 (1761963928) [ 919.707686] Lustre: DEBUG MARKER: == sanity test 230f: migrate mulitple remote link files == 22:25:31 (1761963931) [ 923.115876] Lustre: DEBUG MARKER: == sanity test 230g: migrate dir to non-exist MDT ======== 22:25:34 (1761963934) [ 925.828266] Lustre: DEBUG MARKER: == sanity test 230h: migrate .. and root ================= 22:25:37 (1761963937) [ 928.522454] Lustre: DEBUG MARKER: == sanity test 230i: lfs migrate -m tolerates trailing slashes ========================================================== 22:25:40 (1761963940) [ 931.257662] Lustre: DEBUG MARKER: == sanity test 230j: DoM file data not changed after dir migration ========================================================== 22:25:42 (1761963942) [ 933.959981] Lustre: DEBUG MARKER: == sanity test 230k: file data not changed after dir migration ========================================================== 22:25:45 (1761963945) [ 934.575432] Lustre: DEBUG MARKER: SKIP: sanity test_230k needs >= 4 MDTs [ 935.292784] Lustre: DEBUG MARKER: == sanity test 230l: readdir between MDTs won't crash ==== 22:25:46 (1761963946) [ 972.191307] Lustre: DEBUG MARKER: == sanity test 230m: xattrs not changed after dir migration ========================================================== 22:26:23 (1761963983) [ 977.870574] Lustre: DEBUG MARKER: == sanity test 230n: Dir migration with mirrored file ==== 22:26:29 (1761963989) [ 980.796836] Lustre: DEBUG MARKER: == sanity test 230o: dir split =========================== 22:26:32 (1761963992) [ 995.539418] Lustre: DEBUG MARKER: == sanity test 230p: dir merge =========================== 22:26:47 (1761964007) [ 1017.258473] Lustre: DEBUG MARKER: == sanity test 230q: dir auto split ====================== 22:27:08 (1761964028) [ 1038.650257] Lustre: DEBUG MARKER: == sanity test 230r: migrate with too many local locks === 22:27:30 (1761964050) [ 1041.885153] Lustre: DEBUG MARKER: == sanity test 230s: lfs mkdir should return -EEXIST if target exists ========================================================== 22:27:33 (1761964053) [ 1046.376727] Lustre: DEBUG MARKER: == sanity test 230t: migrate directory with project ID set ========================================================== 22:27:38 (1761964058) [ 1049.832131] Lustre: DEBUG MARKER: == sanity test 230u: migrate directory by QOS ============ 22:27:41 (1761964061) [ 1050.426903] Lustre: DEBUG MARKER: SKIP: sanity test_230u needs >= 4 MDTs [ 1051.112466] Lustre: DEBUG MARKER: == sanity test 230v: subdir migrated to the MDT where its parent is located ========================================================== 22:27:42 (1761964062) [ 1051.752080] Lustre: DEBUG MARKER: SKIP: sanity test_230v needs >= 4 MDTs [ 1052.408063] Lustre: DEBUG MARKER: == sanity test 230w: non-recursive mode dir migration ==== 22:27:44 (1761964064) [ 1055.997163] Lustre: DEBUG MARKER: == sanity test 230x: dir migration check space =========== 22:27:47 (1761964067) [ 1062.525771] LustreError: 53564:0:(mdt_reint.c:2564:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200000007:0x1:0x0]/d230x.sanity failed: rc = -28 [ 1062.528945] LustreError: 53564:0:(mdt_reint.c:2564:mdt_reint_migrate()) Skipped 1 previous similar message [ 1080.596636] Lustre: DEBUG MARKER: == sanity test 230y: unlink dir with bad hash type ======= 22:28:12 (1761964092) [ 1082.440397] Lustre: *** cfs_fail_loc=1802, val=0*** [ 1082.487194] LustreError: 6482:0:(mdt_reint.c:2564:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000406:0x5ba9:0x0]/d65 failed: rc = -77 [ 1087.482287] Lustre: DEBUG MARKER: == sanity test 230z: resume dir migration with bad hash type ========================================================== 22:28:19 (1761964099) [ 1089.410617] Lustre: *** cfs_fail_loc=1802, val=0*** [ 1089.411960] Lustre: Skipped 1 previous similar message [ 1089.451064] LustreError: 6482:0:(mdt_reint.c:2564:mdt_reint_migrate()) lustre-MDT0001: migrate [0x240000406:0x5bb1:0x0]/d36 failed: rc = -77 [ 1104.575762] Lustre: DEBUG MARKER: == sanity test 230A: dir migrate should update lmm_oi ==== 22:28:36 (1761964116) [ 1107.406001] Lustre: DEBUG MARKER: == sanity test 231a: checking that reading/writing of BRW RPC size results in one RPC ========================================================== 22:28:39 (1761964119) [ 1111.514042] Lustre: DEBUG MARKER: == sanity test 231b: must not assert on fully utilized OST request buffer ========================================================== 22:28:43 (1761964123) [ 1134.059289] Lustre: DEBUG MARKER: == sanity test 232a: failed lock should not block umount ========================================================== 22:29:05 (1761964145) [ 1134.445125] Lustre: *** cfs_fail_loc=31c, val=0*** [ 1136.164654] Lustre: Failing over lustre-OST0000 [ 1136.273093] LustreError: 77085:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1136.276327] LustreError: 77085:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1136.323323] Lustre: server umount lustre-OST0000 complete [ 1138.655842] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1138.658055] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1138.662074] Lustre: Skipped 3 previous similar messages [ 1138.664353] LustreError: 65929:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1138.676127] LustreError: 65929:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 1139.235373] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1139.332511] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1139.340553] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1140.461478] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1140.678161] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1140.678177] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1140.683439] Lustre: Skipped 3 previous similar messages [ 1141.298126] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1144.539236] Lustre: DEBUG MARKER: == sanity test 232b: failed data version lock should not block umount ========================================================== 22:29:16 (1761964156) [ 1145.080287] Lustre: *** cfs_fail_loc=31c, val=0*** [ 1145.082313] LustreError: 58394:0:(ldlm_request.c:476:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -12) ns: filter-lustre-OST0000_UUID lock: ffff9e29cae30800/0x1266690a9342b732 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1af7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58394 timeout: 0 lvb_type: 0 [ 1146.588613] Lustre: Failing over lustre-OST0000 [ 1146.609109] LustreError: 78363:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1146.611167] LustreError: 78363:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1146.632347] Lustre: server umount lustre-OST0000 complete [ 1149.696406] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1149.728034] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 1149.730100] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1149.734486] Lustre: Skipped 1 previous similar message [ 1149.815251] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1150.908025] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1151.418542] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 1151.418712] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1151.422493] Lustre: Skipped 1 previous similar message [ 1151.876099] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1154.980211] Lustre: DEBUG MARKER: == sanity test 233a: checking that OBF of the FS root succeeds ========================================================== 22:29:26 (1761964166) [ 1157.574319] Lustre: DEBUG MARKER: == sanity test 233b: checking that OBF of the FS .lustre succeeds ========================================================== 22:29:29 (1761964169) [ 1160.103148] Lustre: DEBUG MARKER: == sanity test 234: xattr cache should not crash on ENOMEM ========================================================== 22:29:31 (1761964171) [ 1162.763867] Lustre: DEBUG MARKER: == sanity test 235: LU-1715: flock deadlock detection does not work properly ========================================================== 22:29:34 (1761964174) [ 1167.209943] Lustre: DEBUG MARKER: == sanity test 236: Layout swap on open unlinked file ==== 22:29:38 (1761964178) [ 1169.982560] Lustre: DEBUG MARKER: == sanity test 238: Verify linkea consistency ============ 22:29:41 (1761964181) [ 1172.690042] Lustre: DEBUG MARKER: == sanity test 239A: osp_sync test ======================= 22:29:44 (1761964184) [ 1200.961493] Lustre: DEBUG MARKER: == sanity test 239a: process invalid osp sync record correctly ========================================================== 22:30:12 (1761964212) [ 1202.227641] Lustre: *** cfs_fail_loc=2100, val=0*** [ 1205.995974] Lustre: DEBUG MARKER: == sanity test 239b: process osp sync record with ENOMEM error correctly ========================================================== 22:30:17 (1761964217) [ 1211.535821] Lustre: DEBUG MARKER: == sanity test 240: race between ldlm enqueue and the connection RPC (no ASSERT) ========================================================== 22:30:23 (1761964223) [ 1212.522477] Lustre: *** cfs_fail_loc=713, val=1*** [ 1212.524412] Lustre: Skipped 1 previous similar message [ 1217.986958] Lustre: DEBUG MARKER: == sanity test 241a: bio vs dio ========================== 22:30:29 (1761964229) [ 1254.266617] Lustre: DEBUG MARKER: == sanity test 241b: dio vs dio ========================== 22:31:06 (1761964266) [ 1265.808258] Lustre: DEBUG MARKER: == sanity test 242: mdt_readpage failure should not cause directory unreadable ========================================================== 22:31:17 (1761964277) [ 1266.211420] Lustre: *** cfs_fail_loc=105, val=0*** [ 1268.662499] Lustre: DEBUG MARKER: == sanity test 243: various group lock tests ============= 22:31:20 (1761964280) [ 1370.497976] Lustre: DEBUG MARKER: == sanity test 244a: sendfile with group lock tests ====== 22:33:02 (1761964382) [ 1411.320123] Lustre: DEBUG MARKER: == sanity test 244b: multi-threaded write with group lock ========================================================== 22:33:43 (1761964423) [ 1413.951977] Lustre: DEBUG MARKER: == sanity test 245a: check mdc connection flag/data: multiple modify RPCs ========================================================== 22:33:45 (1761964425) [ 1416.245820] Lustre: DEBUG MARKER: == sanity test 245b: check osp connection flag/data: multiple modify RPCs ========================================================== 22:33:47 (1761964427) [ 1419.049057] Lustre: DEBUG MARKER: == sanity test 247a: mount subdir as fileset ============= 22:33:50 (1761964430) [ 1421.948336] Lustre: DEBUG MARKER: == sanity test 247b: mount subdir that dose not exist ==== 22:33:53 (1761964433) [ 1424.435021] Lustre: DEBUG MARKER: == sanity test 247c: running fid2path outside subdirectory root ========================================================== 22:33:56 (1761964436) [ 1427.527810] Lustre: DEBUG MARKER: == sanity test 247d: running fid2path inside subdirectory root ========================================================== 22:33:59 (1761964439) [ 1430.573083] Lustre: DEBUG MARKER: == sanity test 247e: mount .. as fileset ================= 22:34:02 (1761964442) [ 1433.345937] Lustre: DEBUG MARKER: == sanity test 247f: mount striped or remote directory as fileset ========================================================== 22:34:05 (1761964445) [ 1433.974895] Lustre: enable_remote_subdir_mount is deprecated, it's always enabled. [ 1439.764758] Lustre: DEBUG MARKER: == sanity test 247g: striped directory submount revalidate ROOT from cache ========================================================== 22:34:11 (1761964451) [ 1443.556054] Lustre: DEBUG MARKER: == sanity test 247h: remote directory submount revalidate ROOT from cache ========================================================== 22:34:15 (1761964455) [ 1448.799256] Lustre: DEBUG MARKER: == sanity test 248a: fast read verification ============== 22:34:20 (1761964460) [ 1512.383810] Lustre: DEBUG MARKER: == sanity test 248b: test short_io read and write for both small and large sizes ========================================================== 22:35:24 (1761964524) [ 1526.343251] Lustre: DEBUG MARKER: == sanity test 248c: verify whole file read behavior ===== 22:35:38 (1761964538) [ 1535.718802] Lustre: DEBUG MARKER: == sanity test 249: Write above 2T file size ============= 22:35:47 (1761964547) [ 1537.793548] Lustre: DEBUG MARKER: == sanity test 250: Write above 16T limit ================ 22:35:49 (1761964549) [ 1540.103454] Lustre: DEBUG MARKER: == sanity test 251a: Handling short read and write correctly ========================================================== 22:35:51 (1761964551) [ 1543.263276] Lustre: DEBUG MARKER: == sanity test 251b: short read restore offset correctly ========================================================== 22:35:54 (1761964554) [ 1550.660263] Lustre: DEBUG MARKER: == sanity test 252: check lr_reader tool ================= 22:36:02 (1761964562) [ 1554.461693] Lustre: DEBUG MARKER: == sanity test 253: Check object allocation limit ======== 22:36:06 (1761964566) [ 1586.810733] LustreError: 8957:0:(lod_qos.c:1385:lod_ost_alloc_specific()) can't lstripe objid [0x200001b73:0x41:0x0]: have 0 want 1 [ 1625.279394] Lustre: DEBUG MARKER: == sanity test 254: Check changelog size ================= 22:37:17 (1761964637) [ 1626.605807] Lustre: lustre-MDD0000: changelog on [ 1627.501816] Lustre: lustre-MDD0001: changelog on [ 1630.549055] Lustre: lustre-MDD0001: changelog off [ 1631.455270] Lustre: lustre-MDD0000: changelog off [ 1632.355320] Lustre: DEBUG MARKER: SKIP: sanity test_255a skipping excluded test 255a (base 255) [ 1632.921495] Lustre: DEBUG MARKER: SKIP: sanity test_255b skipping excluded test 255b (base 255) [ 1633.478300] Lustre: DEBUG MARKER: SKIP: sanity test_255c skipping excluded test 255c (base 255) [ 1634.054473] Lustre: DEBUG MARKER: SKIP: sanity test_256 skipping excluded test 256 [ 1634.715611] Lustre: DEBUG MARKER: == sanity test 257: xattr locks are not lost ============= 22:37:26 (1761964646) [ 1635.321749] Lustre: *** cfs_fail_loc=161, val=0*** [ 1635.953117] Lustre: Failing over lustre-MDT0001 [ 1636.831980] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 1636.836932] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1636.845241] Lustre: Skipped 1 previous similar message [ 1636.848192] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 1639.392722] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 1642.316484] LustreError: 91610:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 1642.319845] LustreError: 91610:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1642.431774] Lustre: server umount lustre-MDT0001 complete [ 1644.514536] LustreError: 6468:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1644.522631] LustreError: 6468:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1645.450108] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1645.621258] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1645.642744] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 1646.992297] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1647.618413] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1648.711559] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 1650.663495] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1650.665582] Lustre: Skipped 1 previous similar message [ 1650.672936] Lustre: lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. [ 1650.690936] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:19541 to 0x280000400:19585) [ 1650.690994] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:19519 to 0x2c0000400:19553) [ 1656.266625] Lustre: DEBUG MARKER: == sanity test 258a: verify i_mutex security behavior when suid attributes is set ========================================================== 22:37:47 (1761964667) [ 1658.778830] Lustre: DEBUG MARKER: == sanity test 258b: verify i_mutex security behavior ==== 22:37:50 (1761964670) [ 1661.214837] Lustre: DEBUG MARKER: == sanity test 259: crash at delayed truncate ============ 22:37:52 (1761964672) [ 1674.068088] Lustre: *** cfs_fail_loc=2301, val=0*** [ 1675.119577] Lustre: Failing over lustre-OST0000 [ 1675.161075] LustreError: 94135:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1675.163174] LustreError: 94135:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1675.226629] Lustre: server umount lustre-OST0000 complete [ 1675.231994] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1675.236285] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1675.240702] Lustre: Skipped 2 previous similar messages [ 1678.494451] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1678.600189] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1678.608101] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1679.750433] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1680.578672] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1680.748630] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1680.748931] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1680.752219] Lustre: Skipped 2 previous similar messages [ 1685.721233] Lustre: DEBUG MARKER: == sanity test 260: Check mdc_close fail ================= 22:38:17 (1761964697) [ 1687.878645] Lustre: DEBUG MARKER: == sanity test 270a: DoM: basic functionality tests ====== 22:38:19 (1761964699) [ 1692.695554] Lustre: DEBUG MARKER: == sanity test 270b: DoM: maximum size overflow checks for DoM-only file ========================================================== 22:38:24 (1761964704) [ 1694.942487] Lustre: DEBUG MARKER: == sanity test 270c: DoM: DoM EA inheritance tests ======= 22:38:26 (1761964706) [ 1697.238282] Lustre: DEBUG MARKER: == sanity test 270d: DoM: change striping from DoM to RAID0 ========================================================== 22:38:29 (1761964709) [ 1699.465878] Lustre: DEBUG MARKER: == sanity test 270e: DoM: lfs find with DoM files test === 22:38:31 (1761964711) [ 1702.168406] Lustre: DEBUG MARKER: == sanity test 270f: DoM: maximum DoM stripe size checks ========================================================== 22:38:33 (1761964713) [ 1704.241872] Lustre: Increasing provided stripe size to a minimum value 64 [ 1708.653093] Lustre: DEBUG MARKER: == sanity test 270g: DoM: default DoM stripe size depends on free space ========================================================== 22:38:40 (1761964720) [ 1711.358610] Lustre: *** cfs_fail_loc=168, val=40*** [ 1712.051303] Lustre: *** cfs_fail_loc=168, val=20*** [ 1712.053012] Lustre: Skipped 2 previous similar messages [ 1713.412212] Lustre: *** cfs_fail_loc=168, val=15*** [ 1713.413564] Lustre: Skipped 5 previous similar messages [ 1717.926109] Lustre: DEBUG MARKER: == sanity test 270h: DoM: DoM stripe removal when disabled on server ========================================================== 22:38:49 (1761964729) [ 1721.310503] Lustre: DEBUG MARKER: == sanity test 270i: DoM: setting invalid DoM striping should fail ========================================================== 22:38:53 (1761964733) [ 1723.612355] Lustre: DEBUG MARKER: == sanity test 270j: DoM migration: DOM file to the OST-striped file (plain) ========================================================== 22:38:55 (1761964735) [ 1726.353706] Lustre: DEBUG MARKER: == sanity test 271a: DoM: data is cached for read after write ========================================================== 22:38:58 (1761964738) [ 1728.709347] Lustre: DEBUG MARKER: == sanity test 271b: DoM: no glimpse RPC for stat (DoM only file) ========================================================== 22:39:00 (1761964740) [ 1731.221118] Lustre: DEBUG MARKER: == sanity test 271ba: DoM: no glimpse RPC for stat (combined file) ========================================================== 22:39:02 (1761964742) [ 1734.078481] Lustre: DEBUG MARKER: == sanity test 271c: DoM: IO lock at open saves enqueue RPCs ========================================================== 22:39:05 (1761964745) [ 1771.311449] Lustre: DEBUG MARKER: == sanity test 271d: DoM: read on open (1K file in reply buffer) ========================================================== 22:39:42 (1761964782) [ 1774.279504] Lustre: DEBUG MARKER: == sanity test 271f: DoM: read on open (200K file and read tail) ========================================================== 22:39:45 (1761964785) [ 1776.769084] Lustre: DEBUG MARKER: == sanity test 271g: Discard DoM data vs client flush race ========================================================== 22:39:48 (1761964788) [ 1779.921720] Lustre: DEBUG MARKER: == sanity test 272a: DoM migration: new layout with the same DOM component ========================================================== 22:39:51 (1761964791) [ 1782.593644] Lustre: DEBUG MARKER: == sanity test 272b: DoM migration: DOM file to the OST-striped file (plain) ========================================================== 22:39:54 (1761964794) [ 1787.009743] Lustre: DEBUG MARKER: == sanity test 272c: DoM migration: DOM file to the OST-striped file (composite) ========================================================== 22:39:58 (1761964798) [ 1790.972915] Lustre: DEBUG MARKER: == sanity test 272d: DoM mirroring: OST-striped mirror to DOM file ========================================================== 22:40:02 (1761964802) [ 1794.784353] Lustre: DEBUG MARKER: == sanity test 272e: DoM mirroring: DOM mirror to the OST-striped file ========================================================== 22:40:06 (1761964806) [ 1798.156370] Lustre: DEBUG MARKER: == sanity test 272f: DoM migration: OST-striped file to DOM file ========================================================== 22:40:09 (1761964809) [ 1801.520638] Lustre: DEBUG MARKER: == sanity test 273a: DoM: layout swapping should fail with DOM ========================================================== 22:40:13 (1761964813) [ 1804.361222] Lustre: DEBUG MARKER: == sanity test 273b: DoM: race writeback and object destroy ========================================================== 22:40:16 (1761964816) [ 1805.353629] LustreError: 100227:0:(mdt_io.c:592:mdt_commitrw_write()) cfs_fail_timeout id 16b sleeping for 2000ms [ 1807.439113] LustreError: 100227:0:(mdt_io.c:592:mdt_commitrw_write()) cfs_fail_timeout id 16b awake [ 1809.802563] Lustre: DEBUG MARKER: == sanity test 273c: race writeback and object destroy === 22:40:21 (1761964821) [ 1810.750248] LustreError: 8344:0:(ofd_io.c:1299:ofd_commitrw_write()) cfs_fail_timeout id 1e1 sleeping for 2000ms [ 1812.839178] LustreError: 8344:0:(ofd_io.c:1299:ofd_commitrw_write()) cfs_fail_timeout id 1e1 awake [ 1815.202977] Lustre: DEBUG MARKER: == sanity test 275: Read on a canceled duplicate lock ==== 22:40:26 (1761964826) [ 1819.608229] Lustre: DEBUG MARKER: == sanity test 276: Race between mount and obd_statfs ==== 22:40:31 (1761964831) [ 1820.446727] Lustre: Failing over lustre-OST0000 [ 1820.447229] LustreError: 104144:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1820.475669] LustreError: 104139:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1820.478742] LustreError: 104139:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1820.498604] Lustre: server umount lustre-OST0000 complete [ 1821.632459] LustreError: 8337:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1821.640175] LustreError: 8337:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 1822.183359] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1822.186868] Lustre: Skipped 1 previous similar message [ 1823.944672] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1824.069286] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1824.079163] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1825.587040] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1825.997716] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 1825.997906] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1826.001692] Lustre: Skipped 1 previous similar message [ 1826.404578] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1827.908652] Lustre: Failing over lustre-OST0000 [ 1827.909594] LustreError: 106591:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1827.949647] Lustre: server umount lustre-OST0000 complete [ 1831.430000] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1831.489413] LustreError: 107757:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1831.554063] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1833.946365] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1835.373813] Lustre: Failing over lustre-OST0000 [ 1835.413261] Lustre: server umount lustre-OST0000 complete [ 1838.811233] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1838.871479] LustreError: 110231:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1838.935666] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1841.244806] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1842.838759] Lustre: Failing over lustre-OST0000 [ 1842.889378] Lustre: server umount lustre-OST0000 complete [ 1846.393404] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1846.550141] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1846.552026] Lustre: Skipped 2 previous similar messages [ 1848.997691] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1850.631516] Lustre: Failing over lustre-OST0000 [ 1850.632754] LustreError: 113957:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1850.636897] LustreError: 113957:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1850.679722] Lustre: server umount lustre-OST0000 complete [ 1854.080731] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1854.192854] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1854.195311] Lustre: Skipped 1 previous similar message [ 1856.663076] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1858.294849] Lustre: Failing over lustre-OST0000 [ 1858.346033] Lustre: server umount lustre-OST0000 complete [ 1861.868642] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1861.928856] LustreError: 117553:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1861.931479] LustreError: 117553:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1864.341992] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1865.831783] Lustre: Failing over lustre-OST0000 [ 1865.871930] Lustre: server umount lustre-OST0000 complete [ 1869.342598] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1871.821198] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1873.323937] Lustre: Failing over lustre-OST0000 [ 1873.363414] Lustre: server umount lustre-OST0000 complete [ 1876.665218] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1876.789601] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1876.793434] Lustre: Skipped 2 previous similar messages [ 1878.939909] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1880.389919] Lustre: Failing over lustre-OST0000 [ 1880.390867] LustreError: 123779:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1880.394673] LustreError: 123779:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1880.439372] Lustre: server umount lustre-OST0000 complete [ 1883.667797] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1883.782460] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1883.785188] Lustre: Skipped 4 previous similar messages [ 1885.890180] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1887.291216] Lustre: Failing over lustre-OST0000 [ 1887.320127] LustreError: 126264:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1887.322144] LustreError: 126264:0:(obd_class.h:479:obd_check_dev()) Skipped 35 previous similar messages [ 1887.341409] Lustre: server umount lustre-OST0000 complete [ 1889.253156] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1889.256088] Lustre: Skipped 17 previous similar messages [ 1890.562049] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1892.035702] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1892.039442] Lustre: Skipped 8 previous similar messages [ 1892.151583] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1892.151591] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 1892.154380] Lustre: Skipped 17 previous similar messages [ 1892.157977] Lustre: Skipped 8 previous similar messages [ 1892.727564] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1894.093446] Lustre: Failing over lustre-OST0000 [ 1894.137428] Lustre: server umount lustre-OST0000 complete [ 1897.293842] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1899.533886] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1900.946287] Lustre: Failing over lustre-OST0000 [ 1901.001089] Lustre: server umount lustre-OST0000 complete [ 1904.293572] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1906.596947] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1908.008900] Lustre: Failing over lustre-OST0000 [ 1908.055637] Lustre: server umount lustre-OST0000 complete [ 1911.530290] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1911.671167] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1911.676410] Lustre: Skipped 4 previous similar messages [ 1913.991401] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1915.400474] Lustre: Failing over lustre-OST0000 [ 1915.402035] LustreError: 136242:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 1915.404119] LustreError: 136242:0:(obd_class.h:479:obd_check_dev()) Skipped 6 previous similar messages [ 1915.442756] Lustre: server umount lustre-OST0000 complete [ 1918.621644] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1920.915579] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1922.289846] Lustre: Failing over lustre-OST0000 [ 1922.331354] Lustre: server umount lustre-OST0000 complete [ 1925.397892] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1927.643880] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1929.003022] Lustre: Failing over lustre-OST0000 [ 1929.039968] Lustre: server umount lustre-OST0000 complete [ 1932.221985] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1934.409703] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1935.790491] Lustre: Failing over lustre-OST0000 [ 1935.837386] Lustre: server umount lustre-OST0000 complete [ 1939.131737] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1941.530030] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1942.905040] Lustre: Failing over lustre-OST0000 [ 1942.950035] Lustre: server umount lustre-OST0000 complete [ 1946.048806] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1948.207320] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1949.555271] Lustre: Failing over lustre-OST0000 [ 1949.607238] Lustre: server umount lustre-OST0000 complete [ 1951.205840] LustreError: 58395:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1951.210857] LustreError: 58395:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 48 previous similar messages [ 1952.812781] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1952.948878] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1952.950989] Lustre: Skipped 9 previous similar messages [ 1955.146270] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1956.493796] Lustre: Failing over lustre-OST0000 [ 1956.530275] Lustre: server umount lustre-OST0000 complete [ 1959.678830] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1961.924392] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1965.138618] Lustre: DEBUG MARKER: == sanity test 277: Direct IO shall drop page cache ====== 22:42:56 (1761964976) [ 1967.771847] Lustre: DEBUG MARKER: == sanity test 278: Race starting MDS between MDTs stop/start ========================================================== 22:42:59 (1761964979) [ 1968.929164] Lustre: Failing over lustre-MDT0000 [ 1969.035326] Lustre: Failing over lustre-MDT0001 [ 1969.198508] LustreError: 154364:0:(tgt_mount.c:1970:server_put_super()) cfs_race id 60c sleeping [ 1969.256476] Lustre: server umount lustre-MDT0000 complete [ 1972.139115] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1972.180927] LustreError: MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1972.189682] LustreError: 154812:0:(tgt_mount.c:1695:server_start_targets()) cfs_fail_race id 60c waking [ 1972.192603] LustreError: 154364:0:(tgt_mount.c:1970:server_put_super()) cfs_fail_race id 60c awake: rc=2008 [ 1972.214729] Lustre: server umount lustre-MDT0001 complete [ 1974.336304] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1974.338213] Lustre: Skipped 1 previous similar message [ 1975.689611] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1978.769417] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1978.889311] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_connect to node 0@lo failed: rc = -114 [ 1978.893446] LustreError: Skipped 1 previous similar message [ 1980.229863] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 1981.796336] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 [ 1984.154880] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:19559 to 0x2c0000400:19585) [ 1984.154880] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:19602 to 0x280000400:19617) [ 1984.189500] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6876 to 0x2c0000401:6913) [ 1984.189637] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6947 to 0x280000401:6977) [ 1989.105069] Lustre: DEBUG MARKER: == sanity test 280: Race between MGS umount and client llog processing ========================================================== 22:43:20 (1761965000) [ 1989.947899] LustreError: 154820:0:(llog_osd.c:1484:llog_osd_open()) cfs_race id 15e sleeping [ 1991.527266] Lustre: Failing over lustre-MDT0000 [ 1991.603841] LustreError: 156545:0:(tgt_mount.c:128:server_deregister_mount()) cfs_fail_race id 15e waking [ 1991.607063] LustreError: 154820:0:(llog_osd.c:1484:llog_osd_open()) cfs_fail_race id 15e awake: rc=3342 [ 1992.675734] LustreError: 156545:0:(tgt_mount.c:128:server_deregister_mount()) cfs_fail_race id 15e waking [ 1992.695248] Lustre: server umount lustre-MDT0000 complete [ 1995.635353] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1995.675198] LustreError: MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1995.690305] LustreError: 157002:0:(llog_osd.c:1484:llog_osd_open()) cfs_fail_race id 15e waking [ 1996.763234] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) cfs_fail_race id 15e waking [ 1997.793444] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) cfs_fail_race id 15e waking [ 1999.846142] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) cfs_fail_race id 15e waking [ 1999.847901] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) Skipped 1 previous similar message [ 2003.936943] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) cfs_fail_race id 15e waking [ 2003.938960] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) Skipped 3 previous similar messages [ 2005.987327] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2005.991694] Lustre: Skipped 1 previous similar message [ 2007.278680] Lustre: DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug all all [ 2008.058463] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6876 to 0x2c0000401:6945) [ 2008.058485] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6947 to 0x280000401:7009) [ 2012.075859] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) cfs_fail_race id 15e waking [ 2012.077633] LustreError: 157001:0:(llog_osd.c:1484:llog_osd_open()) Skipped 5 previous similar messages [ 2016.481144] Lustre: DEBUG MARKER: == sanity test 300a: basic striped dir sanity test ======= 22:43:48 (1761965028) [ 2019.529048] Lustre: DEBUG MARKER: == sanity test 300b: check ctime/mtime for striped dir === 22:43:51 (1761965031) [ 2042.930822] Lustre: DEBUG MARKER: == sanity test 300c: chown [ 2105.613513] Lustre: DEBUG MARKER: == sanity test 300d: check default stripe under striped directory ========================================================== 22:45:17 (1761965117) [ 2108.874828] Lustre: DEBUG MARKER: == sanity test 300e: check rename under striped directory ========================================================== 22:45:20 (1761965120) [ 2112.078306] Lustre: DEBUG MARKER: == sanity test 300f: check rename cross striped directory ========================================================== 22:45:23 (1761965123) [ 2115.223103] Lustre: DEBUG MARKER: == sanity test 300g: check default striped directory for normal directory ========================================================== 22:45:26 (1761965126) [ 2120.795555] Lustre: DEBUG MARKER: == sanity test 300h: check default striped directory for striped directory ========================================================== 22:45:32 (1761965132) [ 2125.963478] Lustre: DEBUG MARKER: == sanity test 300i: client handle unknown hash type striped directory ========================================================== 22:45:37 (1761965137) [ 2160.891609] Lustre: DEBUG MARKER: == sanity test 300j: test large update record ============ 22:46:12 (1761965172) [ 2163.397372] Lustre: DEBUG MARKER: == sanity test 300k: test large striped directory ======== 22:46:15 (1761965175) [ 2166.692598] Lustre: DEBUG MARKER: == sanity test 300l: non-root user to create dir under striped dir with stale layout ========================================================== 22:46:18 (1761965178) [ 2170.181934] Lustre: DEBUG MARKER: == sanity test 300m: setstriped directory on single MDT FS ========================================================== 22:46:21 (1761965181) [ 2170.822622] Lustre: DEBUG MARKER: SKIP: sanity test_300m Only for single MDT [ 2171.508617] Lustre: DEBUG MARKER: == sanity test 300n: non-root user to create dir under striped dir with default EA ========================================================== 22:46:23 (1761965183) [ 2177.076969] Lustre: DEBUG MARKER: SKIP: sanity test_300o skipping SLOW test 300o [ 2177.781785] Lustre: DEBUG MARKER: == sanity test 300p: create striped directory without space ========================================================== 22:46:29 (1761965189) [ 2178.225336] Lustre: *** cfs_fail_loc=1704, val=0*** [ 2178.227187] Lustre: 8348:0:(out_handler.c:879:out_tx_end()) lustre-MDT0001-osd: error during execution of #8 from /home/green/git/lustre-release/lustre/ptlrpc/../../lustre/target/out_handler.c:638: rc = -28 [ 2178.233851] LustreError: 8348:0:(out_handler.c:889:out_tx_end()) lustre-MDT0001-osd: undo for /home/green/git/lustre-release/lustre/ptlrpc/../../lustre/target/out_handler.c:410: rc = -524 [ 2180.529390] Lustre: DEBUG MARKER: == sanity test 300q: create remote directory under orphan directory ========================================================== 22:46:32 (1761965192) [ 2182.901228] Lustre: DEBUG MARKER: == sanity test 300r: test -1 striped directory =========== 22:46:34 (1761965194) [ 2185.235031] Lustre: DEBUG MARKER: == sanity test 300s: test lfs mkdir -c without -i ======== 22:46:36 (1761965196) [ 2187.636526] Lustre: DEBUG MARKER: == sanity test 300t: test max_mdt_stripecount ============ 22:46:39 (1761965199) [ 2191.367792] Lustre: DEBUG MARKER: == sanity test 300ua: basic overstriped dir sanity test == 22:46:43 (1761965203) [ 2192.142434] Lustre: 6497:0:(osd_handler.c:2182:osd_trans_start()) lustre-MDT0000: credits 3644 > trans_max 3200 [ 2192.144707] Lustre: 6497:0:(osd_handler.c:2081:osd_trans_dump_creds()) create: 7/28/0, destroy: 0/0/0 [ 2192.146603] Lustre: 6497:0:(osd_handler.c:2088:osd_trans_dump_creds()) attr_set: 3/3/0, xattr_set: 16/2935/0 [ 2192.148756] Lustre: 6497:0:(osd_handler.c:2098:osd_trans_dump_creds()) write: 5/58/0, punch: 0/0/0, quota 0/0/0 [ 2192.150762] Lustre: 6497:0:(osd_handler.c:2105:osd_trans_dump_creds()) insert: 31/603/0, delete: 0/0/0 [ 2192.152802] Lustre: 6497:0:(osd_handler.c:2112:osd_trans_dump_creds()) ref_add: 17/17/0, ref_del: 0/0/0 [ 2192.154591] CPU: 0 PID: 6497 Comm: mdt00_003 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 [ 2192.156797] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-2.fc40 04/01/2014 [ 2192.158528] Call Trace: [ 2192.159057] ? dump_stack+0xbb/0x10e [ 2192.159929] ? osd_trans_start+0x8db/0x9d0 [osd_ldiskfs] [ 2192.161308] ? top_trans_start+0x3f6/0xd80 [ptlrpc] [ 2192.162517] ? lod_trans_start+0x109/0x4c0 [lod] [ 2192.163465] ? mdd_trans_start+0x18/0x30 [mdd] [ 2192.164377] ? mdd_create+0xa6a/0x1d00 [mdd] [ 2192.165313] ? mdd_links_rename+0x550/0x550 [mdd] [ 2192.166302] ? mdt_create+0xcd7/0x1e50 [mdt] [ 2192.167189] ? mdt_reint_create+0x336/0x5d0 [mdt] [ 2192.168161] ? mdt_reint_rec+0x139/0x2b0 [mdt] [ 2192.169088] ? mdt_reint_internal+0x6a0/0xdc0 [mdt] [ 2192.170273] ? mdt_reint+0x163/0x190 [mdt] [ 2192.171057] ? tgt_handle_request0+0x137/0xaf0 [ptlrpc] [ 2192.172321] ? tgt_request_handle+0x573/0x1e70 [ptlrpc] [ 2192.173471] ? ptlrpc_server_handle_request+0x443/0x13b0 [ptlrpc] [ 2192.174882] ? lprocfs_counter_add+0x15b/0x210 [obdclass] [ 2192.176155] ? ptlrpc_main+0xce8/0x1400 [ptlrpc] [ 2192.177259] ? ptlrpc_wait_event+0x980/0x980 [ptlrpc] [ 2192.178517] ? kthread+0x1d1/0x200 [ 2192.179352] ? set_kthread_struct+0x70/0x70 [ 2192.180224] ? ret_from_fork+0x1f/0x30 [ 2192.188291] Lustre: 8349:0:(osd_internal.h:1471:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 3204 < left 3580, rollback = 2 [ 2194.664359] Lustre: DEBUG MARKER: == sanity test 300ub: test MDT overstriping interface [ 2194.793992] Lustre: 8349:0:(osd_internal.h:1471:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 3204 < left 3594, rollback = 2 [ 2194.798279] Lustre: 8349:0:(osd_internal.h:1471:osd_trans_exec_op()) Skipped 14 previous similar messages [ 2194.802123] Lustre: 8349:0:(osd_handler.c:2081:osd_trans_dump_creds()) create: 5/20/0, destroy: 0/0/0 [ 2194.806436] Lustre: 8349:0:(osd_handler.c:2081:osd_trans_dump_creds()) Skipped 15 previous similar messages [ 2194.810456] Lustre: 8349:0:(osd_handler.c:2088:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 21/3594/0 [ 2194.814726] Lustre: 8349:0:(osd_handler.c:2088:osd_trans_dump_creds()) Skipped 15 previous similar messages [ 2194.818612] Lustre: 8349:0:(osd_handler.c:2098:osd_trans_dump_creds()) write: 5/32/0, punch: 0/0/0, quota 1/3/0 [ 2194.822222] Lustre: 8349:0:(osd_handler.c:2098:osd_trans_dump_creds()) Skipped 15 previous similar messages [ 2194.825571] Lustre: 8349:0:(osd_handler.c:2105:osd_trans_dump_creds()) insert: 15/345/0, delete: 0/0/0 [ 2194.828556] Lustre: 8349:0:(osd_handler.c:2105:osd_trans_dump_creds()) Skipped 15 previous similar messages [ 2194.831745] Lustre: 8349:0:(osd_handler.c:2112:osd_trans_dump_creds()) ref_add: 5/5/0, ref_del: 0/0/0 [ 2194.835484] Lustre: 8349:0:(osd_handler.c:2112:osd_trans_dump_creds()) Skipped 15 previous similar messages [ 2197.375782] Lustre: DEBUG MARKER: == sanity test 300uc: test MDT overstriping as default [ 2199.836850] Lustre: DEBUG MARKER: == sanity test 300ud: dir split ========================== 22:46:51 (1761965211) [ 2287.592415] Lustre: DEBUG MARKER: == sanity test 398k: test enospc on first stripe ========= 22:48:19 (1761965299) [ 2288.156056] Lustre: DEBUG MARKER: sanity test_398k: @@@@@@ FAIL: test_398k failed with 127