[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 574199513 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b30-0x000f5b3f] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F5950 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE1BB7 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE1A53 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 001A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE1AC7 000090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE1B57 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE1B8F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe1a53-0xbffe1ac6] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a52] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe1ac7-0xbffe1b56] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe1b57-0xbffe1b8e] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe1b8f-0xbffe1bb6] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.002338] x2apic enabled [ 0.003006] Switched APIC routing to physical x2apic. [ 0.004010] kvm-guest: setup PV IPIs [ 0.008000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008046] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009000] pid_max: default: 32768 minimum: 301 [ 0.009171] LSM: Security Framework initializing [ 0.010057] Yama: becoming mindful. [ 0.011032] SELinux: Initializing. [ 0.012072] *** VALIDATE selinux *** [ 0.020608] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025567] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026146] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.027103] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028115] *** VALIDATE tmpfs *** [ 0.030423] *** VALIDATE proc *** [ 0.032219] *** VALIDATE cgroup *** [ 0.033019] *** VALIDATE cgroup2 *** [ 0.034276] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.036006] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.037004] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.038023] Spectre V2 : User space: Vulnerable [ 0.039006] Speculative Store Bypass: Vulnerable [ 0.042510] debug: unmapping init [mem 0xffffffffac659000-0xffffffffac660fff] [ 0.044154] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.045791] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.046018] ... version: 2 [ 0.047008] ... bit width: 48 [ 0.048008] ... generic registers: 4 [ 0.049013] ... value mask: 0000ffffffffffff [ 0.050015] ... max period: 00007fffffffffff [ 0.051019] ... fixed-purpose events: 3 [ 0.052007] ... event mask: 000000070000000f [ 0.053272] rcu: Hierarchical SRCU implementation. [ 0.055558] smp: Bringing up secondary CPUs ... [ 0.056642] x86: Booting SMP configuration: [ 0.057035] .... node #0, CPUs: #1 #2 #3 [ 0.066340] smp: Brought up 1 node, 4 CPUs [ 0.068009] smpboot: Max logical packages: 1 [ 0.069013] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.123513] node 0 deferred pages initialised in 51ms [ 0.129144] devtmpfs: initialized [ 0.130000] x86/mm: Memory block size: 128MB [ 0.132610] gcov: version magic: 0x41383552 [ 0.139195] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.140080] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.141000] pinctrl core: initialized pinctrl subsystem [ 0.141000] [ 0.143011] ************************************************************* [ 0.145018] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.148013] ** ** [ 0.150017] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.153015] ** ** [ 0.156019] ** This means that this kernel is built to expose internal ** [ 0.158294] ** IOMMU data structures, which may compromise security on ** [ 0.162016] ** your system. ** [ 0.165033] ** ** [ 0.168025] ** If you see this message and you are not debugging the ** [ 0.171017] ** kernel, report this immediately to your vendor! ** [ 0.174025] ** ** [ 0.177012] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.180012] ************************************************************* [ 0.182835] NET: Registered protocol family 16 [ 0.184604] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.188054] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.191056] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.195009] cpuidle: using governor menu [ 0.196465] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.198654] PCI: Using configuration type 1 for base access [ 0.201133] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.212411] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.213000] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.216040] cryptd: max_cpu_qlen set to 1000 [ 0.221880] ACPI: Added _OSI(Module Device) [ 0.222000] ACPI: Added _OSI(Processor Device) [ 0.222000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.222000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.222000] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.234490] ACPI: Interpreter enabled [ 0.236073] ACPI: PM: (supports S0 S3 S4 S5) [ 0.238011] ACPI: Using IOAPIC for interrupt routing [ 0.240114] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.244364] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.254000] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.256031] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.259019] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.262080] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.267473] acpiphp: Slot [2] registered [ 0.269092] acpiphp: Slot [3] registered [ 0.270069] acpiphp: Slot [4] registered [ 0.271014] acpiphp: Slot [5] registered [ 0.272000] acpiphp: Slot [6] registered [ 0.272000] acpiphp: Slot [7] registered [ 0.274086] acpiphp: Slot [8] registered [ 0.275115] acpiphp: Slot [9] registered [ 0.278098] acpiphp: Slot [10] registered [ 0.279110] acpiphp: Slot [11] registered [ 0.281066] acpiphp: Slot [12] registered [ 0.285133] acpiphp: Slot [13] registered [ 0.287073] acpiphp: Slot [14] registered [ 0.291153] acpiphp: Slot [15] registered [ 0.292093] acpiphp: Slot [16] registered [ 0.293000] acpiphp: Slot [17] registered [ 0.293000] acpiphp: Slot [18] registered [ 0.294124] acpiphp: Slot [19] registered [ 0.296097] acpiphp: Slot [20] registered [ 0.298096] acpiphp: Slot [21] registered [ 0.299080] acpiphp: Slot [22] registered [ 0.301091] acpiphp: Slot [23] registered [ 0.302114] acpiphp: Slot [24] registered [ 0.304078] acpiphp: Slot [25] registered [ 0.305074] acpiphp: Slot [26] registered [ 0.306100] acpiphp: Slot [27] registered [ 0.308085] acpiphp: Slot [28] registered [ 0.310099] acpiphp: Slot [29] registered [ 0.311063] acpiphp: Slot [30] registered [ 0.313092] acpiphp: Slot [31] registered [ 0.314054] PCI host bridge to bus 0000:00 [ 0.315016] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.317018] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.319012] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.321016] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.324025] pci_bus 0000:00: root bus resource [mem 0x180000000-0x1ffffffff window] [ 0.326016] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.328146] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.332133] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.337773] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.349841] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.354013] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.356017] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.358012] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.361018] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.364454] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.366685] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.376042] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.382099] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x1e0 took 15625 usecs [ 0.385595] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.389982] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.407018] pci 0000:00:02.0: reg 0x20: [mem 0xfebe4000-0xfebe7fff 64bit pref] [ 0.413021] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.422488] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.432016] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.441015] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.453013] pci 0000:00:05.0: reg 0x20: [mem 0xfebe8000-0xfebebfff 64bit pref] [ 0.461000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.471014] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.474012] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.486014] pci 0000:00:06.0: reg 0x20: [mem 0xfebec000-0xfebeffff 64bit pref] [ 0.496493] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.501013] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.507014] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.523000] pci 0000:00:07.0: reg 0x20: [mem 0xfebf0000-0xfebf3fff 64bit pref] [ 0.528654] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.531014] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.534016] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.562017] pci 0000:00:08.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.588959] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.603015] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.609012] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.627012] pci 0000:00:09.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.638207] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.644014] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.650015] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.665019] pci 0000:00:0a.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.676000] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.678377] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.681448] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.684380] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.687241] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.691094] iommu: Default domain type: Passthrough [ 0.697587] SCSI subsystem initialized [ 0.704137] ACPI: bus type USB registered [ 0.710213] usbcore: registered new interface driver usbfs [ 0.712054] usbcore: registered new interface driver hub [ 0.724090] usbcore: registered new device driver usb [ 0.725218] pps_core: LinuxPPS API ver. 1 registered [ 0.730013] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.735138] PTP clock support registered [ 0.738047] EDAC MC: Ver: 3.0.0 [ 0.739553] PCI: Using ACPI for IRQ routing [ 0.744730] NetLabel: Initializing [ 0.745008] NetLabel: domain hash size = 128 [ 0.747009] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.751099] NetLabel: unlabeled traffic allowed by default [ 0.753170] vgaarb: loaded [ 0.756456] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.757011] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.763405] clocksource: Switched to clocksource kvm-clock [ 0.944900] VFS: Disk quotas dquot_6.6.0 [ 0.952107] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.958611] *** VALIDATE ramfs *** [ 0.959643] *** VALIDATE hugetlbfs *** [ 0.976637] pnp: PnP ACPI init [ 0.982170] pnp: PnP ACPI: found 6 devices [ 1.030526] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.038956] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.041168] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.051226] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.058764] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.062244] pci_bus 0000:00: resource 8 [mem 0x180000000-0x1ffffffff window] [ 1.069517] NET: Registered protocol family 2 [ 1.072940] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.078815] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.083485] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.088981] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.092968] TCP: Hash tables configured (established 65536 bind 65536) [ 1.095452] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.098132] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.100655] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.103220] NET: Registered protocol family 1 [ 1.107825] RPC: Registered named UNIX socket transport module. [ 1.110585] RPC: Registered udp transport module. [ 1.112302] RPC: Registered tcp transport module. [ 1.113791] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.116357] NET: Registered protocol family 44 [ 1.118022] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.122759] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.128528] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.134198] PCI: CLS 0 bytes, default 64 [ 1.135572] Unpacking initramfs... [ 3.113271] debug: unmapping init [mem 0xffff8f077cc54000-0xffff8f077ffbffff] [ 3.123110] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.127020] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 3.135245] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 4.104665] Initialise system trusted keyrings [ 4.106161] Key type blacklist registered [ 4.108975] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 4.117250] zbud: loaded [ 4.123442] *** VALIDATE nfs *** [ 4.125679] *** VALIDATE nfs4 *** [ 4.127703] pstore: using deflate compression [ 4.134695] Platform Keyring initialized [ 4.329669] NET: Registered protocol family 38 [ 4.338848] Key type asymmetric registered [ 4.340253] Asymmetric key parser 'x509' registered [ 4.351968] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 4.356773] io scheduler mq-deadline registered [ 4.360263] io scheduler kyber registered [ 4.361670] io scheduler bfq registered [ 4.365470] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 4.368716] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.371559] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 4.376413] ACPI: Power Button [PWRF] [ 4.520458] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 4.640422] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 4.914340] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 5.087770] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 5.370048] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 5.420802] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 5.475091] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 5.485435] Non-volatile memory driver v1.3 [ 5.489353] Linux agpgart interface v0.103 [ 5.543755] virtio_blk virtio1: [vda] 133640 512-byte logical blocks (68.4 MB/65.3 MiB) [ 5.546566] vda: detected capacity change from 0 to 68423680 [ 5.569407] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 5.574122] vdb: detected capacity change from 0 to 1073741824 [ 5.604882] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 5.613178] vdc: detected capacity change from 0 to 2621440000 [ 5.634579] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 5.639410] vdd: detected capacity change from 0 to 2621440000 [ 5.666957] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 5.670131] vde: detected capacity change from 0 to 4294967296 [ 5.698527] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 5.704743] vdf: detected capacity change from 0 to 4294967296 [ 5.717313] libphy: Fixed MDIO Bus: probed [ 5.726717] usbcore: registered new interface driver usbserial_generic [ 5.731389] usbserial: USB Serial support registered for generic [ 5.736808] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 5.744726] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 5.749792] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 5.751788] mousedev: PS/2 mouse device common for all mice [ 5.755393] rtc_cmos 00:05: RTC can wake from S4 [ 5.758785] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 5.766630] rtc_cmos 00:05: registered as rtc0 [ 5.770663] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 5.775513] intel_pstate: CPU model not supported [ 5.776520] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 5.780834] hid: raw HID events driver (C) Jiri Kosina [ 5.790309] usbcore: registered new interface driver usbhid [ 5.795181] usbhid: USB HID core driver [ 5.798270] drop_monitor: Initializing network drop monitor service [ 5.804499] Initializing XFRM netlink socket [ 5.806958] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 5.813894] NET: Registered protocol family 10 [ 5.817171] Segment Routing with IPv6 [ 5.822035] NET: Registered protocol family 17 [ 5.823661] mpls_gso: MPLS GSO support [ 5.828437] RAS: Correctable Errors collector initialized. [ 5.834130] AVX version of gcm_enc/dec engaged. [ 5.835620] AES CTR mode by8 optimization enabled [ 5.965689] sched_clock: Marking stable (5965645727, 0)->(7017864820, -1052219093) [ 5.978513] registered taskstats version 1 [ 5.980603] Loading compiled-in X.509 certificates [ 5.982283] zswap: loaded using pool lzo/zbud [ 6.035324] Key type big_key registered [ 6.056308] Key type encrypted registered [ 6.057774] ima: No TPM chip found, activating TPM-bypass! [ 6.059740] ima: Allocated hash algorithm: sha1 [ 6.064506] ima: No architecture policies found [ 6.065974] evm: Initialising EVM extended attributes: [ 6.067716] evm: security.selinux [ 6.068808] evm: security.ima [ 6.069805] evm: security.capability [ 6.071096] evm: HMAC attrs: 0x1 [ 6.075807] rtc_cmos 00:05: setting system clock to 2025-12-03 19:41:55 UTC (1764790915) [ 6.088784] debug: unmapping init [mem 0xffffffffad603000-0xffffffffad7fffff] [ 6.092432] debug: unmapping init [mem 0xffffffffac382000-0xffffffffac658fff] [ 6.101119] Write protecting the kernel read-only data: 28672k [ 6.104153] debug: unmapping init [mem 0xffffffffaaa03000-0xffffffffaabfffff] [ 6.112721] debug: unmapping init [mem 0xffffffffab314000-0xffffffffab3fffff] [ 6.163979] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 6.177047] systemd[1]: Detected virtualization kvm. [ 6.180868] systemd[1]: Detected architecture x86-64. [ 6.183130] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 6.239300] systemd[1]: No hostname configured. [ 6.244495] systemd[1]: Set hostname to . [ 6.246906] random: systemd: uninitialized urandom read (16 bytes read) [ 6.249140] systemd[1]: Initializing machine ID from random generator. [ 6.374778] random: ln: uninitialized urandom read (6 bytes read) [ 6.546444] random: systemd: uninitialized urandom read (16 bytes read) [ 6.549861] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 6.561502] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 6.569111] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Reached target Swap. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on udev Control Socket. [ OK ] Listening on Journal Socket. Starting Create list of required st…ce nodes for the current kernel... Starting Apply Kernel Variables... [ OK ] Started Memstrack Anylazing Service. Starting Create Volatile Files and Directories... [ OK ] Reached target Paths. [ OK ] Reached target Timers. [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Setup Virtual Console... [ OK ] Reached target Slices. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 7.817151] device-mapper: uevent: version 1.0.3 [ 7.822855] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 9.325532] virtio_net virtio0 ens2: renamed from eth0 [ 9.344166] random: fast init done [ 9.581425] scsi host0: ata_piix [ 9.670540] scsi host1: ata_piix [ 9.676559] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 9.691126] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 14.595474] random: crng init done [ 14.596940] random: 7 urandom warning(s) missed due to ratelimiting [ 15.770420] dracut-initqueue[592]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 17.474812] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 20.270720] printk: systemd: 26 output lines suppressed due to ratelimiting [ 21.074088] SELinux: Disabled at runtime. [ 21.135400] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 21.142965] systemd[1]: Detected virtualization kvm. [ 21.144822] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 22.208193] systemd[1]: initrd-switch-root.service: Succeeded. [ 22.213508] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 22.223836] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 22.233108] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 22.239603] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 22.252307] systemd[1]: Starting Journal Service... Starting Journal Service... [ 22.265893] systemd[1]: Created slice system-getty.slice. [ OK ] Created slice system-getty.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Created slice User and Session Slice. [ OK ] Listening on udev Control Socket. Mounting Huge Pages File System... [ OK ] Listening on Process Core Dump Socket. Mounting Kernel Debug File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Started Dispatch Password Requests to Console Directory Watch. Starting Apply Kernel Variables... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target rpc_pipefs.target. Mounting POSIX Message Queue File System... Starting Remount Root and Kernel File Systems... [ OK ] Reached target Slices. Activating swap /dev/disk/by-label/SWAP... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Encrypted Volumes. [ 22.703977] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 23.523050] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 24.354719] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 24.403908] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 25.336535] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 25.395689] EDAC sbridge: Ver: 1.1.2 [ 28.415643] Key type dns_resolver registered [ 28.829957] NFS: Registering the id_resolver key type [ 28.832244] Key type id_resolver registered [ 28.834585] Key type id_legacy registered [* ] A start job is running for Configur…-only root support (7s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... Starting Rebuild Dynamic Linker Cache... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Basic System. Starting Login Service... [ OK ] Started irqbalance daemon. [ OK ] Started dnf makecache --timer. Starting Restore /run/initramfs on shutdown... [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg311-server login: [ 50.554737] spl: loading out-of-tree module taints kernel. [ 53.120252] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 57.424842] Key type ._llcrypt registered [ 57.426479] Key type .llcrypt registered [ 57.471418] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_hostid [ 65.004272] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local [ 65.568056] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 65.574220] alg: No test for adler32 (adler32-zlib) [ 66.543902] Lustre: Lustre: Build Version: 2.16.59_23_g5b5e124 [ 66.810161] LNet: Added LNI 192.168.203.111@tcp [8/256/0/180] [ 68.407129] Key type lgssc registered [ 68.992027] Lustre: Echo OBD driver; http://www.lustre.org/ [ 72.646712] vdc: vdc1 vdc9 [ 76.142273] vde: vde1 vde9 [ 80.200781] vdf: vdf1 vdf9 [ 87.695635] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local [ 92.181965] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 93.347638] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 93.471433] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 93.513581] Lustre: lustre-MDT0000: new disk, initializing [ 93.710816] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 93.748912] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 95.546872] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 98.138588] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 100.595717] Lustre: lustre-OST0000: new disk, initializing [ 100.598624] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 100.604040] Lustre: Skipped 1 previous similar message [ 100.645887] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 103.081566] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 103.084995] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 103.124767] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 103.175806] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 107.520550] Lustre: lustre-OST0001: new disk, initializing [ 107.523130] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 107.551878] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 109.389343] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 109.392757] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 109.423894] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 109.538864] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 115.444557] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 119.263695] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 128.504216] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing check_logdir /tmp/testlogs/ [ 132.816522] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing yml_node [ 136.923871] Lustre: DEBUG MARKER: Client: 2.16.59.23 [ 138.988203] Lustre: DEBUG MARKER: MDS: 2.16.59.23 [ 141.440056] Lustre: DEBUG MARKER: OSS: 2.16.59.23 [ 142.732897] Lustre: DEBUG MARKER: -----============= acceptance-small: replay-vbr ============----- Wed Dec 3 14:44:10 EST 2025 [ 158.556228] Lustre: DEBUG MARKER: excepting tests: [ 159.922522] Lustre: DEBUG MARKER: skipping tests SLOW=no: 7 [ 161.455536] Lustre: DEBUG MARKER: === replay-vbr: start setup 14:44:28 (1764791068) === [ 164.696811] Lustre: DEBUG MARKER: oleg311-client.virtnet: executing check_config_client /mnt/lustre [ 174.260684] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 175.925488] Lustre: 11043:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 177.517154] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 179.171507] Lustre: DEBUG MARKER: === replay-vbr: finish setup 14:44:47 (1764791087) === [ 180.431583] Lustre: DEBUG MARKER: == replay-vbr test 0a: getversion for non existent file shouldn't cause kernel panic ========================================================== 14:44:48 (1764791088) [ 183.493380] Lustre: DEBUG MARKER: == replay-vbr test 0b: getversion for non existent fid shouldn't cause kernel panic ========================================================== 14:44:51 (1764791091) [ 186.542923] Lustre: DEBUG MARKER: == replay-vbr test 1a: open and close do not change versions ========================================================== 14:44:54 (1764791094) [ 189.587880] Lustre: DEBUG MARKER: == replay-vbr test 1b: open (O_CREAT) checks version of parent ========================================================== 14:44:57 (1764791097) [ 191.491651] LustreError: 12450:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 191.854569] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 193.233557] Lustre: Failing over lustre-MDT0000 [ 193.386183] LustreError: 12595:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup [ 193.462642] Lustre: server umount lustre-MDT0000 complete [ 206.543572] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 206.696837] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 206.772439] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 208.103926] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 208.649034] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 211.807316] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791105/real 1764791105] req@ffff8f0801040a80 x1850517462498560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791121 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 211.937779] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 218.079186] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791111/real 1764791111] req@ffff8f07ffb6d880 x1850517462499072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791127 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 218.092970] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 278.000477] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 278.003508] Lustre: 13039:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client eac82939-4a6d-48fe-9072-5859062e69ce@ [ 278.009371] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 278.025972] LustreError: 13039:0:(mdt_handler.c:5284:mdt_intent_open()) @@@ Replay open failed with -75 req@ffff8f0801040700 x1850517453036288/t0(4294967311) o101->57c7caec-c182-4e5c-8f73-7864f4740e06@192.168.203.11@tcp:595/0 lens 584/608 e 6 to 0 dl 1764791200 ref 1 fl Complete:/604/0 rc 0/0 job:'openfile.0' uid:0 gid:0 projid:0 [ 278.116962] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 278.136283] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:3 to 0x240000400:33) [ 278.136450] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:33) [ 299.265672] Lustre: DEBUG MARKER: == replay-vbr test 1c: open (non O_CREAT) does not checks versions ========================================================== 14:46:46 (1764791206) [ 303.058772] LustreError: 13866:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 303.709503] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 308.962644] Lustre: Failing over lustre-MDT0000 [ 309.122679] LustreError: 14016:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 309.127747] LustreError: 14016:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 309.227721] Lustre: server umount lustre-MDT0000 complete [ 324.393072] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 324.576505] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 324.576555] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791218/real 1764791218] req@ffff8f07ed9e4e00 x1850517462523520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791234 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 324.581601] Lustre: lustre-MDT0000: Not available for connect from 0@lo (not set up) [ 324.582873] Lustre: Skipped 2 previous similar messages [ 324.728838] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 325.361509] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 327.612265] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 329.699441] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 329.701833] Lustre: Skipped 1 previous similar message [ 329.807154] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791223/real 1764791223] req@ffff8f0801042a00 x1850517462524032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791239 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 329.824777] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 334.751167] Lustre: 3296:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791228/real 1764791228] req@ffff8f07f681f800 x1850517462524288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 334.763885] Lustre: 3296:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 395.000272] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 395.003528] Lustre: 14449:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 29afc795-1e8b-4a4e-a311-e7800faa1fa4@ [ 395.009199] Lustre: 14449:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 395.012636] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 395.014526] Lustre: Skipped 1 previous similar message [ 395.065212] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 1 recovered and 1 was evicted. [ 395.087191] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:65) [ 395.088041] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) [ 398.801853] Lustre: DEBUG MARKER: == replay-vbr test 2a: create operations doesn't change version of parent ========================================================== 14:48:26 (1764791306) [ 406.329490] Lustre: DEBUG MARKER: == replay-vbr test 2b: create checks version of parent === 14:48:34 (1764791314) [ 409.053772] LustreError: 15846:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 409.468866] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 411.519228] Lustre: Failing over lustre-MDT0000 [ 411.617584] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 411.627760] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 411.633625] Lustre: Skipped 1 previous similar message [ 411.745714] LustreError: 15994:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 411.752191] LustreError: 15994:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 411.854212] Lustre: server umount lustre-MDT0000 complete [ 431.226568] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 432.525600] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 433.185677] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 433.194545] Lustre: Skipped 1 previous similar message [ 438.002764] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 438.957307] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 442.400648] hrtimer: interrupt took 5407174 ns [ 508.000161] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 508.004981] Lustre: 16432:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 5b4dc0f2-e743-48db-9e39-307c6895f072@ [ 508.010677] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 508.088874] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 508.108889] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:97) [ 508.109762] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:97) [ 528.982892] Lustre: DEBUG MARKER: == replay-vbr test 3a: unlink doesn't change version of parent ========================================================== 14:50:36 (1764791436) [ 533.444834] Lustre: DEBUG MARKER: == replay-vbr test 3b: unlink checks version of parent === 14:50:41 (1764791441) [ 536.326666] LustreError: 17546:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 536.871883] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 538.503881] Lustre: Failing over lustre-MDT0000 [ 538.663742] LustreError: 17693:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 538.666278] LustreError: 17693:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 538.732511] Lustre: server umount lustre-MDT0000 complete [ 552.227317] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 552.393938] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 552.401276] Lustre: Skipped 2 previous similar messages [ 552.471591] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 554.188564] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 554.199672] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 557.538598] Lustre: 3296:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791450/real 1764791450] req@ffff8f07c79e8000 x1850517462573696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791466 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 557.542459] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 557.558640] Lustre: Skipped 1 previous similar message [ 557.559966] Lustre: 3296:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 624.000130] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 624.002861] Lustre: 18135:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client f40813e4-9e94-4595-b767-078cb3d66697@ [ 624.007043] Lustre: 18135:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 624.009607] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 624.011241] Lustre: Skipped 1 previous similar message [ 624.055265] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 624.074299] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:129) [ 624.074307] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:129) [ 642.822396] Lustre: DEBUG MARKER: == replay-vbr test 4a: setattr of UID changes versions === 14:52:30 (1764791550) [ 645.604529] Lustre: DEBUG MARKER: == replay-vbr test 4b: setattr of GID changes versions === 14:52:33 (1764791553) [ 648.354074] Lustre: DEBUG MARKER: == replay-vbr test 4c: setattr of UID checks versions ==== 14:52:36 (1764791556) [ 650.027693] LustreError: 19541:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 650.313586] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 651.298829] Lustre: Failing over lustre-MDT0000 [ 651.418301] LustreError: 19688:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 651.420727] LustreError: 19688:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 651.474835] Lustre: server umount lustre-MDT0000 complete [ 664.413165] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 664.634447] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 664.646071] Lustre: Skipped 1 previous similar message [ 664.840370] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 664.911719] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 667.696447] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 668.932773] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 670.186986] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 670.193508] Lustre: Skipped 1 previous similar message [ 670.815407] Lustre: 3298:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791564/real 1764791564] req@ffff8f080182df80 x1850517462599168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791580 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 670.854092] Lustre: 3298:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [ 738.000711] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 738.004988] Lustre: 20130:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client e0eb30fd-06d1-4718-8e94-f8fbe95fb6b7@ [ 738.012637] Lustre: 20130:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 738.016457] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 738.019135] Lustre: Skipped 1 previous similar message [ 738.081070] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 738.102611] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:161) [ 738.103329] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:161) [ 758.076567] Lustre: DEBUG MARKER: == replay-vbr test 4d: setattr of GID checks versions ==== 14:54:25 (1764791665) [ 760.519120] LustreError: 20955:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 760.977512] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 762.715345] Lustre: Failing over lustre-MDT0000 [ 762.853640] LustreError: 21102:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 762.856619] LustreError: 21102:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 762.949778] Lustre: server umount lustre-MDT0000 complete [ 780.649512] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 781.061172] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 781.076891] Lustre: Skipped 1 previous similar message [ 781.230599] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 781.282548] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 783.136771] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791676/real 1764791676] req@ffff8f07f7e74a80 x1850517462624384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791692 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 783.198871] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [ 785.987569] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 786.432465] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 786.446568] Lustre: Skipped 1 previous similar message [ 789.719085] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 859.001541] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 859.010681] Lustre: 21548:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 4e47e912-b477-421f-aa6e-7b403c6533ea@ [ 859.054036] Lustre: 21548:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 859.057684] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 859.098878] Lustre: Skipped 1 previous similar message [ 859.285728] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 859.352555] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:193) [ 859.357876] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:193) [ 882.517990] Lustre: DEBUG MARKER: == replay-vbr test 4e: setattr of permission changes versions ========================================================== 14:56:29 (1764791789) [ 889.660188] Lustre: DEBUG MARKER: == replay-vbr test 4f: setattr of permission checks versions ========================================================== 14:56:37 (1764791797) [ 895.358024] LustreError: 22669:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 896.145852] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 899.616201] Lustre: Failing over lustre-MDT0000 [ 899.800970] LustreError: 22814:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 899.814082] LustreError: 22814:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 899.975308] Lustre: server umount lustre-MDT0000 complete [ 916.509698] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 916.752971] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 916.765919] Lustre: Skipped 1 previous similar message [ 916.948659] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 917.051307] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 919.844314] Lustre: 3297:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791813/real 1764791813] req@ffff8f07c12ad500 x1850517462654336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791829 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 919.877032] Lustre: 3297:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [ 921.041685] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 922.093158] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 922.107768] Lustre: Skipped 1 previous similar message [ 926.424619] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 996.000156] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 996.003388] Lustre: 23257:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client d6f5bb1c-0a5a-4ce8-aad1-f6c03eb1668a@ [ 996.010140] Lustre: 23257:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 996.013587] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 996.015747] Lustre: Skipped 1 previous similar message [ 996.105672] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 996.141418] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:195 to 0x280000400:225) [ 996.142108] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:195 to 0x240000400:225) [ 1020.229641] Lustre: DEBUG MARKER: == replay-vbr test 4g: setattr of flags changes versions ========================================================== 14:58:47 (1764791927) [ 1028.459284] Lustre: DEBUG MARKER: == replay-vbr test 4h: setattr of flags checks versions == 14:58:55 (1764791935) [ 1033.201818] LustreError: 24377:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 1033.961248] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1037.230642] Lustre: Failing over lustre-MDT0000 [ 1037.535938] LustreError: 24525:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1037.561886] LustreError: 24525:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 1037.837509] Lustre: server umount lustre-MDT0000 complete [ 1055.233223] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1055.704840] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1056.544685] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764791949/real 1764791949] req@ffff8f080182c700 x1850517462684032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764791965 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1056.556675] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [ 1056.560092] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1056.573292] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1056.576252] Lustre: Skipped 1 previous similar message [ 1057.264175] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1058.879956] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1127.002285] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1127.015325] Lustre: 24959:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 385ac9e3-0bd2-4b78-bdf8-a2a9b91f2618@ [ 1127.067727] Lustre: 24959:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 1127.085306] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1127.092847] Lustre: Skipped 1 previous similar message [ 1127.318816] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 1127.378741] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:227 to 0x240000400:257) [ 1127.379238] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:195 to 0x280000400:257) [ 1152.014695] Lustre: DEBUG MARKER: == replay-vbr test 4i: setattr of times does not change versions ========================================================== 15:00:58 (1764792058) [ 1164.823946] Lustre: DEBUG MARKER: == replay-vbr test 4j: setattr of size does not change versions ========================================================== 15:01:11 (1764792071) [ 1175.329598] Lustre: DEBUG MARKER: == replay-vbr test 4k: setattr of times and size does not check versions ========================================================== 15:01:22 (1764792082) [ 1182.531933] LustreError: 26582:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 1183.475909] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1190.542638] Lustre: Failing over lustre-MDT0000 [ 1190.737614] LustreError: 26732:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1190.743541] LustreError: 26732:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 1190.871905] Lustre: server umount lustre-MDT0000 complete [ 1206.374874] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1206.571658] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1206.577145] Lustre: Skipped 2 previous similar messages [ 1206.698688] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1206.702236] Lustre: Skipped 1 previous similar message [ 1206.757826] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1207.050775] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1210.237797] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1211.880242] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1211.882387] Lustre: Skipped 1 previous similar message [ 1277.001775] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1277.012083] Lustre: 27183:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client b5c6e6e8-f2e5-4b60-a977-422a047b39a3@ [ 1277.037638] Lustre: 27183:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 1277.046731] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1277.051796] Lustre: Skipped 1 previous similar message [ 1277.122769] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 1 recovered and 1 was evicted. [ 1277.185598] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:259 to 0x240000400:289) [ 1277.189614] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:259 to 0x280000400:289) [ 1283.466322] Lustre: DEBUG MARKER: == replay-vbr test 5a: link changes versions of source but not target parent ========================================================== 15:03:10 (1764792190) [ 1292.060234] Lustre: DEBUG MARKER: == replay-vbr test 5b: link checks version of target parent ========================================================== 15:03:19 (1764792199) [ 1297.492980] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1300.411019] Lustre: Failing over lustre-MDT0000 [ 1300.722984] Lustre: server umount lustre-MDT0000 complete [ 1316.677332] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1320.115356] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1320.545915] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764792213/real 1764792213] req@ffff8f080166f480 x1850517462743168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764792229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1320.564915] Lustre: 3299:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 14 previous similar messages [ 1388.112738] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:259 to 0x280000400:321) [ 1388.114857] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:259 to 0x240000400:321) [ 1413.181122] Lustre: DEBUG MARKER: == replay-vbr test 5c: link checks version of source ===== 15:05:19 (1764792319) [ 1421.638128] LustreError: 29809:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 1421.641922] LustreError: 29809:0:(osd_handler.c:720:osd_ro()) Skipped 1 previous similar message [ 1423.109593] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1429.453992] Lustre: Failing over lustre-MDT0000 [ 1429.481504] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1429.524222] Lustre: Skipped 2 previous similar messages [ 1429.537707] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1429.551185] Lustre: Skipped 2 previous similar messages [ 1429.802821] LustreError: 29962:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1429.820345] LustreError: 29962:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages [ 1430.182313] Lustre: server umount lustre-MDT0000 complete [ 1449.127241] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1449.136402] LustreError: Skipped 1 previous similar message [ 1449.853398] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1450.600400] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1450.607339] Lustre: Skipped 3 previous similar messages [ 1451.456630] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1451.467683] Lustre: Skipped 1 previous similar message [ 1454.709508] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1521.000547] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1521.006147] Lustre: Skipped 1 previous similar message [ 1521.008502] Lustre: 30397:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client baccfed8-cc1d-4fe2-a60e-1fd0047d293c@ [ 1521.014039] Lustre: 30397:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 2 previous similar messages [ 1521.018284] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1521.020160] Lustre: Skipped 2 previous similar messages [ 1521.122254] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 1521.142121] Lustre: Skipped 1 previous similar message [ 1521.204182] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:323 to 0x240000400:353) [ 1521.206992] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:259 to 0x280000400:353) [ 1545.622116] Lustre: DEBUG MARKER: == replay-vbr test 6a: rename doesn't change versions of source parent and target parent ========================================================== 15:07:32 (1764792452) [ 1555.265955] Lustre: DEBUG MARKER: == replay-vbr test 6b: rename within same dir doesn't change version of parent ========================================================== 15:07:42 (1764792462) [ 1562.877261] Lustre: DEBUG MARKER: == replay-vbr test 6c: rename checks version of source parent ========================================================== 15:07:50 (1764792470) [ 1569.514442] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1572.658760] Lustre: Failing over lustre-MDT0000 [ 1573.026530] Lustre: server umount lustre-MDT0000 complete [ 1600.986352] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1605.072125] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1671.118811] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:323 to 0x240000400:385) [ 1671.119645] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:259 to 0x280000400:385) [ 1693.606863] Lustre: DEBUG MARKER: == replay-vbr test 6d: rename checks version of target parent ========================================================== 15:10:00 (1764792600) [ 1698.027218] LustreError: 33327:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 1698.031782] LustreError: 33327:0:(osd_handler.c:720:osd_ro()) Skipped 1 previous similar message [ 1698.753991] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1701.564864] Lustre: Failing over lustre-MDT0000 [ 1701.776083] LustreError: 33472:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1701.787704] LustreError: 33472:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages [ 1701.928338] Lustre: server umount lustre-MDT0000 complete [ 1717.728294] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1717.734815] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1717.736317] Lustre: Skipped 3 previous similar messages [ 1717.744060] LustreError: Skipped 1 previous similar message [ 1728.528829] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1728.536849] Lustre: Skipped 3 previous similar messages [ 1728.611642] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1729.445322] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1729.452480] Lustre: Skipped 3 previous similar messages [ 1729.743794] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1729.746924] Lustre: Skipped 1 previous similar message [ 1731.986941] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1799.000132] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1799.003824] Lustre: Skipped 1 previous similar message [ 1799.015697] Lustre: 33913:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 92855932-edeb-42d6-9164-f0ca3789e4ab@ [ 1799.020698] Lustre: 33913:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 3 previous similar messages [ 1799.025237] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1799.028256] Lustre: Skipped 3 previous similar messages [ 1799.088212] Lustre: lustre-MDT0000: Recovery over after 1:10, of 2 clients 0 recovered and 2 were evicted. [ 1799.094307] Lustre: Skipped 1 previous similar message [ 1799.120638] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:323 to 0x240000400:417) [ 1799.127127] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:259 to 0x280000400:417) [ 1824.378594] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7a skipping SLOW test 7a (base 7) [ 1825.922573] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7b skipping SLOW test 7b (base 7) [ 1827.644144] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7c skipping SLOW test 7c (base 7) [ 1829.507171] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7d skipping SLOW test 7d (base 7) [ 1831.128484] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7e skipping SLOW test 7e (base 7) [ 1833.091825] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7f skipping SLOW test 7f (base 7) [ 1835.211706] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7g skipping SLOW test 7g (base 7) [ 1837.036126] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7h skipping SLOW test 7h (base 7) [ 1838.483361] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7i skipping SLOW test 7i (base 7) [ 1840.983135] Lustre: DEBUG MARKER: == replay-vbr test 8a: create | unlink, create shouldn't fail ========================================================== 15:12:27 (1764792747) [ 1846.211739] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1849.547644] Lustre: Failing over lustre-MDT0000 [ 1850.059643] Lustre: server umount lustre-MDT0000 complete [ 1865.707463] Lustre: 3297:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764792759/real 1764792759] req@ffff8f07c60b9180 x1850517462855808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764792775 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1865.752133] Lustre: 3297:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 24 previous similar messages [ 1875.938493] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x9e84d9504061924 [ 1876.547020] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1880.642812] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1948.162846] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:323 to 0x240000400:449) [ 1948.172679] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:419 to 0x280000400:449) [ 1954.191942] Lustre: DEBUG MARKER: == replay-vbr test 8b: create | unlink, create shouldn't fail ========================================================== 15:14:21 (1764792861) [ 1958.668920] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1960.862684] Lustre: Failing over lustre-MDT0000 [ 1961.120861] Lustre: server umount lustre-MDT0000 complete [ 1981.379038] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2050.180164] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:419 to 0x280000400:481) [ 2050.181581] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:451 to 0x240000400:481) [ 2057.313460] Lustre: DEBUG MARKER: == replay-vbr test 8c: create | unlink, create shouldn't fail ========================================================== 15:16:04 (1764792964) [ 2062.335758] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2066.618801] Lustre: Failing over lustre-MDT0000 [ 2067.003950] Lustre: server umount lustre-MDT0000 complete [ 2087.600357] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2163.115608] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:483 to 0x280000400:513) [ 2163.116406] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:451 to 0x240000400:513) [ 2169.699768] Lustre: DEBUG MARKER: == replay-vbr test 10b: 3 clients: some, none, and all reqs replayed ========================================================== 15:17:56 (1764793076) [ 2170.950364] Lustre: DEBUG MARKER: SKIP: replay-vbr test_10b Need two or more clients, have 1 [ 2172.504454] Lustre: DEBUG MARKER: == replay-vbr test 11a: concurrent creates don't affect each other ========================================================== 15:17:59 (1764793079) [ 2177.823514] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2183.246694] Lustre: Failing over lustre-MDT0000 [ 2183.386838] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.11@tcp (stopping) [ 2183.646071] Lustre: server umount lustre-MDT0000 complete [ 2202.931314] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2202.945245] Lustre: Skipped 2 previous similar messages [ 2206.623873] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2276.210712] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:614 to 0x240000400:641) [ 2276.211342] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:614 to 0x280000400:641) [ 2291.560876] Lustre: DEBUG MARKER: == replay-vbr test 11b: concurrent creates and unlinks don't affect each other ========================================================== 15:19:57 (1764793197) [ 2306.004400] LustreError: 40691:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** [ 2306.034609] LustreError: 40691:0:(osd_handler.c:720:osd_ro()) Skipped 4 previous similar messages [ 2308.093365] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2319.544894] Lustre: Failing over lustre-MDT0000 [ 2320.178915] LustreError: 40841:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 2320.207773] LustreError: 40841:0:(obd_class.h:479:obd_check_dev()) Skipped 29 previous similar messages [ 2320.851804] Lustre: server umount lustre-MDT0000 complete [ 2338.272288] LustreError: MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2338.285222] LustreError: Skipped 4 previous similar messages [ 2338.287506] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2338.313408] Lustre: Skipped 9 previous similar messages [ 2349.153136] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2349.155853] Lustre: Skipped 4 previous similar messages [ 2349.775144] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 2349.777829] Lustre: Skipped 4 previous similar messages [ 2353.445785] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2363.364179] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 2363.367120] Lustre: Skipped 10 previous similar messages [ 2419.000136] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 2419.002853] Lustre: Skipped 4 previous similar messages [ 2419.008310] Lustre: 41279:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 9b6c4ca5-abe4-4502-994f-c12f28df64dd@ [ 2419.016753] Lustre: 41279:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 5 previous similar messages [ 2419.021044] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2419.024952] Lustre: Skipped 5 previous similar messages [ 2420.128145] Lustre: lustre-MDT0000: Recovery over after 1:11, of 2 clients 1 recovered and 1 was evicted. [ 2420.131873] Lustre: Skipped 4 previous similar messages [ 2420.154536] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:742 to 0x240000400:769) [ 2420.154775] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:742 to 0x280000400:769) [ 2425.411737] Lustre: DEBUG MARKER: == replay-vbr test 12a: lost data due to missed REMOTE client during replay ========================================================== 15:22:13 (1764793333) [ 2428.450905] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2431.198491] Lustre: Failing over lustre-MDT0000 [ 2431.448490] Lustre: server umount lustre-MDT0000 complete [ 2447.397640] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2516.672536] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:795 to 0x240000400:833) [ 2516.672633] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:795 to 0x280000400:833) [ 2521.598758] Lustre: DEBUG MARKER: == replay-vbr test 13: Shouldn't give up VBR easily on sluggish network ========================================================== 15:23:49 (1764793429) [ 2522.676884] Lustre: DEBUG MARKER: SKIP: replay-vbr test_13 Needs separate MGS to enable IR [ 2524.459211] Lustre: DEBUG MARKER: == replay-vbr test complete, duration 2381 sec =========== 15:23:52 (1764793432) [ 2525.443396] Lustre: DEBUG MARKER: === replay-vbr: start cleanup 15:23:53 (1764793433) === [ 2529.893717] Lustre: DEBUG MARKER: === replay-vbr: finish cleanup 15:23:57 (1764793437) === [ 2531.051112] Lustre: Failing over lustre-MDT0000 [ 2531.288727] Lustre: server umount lustre-MDT0000 complete [ 2548.191400] Lustre: 3296:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1764793441/real 1764793441] req@ffff8f07f7754e00 x1850517463078784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1764793457 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 2548.211633] Lustre: 3296:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 40 previous similar messages [ 2548.506833] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:795 to 0x280000400:865) [ 2548.509139] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:795 to 0x240000400:865) [ 2548.912689] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2554.427698] Lustre: DEBUG MARKER: oleg311-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2555.557857] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 2560.004340] Lustre: server umount lustre-MDT0000 complete [ 2562.503411] LustreError: 8217:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1764793471 with bad export cookie 713905843351265853 [ 2571.807954] Lustre: server umount lustre-OST0000 complete [ 2584.667547] Lustre: server umount lustre-OST0001 complete [ 2592.286061] Lustre: DEBUG MARKER: oleg311-server.virtnet: executing unload_modules_local [ 2594.120776] Key type lgssc unregistered [ 2594.299583] LNet: 45635:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2594.306244] LNetError: 45635:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2594.321387] LNet: Removed LNI 192.168.203.111@tcp [ 2594.823161] Key type .llcrypt unregistered [ 2594.825225] Key type ._llcrypt unregistered