[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 504176655 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2439 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22D5 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 002295 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2349 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23D9 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2411 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22d5-0xbffe2348] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22d4] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2349-0xbffe23d8] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23d9-0xbffe2410] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2411-0xbffe2438] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002396] x2apic enabled [ 0.003008] Switched APIC routing to physical x2apic. [ 0.004012] kvm-guest: setup PV IPIs [ 0.005000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.005000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.005029] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.006017] pid_max: default: 32768 minimum: 301 [ 0.007178] LSM: Security Framework initializing [ 0.008079] Yama: becoming mindful. [ 0.009076] SELinux: Initializing. [ 0.010088] *** VALIDATE selinux *** [ 0.019134] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025466] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026152] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028100] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029103] *** VALIDATE tmpfs *** [ 0.031302] *** VALIDATE proc *** [ 0.032247] *** VALIDATE cgroup *** [ 0.033009] *** VALIDATE cgroup2 *** [ 0.035135] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.036160] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.037009] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.039028] Spectre V2 : User space: Vulnerable [ 0.040007] Speculative Store Bypass: Vulnerable [ 0.043043] debug: unmapping init [mem 0xffffffffa2e59000-0xffffffffa2e60fff] [ 0.046000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.046711] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.047024] ... version: 2 [ 0.048012] ... bit width: 48 [ 0.049013] ... generic registers: 4 [ 0.050011] ... value mask: 0000ffffffffffff [ 0.051013] ... max period: 00007fffffffffff [ 0.052010] ... fixed-purpose events: 3 [ 0.053008] ... event mask: 000000070000000f [ 0.054237] rcu: Hierarchical SRCU implementation. [ 0.056454] smp: Bringing up secondary CPUs ... [ 0.057576] x86: Booting SMP configuration: [ 0.058024] .... node #0, CPUs: #1 #2 #3 [ 0.067222] smp: Brought up 1 node, 4 CPUs [ 0.069011] smpboot: Max logical packages: 1 [ 0.070058] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.126591] node 0 deferred pages initialised in 54ms [ 0.130007] devtmpfs: initialized [ 0.131276] x86/mm: Memory block size: 128MB [ 0.133905] gcov: version magic: 0x41383552 [ 0.135131] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.136071] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.137214] pinctrl core: initialized pinctrl subsystem [ 0.138145] [ 0.138617] ************************************************************* [ 0.139012] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.140013] ** ** [ 0.141010] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.142013] ** ** [ 0.143015] ** This means that this kernel is built to expose internal ** [ 0.144016] ** IOMMU data structures, which may compromise security on ** [ 0.145015] ** your system. ** [ 0.146016] ** ** [ 0.147015] ** If you see this message and you are not debugging the ** [ 0.148011] ** kernel, report this immediately to your vendor! ** [ 0.149011] ** ** [ 0.150013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.151018] ************************************************************* [ 0.152744] NET: Registered protocol family 16 [ 0.153360] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.154039] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.155058] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.157010] cpuidle: using governor menu [ 0.160086] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.162747] PCI: Using configuration type 1 for base access [ 0.164124] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.178415] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.179020] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.180228] cryptd: max_cpu_qlen set to 1000 [ 0.181170] ACPI: Added _OSI(Module Device) [ 0.182011] ACPI: Added _OSI(Processor Device) [ 0.182867] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.183009] ACPI: Added _OSI(Processor Aggregator Device) [ 0.186621] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.189020] ACPI: Interpreter enabled [ 0.190058] ACPI: PM: (supports S0 S3 S4 S5) [ 0.191008] ACPI: Using IOAPIC for interrupt routing [ 0.191998] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.193319] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.201125] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.202022] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.203011] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.204120] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.209482] acpiphp: Slot [2] registered [ 0.210112] acpiphp: Slot [5] registered [ 0.212105] acpiphp: Slot [6] registered [ 0.213128] acpiphp: Slot [7] registered [ 0.215101] acpiphp: Slot [8] registered [ 0.216097] acpiphp: Slot [9] registered [ 0.217157] acpiphp: Slot [10] registered [ 0.219103] acpiphp: Slot [3] registered [ 0.220093] acpiphp: Slot [4] registered [ 0.221112] acpiphp: Slot [11] registered [ 0.222090] acpiphp: Slot [12] registered [ 0.223104] acpiphp: Slot [13] registered [ 0.224087] acpiphp: Slot [14] registered [ 0.226105] acpiphp: Slot [15] registered [ 0.227093] acpiphp: Slot [16] registered [ 0.228178] acpiphp: Slot [17] registered [ 0.229082] acpiphp: Slot [18] registered [ 0.230090] acpiphp: Slot [19] registered [ 0.232083] acpiphp: Slot [20] registered [ 0.233100] acpiphp: Slot [21] registered [ 0.234095] acpiphp: Slot [22] registered [ 0.236086] acpiphp: Slot [23] registered [ 0.237000] acpiphp: Slot [24] registered [ 0.237000] acpiphp: Slot [25] registered [ 0.239105] acpiphp: Slot [26] registered [ 0.240066] acpiphp: Slot [27] registered [ 0.240927] acpiphp: Slot [28] registered [ 0.242066] acpiphp: Slot [29] registered [ 0.243025] acpiphp: Slot [30] registered [ 0.244082] acpiphp: Slot [31] registered [ 0.245050] PCI host bridge to bus 0000:00 [ 0.246016] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.248021] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.251028] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.255047] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.260026] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.266025] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.268202] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.272000] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.278733] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.295027] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.299012] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.300019] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.302017] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.304016] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.306941] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.310372] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.312042] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.314730] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.324016] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.338020] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.343994] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.351472] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.365016] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.369000] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.375023] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.496064] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.501138] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.514015] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.554016] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.596000] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.599014] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.606017] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.625019] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.641835] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.655022] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.662018] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.699015] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.710840] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.720017] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.736017] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.764019] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.778325] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.788016] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.802015] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.827000] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.827000] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.827000] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.827000] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.827000] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.827000] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.827395] iommu: Default domain type: Passthrough [ 0.828000] SCSI subsystem initialized [ 0.828000] ACPI: bus type USB registered [ 0.833817] usbcore: registered new interface driver usbfs [ 0.837110] usbcore: registered new interface driver hub [ 0.846090] usbcore: registered new device driver usb [ 0.848149] pps_core: LinuxPPS API ver. 1 registered [ 0.850011] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.853317] PTP clock support registered [ 0.855043] EDAC MC: Ver: 3.0.0 [ 0.858426] PCI: Using ACPI for IRQ routing [ 0.867193] NetLabel: Initializing [ 0.869012] NetLabel: domain hash size = 128 [ 0.871011] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.873149] NetLabel: unlabeled traffic allowed by default [ 0.877264] vgaarb: loaded [ 0.880696] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.882011] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.889229] clocksource: Switched to clocksource kvm-clock [ 1.059671] VFS: Disk quotas dquot_6.6.0 [ 1.061668] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.064728] *** VALIDATE ramfs *** [ 1.066216] *** VALIDATE hugetlbfs *** [ 1.068232] pnp: PnP ACPI init [ 1.070890] pnp: PnP ACPI: found 6 devices [ 1.096365] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.098694] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.101139] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.103081] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.104612] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.106103] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.108095] NET: Registered protocol family 2 [ 1.109844] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.113731] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.116557] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.120718] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.124758] TCP: Hash tables configured (established 65536 bind 65536) [ 1.129593] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.134532] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.138141] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.141823] NET: Registered protocol family 1 [ 1.144757] RPC: Registered named UNIX socket transport module. [ 1.147567] RPC: Registered udp transport module. [ 1.150264] RPC: Registered tcp transport module. [ 1.152123] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.154983] NET: Registered protocol family 44 [ 1.156871] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.159323] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.161797] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.164474] PCI: CLS 0 bytes, default 64 [ 1.166248] Unpacking initramfs... [ 4.088753] debug: unmapping init [mem 0xffff8a767cc54000-0xffff8a767ffbffff] [ 4.092992] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.095410] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 4.098327] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 5.786569] Initialise system trusted keyrings [ 5.788011] Key type blacklist registered [ 5.789750] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 5.798895] zbud: loaded [ 5.801891] *** VALIDATE nfs *** [ 5.802956] *** VALIDATE nfs4 *** [ 5.804469] pstore: using deflate compression [ 5.808749] Platform Keyring initialized [ 5.965517] NET: Registered protocol family 38 [ 5.967190] Key type asymmetric registered [ 5.968656] Asymmetric key parser 'x509' registered [ 5.970734] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 5.973912] io scheduler mq-deadline registered [ 5.975515] io scheduler kyber registered [ 5.977174] io scheduler bfq registered [ 5.978914] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 5.981720] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 5.984579] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 5.987392] ACPI: Power Button [PWRF] [ 5.997892] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 6.009784] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 6.069535] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 6.078591] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 6.099979] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.229533] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 6.299937] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 6.321339] Non-volatile memory driver v1.3 [ 6.323071] Linux agpgart interface v0.103 [ 6.353314] virtio_blk virtio1: [vda] 134032 512-byte logical blocks (68.6 MB/65.4 MiB) [ 6.355569] vda: detected capacity change from 0 to 68624384 [ 6.383657] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 6.387179] vdb: detected capacity change from 0 to 1073741824 [ 6.423093] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.425972] vdc: detected capacity change from 0 to 2621440000 [ 6.456621] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.459509] vdd: detected capacity change from 0 to 2621440000 [ 6.477990] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.480795] vde: detected capacity change from 0 to 4294967296 [ 6.500525] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.509244] vdf: detected capacity change from 0 to 4294967296 [ 6.564808] libphy: Fixed MDIO Bus: probed [ 6.570459] usbcore: registered new interface driver usbserial_generic [ 6.572157] usbserial: USB Serial support registered for generic [ 6.573830] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 6.577578] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 6.578929] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 6.580814] mousedev: PS/2 mouse device common for all mice [ 6.583252] rtc_cmos 00:05: RTC can wake from S4 [ 6.584706] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 6.588558] rtc_cmos 00:05: registered as rtc0 [ 6.593554] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 6.595769] intel_pstate: CPU model not supported [ 6.598427] hid: raw HID events driver (C) Jiri Kosina [ 6.599926] usbcore: registered new interface driver usbhid [ 6.601665] usbhid: USB HID core driver [ 6.602819] drop_monitor: Initializing network drop monitor service [ 6.604892] Initializing XFRM netlink socket [ 6.608244] NET: Registered protocol family 10 [ 6.610700] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 6.612156] Segment Routing with IPv6 [ 6.615491] NET: Registered protocol family 17 [ 6.617129] mpls_gso: MPLS GSO support [ 6.622945] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 6.626027] RAS: Correctable Errors collector initialized. [ 6.627844] AVX version of gcm_enc/dec engaged. [ 6.629014] AES CTR mode by8 optimization enabled [ 6.705282] sched_clock: Marking stable (6705202463, 0)->(8124908593, -1419706130) [ 6.708259] registered taskstats version 1 [ 6.709914] Loading compiled-in X.509 certificates [ 6.711556] zswap: loaded using pool lzo/zbud [ 6.739410] Key type big_key registered [ 6.752640] Key type encrypted registered [ 6.753881] ima: No TPM chip found, activating TPM-bypass! [ 6.755662] ima: Allocated hash algorithm: sha1 [ 6.757168] ima: No architecture policies found [ 6.758803] evm: Initialising EVM extended attributes: [ 6.760557] evm: security.selinux [ 6.761607] evm: security.ima [ 6.762615] evm: security.capability [ 6.763695] evm: HMAC attrs: 0x1 [ 6.765871] rtc_cmos 00:05: setting system clock to 2026-01-02 00:49:27 UTC (1767314967) [ 6.772674] debug: unmapping init [mem 0xffffffffa3e03000-0xffffffffa3ffffff] [ 6.775538] debug: unmapping init [mem 0xffffffffa2b82000-0xffffffffa2e58fff] [ 6.781534] Write protecting the kernel read-only data: 28672k [ 6.785628] debug: unmapping init [mem 0xffffffffa1203000-0xffffffffa13fffff] [ 6.788711] debug: unmapping init [mem 0xffffffffa1b14000-0xffffffffa1bfffff] [ 6.834972] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 6.846451] systemd[1]: Detected virtualization kvm. [ 6.848485] systemd[1]: Detected architecture x86-64. [ 6.850533] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 6.887057] systemd[1]: No hostname configured. [ 6.889654] systemd[1]: Set hostname to . [ 6.892763] random: systemd: uninitialized urandom read (16 bytes read) [ 6.897082] systemd[1]: Initializing machine ID from random generator. [ 7.144457] random: ln: uninitialized urandom read (6 bytes read) [ 8.001773] random: systemd: uninitialized urandom read (16 bytes read) [ 8.004907] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 8.101624] random: systemd: uninitialized urandom read (16 bytes read) [ 8.103733] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 8.109911] random: systemd: uninitialized urandom read (16 bytes read) [ 8.112256] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Swap. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Timers. [ OK ] Reached target Slices. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Sockets. Starting Apply Kernel Variables... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 10.461401] device-mapper: uevent: version 1.0.3 [ 10.463477] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 12.542853] virtio_net virtio0 ens2: renamed from eth0 [ 12.647371] random: fast init done [ 13.886732] scsi host0: ata_piix [ 13.944249] scsi host1: ata_piix [ 13.945929] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 13.948825] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 18.287309] random: crng init done [ 18.288475] random: 5 urandom warning(s) missed due to ratelimiting [ 22.083808] dracut-initqueue[590]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 23.773308] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 26.815900] printk: systemd: 26 output lines suppressed due to ratelimiting [ 28.163814] SELinux: Disabled at runtime. [ 28.238764] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 28.246689] systemd[1]: Detected virtualization kvm. [ 28.249067] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 29.289957] systemd[1]: initrd-switch-root.service: Succeeded. [ 29.295820] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 29.307884] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 29.316849] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 29.326252] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 29.339751] systemd[1]: Starting Journal Service... Starting Journal Service... [ 29.354986] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Huge Pages File System... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Forward Password Requests to Wall Directory Watch. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-getty.slice. [ OK ] Listening on udev Control Socket. [ 29.613858] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Reached target rpc_pipefs.target. Starting Remount Root and Kernel File Systems... [ OK ] Listening on Process Core Dump Socket. [ OK ] Reached target Slices. [ OK ] Stopped target Switch Root. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Stopped target Initrd Root File System. Mounting POSIX Message Queue File System... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... Starting Apply Kernel Variables... Mounting Kernel Debug File System... [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Kernel Debug File System. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Mounted /mnt. [ 32.495056] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 34.691879] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 34.784933] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 37.388092] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 37.827559] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (9s / no limit) [** ] A start job is running for Configur…-only root support (9s / no limit) [*** ] A start job is running for Configur…only root support (10s / no limit) [ *** ] A start job is running for Configur…only root support (10s / no limit) [ *** ] A start job is running for Configur…only root support (11s / no limit) [ ***] A start job is running for Configur…only root support (11s / no limit) [ **] A start job is running for Configur…only root support (12s / no limit)[ 41.323955] Key type dns_resolver registered [ *] A start job is running for Configur…only root support (12s / no limit)[ 42.087424] NFS: Registering the id_resolver key type [ 42.089516] Key type id_resolver registered [ 42.091073] Key type id_legacy registered [ **] A start job is running for Configur…only root support (13s / no limit) [ ***] A start job is running for Configur…only root support (13s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Load/Save Random Seed... Starting Create Volatile Files and Directories... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Login Service... Starting Restore /run/initramfs on shutdown... [ OK ] Started dnf makecache --timer. [ OK ] Reached target sshd-keygen.target. [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Login Service. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg223-server login: [ 92.547575] hrtimer: interrupt took 6564095 ns [ 108.588210] libcfs: loading out-of-tree module taints kernel. [ 108.666151] Key type ._llcrypt registered [ 108.667392] Key type .llcrypt registered [ 108.848221] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_hostid [ 196.442495] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 198.139275] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 198.150717] alg: No test for adler32 (adler32-zlib) [ 199.757349] Lustre: Lustre: Build Version: 2.17.0_RC4_1_g3742a8b [ 200.731626] LNet: Added LNI 192.168.202.123@tcp [8/256/0/180] [ 202.536870] Key type lgssc registered [ 204.689700] Lustre: Echo OBD driver; http://www.lustre.org/ [ 234.291337] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 235.994084] LDISKFS-fs (vdc): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 251.132424] LDISKFS-fs (vdd): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 263.262111] LDISKFS-fs (vde): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 276.101529] LDISKFS-fs (vdf): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 364.177537] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local [ 388.818407] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 388.885487] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 388.897830] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 390.248519] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 390.280219] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 390.481669] Lustre: lustre-MDT0000: new disk, initializing [ 390.610261] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 390.659521] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 396.565891] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 405.147342] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 422.904381] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 423.027201] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 423.161608] Lustre: 14451:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 423.186409] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 423.190955] Lustre: Skipped 1 previous similar message [ 423.302443] Lustre: lustre-MDT0001: new disk, initializing [ 423.388106] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 423.438441] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 423.455874] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 427.979844] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 436.367119] Lustre: 16507:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 454.182590] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 454.303378] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 454.596877] Lustre: lustre-OST0000: new disk, initializing [ 454.600075] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 454.695751] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 461.327459] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 463.933762] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 463.945436] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 464.020438] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 485.164174] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 485.256669] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 485.437246] Lustre: lustre-OST0001: new disk, initializing [ 485.447577] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 485.545613] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 492.827092] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 494.142545] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 494.156035] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 494.302598] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 505.463996] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 515.813682] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 527.091510] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing check_logdir /tmp/testlogs/ [ 532.253056] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing yml_node [ 541.137115] Lustre: DEBUG MARKER: Client: 2.17.0.RC4 [ 544.255359] Lustre: DEBUG MARKER: MDS: 2.17.0.RC4 [ 547.108334] Lustre: DEBUG MARKER: OSS: 2.17.0.RC4 [ 548.657328] Lustre: DEBUG MARKER: -----============= acceptance-small: replay-vbr ============----- Thu Jan 1 19:58:28 EST 2026 [ 568.866693] Lustre: DEBUG MARKER: excepting tests: [ 570.855577] Lustre: DEBUG MARKER: skipping tests SLOW=no: 7 [ 573.012991] Lustre: DEBUG MARKER: === replay-vbr: start setup 19:58:52 (1767315532) === [ 578.185361] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing check_config_client /mnt/lustre [ 623.661762] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 627.677715] Lustre: 23937:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 631.773825] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 637.407544] Lustre: DEBUG MARKER: === replay-vbr: finish setup 19:59:56 (1767315596) === [ 641.384250] Lustre: DEBUG MARKER: == replay-vbr test 0a: getversion for non existent file shouldn't cause kernel panic ========================================================== 20:00:00 (1767315600) [ 649.816805] Lustre: DEBUG MARKER: == replay-vbr test 0b: getversion for non existent fid shouldn't cause kernel panic ========================================================== 20:00:09 (1767315609) [ 659.819487] Lustre: DEBUG MARKER: == replay-vbr test 1a: open and close do not change versions ========================================================== 20:00:18 (1767315618) [ 675.907855] Lustre: DEBUG MARKER: == replay-vbr test 1b: open (O_CREAT) checks version of parent ========================================================== 20:00:34 (1767315634) [ 688.703770] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 693.299097] Lustre: Failing over lustre-MDT0000 [ 693.565969] LustreError: 25792:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 693.758348] Lustre: server umount lustre-MDT0000 complete [ 694.240347] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 694.266342] Lustre: Skipped 1 previous similar message [ 699.362526] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 699.394812] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 701.992818] LustreError: 14455:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 704.481935] LustreError: 14461:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 704.496363] LustreError: 14461:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 707.120171] LustreError: 14456:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 710.623167] Lustre: 6816:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767315654/real 1767315654] req@ffff8a76ff9dc700 x1853164262417024/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767315670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 710.694214] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 712.206356] LustreError: 14457:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 712.242088] LustreError: 14457:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 720.864910] LustreError: 14457:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 720.886946] LustreError: 14457:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 722.528705] LDISKFS-fs (dm-0): 10 truncates cleaned up [ 722.531233] LDISKFS-fs (dm-0): recovery complete [ 722.543481] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 736.474996] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 736.537371] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 737.854662] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 741.879325] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 742.190789] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 807.500166] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 807.511817] Lustre: 26750:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client da0fb881-f4e4-4f2c-8045-c2e309c14178@ [ 807.548071] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 807.614787] LustreError: 26750:0:(mdt_handler.c:5284:mdt_intent_open()) @@@ Replay open failed with -75 req@ffff8a76ef4b7100 x1853164171075584/t0(4294967313) o101->d1c58c4f-6353-4acf-8be1-038e281cab76@192.168.202.23@tcp:454/0 lens 584/608 e 0 to 0 dl 1767315779 ref 1 fl Complete:/604/0 rc 0/0 job:'openfile.0' uid:0 gid:0 projid:0 [ 807.764717] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 807.767593] Lustre: Skipped 2 previous similar messages [ 807.773139] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 807.881319] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 807.881760] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 831.827543] Lustre: DEBUG MARKER: == replay-vbr test 1c: open (non O_CREAT) does not checks versions ========================================================== 20:03:11 (1767315791) [ 842.567808] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 850.834892] Lustre: Failing over lustre-MDT0000 [ 850.961965] LustreError: 27920:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 850.966485] LustreError: 27920:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 851.223919] Lustre: server umount lustre-MDT0000 complete [ 853.049213] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 853.086728] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 15 previous similar messages [ 853.984883] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 853.992937] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 854.007646] Lustre: Skipped 2 previous similar messages [ 870.882829] Lustre: 6817:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767315815/real 1767315815] req@ffff8a75c91d1500 x1853164262485760/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767315831 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 870.912355] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 882.165153] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 882.168589] LDISKFS-fs (dm-0): recovery complete [ 882.174377] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 886.243711] LustreError: 14461:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 886.262584] LustreError: 14461:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 39 previous similar messages [ 895.467313] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x179faf72e935228c [ 895.480548] Lustre: MGC192.168.202.123@tcp: Connection restored to 0@lo (at 0@lo) [ 895.783217] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 895.820116] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 896.388627] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 900.695238] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 901.098383] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 966.501186] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 966.513607] Lustre: 28863:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client b50cf349-04df-4239-a526-bf036b56e157@ [ 966.548154] Lustre: 28863:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 966.560911] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 966.570916] Lustre: Skipped 1 previous similar message [ 966.746678] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 966.748457] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 2 recovered and 1 was evicted. [ 966.761975] Lustre: Skipped 2 previous similar messages [ 966.857785] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 966.862116] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:65) [ 974.987765] Lustre: DEBUG MARKER: == replay-vbr test 2a: create operations doesn't change version of parent ========================================================== 20:05:34 (1767315934) [ 993.719758] Lustre: DEBUG MARKER: == replay-vbr test 2b: create checks version of parent === 20:05:52 (1767315952) [ 1005.273737] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1009.473898] Lustre: Failing over lustre-MDT0000 [ 1009.627052] LustreError: 30698:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1009.635491] LustreError: 30698:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1009.716514] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1009.744302] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 10 previous similar messages [ 1009.955451] Lustre: server umount lustre-MDT0000 complete [ 1013.217268] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1013.223075] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1013.232430] Lustre: Skipped 3 previous similar messages [ 1029.583095] Lustre: 6817:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767315974/real 1767315974] req@ffff8a76ffe57b80 x1853164262560256/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767315990 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1029.620643] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1038.939432] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 1038.941605] LDISKFS-fs (dm-0): recovery complete [ 1038.947357] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1040.226532] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1040.278939] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1040.417531] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1045.478876] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1046.154106] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1110.500145] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1110.509154] Lustre: 31640:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 40fce9c5-718f-4c08-91a7-5e7d298efb3f@ [ 1110.523362] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1110.627802] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 1110.630131] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1110.649382] Lustre: Skipped 2 previous similar messages [ 1110.681727] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:97) [ 1110.683938] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 1136.061551] Lustre: DEBUG MARKER: == replay-vbr test 3a: unlink doesn't change version of parent ========================================================== 20:08:15 (1767316095) [ 1147.415217] Lustre: DEBUG MARKER: == replay-vbr test 3b: unlink checks version of parent === 20:08:27 (1767316107) [ 1157.885792] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1162.622345] Lustre: Failing over lustre-MDT0000 [ 1162.774506] LustreError: 33184:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1162.778675] LustreError: 33184:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1162.909405] Lustre: server umount lustre-MDT0000 complete [ 1163.240069] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1163.241521] LustreError: 14457:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1163.259129] Lustre: Skipped 6 previous similar messages [ 1163.287793] LustreError: 14457:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 33 previous similar messages [ 1178.592528] Lustre: 6815:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316123/real 1767316123] req@ffff8a76fc1b5880 x1853164262633344/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767316139 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1178.627246] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1191.677506] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 1191.681859] LDISKFS-fs (dm-0): recovery complete [ 1191.694290] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1204.191786] LustreError: 6814:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a76ffe09500 x1853164262644864/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1204.493319] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1204.541227] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1206.168910] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1209.251237] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1209.834062] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1276.501947] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1276.506765] Lustre: 34125:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client f6a98649-8ed0-42e0-8aa2-bbde10862682@ [ 1276.524026] Lustre: 34125:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 1276.539732] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1276.546024] Lustre: Skipped 1 previous similar message [ 1276.683610] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 1276.684361] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1276.700711] Lustre: Skipped 2 previous similar messages [ 1276.737851] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:129) [ 1276.737857] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:129) [ 1301.494941] Lustre: DEBUG MARKER: == replay-vbr test 4a: setattr of UID changes versions === 20:11:00 (1767316260) [ 1310.379349] Lustre: DEBUG MARKER: == replay-vbr test 4b: setattr of GID changes versions === 20:11:09 (1767316269) [ 1318.958942] Lustre: DEBUG MARKER: == replay-vbr test 4c: setattr of UID checks versions ==== 20:11:18 (1767316278) [ 1329.155916] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1334.069277] Lustre: Failing over lustre-MDT0000 [ 1334.216355] LustreError: 35868:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1334.226478] LustreError: 35868:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1334.378227] Lustre: server umount lustre-MDT0000 complete [ 1337.824351] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1337.845829] Lustre: Skipped 1 previous similar message [ 1354.208511] Lustre: 6815:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316298/real 1767316298] req@ffff8a76fe999500 x1853164262709376/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767316314 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1354.232604] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1362.744931] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 1362.747749] LDISKFS-fs (dm-0): recovery complete [ 1362.759883] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1363.723332] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1363.756299] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1365.539275] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1367.617858] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1435.502305] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1435.507291] Lustre: 36811:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 39bf7aa0-c2dc-4013-8e9d-b12436b49ff4@ [ 1435.516526] Lustre: 36811:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 1435.524082] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1435.527220] Lustre: Skipped 1 previous similar message [ 1435.661692] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 1435.661988] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1435.682065] Lustre: Skipped 3 previous similar messages [ 1435.708761] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:161) [ 1435.712803] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:161) [ 1458.413305] Lustre: DEBUG MARKER: == replay-vbr test 4d: setattr of GID checks versions ==== 20:13:38 (1767316418) [ 1468.255249] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1472.652531] Lustre: Failing over lustre-MDT0000 [ 1472.818404] LustreError: 37967:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1472.825031] LustreError: 37967:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1472.932530] Lustre: server umount lustre-MDT0000 complete [ 1474.116676] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1474.131883] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 76 previous similar messages [ 1476.579699] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1476.581234] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1476.591851] Lustre: Skipped 3 previous similar messages [ 1492.965237] Lustre: 6817:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316437/real 1767316437] req@ffff8a76ffdb6a00 x1853164262772608/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767316453 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1492.993682] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1500.276053] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 1500.282531] LDISKFS-fs (dm-0): recovery complete [ 1500.300541] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1502.431156] LustreError: 38874:0:(import.c:337:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) [ 1502.451190] LustreError: 38874:0:(import.c:361:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8a76ca036680 x1853164262778752/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1767316463 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1502.497623] LustreError: 38874:0:(import.c:371:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. [ 1503.204806] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x179faf72e9353f5e [ 1503.467931] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1503.527322] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1503.810554] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1508.145756] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1573.501555] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1573.516760] Lustre: 38909:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client c99e7cab-f06c-470c-95c0-76399e8fee1c@ [ 1573.535576] Lustre: 38909:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 1573.555937] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1573.564899] Lustre: Skipped 1 previous similar message [ 1573.677906] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 1573.721869] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:193) [ 1573.722310] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:193) [ 1598.057497] Lustre: DEBUG MARKER: == replay-vbr test 4e: setattr of permission changes versions ========================================================== 20:15:57 (1767316557) [ 1605.883682] Lustre: DEBUG MARKER: == replay-vbr test 4f: setattr of permission checks versions ========================================================== 20:16:05 (1767316565) [ 1614.663363] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1617.891778] Lustre: Failing over lustre-MDT0000 [ 1618.093500] LustreError: 40355:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1618.098447] LustreError: 40355:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1619.943439] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1619.960781] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1619.974228] Lustre: Skipped 2 previous similar messages [ 1620.236759] Lustre: server umount lustre-MDT0000 complete [ 1637.862305] Lustre: 6818:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316582/real 1767316582] req@ffff8a76ca0b4380 x1853164262837248/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767316598 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1637.890224] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1647.724152] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 1647.726701] LDISKFS-fs (dm-0): recovery complete [ 1647.733724] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1648.100279] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x179faf72e93545b6 [ 1648.394194] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1652.255800] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1652.474695] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1722.500437] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1722.507565] Lustre: 41297:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client d8d17b9d-220d-424a-83b0-5a95952ceff7@ [ 1722.515594] Lustre: 41297:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 1722.520459] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1722.524402] Lustre: Skipped 1 previous similar message [ 1722.648445] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 1722.657810] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1722.681453] Lustre: Skipped 9 previous similar messages [ 1722.700404] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 1722.704512] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:195 to 0x2c0000401:225) [ 1746.997460] Lustre: DEBUG MARKER: == replay-vbr test 4g: setattr of flags changes versions ========================================================== 20:18:26 (1767316706) [ 1754.944753] Lustre: DEBUG MARKER: == replay-vbr test 4h: setattr of flags checks versions == 20:18:34 (1767316714) [ 1764.050995] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1768.336472] Lustre: Failing over lustre-MDT0000 [ 1768.495569] LustreError: 42748:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1768.500301] LustreError: 42748:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1768.639785] Lustre: server umount lustre-MDT0000 complete [ 1768.929441] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1768.942567] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1768.964318] Lustre: Skipped 3 previous similar messages [ 1787.872603] Lustre: 6815:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316732/real 1767316732] req@ffff8a76ca03fb80 x1853164262905088/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767316748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1787.899985] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1796.662820] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 1796.666538] LDISKFS-fs (dm-0): recovery complete [ 1796.674055] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1797.791527] LustreError: 43655:0:(import.c:337:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) [ 1797.801557] LustreError: 43655:0:(import.c:361:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8a76efd31f80 x1853164262910848/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1767316758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1797.839050] LustreError: 43655:0:(import.c:371:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. [ 1798.113307] LustreError: 6814:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a76fff9a680 x1853164262914560/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1798.376285] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1798.390302] Lustre: Skipped 1 previous similar message [ 1798.425838] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1799.530333] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1802.413453] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 1869.500159] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 1869.511507] Lustre: 43688:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 5294a201-85c7-48ba-8bc3-29dd1aaaa9ee@ [ 1869.521307] Lustre: 43688:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 1869.530288] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1869.536150] Lustre: Skipped 1 previous similar message [ 1869.618263] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 1869.661728] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:227 to 0x280000401:257) [ 1869.681711] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:195 to 0x2c0000401:257) [ 1893.220694] Lustre: DEBUG MARKER: == replay-vbr test 4i: setattr of times does not change versions ========================================================== 20:20:52 (1767316852) [ 1904.483619] Lustre: DEBUG MARKER: == replay-vbr test 4j: setattr of size does not change versions ========================================================== 20:21:03 (1767316863) [ 1913.366404] Lustre: DEBUG MARKER: == replay-vbr test 4k: setattr of times and size does not check versions ========================================================== 20:21:12 (1767316872) [ 1923.843894] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1929.909748] Lustre: Failing over lustre-MDT0000 [ 1930.080522] LustreError: 45620:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1930.087264] LustreError: 45620:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1930.187665] Lustre: server umount lustre-MDT0000 complete [ 1931.232996] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1931.245722] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1931.260171] Lustre: Skipped 3 previous similar messages [ 1948.127421] Lustre: 6817:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767316892/real 1767316892] req@ffff8a76ca9b2300 x1853164262978304/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767316908 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1948.163549] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1958.368704] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 1958.372160] LDISKFS-fs (dm-0): recovery complete [ 1958.387480] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1972.920917] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1974.553850] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1977.098643] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2044.502186] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 2044.507330] Lustre: 46563:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 63bcfde2-e112-4768-a88d-144d4ce83c58@ [ 2044.524143] Lustre: 46563:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 1 previous similar message [ 2044.534976] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2044.539276] Lustre: Skipped 1 previous similar message [ 2044.592476] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 2 recovered and 1 was evicted. [ 2044.647843] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:259 to 0x280000401:289) [ 2044.650700] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:259 to 0x2c0000401:289) [ 2051.730699] Lustre: DEBUG MARKER: == replay-vbr test 5a: link changes versions of source but not target parent ========================================================== 20:23:31 (1767317011) [ 2062.269129] Lustre: DEBUG MARKER: == replay-vbr test 5b: link checks version of target parent ========================================================== 20:23:41 (1767317021) [ 2071.124124] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2075.343066] Lustre: Failing over lustre-MDT0000 [ 2075.469521] LustreError: 48109:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2075.477353] LustreError: 48109:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2075.616794] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2075.618256] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2075.620470] LustreError: 14461:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2075.620480] LustreError: 14461:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 159 previous similar messages [ 2075.632153] Lustre: Skipped 4 previous similar messages [ 2075.652909] Lustre: server umount lustre-MDT0000 complete [ 2097.119115] Lustre: 6815:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317041/real 1767317041] req@ffff8a76ca0b2a00 x1853164263042176/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767317057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 2097.136165] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2103.662821] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 2103.666117] LDISKFS-fs (dm-0): recovery complete [ 2103.674166] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2106.664726] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2108.250504] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2111.784288] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2178.500439] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 2178.506264] Lustre: 49049:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 4918ab48-f4f0-4291-b78b-d41ce7e2c655@ [ 2178.526141] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2178.588512] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 2178.641020] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:259 to 0x280000401:321) [ 2178.649050] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:259 to 0x2c0000401:321) [ 2203.111315] Lustre: DEBUG MARKER: == replay-vbr test 5c: link checks version of source ===== 20:26:02 (1767317162) [ 2211.725552] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2215.535307] Lustre: Failing over lustre-MDT0000 [ 2215.850045] Lustre: server umount lustre-MDT0000 complete [ 2219.487865] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2241.833371] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 2241.839843] LDISKFS-fs (dm-0): recovery complete [ 2241.847582] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2245.599661] LustreError: 6814:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a76ffa31180 x1853164263113728/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 2249.516404] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2251.240656] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2251.251720] Lustre: Skipped 12 previous similar messages [ 2316.699037] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:259 to 0x2c0000401:353) [ 2316.702996] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:323 to 0x280000401:353) [ 2339.723446] Lustre: DEBUG MARKER: == replay-vbr test 6a: rename doesn't change versions of source parent and target parent ========================================================== 20:28:19 (1767317299) [ 2349.862539] Lustre: DEBUG MARKER: == replay-vbr test 6b: rename within same dir doesn't change version of parent ========================================================== 20:28:29 (1767317309) [ 2358.526207] Lustre: DEBUG MARKER: == replay-vbr test 6c: rename checks version of source parent ========================================================== 20:28:38 (1767317318) [ 2367.439977] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2370.673891] Lustre: Failing over lustre-MDT0000 [ 2370.836406] LustreError: 52983:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2370.850197] LustreError: 52983:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 2370.934598] Lustre: server umount lustre-MDT0000 complete [ 2373.091947] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2373.101515] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2373.112022] Lustre: Skipped 6 previous similar messages [ 2390.495761] Lustre: 6818:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317334/real 1767317334] req@ffff8a76ca083b80 x1853164263173376/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767317350 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 2390.537790] Lustre: 6818:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 2390.545483] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2390.562411] LustreError: Skipped 1 previous similar message [ 2398.540752] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 2398.551472] LDISKFS-fs (dm-0): recovery complete [ 2398.563577] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2400.809626] Lustre: lustre-MDT0000: Not available for connect from 192.168.202.23@tcp (not set up) [ 2400.973506] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2400.979867] Lustre: Skipped 3 previous similar messages [ 2401.012359] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2401.024963] Lustre: Skipped 1 previous similar message [ 2402.132982] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2402.149640] Lustre: Skipped 1 previous similar message [ 2405.700374] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2472.500244] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 2472.514853] Lustre: Skipped 1 previous similar message [ 2472.521864] Lustre: 53927:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 86e6034c-be52-4e93-b301-f4e1d2ddd7e9@ [ 2472.550986] Lustre: 53927:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 3 previous similar messages [ 2472.566428] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2472.573615] Lustre: Skipped 3 previous similar messages [ 2472.688266] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 1 recovered and 2 were evicted. [ 2472.695485] Lustre: Skipped 1 previous similar message [ 2472.740685] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:259 to 0x2c0000401:385) [ 2472.741851] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:323 to 0x280000401:385) [ 2496.370972] Lustre: DEBUG MARKER: == replay-vbr test 6d: rename checks version of target parent ========================================================== 20:30:56 (1767317456) [ 2506.393082] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2510.504472] Lustre: Failing over lustre-MDT0000 [ 2510.805533] Lustre: server umount lustre-MDT0000 complete [ 2513.889831] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2537.068819] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 2537.071248] LDISKFS-fs (dm-0): recovery complete [ 2537.078706] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2545.369476] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2611.623954] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:259 to 0x2c0000401:417) [ 2611.624254] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:323 to 0x280000401:417) [ 2635.459983] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7a skipping SLOW test 7a (base 7) [ 2637.179124] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7b skipping SLOW test 7b (base 7) [ 2638.502982] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7c skipping SLOW test 7c (base 7) [ 2640.080233] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7d skipping SLOW test 7d (base 7) [ 2641.638419] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7e skipping SLOW test 7e (base 7) [ 2643.160673] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7f skipping SLOW test 7f (base 7) [ 2644.547873] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7g skipping SLOW test 7g (base 7) [ 2645.953682] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7h skipping SLOW test 7h (base 7) [ 2647.356166] Lustre: DEBUG MARKER: SKIP: replay-vbr test_7i skipping SLOW test 7i (base 7) [ 2649.194764] Lustre: DEBUG MARKER: == replay-vbr test 8a: create | unlink, create shouldn't fail ========================================================== 20:33:28 (1767317608) [ 2659.160409] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2663.892806] Lustre: Failing over lustre-MDT0000 [ 2663.905844] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2663.917466] Lustre: Skipped 3 previous similar messages [ 2664.239879] Lustre: server umount lustre-MDT0000 complete [ 2678.302237] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2678.340325] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 152 previous similar messages [ 2693.119666] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 2693.121456] LDISKFS-fs (dm-0): recovery complete [ 2693.126613] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2698.350924] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2766.692892] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:419 to 0x2c0000401:449) [ 2766.694200] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:323 to 0x280000401:449) [ 2773.680064] Lustre: DEBUG MARKER: == replay-vbr test 8b: create | unlink, create shouldn't fail ========================================================== 20:35:33 (1767317733) [ 2783.127966] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2787.024408] Lustre: Failing over lustre-MDT0000 [ 2787.224530] Lustre: server umount lustre-MDT0000 complete [ 2787.295651] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2813.567195] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 2813.569141] LDISKFS-fs (dm-0): recovery complete [ 2813.575234] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2823.778793] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2891.575718] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2891.590068] Lustre: Skipped 18 previous similar messages [ 2891.642214] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:451 to 0x2c0000401:481) [ 2891.646439] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:323 to 0x280000401:481) [ 2899.705695] Lustre: DEBUG MARKER: == replay-vbr test 8c: create | unlink, create shouldn't fail ========================================================== 20:37:39 (1767317859) [ 2908.703475] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2913.112152] Lustre: Failing over lustre-MDT0000 [ 2913.291463] LustreError: 61661:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2913.298241] LustreError: 61661:0:(obd_class.h:479:obd_check_dev()) Skipped 31 previous similar messages [ 2913.397541] Lustre: server umount lustre-MDT0000 complete [ 2914.785419] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2914.807636] Lustre: Skipped 16 previous similar messages [ 2931.174888] Lustre: 6816:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767317875/real 1767317875] req@ffff8a76fbedb480 x1853164263415552/t0(0) o400->MGC192.168.202.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767317891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 2931.191433] Lustre: 6816:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 2931.196310] LustreError: MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2931.202118] LustreError: Skipped 3 previous similar messages [ 2940.620667] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 2940.622627] LDISKFS-fs (dm-0): recovery complete [ 2940.639890] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2956.051071] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2956.054400] Lustre: Skipped 3 previous similar messages [ 2957.267345] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2957.274918] Lustre: Skipped 3 previous similar messages [ 2961.412559] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3027.500122] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 3027.506697] Lustre: Skipped 3 previous similar messages [ 3027.514577] Lustre: 62603:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 89e2f3cb-f854-4202-8967-c2c122f394e7@ [ 3027.539760] Lustre: 62603:0:(genops.c:1618:class_disconnect_stale_exports()) Skipped 5 previous similar messages [ 3027.548784] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 3027.558510] Lustre: Skipped 5 previous similar messages [ 3027.649143] Lustre: lustre-MDT0000: Recovery over after 1:10, of 3 clients 2 recovered and 1 was evicted. [ 3027.653430] Lustre: Skipped 3 previous similar messages [ 3027.695587] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:323 to 0x280000401:513) [ 3027.696137] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:483 to 0x2c0000401:513) [ 3034.862362] Lustre: DEBUG MARKER: == replay-vbr test 10b: 3 clients: some, none, and all reqs replayed ========================================================== 20:39:54 (1767317994) [ 3036.379345] Lustre: DEBUG MARKER: SKIP: replay-vbr test_10b Need two or more clients, have 1 [ 3037.900600] Lustre: DEBUG MARKER: == replay-vbr test 11a: concurrent creates don't affect each other ========================================================== 20:39:57 (1767317997) [ 3047.365464] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3053.715812] Lustre: Failing over lustre-MDT0000 [ 3053.989762] Lustre: server umount lustre-MDT0000 complete [ 3081.600932] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 3081.605800] LDISKFS-fs (dm-0): recovery complete [ 3081.612899] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3085.282898] LustreError: 6814:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a76fff8f480 x1853164263494784/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 3085.600107] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3085.609951] Lustre: Skipped 4 previous similar messages [ 3089.804741] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3156.764378] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:614 to 0x2c0000401:641) [ 3156.769789] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:614 to 0x280000401:641) [ 3165.131382] Lustre: DEBUG MARKER: == replay-vbr test 11b: concurrent creates and unlinks don't affect each other ========================================================== 20:42:04 (1767318124) [ 3175.789897] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3180.100209] Lustre: Failing over lustre-MDT0000 [ 3180.364426] Lustre: server umount lustre-MDT0000 complete [ 3209.055543] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 3209.057712] LDISKFS-fs (dm-0): recovery complete [ 3209.064161] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3209.706645] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x179faf72e9360667 [ 3215.071988] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3283.879613] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:742 to 0x2c0000401:769) [ 3283.879915] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:742 to 0x280000401:769) [ 3291.727611] Lustre: DEBUG MARKER: == replay-vbr test 12a: lost data due to missed REMOTE client during replay ========================================================== 20:44:11 (1767318251) [ 3299.949467] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3304.575874] Lustre: Failing over lustre-MDT0000 [ 3305.082838] Lustre: server umount lustre-MDT0000 complete [ 3307.489684] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3307.518509] LustreError: 21747:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 183 previous similar messages [ 3331.742884] LDISKFS-fs (dm-0): 2 truncates cleaned up [ 3331.748207] LDISKFS-fs (dm-0): recovery complete [ 3331.757083] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3333.919656] LustreError: 68815:0:(import.c:337:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) [ 3333.936918] LustreError: 68815:0:(import.c:361:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8a75c7f73480 x1853164263627520/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1767318294 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 3333.952852] LustreError: 68815:0:(import.c:371:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. [ 3334.112854] LustreError: 6814:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a75c7f70380 x1853164263630208/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 3338.278648] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3405.376714] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:795 to 0x2c0000401:833) [ 3405.378736] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:795 to 0x280000401:833) [ 3413.362875] Lustre: DEBUG MARKER: == replay-vbr test 13: Shouldn't give up VBR easily on sluggish network ========================================================== 20:46:12 (1767318372) [ 3417.390693] Lustre: DEBUG MARKER: SKIP: replay-vbr test_13 Needs separate MGS to enable IR [ 3421.069962] Lustre: DEBUG MARKER: == replay-vbr test complete, duration 2871 sec =========== 20:46:20 (1767318380) [ 3422.538737] Lustre: DEBUG MARKER: === replay-vbr: start cleanup 20:46:22 (1767318382) === [ 3427.926776] Lustre: DEBUG MARKER: === replay-vbr: finish cleanup 20:46:27 (1767318387) === [ 3429.734857] Lustre: Failing over lustre-MDT0000 [ 3430.167533] Lustre: server umount lustre-MDT0000 complete [ 3430.880036] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3430.890776] LustreError: Skipped 2 previous similar messages [ 3460.365042] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3473.891155] LustreError: 6814:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a76fe99bb80 x1853164263736448/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 3479.597524] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:795 to 0x2c0000401:865) [ 3479.598452] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:795 to 0x280000401:865) [ 3479.663914] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3487.736937] Lustre: DEBUG MARKER: oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3489.505533] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 3500.003441] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3500.019557] Lustre: Skipped 3 previous similar messages [ 3501.250468] Lustre: server umount lustre-MDT0000 complete [ 3509.822381] LustreError: 69828:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1767318470 with bad export cookie 1702272092243133480 [ 3509.851273] LustreError: 69828:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3510.256724] Lustre: server umount lustre-MDT0001 complete [ 3525.343792] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3525.363068] Lustre: Skipped 22 previous similar messages [ 3531.610092] LustreError: 72794:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 3531.617908] LustreError: 72794:0:(obd_class.h:479:obd_check_dev()) Skipped 55 previous similar messages [ 3531.624840] Lustre: 6818:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318476/real 1767318476] req@ffff8a76fffd9880 x1853164263776384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1767318492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 3531.654857] Lustre: 6818:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [ 3531.825286] Lustre: server umount lustre-OST0000 complete [ 3540.841638] Lustre: server umount lustre-OST0001 complete [ 3563.693272] Lustre: DEBUG MARKER: oleg223-server.virtnet: executing unload_modules_local [ 3566.526386] Key type lgssc unregistered [ 3566.869930] LNet: 74221:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3566.877944] LNetError: 74221:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3566.898313] LNet: Removed LNI 192.168.202.123@tcp [ 3567.691409] Key type .llcrypt unregistered [ 3567.693600] Key type ._llcrypt unregistered