[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 603523948 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.003000] x2apic enabled [ 0.003010] Switched APIC routing to physical x2apic. [ 0.004017] kvm-guest: setup PV IPIs [ 0.008704] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.009000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.009019] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.010012] pid_max: default: 32768 minimum: 301 [ 0.011125] LSM: Security Framework initializing [ 0.012048] Yama: becoming mindful. [ 0.013043] SELinux: Initializing. [ 0.014000] *** VALIDATE selinux *** [ 0.023000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.028056] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.030055] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031106] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.033087] *** VALIDATE tmpfs *** [ 0.034433] *** VALIDATE proc *** [ 0.035000] *** VALIDATE cgroup *** [ 0.035000] *** VALIDATE cgroup2 *** [ 0.035279] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.036149] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.037011] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.038028] Spectre V2 : User space: Vulnerable [ 0.039010] Speculative Store Bypass: Vulnerable [ 0.042587] debug: unmapping init [mem 0xffffffff88259000-0xffffffff88260fff] [ 0.044974] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.045984] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.047024] ... version: 2 [ 0.048012] ... bit width: 48 [ 0.049012] ... generic registers: 4 [ 0.050012] ... value mask: 0000ffffffffffff [ 0.051012] ... max period: 00007fffffffffff [ 0.052011] ... fixed-purpose events: 3 [ 0.053011] ... event mask: 000000070000000f [ 0.054275] rcu: Hierarchical SRCU implementation. [ 0.056836] smp: Bringing up secondary CPUs ... [ 0.057568] x86: Booting SMP configuration: [ 0.058020] .... node #0, CPUs: #1 #2 #3 [ 0.089135] smp: Brought up 1 node, 4 CPUs [ 0.091017] smpboot: Max logical packages: 1 [ 0.092017] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.145174] node 0 deferred pages initialised in 49ms [ 0.153475] devtmpfs: initialized [ 0.154258] x86/mm: Memory block size: 128MB [ 0.156137] gcov: version magic: 0x41383552 [ 0.162370] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.169071] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.175806] pinctrl core: initialized pinctrl subsystem [ 0.180226] [ 0.182011] ************************************************************* [ 0.186016] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.192013] ** ** [ 0.194010] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.197012] ** ** [ 0.202014] ** This means that this kernel is built to expose internal ** [ 0.204025] ** IOMMU data structures, which may compromise security on ** [ 0.212025] ** your system. ** [ 0.217011] ** ** [ 0.224035] ** If you see this message and you are not debugging the ** [ 0.227014] ** kernel, report this immediately to your vendor! ** [ 0.232439] ** ** [ 0.237014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.241014] ************************************************************* [ 0.246494] NET: Registered protocol family 16 [ 0.260030] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.264282] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.270091] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.275153] cpuidle: using governor menu [ 0.279037] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.286194] PCI: Using configuration type 1 for base access [ 0.293279] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.303199] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.306031] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.312346] cryptd: max_cpu_qlen set to 1000 [ 0.316097] ACPI: Added _OSI(Module Device) [ 0.317023] ACPI: Added _OSI(Processor Device) [ 0.319021] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.323029] ACPI: Added _OSI(Processor Aggregator Device) [ 0.335065] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.365417] ACPI: Interpreter enabled [ 0.371102] ACPI: PM: (supports S0 S3 S4 S5) [ 0.375021] ACPI: Using IOAPIC for interrupt routing [ 0.379862] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.390917] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.408000] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.411101] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.416028] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.421289] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.429062] acpiphp: Slot [2] registered [ 0.431252] acpiphp: Slot [5] registered [ 0.433357] acpiphp: Slot [6] registered [ 0.435203] acpiphp: Slot [7] registered [ 0.437408] acpiphp: Slot [8] registered [ 0.440355] acpiphp: Slot [9] registered [ 0.442368] acpiphp: Slot [10] registered [ 0.445323] acpiphp: Slot [3] registered [ 0.447254] acpiphp: Slot [4] registered [ 0.449320] acpiphp: Slot [11] registered [ 0.451153] acpiphp: Slot [12] registered [ 0.453137] acpiphp: Slot [13] registered [ 0.455123] acpiphp: Slot [14] registered [ 0.456116] acpiphp: Slot [15] registered [ 0.458192] acpiphp: Slot [16] registered [ 0.461187] acpiphp: Slot [17] registered [ 0.463159] acpiphp: Slot [18] registered [ 0.465163] acpiphp: Slot [19] registered [ 0.468164] acpiphp: Slot [20] registered [ 0.470205] acpiphp: Slot [21] registered [ 0.472264] acpiphp: Slot [22] registered [ 0.475164] acpiphp: Slot [23] registered [ 0.483148] acpiphp: Slot [24] registered [ 0.485170] acpiphp: Slot [25] registered [ 0.488216] acpiphp: Slot [26] registered [ 0.491165] acpiphp: Slot [27] registered [ 0.493240] acpiphp: Slot [28] registered [ 0.495156] acpiphp: Slot [29] registered [ 0.497089] acpiphp: Slot [30] registered [ 0.499198] acpiphp: Slot [31] registered [ 0.501219] PCI host bridge to bus 0000:00 [ 0.504031] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.508031] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.511033] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.515032] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.526041] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.535038] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.541223] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.547018] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.552933] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.568029] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.575691] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.583030] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.589036] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.594029] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.599328] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.607431] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.612059] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.615989] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.632023] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.654025] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.668024] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.687506] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.704017] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.711017] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.733015] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.748317] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.758021] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.776025] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.802026] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.832243] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.858028] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.870021] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.901020] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.916421] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.927073] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.937030] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.969079] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.981320] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.990027] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 1.001023] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 1.025021] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 1.038376] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 1.063023] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 1.083021] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 1.114021] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 1.129345] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 1.134425] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.139421] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 1.142999] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.147316] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 1.161059] iommu: Default domain type: Passthrough [ 1.166399] SCSI subsystem initialized [ 1.168425] ACPI: bus type USB registered [ 1.172463] usbcore: registered new interface driver usbfs [ 1.180502] usbcore: registered new interface driver hub [ 1.182309] usbcore: registered new device driver usb [ 1.185228] pps_core: LinuxPPS API ver. 1 registered [ 1.187015] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.200085] PTP clock support registered [ 1.205073] EDAC MC: Ver: 3.0.0 [ 1.207282] PCI: Using ACPI for IRQ routing [ 1.208000] NetLabel: Initializing [ 1.212015] NetLabel: domain hash size = 128 [ 1.220066] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.223117] NetLabel: unlabeled traffic allowed by default [ 1.228050] vgaarb: loaded [ 1.230000] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 1.230000] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.241956] clocksource: Switched to clocksource kvm-clock [ 1.530112] VFS: Disk quotas dquot_6.6.0 [ 1.534153] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.541708] *** VALIDATE ramfs *** [ 1.547586] *** VALIDATE hugetlbfs *** [ 1.550721] pnp: PnP ACPI init [ 1.561882] pnp: PnP ACPI: found 6 devices [ 1.604185] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.612467] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.621669] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.630373] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.638811] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.647666] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.653135] NET: Registered protocol family 2 [ 1.658665] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.668127] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.678462] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.687380] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.694517] TCP: Hash tables configured (established 65536 bind 65536) [ 1.697800] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.705505] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.712728] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.717497] NET: Registered protocol family 1 [ 1.722845] RPC: Registered named UNIX socket transport module. [ 1.724835] RPC: Registered udp transport module. [ 1.729500] RPC: Registered tcp transport module. [ 1.734481] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.736585] NET: Registered protocol family 44 [ 1.742862] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.744816] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.748176] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.750796] PCI: CLS 0 bytes, default 64 [ 1.754587] Unpacking initramfs... [ 4.711509] debug: unmapping init [mem 0xffff9a6f7cc54000-0xffff9a6f7ffbffff] [ 4.735040] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.744792] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 4.754501] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 5.628113] Initialise system trusted keyrings [ 5.631090] Key type blacklist registered [ 5.633675] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 5.660670] zbud: loaded [ 5.667621] *** VALIDATE nfs *** [ 5.671717] *** VALIDATE nfs4 *** [ 5.680347] pstore: using deflate compression [ 5.696590] Platform Keyring initialized [ 6.098717] NET: Registered protocol family 38 [ 6.102546] Key type asymmetric registered [ 6.105504] Asymmetric key parser 'x509' registered [ 6.115217] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 6.122600] io scheduler mq-deadline registered [ 6.124241] io scheduler kyber registered [ 6.131526] io scheduler bfq registered [ 6.141931] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 6.150063] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 6.157859] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 6.164431] ACPI: Power Button [PWRF] [ 6.181688] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 6.254877] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 6.304707] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 6.324317] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 6.349571] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.379337] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 6.423181] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 6.429553] Non-volatile memory driver v1.3 [ 6.431370] Linux agpgart interface v0.103 [ 6.502403] virtio_blk virtio1: [vda] 149768 512-byte logical blocks (76.7 MB/73.1 MiB) [ 6.506849] vda: detected capacity change from 0 to 76681216 [ 6.553181] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 6.557193] vdb: detected capacity change from 0 to 1073741824 [ 6.595738] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.601890] vdc: detected capacity change from 0 to 2621440000 [ 6.667109] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.678068] vdd: detected capacity change from 0 to 2621440000 [ 6.715531] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.719978] vde: detected capacity change from 0 to 4294967296 [ 6.761283] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.766227] vdf: detected capacity change from 0 to 4294967296 [ 6.787864] libphy: Fixed MDIO Bus: probed [ 6.842919] usbcore: registered new interface driver usbserial_generic [ 6.857800] usbserial: USB Serial support registered for generic [ 6.860357] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 6.883821] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 6.886942] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 6.895546] mousedev: PS/2 mouse device common for all mice [ 6.900945] rtc_cmos 00:05: RTC can wake from S4 [ 6.906670] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 6.917253] rtc_cmos 00:05: registered as rtc0 [ 6.921130] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 6.926777] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 6.929308] intel_pstate: CPU model not supported [ 6.942452] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 6.955672] hid: raw HID events driver (C) Jiri Kosina [ 6.959124] usbcore: registered new interface driver usbhid [ 6.961383] usbhid: USB HID core driver [ 6.963505] drop_monitor: Initializing network drop monitor service [ 6.966601] Initializing XFRM netlink socket [ 6.968961] NET: Registered protocol family 10 [ 6.972841] Segment Routing with IPv6 [ 6.974304] NET: Registered protocol family 17 [ 6.976707] mpls_gso: MPLS GSO support [ 6.984204] RAS: Correctable Errors collector initialized. [ 6.987220] AVX version of gcm_enc/dec engaged. [ 6.988904] AES CTR mode by8 optimization enabled [ 7.092537] sched_clock: Marking stable (7092458594, 0)->(8586774472, -1494315878) [ 7.096321] registered taskstats version 1 [ 7.097880] Loading compiled-in X.509 certificates [ 7.099902] zswap: loaded using pool lzo/zbud [ 7.157542] Key type big_key registered [ 7.190461] Key type encrypted registered [ 7.191968] ima: No TPM chip found, activating TPM-bypass! [ 7.199333] ima: Allocated hash algorithm: sha1 [ 7.201346] ima: No architecture policies found [ 7.205174] evm: Initialising EVM extended attributes: [ 7.208813] evm: security.selinux [ 7.211815] evm: security.ima [ 7.215404] evm: security.capability [ 7.217689] evm: HMAC attrs: 0x1 [ 7.222395] rtc_cmos 00:05: setting system clock to 2026-09-03 19:08:32 UTC (1788462512) [ 7.232989] debug: unmapping init [mem 0xffffffff89203000-0xffffffff893fffff] [ 7.240674] debug: unmapping init [mem 0xffffffff87f82000-0xffffffff88258fff] [ 7.256058] Write protecting the kernel read-only data: 28672k [ 7.264655] debug: unmapping init [mem 0xffffffff86603000-0xffffffff867fffff] [ 7.273433] debug: unmapping init [mem 0xffffffff86f14000-0xffffffff86ffffff] [ 7.360956] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.372802] systemd[1]: Detected virtualization kvm. [ 7.375141] systemd[1]: Detected architecture x86-64. [ 7.376996] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 7.418577] systemd[1]: No hostname configured. [ 7.420343] systemd[1]: Set hostname to . [ 7.427432] random: systemd: uninitialized urandom read (16 bytes read) [ 7.429248] systemd[1]: Initializing machine ID from random generator. [ 7.573958] random: ln: uninitialized urandom read (6 bytes read) [ 7.776486] random: systemd: uninitialized urandom read (16 bytes read) [ 7.781239] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 7.791805] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 7.802374] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Paths. [ OK ] Reached target Timers. [ OK ] Reached target Local File Systems. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Reached target Local Encrypted Volumes. Starting Create Volatile Files and Directories... Starting Create list of required st…ce nodes for the current kernel... Starting Apply Kernel Variables... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Slices. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 9.686949] device-mapper: uevent: version 1.0.3 [ 9.695398] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 11.531656] random: fast init done [ 11.604211] virtio_net virtio0 ens2: renamed from eth0 [ 12.203291] scsi host0: ata_piix [ 12.289672] scsi host1: ata_piix [ 12.295628] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 12.300714] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 16.730111] random: crng init done [ 16.735456] random: 7 urandom warning(s) missed due to ratelimiting [ 19.164520] dracut-initqueue[590]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 21.086084] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 24.126686] printk: systemd: 25 output lines suppressed due to ratelimiting [ 25.079692] SELinux: Disabled at runtime. [ 25.239523] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 25.264089] systemd[1]: Detected virtualization kvm. [ 25.268997] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 27.234644] systemd[1]: initrd-switch-root.service: Succeeded. [ 27.244715] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 27.264921] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 27.271834] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 27.280993] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 27.303880] systemd[1]: Starting Journal Service... Starting Journal Service... [ 27.322277] systemd[1]: Created slice system-getty.slice. [ OK ] Created slice system-getty.slice. [ OK ] Reached target rpc_pipefs.target. Activating swap /dev/disk/by-label/SWAP... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ 27.411361] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on initctl Compatibility Named Pipe. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Starting Apply Kernel Variables... [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. Starting Remount Root and Kernel File Systems... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Huge Pages File System... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on udev Control Socket. [ OK ] Stopped target Initrd Root File System. [ OK ] Created slice User and Session Slice. Mounting Kernel Debug File System... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Slices. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... Mounting POSIX Message Queue File System... [ OK ] Reached target Paths. [ OK ] Started Journal Service. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted POSIX Message Queue File System. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 28.659903] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 29.758591] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 29.857366] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 30.331487] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 30.370337] EDAC sbridge: Ver: 1.1.2 [ 34.320059] Key type dns_resolver registered [* ] A start job is running for Configur…-only root support (7s / no limit)[ 34.933783] NFS: Registering the id_resolver key type [ 34.937238] Key type id_resolver registered [ 34.938965] Key type id_legacy registered [** ] A start job is running for Configur…-only root support (8s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started irqbalance daemon. Starting Login Service... [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... Starting Hostname Service... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg642-server login: [ 87.073250] libcfs: loading out-of-tree module taints kernel. [ 87.167881] Key type ._llcrypt registered [ 87.171046] Key type .llcrypt registered [ 87.329763] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_hostid [ 104.597903] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing load_modules_local [ 106.217723] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 106.251711] alg: No test for adler32 (adler32-zlib) [ 107.737231] Lustre: Lustre: Build Version: 2.17.58_2_g1e70112 [ 108.721899] LNet: Added LNI 192.168.206.142@tcp [8/256/0/180] [ 110.585811] Key type lgssc registered [ 112.613931] Lustre: Echo OBD driver; http://www.lustre.org/ [ 133.585476] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 174.344417] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing load_modules_local [ 187.899548] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 187.937751] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 189.366793] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 189.455589] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 189.612088] Lustre: lustre-MDT0000: new disk, initializing [ 189.705044] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 189.729788] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 194.021420] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 207.741422] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 207.881616] Lustre: 6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 207.946578] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 207.952576] Lustre: Skipped 1 previous similar message [ 208.069592] Lustre: lustre-MDT0001: new disk, initializing [ 208.189412] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 208.235026] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 208.245069] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 212.333890] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 216.754438] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 226.737414] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 227.183704] Lustre: lustre-OST0000: new disk, initializing [ 227.189059] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 227.195935] Lustre: 8452:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 227.286256] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 232.510027] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 232.519038] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 232.621704] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 234.248961] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 249.380715] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 249.551273] Lustre: lustre-OST0001: new disk, initializing [ 249.555181] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 249.561671] Lustre: 9526:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 249.637616] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 256.412412] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 258.591605] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 258.598175] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 258.684071] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 270.044147] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 277.336440] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 284.781393] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing check_logdir /tmp/testlogs/ [ 291.056819] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing yml_node [ 295.184340] Lustre: DEBUG MARKER: Client: 2.17.58.2 [ 298.019843] Lustre: DEBUG MARKER: MDS: 2.17.58.2 [ 301.170485] Lustre: DEBUG MARKER: OSS: 2.17.58.2 [ 302.768148] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity ============----- Thu Sep 3 15:13:26 EDT 2026 [ 322.557065] Lustre: DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683394 <= 34618625) for LU-18938, skip 360 [ 324.434719] Lustre: DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683394 < 34486116) for LU-14927, skip 0f [ 326.156661] Lustre: DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683394 < 34681754) for LU-12550, skip 216 [ 328.105763] Lustre: DEBUG MARKER: excepting tests: 56oc 42a 42c 42b 118c 118d 407 119i 216 817 411a [ 331.194767] Lustre: DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51c 51e 834 [ 334.916677] Lustre: DEBUG MARKER: === sanity: start setup 15:13:56 (1788462836) === [ 345.976535] Lustre: DEBUG MARKER: oleg642-client.virtnet: executing check_config_client /mnt/lustre [ 348.529215] hrtimer: interrupt took 2322773 ns [ 373.193505] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 377.283564] Lustre: 13534:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 381.238212] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 387.188733] Lustre: DEBUG MARKER: === sanity: finish setup 15:14:50 (1788462890) === [ 389.902707] Lustre: DEBUG MARKER: == sanity test 0a: touch; rm ============================= 15:14:53 (1788462893) [ 396.688412] Lustre: DEBUG MARKER: == sanity test 0b: chmod 0755 /mnt/lustre ======================================================================================= 15:15:00 (1788462900) [ 402.836649] Lustre: DEBUG MARKER: == sanity test 0c: check import proc ===================== 15:15:06 (1788462906) [ 409.078484] Lustre: DEBUG MARKER: == sanity test 0d: check export proc ===================== 15:15:12 (1788462912) [ 421.274868] Lustre: DEBUG MARKER: == sanity test 0e: Enable DNE MDT balancing for mkdir in the ROOT ========================================================== 15:15:24 (1788462924) [ 428.211807] Lustre: DEBUG MARKER: == sanity test 1: mkdir; remkdir; rmdir ================== 15:15:31 (1788462931) [ 436.258385] Lustre: DEBUG MARKER: == sanity test 2: mkdir; touch; rmdir; check file ======== 15:15:39 (1788462939) [ 443.289409] Lustre: DEBUG MARKER: == sanity test 3: mkdir; touch; rmdir; check dir ========= 15:15:47 (1788462947) [ 448.878914] Lustre: DEBUG MARKER: == sanity test 4: mkdir; touch dir/file; rmdir; checkdir (expect error) ========================================================== 15:15:52 (1788462952) [ 460.141139] Lustre: DEBUG MARKER: == sanity test 5: mkdir .../d5 .../d5/d2; chmod .../d5/d2 ========================================================== 15:16:02 (1788462962) [ 475.098777] Lustre: DEBUG MARKER: == sanity test 6a: touch f6a; chmod f6a; runas -u 500 -g 500 chmod f6a (should return error) ============================================================ 15:16:17 (1788462977) [ 487.201987] Lustre: DEBUG MARKER: == sanity test 6c: touch f6c; chown f6c; runas -u 500 -g 500 chown f6c (should return error) ============================================================ 15:16:30 (1788462990) [ 495.160081] Lustre: DEBUG MARKER: == sanity test 6e: touch+chgrp ; runas -u 500 -g 500 chgrp (should return error) ========================================================== 15:16:38 (1788462998) [ 502.551177] Lustre: DEBUG MARKER: == sanity test 6g: verify new dir in sgid dir inherits group ========================================================== 15:16:45 (1788463005) [ 509.711455] Lustre: DEBUG MARKER: == sanity test 6h: runas -u 500 -g 500 chown RUNAS_ID.0 .../ (should return error) ========================================================== 15:16:53 (1788463013) [ 516.539347] Lustre: DEBUG MARKER: == sanity test 6i: touch+chmod+chgrp ; chgrp read-only file should succeed ========================================================== 15:17:00 (1788463020) [ 523.736311] Lustre: DEBUG MARKER: == sanity test 7a: mkdir .../d7; mcreate .../d7/f; chmod .../d7/f ============================================================== 15:17:07 (1788463027) [ 530.545729] Lustre: DEBUG MARKER: == sanity test 7b: mkdir .../d7; mcreate d7/f2; echo foo > d7/f2 =============================================================== 15:17:14 (1788463034) [ 537.386562] Lustre: DEBUG MARKER: == sanity test 8: mkdir .../d8; touch .../d8/f; chmod .../d8/f ================================================================= 15:17:20 (1788463040) [ 543.277836] Lustre: DEBUG MARKER: == sanity test 9: mkdir .../d9 .../d9/d2 .../d9/d2/d3 ========================================================================== 15:17:27 (1788463047) [ 549.747798] Lustre: DEBUG MARKER: == sanity test 10: mkdir .../d10 .../d10/d2; touch .../d10/d2/f ================================================================ 15:17:33 (1788463053) [ 555.520063] Lustre: DEBUG MARKER: == sanity test 11: mkdir .../d11 d11/d2; chmod .../d11/d2 ====================================================================== 15:17:39 (1788463059) [ 562.588506] Lustre: DEBUG MARKER: == sanity test 12: touch .../d12/f; chmod .../d12/f .../d12/f ================================================================== 15:17:46 (1788463066) [ 570.167831] Lustre: DEBUG MARKER: == sanity test 13: creat .../d13/f; dd .../d13/f; > .../d13/f ================================================================== 15:17:53 (1788463073) [ 577.461632] Lustre: DEBUG MARKER: == sanity test 14: touch .../d14/f; rm .../d14/f; rm .../d14/f ================================================================= 15:18:00 (1788463080) [ 584.227572] Lustre: DEBUG MARKER: == sanity test 15: touch .../d15/f; mv .../d15/f .../d15/f2 ==================================================================== 15:18:07 (1788463087) [ 591.325428] Lustre: DEBUG MARKER: == sanity test 16: touch .../d16/f; rm -rf .../d16/f ===== 15:18:14 (1788463094) [ 599.328211] Lustre: DEBUG MARKER: == sanity test 17a: symlinks: create, remove (real) ====== 15:18:22 (1788463102) [ 606.741655] Lustre: DEBUG MARKER: == sanity test 17b: symlinks: create, remove (dangling) == 15:18:30 (1788463110) [ 613.821059] Lustre: DEBUG MARKER: == sanity test 17c: symlinks: open dangling (should return error) ========================================================== 15:18:37 (1788463117) [ 621.301885] Lustre: DEBUG MARKER: == sanity test 17d: symlinks: create dangling ============ 15:18:44 (1788463124) [ 627.788972] Lustre: DEBUG MARKER: == sanity test 17e: symlinks: create recursive symlink (should return error) ========================================================== 15:18:51 (1788463131) [ 634.253977] Lustre: DEBUG MARKER: == sanity test 17f: symlinks: long and very long symlink name ========================================================== 15:18:57 (1788463137) [ 641.179386] Lustre: DEBUG MARKER: == sanity test 17g: symlinks: really long symlink name and inode boundaries ========================================================== 15:19:04 (1788463144) [ 648.474679] Lustre: DEBUG MARKER: == sanity test 17h: create objects: lov_free_memmd() doesn't lbug ========================================================== 15:19:11 (1788463151) [ 658.516739] Lustre: DEBUG MARKER: == sanity test 17i: don't panic on short symlink (should return error) ========================================================== 15:19:21 (1788463161) [ 660.043721] Lustre: *** cfs_fail_loc=143, val=0*** [ 667.313127] Lustre: DEBUG MARKER: == sanity test 17k: symlinks: rsync with xattrs enabled == 15:19:30 (1788463170) [ 675.362553] Lustre: DEBUG MARKER: == sanity test 17l: Ensure lgetxattr's returned xattr size is consistent ========================================================== 15:19:39 (1788463179) [ 683.204546] Lustre: DEBUG MARKER: == sanity test 17m: run e2fsck against MDT which contains short/long symlink ========================================================== 15:19:46 (1788463186) [ 765.113195] Lustre: Failing over lustre-MDT0001 [ 765.404915] Lustre: server umount lustre-MDT0001 complete [ 765.410559] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 765.422166] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 765.454718] Lustre: Skipped 2 previous similar messages [ 770.527810] LustreError: 6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 770.535535] LustreError: 6521:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 7 previous similar messages [ 774.419118] LustreError: 21763:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.206.42@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 775.652694] LustreError: 6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 775.665313] LustreError: 6521:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 775.709457] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 776.096148] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 776.138449] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 777.774495] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 781.289061] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 781.336953] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 781.385991] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:7 to 0x2c0000400:33) [ 781.389500] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:8 to 0x280000400:33) [ 782.033377] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 815.497378] Lustre: DEBUG MARKER: == sanity test 17n: run e2fsck against master/slave MDT which contains remote dir ========================================================== 15:21:58 (1788463318) [ 822.601630] Lustre: Failing over lustre-MDT0000 [ 823.029499] Lustre: server umount lustre-MDT0000 complete [ 823.591455] LustreError: 8701:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.42@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 827.366846] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 827.375211] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 827.404789] Lustre: Skipped 3 previous similar messages [ 828.676771] LustreError: 6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.42@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 828.703461] LustreError: 6521:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [ 834.111562] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 834.360471] LustreError: MGC192.168.206.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 834.848609] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 834.934187] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 838.916997] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 840.174655] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 840.184844] Lustre: Skipped 2 previous similar messages [ 840.223646] Lustre: lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. [ 840.302262] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:45 to 0x280000401:65) [ 840.310054] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:65) [ 840.458120] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 844.703255] Lustre: Failing over lustre-MDT0001 [ 845.029202] Lustre: server umount lustre-MDT0001 complete [ 845.279795] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 845.284597] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 845.292221] LustreError: 12156:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 845.292231] LustreError: 12156:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 845.361308] Lustre: Skipped 2 previous similar messages [ 856.090504] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 856.544349] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 856.608710] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 857.874950] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 861.326180] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 861.680970] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 861.690516] Lustre: Skipped 3 previous similar messages [ 861.738147] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 861.811557] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:49 to 0x280000400:65) [ 861.812502] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:49 to 0x2c0000400:65) [ 870.831345] Lustre: Failing over lustre-MDT0000 [ 871.309445] Lustre: server umount lustre-MDT0000 complete [ 871.905371] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 871.915532] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 871.925341] LustreError: 21763:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 871.943861] Lustre: Skipped 2 previous similar messages [ 871.961277] LustreError: 21763:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 13 previous similar messages [ 883.311824] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 883.525460] LustreError: MGC192.168.206.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 884.239469] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 884.327455] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 888.072886] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 889.322531] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 889.330302] Lustre: Skipped 2 previous similar messages [ 889.353783] Lustre: lustre-MDT0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. [ 889.393919] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:45 to 0x280000401:97) [ 889.395321] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:97) [ 889.836296] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 894.032068] Lustre: Failing over lustre-MDT0001 [ 894.450240] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 894.454416] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 894.481854] Lustre: Skipped 3 previous similar messages [ 894.623877] Lustre: server umount lustre-MDT0001 complete [ 904.696761] LustreError: 6522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 904.728726] LustreError: 6522:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 21 previous similar messages [ 907.037946] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 907.641275] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 908.557700] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 912.550546] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 912.905076] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 912.914186] Lustre: Skipped 3 previous similar messages [ 913.168766] Lustre: lustre-MDT0001: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. [ 913.245656] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:49 to 0x2c0000400:97) [ 913.246453] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:49 to 0x280000400:97) [ 929.229504] Lustre: Failing over lustre-MDT0000 [ 929.660785] Lustre: server umount lustre-MDT0000 complete [ 929.775195] LustreError: 6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463435 with bad export cookie 14744425836312278028 [ 929.777915] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 929.791374] LustreError: 6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 929.791525] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [ 940.672966] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 940.805512] LustreError: MGC192.168.206.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 941.335625] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 941.340194] Lustre: Skipped 1 previous similar message [ 941.423931] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 944.402488] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 946.657767] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 946.675110] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 946.689648] Lustre: Skipped 2 previous similar messages [ 946.829186] Lustre: lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. [ 946.879287] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:123 to 0x280000401:161) [ 946.880320] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:123 to 0x2c0000401:161) [ 950.409049] Lustre: Failing over lustre-MDT0001 [ 950.795888] Lustre: server umount lustre-MDT0001 complete [ 951.789047] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 951.809308] Lustre: Skipped 5 previous similar messages [ 951.821835] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 960.520628] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 961.038408] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 962.349809] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 964.395112] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 966.135122] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 966.145093] Lustre: Skipped 3 previous similar messages [ 966.194641] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 966.250337] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:123 to 0x280000400:161) [ 966.251759] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:123 to 0x2c0000400:161) [ 972.993739] Lustre: Failing over lustre-MDT0000 [ 973.069723] Lustre: lustre-MDT0000: Not available for connect from 192.168.206.42@tcp (stopping) [ 973.310400] Lustre: server umount lustre-MDT0000 complete [ 976.358420] LustreError: 6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 976.399871] LustreError: 6520:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 22 previous similar messages [ 985.698814] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 985.872947] LustreError: MGC192.168.206.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 991.748541] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:123 to 0x280000401:193) [ 991.758516] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:123 to 0x2c0000401:193) [ 991.856170] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 995.903671] Lustre: Failing over lustre-MDT0001 [ 996.327987] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 996.335309] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 996.341300] Lustre: Skipped 5 previous similar messages [ 996.432446] Lustre: server umount lustre-MDT0001 complete [ 1007.080783] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1007.636729] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1007.644662] Lustre: Skipped 2 previous similar messages [ 1007.709045] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 1007.714159] Lustre: Skipped 1 previous similar message [ 1008.904326] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1008.914659] Lustre: Skipped 1 previous similar message [ 1011.292154] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 1012.728910] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1012.735239] Lustre: Skipped 6 previous similar messages [ 1012.770169] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 1012.775732] Lustre: Skipped 1 previous similar message [ 1012.806765] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:123 to 0x2c0000400:193) [ 1012.811518] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:123 to 0x280000400:193) [ 1021.333652] Lustre: DEBUG MARKER: == sanity test 17o: stat file with incompat LMA feature == 15:25:25 (1788463525) [ 1024.031375] Lustre: Failing over lustre-MDT0000 [ 1024.301240] Lustre: server umount lustre-MDT0000 complete [ 1042.359652] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1042.537397] LustreError: MGC192.168.206.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1046.371407] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 1048.229528] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:123 to 0x2c0000401:225) [ 1048.229610] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 1056.482557] Lustre: DEBUG MARKER: oleg642-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1058.178988] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1061.156498] Lustre: *** cfs_fail_loc=194, val=0*** [ 1061.178067] Lustre: 6520:0:(osd_handler.c:873:osd_check_lma()) lustre-MDT0000: unsupported incompat LMA feature(s) 0x0 for fid = [0x200000402:0x3a7:0x0], ino = 512164 [ 1069.027315] Lustre: DEBUG MARKER: == sanity test 17p: symlink overwrite directory error message ========================================================== 15:26:12 (1788463572) [ 1076.012925] Lustre: DEBUG MARKER: == sanity test 17q: set large xattr on fast symlink ====== 15:26:19 (1788463579) [ 1080.035558] sysctl (33333): drop_caches: 3 [ 1087.724758] Lustre: DEBUG MARKER: == sanity test 18: touch .../f ; ls ... ======================================================================================== 15:26:31 (1788463591) [ 1094.399398] Lustre: DEBUG MARKER: == sanity test 19a: touch .../f19 ; ls -l ... ; rm .../f19 ===================================================================== 15:26:38 (1788463598) [ 1104.433706] Lustre: DEBUG MARKER: == sanity test 19b: ls -l .../f19 (should return error) ======================================================================== 15:26:47 (1788463607) [ 1113.664895] Lustre: DEBUG MARKER: == sanity test 19c: runas -u 500 -g 500 touch .../f19 (should return error) ============================================================ 15:26:56 (1788463616) [ 1121.105720] Lustre: DEBUG MARKER: == sanity test 19d: cat .../f19 (should return error) ======================================================================== 15:27:04 (1788463624) [ 1127.657787] Lustre: DEBUG MARKER: == sanity test 20: touch .../f ; ls -l ... =============== 15:27:11 (1788463631) [ 1134.118806] Lustre: DEBUG MARKER: == sanity test 21: write to dangling link ================ 15:27:17 (1788463637) [ 1140.786487] Lustre: DEBUG MARKER: == sanity test 22: unpack tar archive as non-root user === 15:27:24 (1788463644) [ 1148.691404] Lustre: DEBUG MARKER: == sanity test 23a: O_CREAT|O_EXCL in subdir ============= 15:27:32 (1788463652) [ 1155.814301] Lustre: DEBUG MARKER: == sanity test 23b: O_APPEND check ======================= 15:27:39 (1788463659) [ 1163.428778] Lustre: DEBUG MARKER: == sanity test 23c: O_APPEND size checks for tiny writes ========================================================== 15:27:46 (1788463666) [ 1174.596595] Lustre: DEBUG MARKER: == sanity test 23d: file offset is correct after appending writes ========================================================== 15:27:58 (1788463678) [ 1182.171971] Lustre: DEBUG MARKER: == sanity test 23e: tiny write updates the size seen by cached statx ========================================================== 15:28:05 (1788463685) [ 1190.539404] Lustre: DEBUG MARKER: == sanity test 24a: rename file to non-existent target === 15:28:13 (1788463693) [ 1198.166155] Lustre: DEBUG MARKER: == sanity test 24b: rename file to existing target ======= 15:28:21 (1788463701) [ 1205.047598] Lustre: DEBUG MARKER: == sanity test 24c: rename directory to non-existent target ========================================================== 15:28:28 (1788463708) [ 1211.583683] Lustre: DEBUG MARKER: == sanity test 24d: rename directory to existing target == 15:28:35 (1788463715) [ 1218.083339] Lustre: DEBUG MARKER: == sanity test 24e: touch .../R5a/f; rename .../R5a/f .../R5b/g ================================================================ 15:28:41 (1788463721) [ 1226.193227] Lustre: DEBUG MARKER: == sanity test 24f: touch .../R6a/f R6b/g; mv .../R6a/f .../R6b/g ============================================================== 15:28:49 (1788463729) [ 1235.005386] Lustre: DEBUG MARKER: == sanity test 24g: mkdir .../R7a/d; .../R7b/d; mv .../R7a/d .../R7b/e ================================================================ 15:28:58 (1788463738) [ 1244.397667] Lustre: DEBUG MARKER: == sanity test 24h: mkdir .../R8a/d; .../R8a/e; .../R8b/d; .../R8b/e; rename .../R8a/d .../R8b/e ========================================================== 15:29:07 (1788463747) [ 1250.588589] Lustre: DEBUG MARKER: == sanity test 24i: rename file to dir error: touch f ; mkdir a ; rename f a ========================================================== 15:29:14 (1788463754) [ 1258.158261] Lustre: DEBUG MARKER: == sanity test 24j: source does not exist ====================================================================================== 15:29:21 (1788463761) [ 1266.356727] Lustre: DEBUG MARKER: == sanity test 24k: touch .../R11a/f; mv .../R11a/f .../R11a/d ================================================================= 15:29:29 (1788463769) [ 1274.206791] Lustre: DEBUG MARKER: == sanity test 24l: Renaming a file to itself ================================================================================== 15:29:37 (1788463777) [ 1280.467616] Lustre: DEBUG MARKER: == sanity test 24m: Renaming a file to a hard link to itself =================================================================== 15:29:44 (1788463784) [ 1288.374101] Lustre: DEBUG MARKER: == sanity test 24n: Statting the old file after renaming (Posix rename 2) ========================================================== 15:29:51 (1788463791) [ 1294.762727] Lustre: DEBUG MARKER: == sanity test 24o: rename of files during htree split === 15:29:58 (1788463798) [ 2033.281602] Lustre: DEBUG MARKER: == sanity test 24p: mkdir .../R12a; .../R12b; rename .../R12a .../R12b ========================================================== 15:42:16 (1788464536) [ 2041.820708] Lustre: DEBUG MARKER: == sanity test 24q: mkdir .../R13a; .../R13b; open R13b rename R13a R13b ============================================================= 15:42:25 (1788464545) [ 2050.890239] Lustre: DEBUG MARKER: == sanity test 24r: mkdir .../R14a/b; rename .../R14a .../R14a/b =============================================================== 15:42:33 (1788464553) [ 2057.552108] Lustre: DEBUG MARKER: == sanity test 24s: mkdir .../R15a/b/c; rename .../R15a .../R15a/b/c =========================================================== 15:42:41 (1788464561) [ 2065.354995] Lustre: DEBUG MARKER: == sanity test 24t: mkdir .../R16a/b/c; rename .../R16a/b/c .../R16a =========================================================== 15:42:49 (1788464569) [ 2072.520643] Lustre: DEBUG MARKER: == sanity test 24u: create stripe file =================== 15:42:56 (1788464576) [ 2081.259582] Lustre: DEBUG MARKER: == sanity test 24v: list large directory (test hash collision, b=17560) ========================================================== 15:43:04 (1788464584) [ 4119.463958] Lustre: DEBUG MARKER: == sanity test 24w: Reading a file larger than 4Gb ======= 16:17:03 (1788466623) [ 4125.980845] Lustre: DEBUG MARKER: == sanity test 24x: cross MDT rename/link ================ 16:17:09 (1788466629) [ 4134.176316] Lustre: DEBUG MARKER: == sanity test 24y: rename/link on the same dir should succeed ========================================================== 16:17:17 (1788466637) [ 4142.273340] Lustre: DEBUG MARKER: == sanity test 24z: cross-MDT rename is done as cp ======= 16:17:26 (1788466646) [ 4150.987531] Lustre: DEBUG MARKER: == sanity test 24A: readdir() returns correct number of entries. ========================================================== 16:17:34 (1788466654) [ 4245.536357] Lustre: DEBUG MARKER: == sanity test 24B: readdir for striped dir return correct number of entries ========================================================== 16:19:09 (1788466749) [ 4251.974531] Lustre: DEBUG MARKER: == sanity test 24C: check .. in striped dir ============== 16:19:15 (1788466755) [ 4259.119571] Lustre: DEBUG MARKER: == sanity test 24E: cross MDT rename/link ================ 16:19:22 (1788466762) [ 4260.458914] Lustre: DEBUG MARKER: SKIP: sanity test_24E needs >= 4 MDTs [ 4261.786151] Lustre: DEBUG MARKER: == sanity test 24F: hash order vs readdir (LU-11330) ===== 16:19:25 (1788466765) [ 4318.777439] Lustre: DEBUG MARKER: == sanity test 24G: migrate symlink in rename ============ 16:20:22 (1788466822) [ 4325.251948] Lustre: DEBUG MARKER: == sanity test 24H: repeat FLD_QUERY rpc ================= 16:20:29 (1788466829) [ 4331.492461] Lustre: DEBUG MARKER: == sanity test 24I: large striped mkdir with limit check ========================================================== 16:20:35 (1788466835) [ 4336.738456] Lustre: DEBUG MARKER: == sanity test 25a: create file in symlinked directory ========================================================================= 16:20:40 (1788466840) [ 4342.804731] Lustre: DEBUG MARKER: == sanity test 25b: lookup file in symlinked directory ========================================================================= 16:20:46 (1788466846) [ 4348.798532] Lustre: DEBUG MARKER: == sanity test 26a: multiple component symlink ================================================================================= 16:20:52 (1788466852) [ 4355.720293] Lustre: DEBUG MARKER: == sanity test 26b: multiple component symlink at end of lookup ================================================================ 16:20:59 (1788466859) [ 4362.295727] Lustre: DEBUG MARKER: == sanity test 26c: chain of symlinks ==================== 16:21:06 (1788466866) [ 4368.606608] Lustre: DEBUG MARKER: == sanity test 26d: create multiple component recursive symlink ========================================================== 16:21:12 (1788466872) [ 4373.970171] Lustre: DEBUG MARKER: == sanity test 26e: unlink multiple component recursive symlink ========================================================== 16:21:17 (1788466877) [ 4379.953714] Lustre: DEBUG MARKER: == sanity test 26f: rm -r of a directory which has recursive symlink ========================================================== 16:21:23 (1788466883) [ 4388.351941] Lustre: DEBUG MARKER: == sanity test 27a: one stripe file ====================== 16:21:32 (1788466892) [ 4395.462460] Lustre: DEBUG MARKER: == sanity test 27b: create and write to two stripe file == 16:21:39 (1788466899) [ 4402.502296] Lustre: DEBUG MARKER: == sanity test 27ca: one stripe on specified OST ========= 16:21:46 (1788466906) [ 4409.662928] Lustre: DEBUG MARKER: == sanity test 27cb: two stripes on specified OSTs ======= 16:21:53 (1788466913) [ 4416.987580] Lustre: DEBUG MARKER: == sanity test 27cc: two stripes on the same OST ========= 16:22:00 (1788466920) [ 4423.611613] Lustre: DEBUG MARKER: == sanity test 27cd: four stripes on two OSTs ============ 16:22:07 (1788466927) [ 4429.952457] Lustre: DEBUG MARKER: == sanity test 27ce: more stripes than OSTs with -o ====== 16:22:13 (1788466933) [ 4436.255842] Lustre: DEBUG MARKER: == sanity test 27cf: 'setstripe -o' on inactive OSTs should return error ========================================================== 16:22:20 (1788466940) [ 4437.316297] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4439.972816] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4439.981735] Lustre: Skipped 5 previous similar messages [ 4439.992480] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4440.001841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.013895] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4440.019827] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.020723] Lustre: Skipped 6 previous similar messages [ 4447.500951] Lustre: DEBUG MARKER: == sanity test 27cg: 1000 shouldn't cause too many credits ========================================================== 16:22:31 (1788466951) [ 4451.857532] Lustre: 6522:0:(osd_handler.c:2191:osd_trans_start()) lustre-MDT0000: credits 30549 > trans_max 3200 [ 4451.866136] Lustre: 6522:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 4/16/0, destroy: 1/4/0 [ 4451.872057] Lustre: 6522:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2003/2003/0, xattr_set: 3004/28292/0 [ 4451.876935] Lustre: 6522:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 20/142/0, punch: 0/0/0, quota 0/0/0 [ 4451.883784] Lustre: 6522:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 5/84/0, delete: 2/5/0 [ 4451.888109] Lustre: 6522:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 1/1/0, ref_del: 2/2/0 [ 4451.892070] CPU: 1 PID: 6522 Comm: mdt00_002 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 [ 4451.896350] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 4451.899874] Call Trace: [ 4451.902183] ? dump_stack+0xbb/0x10e [ 4451.903986] ? osd_trans_start+0x8db/0x9d0 [osd_ldiskfs] [ 4451.907879] ? dt_trans_start+0x1c/0x70 [obdclass] [ 4451.910830] ? top_trans_start+0x4fd/0xd00 [ptlrpc] [ 4451.917728] ? lod_declare_ref_add+0x1a/0x30 [lod] [ 4451.920147] ? dt_declare_ref_add+0x6c/0x200 [obdclass] [ 4451.924470] ? lod_trans_start+0x109/0x4c0 [lod] [ 4451.929640] ? mdd_declare_links_add+0x60/0x90 [mdd] [ 4451.932180] ? mdd_trans_start+0x18/0x30 [mdd] [ 4451.933915] ? mdd_unlink+0x7a4/0x13c0 [mdd] [ 4451.935451] ? mdt_reint_unlink+0x14aa/0x1a30 [mdt] [ 4451.937074] ? mdt_reint_rec+0x139/0x2b0 [mdt] [ 4451.939103] ? mdt_reint_internal+0x693/0xdc0 [mdt] [ 4451.940813] ? mdt_reint+0x163/0x190 [mdt] [ 4451.943834] ? tgt_handle_request0+0x137/0xaf0 [ptlrpc] [ 4451.946935] ? tgt_request_handle+0x575/0x1f70 [ptlrpc] [ 4451.953465] ? ptlrpc_server_handle_request+0x443/0x13b0 [ptlrpc] [ 4451.960791] ? lprocfs_counter_add+0x15b/0x210 [obdclass] [ 4451.966902] ? ptlrpc_main+0xce8/0x1400 [ptlrpc] [ 4451.971151] ? ptlrpc_wait_event+0x690/0x690 [ptlrpc] [ 4451.977001] ? kthread+0x1d1/0x200 [ 4451.981078] ? set_kthread_struct+0x70/0x70 [ 4451.983190] ? ret_from_fork+0x1f/0x30 [ 4458.351924] Lustre: DEBUG MARKER: == sanity test 27d: create file with default settings ==== 16:22:42 (1788466962) [ 4465.383665] Lustre: DEBUG MARKER: == sanity test 27e: setstripe existing file (should return error) ========================================================== 16:22:49 (1788466969) [ 4470.568617] Lustre: DEBUG MARKER: == sanity test 27f: setstripe with bad stripe size (should return error) ========================================================== 16:22:54 (1788466974) [ 4475.704392] Lustre: DEBUG MARKER: == sanity test 27g: /home/green/git/lustre-release/lustre/utils/lfs getstripe with no objects ========================================================== 16:22:59 (1788466979) [ 4481.056533] Lustre: DEBUG MARKER: == sanity test 27ga: /home/green/git/lustre-release/lustre/utils/lfs getstripe with missing file (should return error) ========================================================== 16:23:04 (1788466984) [ 4486.367581] Lustre: DEBUG MARKER: == sanity test 27i: /home/green/git/lustre-release/lustre/utils/lfs getstripe with some objects ========================================================== 16:23:10 (1788466990) [ 4491.446410] Lustre: DEBUG MARKER: == sanity test 27j: setstripe with bad stripe offset (should return error) ========================================================== 16:23:15 (1788466995) [ 4497.165066] Lustre: DEBUG MARKER: == sanity test 27k: limit i_blksize for broken user apps ========================================================== 16:23:20 (1788467000) [ 4502.871882] Lustre: DEBUG MARKER: == sanity test 27l: check setstripe permissions (should return error) ========================================================== 16:23:26 (1788467006) [ 4507.855453] Lustre: DEBUG MARKER: SKIP: sanity test_27m skipping SLOW test 27m [ 4509.119476] Lustre: DEBUG MARKER: == sanity test 27n: create file with some full OSTs ====== 16:23:33 (1788467013) [ 4516.832249] Lustre: *** cfs_fail_loc=215, val=0*** [ 4516.838555] Lustre: Skipped 1 previous similar message [ 4521.952025] Lustre: *** cfs_fail_loc=215, val=0*** [ 4542.078846] Lustre: DEBUG MARKER: == sanity test 27o: create file with all full OSTs (should error) ========================================================== 16:24:06 (1788467046) [ 4550.628674] Lustre: *** cfs_fail_loc=215, val=1*** [ 4552.680477] Lustre: *** cfs_fail_loc=215, val=0*** [ 4552.691361] Lustre: Skipped 2 previous similar messages [ 4556.517719] LustreError: 38920:0:(lod_qos.c:1827:lod_ost_alloc_specific()) can't lstripe objid [0x200000402:0xf9cf:0x0]: have 0 want 1 [ 4557.792156] Lustre: *** cfs_fail_loc=215, val=0*** [ 4557.797701] Lustre: Skipped 3 previous similar messages [ 4565.984864] Lustre: *** cfs_fail_loc=215, val=1*** [ 4565.990220] Lustre: Skipped 4 previous similar messages [ 4581.858070] Lustre: DEBUG MARKER: == sanity test 27oo: don't let few threads to reserve too many objects ========================================================== 16:24:45 (1788467085) [ 4606.199447] Lustre: Failing over lustre-OST0000 [ 4608.319298] Lustre: server umount lustre-OST0000 complete [ 4608.992195] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4608.998222] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4609.001553] LustreError: Skipped 2 previous similar messages [ 4609.020059] Lustre: Skipped 1 previous similar message [ 4609.023422] LustreError: 25298:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4609.023433] LustreError: 25298:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 34 previous similar messages [ 4621.883417] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4622.192405] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 4622.221936] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 4622.233405] Lustre: Skipped 1 previous similar message [ 4623.570311] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 4623.578248] Lustre: Skipped 1 previous similar message [ 4624.168892] Lustre: lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. [ 4624.169731] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 4624.179778] Lustre: Skipped 1 previous similar message [ 4624.201018] Lustre: Skipped 1 previous similar message [ 4628.712625] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 4634.180434] Lustre: DEBUG MARKER: == sanity test 27p: append to a truncated file with some full OSTs ========================================================== 16:25:37 (1788467137) [ 4649.952187] Lustre: *** cfs_fail_loc=215, val=0*** [ 4649.955154] Lustre: Skipped 3 previous similar messages [ 4672.627355] Lustre: DEBUG MARKER: == sanity test 27q: append to truncated file with all OSTs full (should error) ========================================================== 16:26:16 (1788467176) [ 4683.751325] Lustre: *** cfs_fail_loc=215, val=1*** [ 4683.753514] Lustre: Skipped 4 previous similar messages [ 4685.610322] LustreError: 38920:0:(lod_qos.c:1827:lod_ost_alloc_specific()) can't lstripe objid [0x200000402:0xfa06:0x0]: have 0 want 1 [ 4710.003380] Lustre: DEBUG MARKER: == sanity test 27r: stripe file with some full OSTs (shouldn't LBUG) =========================================================== 16:26:53 (1788467213) [ 4742.394495] Lustre: DEBUG MARKER: == sanity test 27s: lsm_xfersize overflow (should error) (bug 10725) ========================================================== 16:27:26 (1788467246) [ 4748.279953] Lustre: DEBUG MARKER: == sanity test 27t: check that utils parse path correctly ========================================================== 16:27:32 (1788467252) [ 4754.063918] Lustre: DEBUG MARKER: == sanity test 27u: skip object creation on OSC w/o objects ========================================================== 16:27:37 (1788467257) [ 4757.715025] Lustre: *** cfs_fail_loc=139, val=0*** [ 4758.220918] Lustre: *** cfs_fail_loc=139, val=0*** [ 4758.224899] Lustre: Skipped 61 previous similar messages [ 4759.222120] Lustre: *** cfs_fail_loc=139, val=0*** [ 4759.227107] Lustre: Skipped 155 previous similar messages [ 4761.224259] Lustre: *** cfs_fail_loc=139, val=0*** [ 4761.229397] Lustre: Skipped 311 previous similar messages [ 4765.234575] Lustre: *** cfs_fail_loc=139, val=0*** [ 4765.237819] Lustre: Skipped 683 previous similar messages [ 4806.353413] Lustre: DEBUG MARKER: == sanity test 27v: skip object creation on slow OST ===== 16:28:30 (1788467310) [ 4811.752402] Lustre: *** cfs_fail_loc=215, val=1*** [ 4811.755513] Lustre: Skipped 12 previous similar messages [ 4817.588947] LustreError: 12156:0:(lod_qos.c:1827:lod_ost_alloc_specific()) can't lstripe objid [0x200000402:0xfc42:0x0]: have 0 want 1 [ 4856.864469] Lustre: DEBUG MARKER: == sanity test 27w: check /home/green/git/lustre-release/lustre/utils/lfs setstripe -S and getstrip -d options ========================================================== 16:29:20 (1788467360) [ 4862.532562] Lustre: DEBUG MARKER: == sanity test 27wa: check /home/green/git/lustre-release/lustre/utils/lfs setstripe -c -i options ========================================================== 16:29:26 (1788467366) [ 4868.567473] Lustre: DEBUG MARKER: == sanity test 27x: create files while OST0 is degraded == 16:29:32 (1788467372) [ 4887.313954] Lustre: DEBUG MARKER: == sanity test 27y: create files while OST0 is degraded and the rest inactive ========================================================== 16:29:51 (1788467391) [ 4890.917789] Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request [ 4890.925850] Lustre: Skipped 1 previous similar message [ 4907.515888] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4907.525903] Lustre: Skipped 1 previous similar message [ 4907.529986] Lustre: lustre-OST0001: Client lustre-MDT0001-mdtlov_UUID (at 0@lo) reconnecting [ 4907.536147] Lustre: Skipped 1 previous similar message [ 4907.541420] LustreError: lustre-OST0001-osc-MDT0001: This client was evicted by lustre-OST0001; in progress operations using this service will fail. [ 4907.554295] Lustre: lustre-OST0001-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 4907.560102] Lustre: Skipped 1 previous similar message [ 4908.116994] LustreError: lustre-OST0001-osc-MDT0000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. [ 4924.215460] Lustre: DEBUG MARKER: == sanity test 27z: check SEQ/OID on the MDT and OST filesystems ========================================================== 16:30:28 (1788467428) [ 4931.615685] Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-1 [ 4933.203645] Lustre: DEBUG MARKER: FID seq 0x200000402, oid 0xfc6e ver 0x0 [ 4934.535531] Lustre: DEBUG MARKER: LOV seq 0x200000402, oid 0xfc6e, count: 1 [ 4935.674656] Lustre: DEBUG MARKER: want: stripe:0 ost:0 oid:921/0x399 seq:0x280000401 [ 4938.151219] Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-2 [ 4939.661292] Lustre: DEBUG MARKER: FID seq 0x200000402, oid 0xfc70 ver 0x0 [ 4941.054805] Lustre: DEBUG MARKER: LOV seq 0x200000402, oid 0xfc70, count: 2 [ 4942.287803] Lustre: DEBUG MARKER: want: stripe:0 ost:1 oid:1383/0x567 seq:0x2c0000401 [ 4944.743645] Lustre: DEBUG MARKER: want: stripe:1 ost:0 oid:922/0x39a seq:0x280000401 [ 4951.185193] Lustre: DEBUG MARKER: == sanity test 27A: check filesystem-wide default LOV EA values ========================================================== 16:30:54 (1788467454) [ 4957.460556] Lustre: DEBUG MARKER: == sanity test 27B: call setstripe on open unlinked file/rename victim ========================================================== 16:31:01 (1788467461) [ 4962.716941] Lustre: DEBUG MARKER: == sanity test 27Ca: check full striping across all OSTs ========================================================== 16:31:06 (1788467466) [ 4968.390055] Lustre: DEBUG MARKER: == sanity test 27Cb: more stripes than OSTs with -C ====== 16:31:12 (1788467472) [ 4975.511358] Lustre: DEBUG MARKER: == sanity test 27Cc: fewer stripes than OSTs does not set overstriping ========================================================== 16:31:19 (1788467479) [ 4982.906412] Lustre: DEBUG MARKER: == sanity test 27Cd: test maximum stripe count =========== 16:31:26 (1788467486) [ 4991.133610] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x2c0000401 to 0x2c0000402 [ 4991.198723] Lustre: lustre-OST0000-osc-MDT0001: update sequence from 0x280000400 to 0x280000402 [ 4991.340827] Lustre: lustre-OST0001-osc-MDT0001: update sequence from 0x2c0000400 to 0x2c0000403 [ 4992.102238] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x280000401 to 0x280000403 [ 5015.772204] Lustre: 8701:0:(osd_handler.c:2191:osd_trans_start()) lustre-MDT0001: credits 60549 > trans_max 3200 [ 5015.787893] Lustre: 8701:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 4/16/0, destroy: 1/4/0 [ 5015.798122] Lustre: 8701:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 4003/4003/0, xattr_set: 6004/56292/0 [ 5015.804195] Lustre: 8701:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 20/142/0, punch: 0/0/0, quota 0/0/0 [ 5015.819763] Lustre: 8701:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 5/84/0, delete: 2/5/0 [ 5015.826921] Lustre: 8701:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 1/1/0, ref_del: 2/2/0 [ 5015.832348] CPU: 3 PID: 8701 Comm: mdt00_003 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 [ 5015.841463] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 5015.848928] Call Trace: [ 5015.850487] ? dump_stack+0xbb/0x10e [ 5015.852152] ? osd_trans_start+0x8db/0x9d0 [osd_ldiskfs] [ 5015.855051] ? dt_trans_start+0x1c/0x70 [obdclass] [ 5015.857102] ? top_trans_start+0x4fd/0xd00 [ptlrpc] [ 5015.859750] ? lod_declare_ref_add+0x1a/0x30 [lod] [ 5015.862824] ? dt_declare_ref_add+0x6c/0x200 [obdclass] [ 5015.865137] ? lod_trans_start+0x109/0x4c0 [lod] [ 5015.867247] ? mdd_declare_links_add+0x60/0x90 [mdd] [ 5015.869784] ? mdd_trans_start+0x18/0x30 [mdd] [ 5015.872074] ? mdd_unlink+0x7a4/0x13c0 [mdd] [ 5015.873832] ? mdt_reint_unlink+0x14aa/0x1a30 [mdt] [ 5015.876272] ? mdt_reint_rec+0x139/0x2b0 [mdt] [ 5015.878897] ? mdt_reint_internal+0x693/0xdc0 [mdt] [ 5015.880683] ? mdt_reint+0x163/0x190 [mdt] [ 5015.881872] ? tgt_handle_request0+0x137/0xaf0 [ptlrpc] [ 5015.885461] ? tgt_request_handle+0x575/0x1f70 [ptlrpc] [ 5015.888196] ? ptlrpc_server_handle_request+0x443/0x13b0 [ptlrpc] [ 5015.892224] ? lprocfs_counter_add+0x15b/0x210 [obdclass] [ 5015.895393] ? ptlrpc_main+0xce8/0x1400 [ptlrpc] [ 5015.898189] ? ptlrpc_wait_event+0x690/0x690 [ptlrpc] [ 5015.901590] ? kthread+0x1d1/0x200 [ 5015.902805] ? set_kthread_struct+0x70/0x70 [ 5015.904496] ? ret_from_fork+0x1f/0x30 [ 5015.908091] Lustre: 8701:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-MDT0001: opcode 0: before 3202 < left 4003, rollback = 0 [ 5025.876983] Lustre: DEBUG MARKER: == sanity test 27Ce: test pool with overstriping ========= 16:32:08 (1788467528) [ 5050.858394] Lustre: DEBUG MARKER: == sanity test 27Cf: test default inheritance with overstriping ========================================================== 16:32:34 (1788467554) [ 5057.915033] Lustre: DEBUG MARKER: == sanity test 27Cg: test setstripe with wrong OST idx === 16:32:41 (1788467561) [ 5063.557304] Lustre: DEBUG MARKER: == sanity test 27Ci: add an overstriping component ======= 16:32:47 (1788467567) [ 5071.447352] Lustre: DEBUG MARKER: == sanity test 27Cj: overstriping with -C for max values in multiple of targets ========================================================== 16:32:55 (1788467575) [ 5078.046952] Lustre: DEBUG MARKER: == sanity test 27D: validate llapi_layout API ============ 16:33:01 (1788467581) [ 5106.031715] Lustre: DEBUG MARKER: == sanity test 27E: check that default extended attribute size properly increases ========================================================== 16:33:29 (1788467609) [ 5111.422688] Lustre: DEBUG MARKER: == sanity test 27F: Client resend delayed layout creation with non-zero size ========================================================== 16:33:35 (1788467615) [ 5113.520069] Lustre: Failing over lustre-OST0000 [ 5114.859062] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5114.862403] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5114.865944] Lustre: Skipped 2 previous similar messages [ 5115.718794] Lustre: server umount lustre-OST0000 complete [ 5117.230637] LustreError: 47822:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.206.42@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5117.249182] LustreError: 47822:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 10 previous similar messages [ 5119.195640] Lustre: Failing over lustre-OST0001 [ 5119.348861] Lustre: server umount lustre-OST0001 complete [ 5127.410432] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5127.812469] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 5127.824650] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 5133.635959] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 5135.363352] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 5136.353845] Lustre: 3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788467625/real 1788467625] req@ffff9a6ec6788e00 x1875338977259264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 1 dl 1788467641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 5138.065235] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 5138.065888] Lustre: lustre-OST0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. [ 5138.078404] Lustre: Skipped 1 previous similar message [ 5138.401435] Lustre: 6521:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788467627/real 1788467627] req@ffff9a6ec79bb480 x1875338977259776/t0(0) o10->lustre-OST0001-osc-MDT0000@0@lo:6/4 lens 440/432 e 0 to 1 dl 1788467643 ref 2 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 [ 5138.431667] Lustre: 6521:0:(client.c:2504:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 5139.490891] Lustre: 3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788467628/real 1788467628] req@ffff9a6ec79b9180 x1875338977260160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 1 dl 1788467644 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 [ 5139.533057] Lustre: 3647:0:(client.c:2504:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 5142.411511] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5142.706793] Lustre: lustre-OST0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 5147.939538] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug all all [ 5155.389480] Lustre: DEBUG MARKER: == sanity test 27G: Clear OST pool from stripe =========== 16:34:19 (1788467659) [ 5179.226729] Lustre: DEBUG MARKER: == sanity test 27H: Set specific OSTs stripe ============= 16:34:43 (1788467683) [ 5180.468826] Lustre: DEBUG MARKER: SKIP: sanity test_27H needs >= 3 OSTs [ 5181.873390] Lustre: DEBUG MARKER: == sanity test 27I: check that root dir striping does not break parent dir one ========================================================== 16:34:45 (1788467685) [ 5204.504734] Lustre: DEBUG MARKER: == sanity test 27Ia: check that root dir pool is dropped with conflict parent dir settings ========================================================== 16:35:08 (1788467708) [ 5232.862510] Lustre: DEBUG MARKER: == sanity test 27J: basic ops on file with foreign LOV === 16:35:36 (1788467736) [ 5241.351127] Lustre: DEBUG MARKER: == sanity test 27K: basic ops on dir with foreign LMV ==== 16:35:44 (1788467744) [ 5252.851960] Lustre: DEBUG MARKER: == sanity test 27Ke: test enable_foreign_dir and enable_foreign_dir_gid ========================================================== 16:35:55 (1788467755) [ 5283.176969] Lustre: DEBUG MARKER: == sanity test 27L: lfs pool_list gives correct pool name ========================================================== 16:36:26 (1788467786) [ 5301.781345] Lustre: DEBUG MARKER: == sanity test 27M: test O_APPEND striping =============== 16:36:45 (1788467805) [ 5360.814971] Lustre: DEBUG MARKER: == sanity test 27N: lctl pool_list on separate MGS gives correct pool name ========================================================== 16:37:44 (1788467864) [ 5362.431526] Lustre: DEBUG MARKER: SKIP: sanity test_27N needs separate MGS/MDT [ 5363.804814] Lustre: DEBUG MARKER: == sanity test 27O: basic ops on foreign file of symlink type ========================================================== 16:37:47 (1788467867) [ 5372.641116] Lustre: DEBUG MARKER: == sanity test 27P: basic ops on foreign dir of foreign_symlink type ========================================================== 16:37:55 (1788467875) [ 5381.724509] Lustre: DEBUG MARKER: == sanity test 27Q: llapi_file_get_stripe() works on symlinks ========================================================== 16:38:05 (1788467885) [ 5389.255846] Lustre: DEBUG MARKER: == sanity test 27R: test max_stripecount limitation when stripe count is set to -1 ========================================================== 16:38:12 (1788467892) [ 5399.252292] Lustre: DEBUG MARKER: == sanity test 27T: no eio on close on partial write due to enosp ========================================================== 16:38:23 (1788467903) [ 5407.430584] Lustre: *** cfs_fail_loc=255, val=0*** [ 5412.912068] Lustre: DEBUG MARKER: == sanity test 27U: append pool and stripe count work with composite default layout ========================================================== 16:38:36 (1788467916) [ 5469.405661] Lustre: DEBUG MARKER: == sanity test 27V: creating widely striped file races with deactivating OST ========================================================== 16:39:32 (1788467972) [ 5471.107546] Lustre: DEBUG MARKER: SKIP: sanity test_27V needs >= 4 OSTs [ 5472.825615] Lustre: DEBUG MARKER: == sanity test 27W: test enable_setstripe_gid ============ 16:39:36 (1788467976) [ 5479.196517] Lustre: DEBUG MARKER: == sanity test 27X: lfs migrate honors --overstripe-count option ========================================================== 16:39:43 (1788467983) [ 5485.583461] Lustre: DEBUG MARKER: == sanity test 28: create/mknod/mkdir with bad file types ====================================================================== 16:39:49 (1788467989) [ 5493.545960] Lustre: DEBUG MARKER: == sanity test 29: IT_GETATTR regression ====================================================================================== 16:39:57 (1788467997) [ 5496.829944] Lustre: DEBUG MARKER: first d29 [ 5498.555615] Lustre: DEBUG MARKER: second d29 [ 5500.411775] Lustre: DEBUG MARKER: done [ 5506.623846] Lustre: DEBUG MARKER: == sanity test 30a: execute binary from Lustre (execve) ======================================================================== 16:40:10 (1788468010) [ 5514.349985] Lustre: DEBUG MARKER: == sanity test 30b: execute binary from Lustre as non-root ===================================================================== 16:40:17 (1788468017) [ 5521.846075] Lustre: DEBUG MARKER: == sanity test 30c: execute binary from Lustre without read perms ============================================================== 16:40:25 (1788468025) [ 5529.917428] Lustre: DEBUG MARKER: == sanity test 30d: execute binary from Lustre while clear locks ========================================================== 16:40:33 (1788468033) [ 5731.222961] Lustre: DEBUG MARKER: == sanity test 31a: open-unlink file ============================================================================================ 16:43:54 (1788468234) [ 5739.225684] Lustre: DEBUG MARKER: == sanity test 31b: unlink file with multiple links while open ================================================================= 16:44:02 (1788468242) [ 5745.521876] Lustre: DEBUG MARKER: == sanity test 31c: open-unlink file with multiple links ======================================================================= 16:44:09 (1788468249) [ 5751.755381] Lustre: DEBUG MARKER: == sanity test 31d: remove of open directory =================================================================================== 16:44:15 (1788468255) [ 5758.749737] Lustre: DEBUG MARKER: == sanity test 31e: remove of open non-empty directory ========================================================================= 16:44:22 (1788468262) [ 5765.260701] Lustre: DEBUG MARKER: == sanity test 31f: remove of open directory with open-unlink file ============================================================= 16:44:29 (1788468269) [ 5779.556315] Lustre: DEBUG MARKER: == sanity test 31g: cross directory link================== 16:44:43 (1788468283) [ 5787.023476] Lustre: DEBUG MARKER: == sanity test 31h: cross directory link under child========================================================================= 16:44:50 (1788468290) [ 5795.177806] Lustre: DEBUG MARKER: == sanity test 31i: cross directory link under parent========================================================================= 16:44:58 (1788468298) [ 5805.057862] Lustre: DEBUG MARKER: == sanity test 31j: link for directory =================== 16:45:08 (1788468308) [ 5812.070336] Lustre: DEBUG MARKER: == sanity test 31k: link to file: the same, non-existing, dir ========================================================== 16:45:15 (1788468315) [ 5818.551514] Lustre: DEBUG MARKER: == sanity test 31l: link to file: target dir has trailing slash ========================================================== 16:45:22 (1788468322) [ 5825.595741] Lustre: DEBUG MARKER: == sanity test 31m: link to file: the same, non-existing, dir ========================================================== 16:45:29 (1788468329) [ 5832.616385] Lustre: DEBUG MARKER: == sanity test 31n: check link count of unlinked file ==== 16:45:36 (1788468336) [ 5839.657919] Lustre: DEBUG MARKER: == sanity test 31o: duplicate hard links with same filename ========================================================== 16:45:42 (1788468342) [ 5937.205507] Lustre: DEBUG MARKER: == sanity test 31p: remove of open striped directory ===== 16:47:20 (1788468440) [ 5944.605543] Lustre: DEBUG MARKER: == sanity test 31q: create striped directory on specific MDTs ========================================================== 16:47:28 (1788468448) [ 5946.158715] Lustre: DEBUG MARKER: SKIP: sanity test_31q needs >= 3 MDTs [ 5948.133541] Lustre: DEBUG MARKER: == sanity test 31r: open-rename(replace) race ============ 16:47:31 (1788468451) [ 5956.076929] Lustre: DEBUG MARKER: == sanity test 32a: stat d32a/ext2-mountpoint/.. =============================================================================== 16:47:39 (1788468459) [ 5964.764655] Lustre: DEBUG MARKER: == sanity test 32b: open d32b/ext2-mountpoint/.. =============================================================================== 16:47:48 (1788468468) [ 5972.405708] Lustre: DEBUG MARKER: == sanity test 32c: stat d32c/ext2-mountpoint/../d2/test_dir =================================================================== 16:47:55 (1788468475) [ 5980.149463] Lustre: DEBUG MARKER: == sanity test 32d: open d32d/ext2-mountpoint/../d2/test_dir ========================================================== 16:48:03 (1788468483) [ 5988.466263] Lustre: DEBUG MARKER: == sanity test 32e: stat d32e/symlink->tmp/symlink->lustre-subdir ========================================================== 16:48:12 (1788468492) [ 5995.869269] Lustre: DEBUG MARKER: == sanity test 32f: open d32f/symlink->tmp/symlink->lustre-subdir ========================================================== 16:48:19 (1788468499) [ 6003.191434] Lustre: DEBUG MARKER: == sanity test 32g: stat d32g/symlink->tmp/symlink->lustre-subdir/2 ========================================================== 16:48:26 (1788468506) [ 6010.268580] Lustre: DEBUG MARKER: == sanity test 32h: open d32h/symlink->tmp/symlink->lustre-subdir/2 ========================================================== 16:48:33 (1788468513) [ 6018.507489] Lustre: DEBUG MARKER: == sanity test 32i: stat d32i/ext2-mountpoint/../test_file ===================================================================== 16:48:42 (1788468522) [ 6025.772753] Lustre: DEBUG MARKER: == sanity test 32j: open d32j/ext2-mountpoint/../test_file ===================================================================== 16:48:49 (1788468529) [ 6033.441346] Lustre: DEBUG MARKER: == sanity test 32k: stat d32k/ext2-mountpoint/../d2/test_file ================================================================== 16:48:57 (1788468537) [ 6041.982523] Lustre: DEBUG MARKER: == sanity test 32l: open d32l/ext2-mountpoint/../d2/test_file ================================================================== 16:49:05 (1788468545) [ 6049.860474] Lustre: DEBUG MARKER: == sanity test 32m: stat d32m/symlink->tmp/symlink->lustre-root ================================================================ 16:49:13 (1788468553) [ 6057.893519] Lustre: DEBUG MARKER: == sanity test 32n: open d32n/symlink->tmp/symlink->lustre-root ================================================================ 16:49:21 (1788468561) [ 6067.114115] Lustre: DEBUG MARKER: == sanity test 32o: stat d32o/symlink->tmp/symlink->lustre-root/ ========================================================== 16:49:30 (1788468570) [ 6074.242178] Lustre: DEBUG MARKER: == sanity test 32p: open d32p/symlink->tmp/symlink->lustre-root/ ========================================================== 16:49:38 (1788468578) [ 6075.448600] Lustre: DEBUG MARKER: 32p_1 [ 6076.975851] Lustre: DEBUG MARKER: 32p_2 [ 6078.591869] Lustre: DEBUG MARKER: 32p_3 [ 6080.634467] Lustre: DEBUG MARKER: 32p_4 [ 6082.805852] Lustre: DEBUG MARKER: 32p_5 [ 6084.268194] Lustre: DEBUG MARKER: 32p_6 [ 6085.688330] Lustre: DEBUG MARKER: 32p_7 [ 6087.405443] Lustre: DEBUG MARKER: 32p_8 [ 6089.077334] Lustre: DEBUG MARKER: 32p_9 [ 6090.775450] Lustre: DEBUG MARKER: 32p_10 [ 6096.934939] Lustre: DEBUG MARKER: == sanity test 32q: stat follows mountpoints in Lustre (should return error) ========================================================== 16:50:00 (1788468600) [ 6103.215531] Lustre: DEBUG MARKER: == sanity test 32r: opendir follows mountpoints in Lustre (should return error) ========================================================== 16:50:07 (1788468607) [ 6111.280619] Lustre: DEBUG MARKER: == sanity test 33aa: write file with mode 444 (should return error) ========================================================== 16:50:14 (1788468614) [ 6113.022242] Lustre: DEBUG MARKER: 33_1 [ 6114.759344] Lustre: DEBUG MARKER: 33_2 [ 6122.074531] Lustre: DEBUG MARKER: == sanity test 33a: test open file(mode=0444) with O_RDWR (should return error) ========================================================== 16:50:25 (1788468625) [ 6128.955843] Lustre: DEBUG MARKER: == sanity test 33b: test open file with malformed flags (No panic) ========================================================== 16:50:32 (1788468632) [ 6136.616337] Lustre: DEBUG MARKER: == sanity test 33c: test write_bytes stats =============== 16:50:40 (1788468640) [ 6143.467740] Lustre: DEBUG MARKER: == sanity test 33d: openfile with 444 modes and malformed flags under remote dir ========================================================== 16:50:47 (1788468647) [ 6152.033045] Lustre: DEBUG MARKER: == sanity test 33e: mkdir and striped directory should have same mode ========================================================== 16:50:55 (1788468655) [ 6161.408819] Lustre: DEBUG MARKER: == sanity test 33f: nonroot user can create, access, and remove a striped directory ========================================================== 16:51:04 (1788468664) [ 6170.687419] Lustre: DEBUG MARKER: == sanity test 33g: nonroot user create already existing root created file ========================================================== 16:51:14 (1788468674) [ 6176.075988] Lustre: DEBUG MARKER: == sanity test 33h: temp file is located on the same MDT as target (crush) ========================================================== 16:51:19 (1788468679) [ 6310.345091] Lustre: DEBUG MARKER: == sanity test 33hh: temp file is located on the same MDT as target (crush2) ========================================================== 16:53:33 (1788468813) [ 6462.159452] Lustre: DEBUG MARKER: == sanity test 33i: striped directory can be accessed when one MDT is down ========================================================== 16:56:05 (1788468965) [ 6517.081607] Lustre: lustre-MDT0001: Client a9facf49-e12e-48d7-8885-bb2ca6d45975 (at 192.168.206.42@tcp) reconnecting [ 6517.110855] Lustre: Skipped 1 previous similar message [ 6519.319122] Lustre: DEBUG MARKER: == sanity test 33j: lfs setdirstripe -D -i x,y,x should fail ========================================================== 16:57:02 (1788469022) [ 6530.777921] Lustre: DEBUG MARKER: == sanity test 34a: truncate file that has not been opened ===================================================================== 16:57:14 (1788469034) [ 6537.822810] Lustre: DEBUG MARKER: == sanity test 34b: O_RDONLY opening file doesn't create objects =============================================================== 16:57:21 (1788469041) [ 6547.160150] Lustre: DEBUG MARKER: == sanity test 34c: O_RDWR opening file-with-size works ======================================================================== 16:57:29 (1788469049) [ 6557.352057] Lustre: DEBUG MARKER: == sanity test 34d: write to sparse file ======================================================================================= 16:57:40 (1788469060) [ 6567.424426] Lustre: DEBUG MARKER: == sanity test 34e: create objects, some with size and some without ============================================================ 16:57:49 (1788469069) [ 6576.453488] Lustre: DEBUG MARKER: == sanity test 34f: read from a file with no objects until EOF ================================================================= 16:57:59 (1788469079) [ 6587.628608] Lustre: DEBUG MARKER: == sanity test 34g: truncate long file ========================================================================================= 16:58:10 (1788469090) [ 6596.641522] Lustre: DEBUG MARKER: == sanity test 34h: ftruncate file under grouplock should not block ========================================================== 16:58:20 (1788469100) [ 6608.169046] Lustre: DEBUG MARKER: == sanity test 35a: exec file with mode 444 (should return and not leak) ========================================================== 16:58:31 (1788469111) [ 6616.247892] Lustre: DEBUG MARKER: == sanity test 36a: MDS utime check (mknod, utime) ======= 16:58:39 (1788469119) [ 6623.510671] Lustre: DEBUG MARKER: == sanity test 36b: OST utime check (open, utime) ======== 16:58:46 (1788469126) [ 6631.869104] Lustre: DEBUG MARKER: == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 16:58:55 (1788469135) [ 6639.748340] Lustre: DEBUG MARKER: == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 16:59:03 (1788469143) [ 6647.541847] Lustre: DEBUG MARKER: == sanity test 36e: utime on non-owned file (should return error) ========================================================== 16:59:11 (1788469151) [ 6653.888991] Lustre: DEBUG MARKER: == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 16:59:17 (1788469157) [ 6661.519368] Lustre: DEBUG MARKER: == sanity test 36g: FMD cache expiry =============================================================================== 16:59:25 (1788469165) [ 6713.315527] Lustre: DEBUG MARKER: == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 17:00:17 (1788469217) [ 6720.625477] Lustre: DEBUG MARKER: == sanity test 36i: change mtime on striped directory ==== 17:00:24 (1788469224) [ 6728.008823] Lustre: DEBUG MARKER: == sanity test 38: open a regular file with O_DIRECTORY should return -ENOTDIR ============================================================= 17:00:31 (1788469231) [ 6734.293568] Lustre: DEBUG MARKER: == sanity test 39a: mtime changed on create ============== 17:00:37 (1788469237) [ 6744.056726] Lustre: DEBUG MARKER: == sanity test 39b: mtime change on open, link, unlink, rename ========================================================== 17:00:47 (1788469247) [ 6753.976878] Lustre: DEBUG MARKER: == sanity test 39c: mtime change on rename =============== 17:00:57 (1788469257) [ 6764.530871] Lustre: DEBUG MARKER: == sanity test 39d: create, utime, stat ================== 17:01:07 (1788469267) [ 6772.163689] Lustre: DEBUG MARKER: == sanity test 39e: create, stat, utime, stat ============ 17:01:15 (1788469275) [ 6779.232705] Lustre: DEBUG MARKER: == sanity test 39f: create, stat, sleep, utime, stat ===== 17:01:22 (1788469282) [ 6790.352719] Lustre: DEBUG MARKER: == sanity test 39g: write, chmod, stat =================== 17:01:33 (1788469293) [ 6800.704598] Lustre: DEBUG MARKER: == sanity test 39h: write, utime within one second, stat ========================================================== 17:01:44 (1788469304) [ 6808.531864] Lustre: DEBUG MARKER: == sanity test 39i: write, rename, stat ================== 17:01:51 (1788469311) [ 6816.237246] Lustre: DEBUG MARKER: == sanity test 39j: write, rename, close, stat =========== 17:01:59 (1788469319) [ 6845.205994] Lustre: DEBUG MARKER: == sanity test 39k: write, utime, close, stat ============ 17:02:28 (1788469348) [ 6855.933905] Lustre: DEBUG MARKER: == sanity test 39l: directory atime update =============== 17:02:39 (1788469359) [ 6874.616709] Lustre: DEBUG MARKER: == sanity test 39m: test atime and mtime before 1970 ===== 17:02:58 (1788469378) [ 6883.560825] Lustre: DEBUG MARKER: == sanity test 39n: check that O_NOATIME is honored ====== 17:03:07 (1788469387) [ 6904.822241] Lustre: DEBUG MARKER: == sanity test 39o: directory cached attributes updated after create ========================================================== 17:03:27 (1788469407) [ 6913.531231] Lustre: DEBUG MARKER: == sanity test 39p: remote directory cached attributes updated after create ================================================================== 17:03:36 (1788469416) [ 6922.138293] Lustre: DEBUG MARKER: == sanity test 39r: lazy atime update on OST ============= 17:03:45 (1788469425) [ 6947.615214] Lustre: DEBUG MARKER: == sanity test 39q: close won't zero out atime =========== 17:04:10 (1788469450) [ 6955.595894] Lustre: DEBUG MARKER: == sanity test 39s: relatime is supported ================ 17:04:19 (1788469459) [ 6980.994785] Lustre: DEBUG MARKER: == sanity test 39u: stat race ============================ 17:04:44 (1788469484) [ 7004.595678] Lustre: DEBUG MARKER: == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 17:05:08 (1788469508) [ 7012.027647] Lustre: DEBUG MARKER: == sanity test 41: test small file write + fstat =============================================================================== 17:05:15 (1788469515) [ 7019.787803] Lustre: DEBUG MARKER: SKIP: sanity test_42a skipping ALWAYS excluded test 42a [ 7021.302334] Lustre: DEBUG MARKER: SKIP: sanity test_42b skipping ALWAYS excluded test 42b [ 7022.886785] Lustre: DEBUG MARKER: SKIP: sanity test_42c skipping ALWAYS excluded test 42c [ 7024.776400] Lustre: DEBUG MARKER: == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 17:05:28 (1788469528) [ 7035.759447] Lustre: DEBUG MARKER: == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 17:05:39 (1788469539) [ 7316.578161] Lustre: DEBUG MARKER: == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 17:10:19 (1788469819) [ 7325.711835] Lustre: DEBUG MARKER: == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 17:10:29 (1788469829) [ 7334.025869] Lustre: DEBUG MARKER: == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 17:10:37 (1788469837) [ 7342.850472] Lustre: DEBUG MARKER: == sanity test 43c: md5sum of copy into lustre =========== 17:10:46 (1788469846) [ 7351.905201] Lustre: DEBUG MARKER: == sanity test 44A: zero length read from a sparse stripe ========================================================== 17:10:55 (1788469855) [ 7360.863045] Lustre: DEBUG MARKER: == sanity test 44a: test sparse pwrite ========================================================================================= 17:11:03 (1788469863) [ 7377.530346] Lustre: DEBUG MARKER: == sanity test 44b: write one byte at offset 0xfffffffe000 ========================================================== 17:11:20 (1788469880) [ 7384.837583] Lustre: DEBUG MARKER: == sanity test 44c: write 1 byte at max_object_bytes - 1 offset ========================================================== 17:11:28 (1788469888) [ 7392.533776] Lustre: DEBUG MARKER: == sanity test 44d: if write at position fails (EFBIG), so should do append ========================================================== 17:11:35 (1788469895) [ 7400.554440] Lustre: DEBUG MARKER: == sanity test 44e: write and read maximal stripes ======= 17:11:44 (1788469904) [ 7431.574647] Lustre: DEBUG MARKER: == sanity test 44f: Check fiemap for sparse files ======== 17:12:15 (1788469935) [ 7488.469523] LustreError: 102221:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0001: cli 7ada6909-0f92-4a39-8d7c-154418d23885 claims 2121728 GRANT, real grant 0 [ 7811.747125] LustreError: 78233:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0001: cli 7ada6909-0f92-4a39-8d7c-154418d23885 claims 4218880 GRANT, real grant 2097152 [ 7871.289147] LustreError: 102211:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0000: cli 7ada6909-0f92-4a39-8d7c-154418d23885 claims 4218880 GRANT, real grant 2097152 [ 8077.373839] LustreError: 102212:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0001: cli 7ada6909-0f92-4a39-8d7c-154418d23885 claims 2121728 GRANT, real grant 0 [ 8086.867693] Lustre: DEBUG MARKER: == sanity test 44g: test overflow in lov_stripe_size ===== 17:23:09 (1788470589) [ 8096.520910] Lustre: DEBUG MARKER: == sanity test 45: osc io page accounting ================ 17:23:19 (1788470599) [ 8106.535604] Lustre: DEBUG MARKER: == sanity test 46: dirtying a previously written page ========================================================================== 17:23:29 (1788470609) [ 8114.405704] Lustre: DEBUG MARKER: == sanity test 48a: Access renamed working dir (should return errors)=========================================================== 17:23:37 (1788470617) [ 8125.062967] Lustre: DEBUG MARKER: == sanity test 48b: Access removed working dir (should return errors)=========================================================== 17:23:48 (1788470628) [ 8133.652271] Lustre: DEBUG MARKER: == sanity test 48c: Access removed working subdir (should return errors) ========================================================== 17:23:56 (1788470636) [ 8141.696555] Lustre: DEBUG MARKER: == sanity test 48d: Access removed parent subdir (should return errors) ========================================================== 17:24:05 (1788470645) [ 8149.814859] Lustre: DEBUG MARKER: == sanity test 48e: Access to recreated parent subdir (should return errors) ========================================================== 17:24:13 (1788470653) [ 8158.070330] Lustre: DEBUG MARKER: == sanity test 48f: non-zero nlink dir unlink won't LBUG() ========================================================== 17:24:21 (1788470661) [ 8159.952400] Lustre: DEBUG MARKER: SKIP: sanity test_48f needs different host for mdt1 mdt2 [ 8161.639729] Lustre: DEBUG MARKER: == sanity test 49a: Change max_pages_per_rpc won't break osc extent ========================================================== 17:24:25 (1788470665) [ 8840.018693] Lustre: DEBUG MARKER: == sanity test 49b: verify max_mb_per_rpc_read/write after setting max_pages_per_rpc ========================================================== 17:35:43 (1788471343) [ 8846.832211] Lustre: DEBUG MARKER: == sanity test 49c: verify max_mb_per_rpc_read/write ===== 17:35:50 (1788471350) [ 8853.606680] Lustre: DEBUG MARKER: == sanity test 50: special situations: /proc symlinks ========================================================================= 17:35:56 (1788471356) [ 8860.444921] Lustre: DEBUG MARKER: == sanity test 51a: special situations: split htree with empty entry ============================================================ 17:36:04 (1788471364) [ 8874.830580] Lustre: DEBUG MARKER: == sanity test 51b: exceed 64k subdirectory nlink limit on create, verify unlink ========================================================== 17:36:18 (1788471378) [10956.416590] Lustre: DEBUG MARKER: SKIP: sanity test_51c skipping SLOW test 51c [10958.112743] Lustre: DEBUG MARKER: == sanity test 51d: check LOV round-robin OST object distribution ========================================================== 18:11:01 (1788473461) [10959.816668] Lustre: DEBUG MARKER: SKIP: sanity test_51d needs >= 3 OSTs [10961.460976] Lustre: DEBUG MARKER: SKIP: sanity test_51e skipping SLOW test 51e [10963.462679] Lustre: DEBUG MARKER: == sanity test 51f: check many open files limit ========== 18:11:06 (1788473466) [11285.603021] Lustre: DEBUG MARKER: == sanity test 52a: append-only flag test (should return errors) ========================================================== 18:16:29 (1788473789) [11294.074829] Lustre: DEBUG MARKER: == sanity test 52b: immutable flag test (should return errors) ================================================================= 18:16:37 (1788473797) [11303.637658] Lustre: DEBUG MARKER: == sanity test 53: verify that MDS and OSTs agree on pre-creation ============================================================== 18:16:46 (1788473806) [11320.213823] Lustre: DEBUG MARKER: == sanity test 54a: unix domain socket test ============== 18:17:03 (1788473823) [11328.582520] Lustre: DEBUG MARKER: == sanity test 54b: char device works in lustre ================================================================================ 18:17:11 (1788473831) [11336.929758] Lustre: DEBUG MARKER: == sanity test 54c: block device works in lustre =============================================================================== 18:17:20 (1788473840) [11347.127257] Lustre: DEBUG MARKER: == sanity test 54d: fifo device works in lustre ================================================================================ 18:17:30 (1788473850) [11355.637811] Lustre: DEBUG MARKER: == sanity test 54e: console/tty device works in lustre ================================================================================ 18:17:38 (1788473858) [11364.172674] Lustre: DEBUG MARKER: == sanity test 55a: OBD device life cycle unit tests ===== 18:17:47 (1788473867) [11372.582702] Lustre: DEBUG MARKER: == sanity test 55b: Load and unload max OBD devices ====== 18:17:55 (1788473875) [12016.342828] Lustre: DEBUG MARKER: == sanity test 55c: obd_mod_rpcs_test ==================== 18:28:39 (1788474519) [12024.168491] Lustre: DEBUG MARKER: == sanity test 56a: check /home/green/git/lustre-release/lustre/utils/lfs getstripe ========================================================== 18:28:47 (1788474527) [12034.539837] Lustre: DEBUG MARKER: == sanity test 56b: check /home/green/git/lustre-release/lustre/utils/lfs getdirstripe ========================================================== 18:28:58 (1788474538) [12042.847264] Lustre: DEBUG MARKER: == sanity test 56bb: check /home/green/git/lustre-release/lustre/utils/lfs getdirstripe layout is YAML ========================================================== 18:29:06 (1788474546) [12051.095378] Lustre: DEBUG MARKER: == sanity test 56bc: check '/home/green/git/lustre-release/lustre/utils/lfs getdirstripe --yaml' params are valid ========================================================== 18:29:14 (1788474554) [12058.547663] Lustre: DEBUG MARKER: == sanity test 56bd: check '/home/green/git/lustre-release/lustre/utils/lfs getdirstripe' output contains header only when needed ========================================================== 18:29:22 (1788474562) [12065.736483] Lustre: DEBUG MARKER: == sanity test 56c: check 'lfs df' showing device status ========================================================== 18:29:29 (1788474569) [12097.938785] Lustre: DEBUG MARKER: == sanity test 56ca: 'lfs df -v' correctly reports 'R' flag when OST set as Readonly ========================================================== 18:30:01 (1788474601) [12131.074947] Lustre: DEBUG MARKER: == sanity test 56d: 'lfs df -v' prints only configured devices ========================================================== 18:30:34 (1788474634) [12140.109463] Lustre: DEBUG MARKER: == sanity test 56e: 'lfs df' Handle non LustreFS [12147.598334] Lustre: DEBUG MARKER: == sanity test 56g: check lfs find -name ================= 18:30:51 (1788474651) [12157.349547] Lustre: DEBUG MARKER: == sanity test 56h: check lfs find ! -name =============== 18:31:00 (1788474660) [12164.183669] Lustre: DEBUG MARKER: == sanity test 56i: check 'lfs find -ost UUID' skips directories ========================================================== 18:31:07 (1788474667) [12173.213876] Lustre: DEBUG MARKER: == sanity test 56ib: check 'lfs find -ost INDEX_RANGE' command ========================================================== 18:31:16 (1788474676) [12182.440451] Lustre: DEBUG MARKER: == sanity test 56j: check lfs find -type d =============== 18:31:25 (1788474685) [12191.349749] Lustre: DEBUG MARKER: == sanity test 56k: check lfs find -type f =============== 18:31:34 (1788474694) [12197.961844] Lustre: DEBUG MARKER: == sanity test 56l: check lfs find -type b =============== 18:31:41 (1788474701) [12205.006592] Lustre: DEBUG MARKER: == sanity test 56m: check lfs find -type c =============== 18:31:48 (1788474708) [12211.429292] Lustre: DEBUG MARKER: == sanity test 56n: check lfs find -type l =============== 18:31:55 (1788474715) [12217.620866] Lustre: DEBUG MARKER: == sanity test 56o: check lfs find -mtime for old files == 18:32:01 (1788474721) [12225.931986] Lustre: DEBUG MARKER: == sanity test 56ob: check lfs find -atime -mtime -ctime with units ========================================================== 18:32:09 (1788474729) [12237.597868] Lustre: DEBUG MARKER: SKIP: sanity test_56oc skipping excluded test 56oc [12239.232910] Lustre: DEBUG MARKER: == sanity test 56od: check lfs find -btime with units ==== 18:32:22 (1788474742) [12256.197406] Lustre: DEBUG MARKER: == sanity test 56oe: check lfs find with time range ====== 18:32:40 (1788474760) [12391.794392] Lustre: DEBUG MARKER: == sanity test 56p: check lfs find -uid and ! -uid ======= 18:34:55 (1788474895) [12402.206540] Lustre: DEBUG MARKER: == sanity test 56q: check lfs find -gid and ! -gid ======= 18:35:05 (1788474905) [12412.801492] Lustre: DEBUG MARKER: == sanity test 56r: check lfs find -size works =========== 18:35:16 (1788474916) [12427.160333] Lustre: DEBUG MARKER: == sanity test 56ra: check lfs find -size -lazy works for data on OSTs ========================================================== 18:35:30 (1788474930) [12443.174279] Lustre: DEBUG MARKER: == sanity test 56rb: check lfs find --size --ost/--mdt works ========================================================== 18:35:46 (1788474946) [12450.950034] Lustre: DEBUG MARKER: == sanity test 56rc: check lfs find --mdt-count/--mdt-hash works ========================================================== 18:35:54 (1788474954) [12462.750417] Lustre: DEBUG MARKER: == sanity test 56rd: check lfs find --printf special files ========================================================== 18:36:06 (1788474966) [12469.929892] Lustre: DEBUG MARKER: == sanity test 56re: check lfs find -printf width format specifiers are consistant with regular find ========================================================== 18:36:13 (1788474973) [12481.094640] Lustre: DEBUG MARKER: == sanity test 56rf: check lfs find -printf width format specifiers for lustre specific formats ========================================================== 18:36:24 (1788474984) [12504.449428] Lustre: DEBUG MARKER: == sanity test 56s: check lfs find -stripe-count works === 18:36:47 (1788475007) [12513.926118] Lustre: DEBUG MARKER: == sanity test 56t: check lfs find -stripe-size works ==== 18:36:57 (1788475017) [12526.146250] Lustre: DEBUG MARKER: == sanity test 56u: check lfs find -stripe-index works === 18:37:09 (1788475029) [12536.692619] Lustre: DEBUG MARKER: == sanity test 56v: check 'lfs find -m match with lfs getstripe -m' ========================================================== 18:37:19 (1788475039) [12546.823805] Lustre: DEBUG MARKER: == sanity test 56wa: check 'lfs migrate -c stripe_count' works ========================================================== 18:37:30 (1788475050) [12806.328422] Lustre: DEBUG MARKER: == sanity test 56wb: check 'lfs migrate' pool support ==== 18:41:49 (1788475309) [12837.278342] Lustre: DEBUG MARKER: == sanity test 56wc: check unrecognized options for lfs migrate are passed through ========================================================== 18:42:20 (1788475340) [12878.017659] Lustre: DEBUG MARKER: == sanity test 56wd: check lfs_migrate --rsync and --no-rsync work ========================================================== 18:43:01 (1788475381) [12885.748761] Lustre: DEBUG MARKER: == sanity test 56we: check lfs migrate --non-direct|-D support ========================================================== 18:43:09 (1788475389) [12895.159665] Lustre: DEBUG MARKER: == sanity test 56x: lfs migration support ================ 18:43:18 (1788475398) [12905.018666] Lustre: DEBUG MARKER: == sanity test 56xB: lfs migrate with -0, --null, --files-from arguments ========================================================== 18:43:28 (1788475408) [12919.003276] Lustre: DEBUG MARKER: == sanity test 56xC: lfs migration can accept FID list file ========================================================== 18:43:42 (1788475422) [12931.463684] Lustre: DEBUG MARKER: == sanity test 56xD: lfs_migration can accept FIDs ======= 18:43:55 (1788475435) [12942.477743] Lustre: DEBUG MARKER: == sanity test 56xa: lfs migration --block support ======= 18:44:05 (1788475445) [12950.863862] Lustre: DEBUG MARKER: == sanity test 56xab: lfs migration --block on changing file ========================================================== 18:44:14 (1788475454) [12960.919152] Lustre: DEBUG MARKER: == sanity test 56xb: lfs migration hard link support ===== 18:44:24 (1788475464) [13244.030521] Lustre: DEBUG MARKER: == sanity test 56xc: lfs migration autostripe ============ 18:49:07 (1788475747) [13253.229211] Lustre: DEBUG MARKER: == sanity test 56xd: check lfs migrate --yaml and --copy support ========================================================== 18:49:16 (1788475756) [13268.220993] Lustre: DEBUG MARKER: == sanity test 56xe: migrate a composite layout file ===== 18:49:32 (1788475772) [13285.989597] Lustre: DEBUG MARKER: == sanity test 56xf: FID is not lost during migration of a composite layout file ========================================================== 18:49:49 (1788475789) [13298.333832] Lustre: DEBUG MARKER: == sanity test 56xg: lfs migrate pool support ============ 18:50:01 (1788475801) [13366.884789] Lustre: DEBUG MARKER: == sanity test 56xh: lfs migrate bandwidth limitation support ========================================================== 18:51:10 (1788475870) [13406.932781] Lustre: DEBUG MARKER: == sanity test 56xi: lfs migrate stats support =========== 18:51:50 (1788475910) [13420.556164] Lustre: DEBUG MARKER: == sanity test 56xj: lfs migrate -b should not cause starvation of threads on OSS ========================================================== 18:52:04 (1788475924) [13459.636755] Lustre: DEBUG MARKER: == sanity test 56xk: lfs mirror resync bandwidth limitation support ========================================================== 18:52:41 (1788475961) [13475.665440] Lustre: DEBUG MARKER: == sanity test 56xl: lfs mirror resync stats support ===== 18:52:59 (1788475979) [13486.102160] Lustre: DEBUG MARKER: == sanity test 56y: lfs find -L raid0|released =========== 18:53:09 (1788475989) [13492.889611] Lustre: DEBUG MARKER: == sanity test 56z: lfs find should continue after an error ========================================================== 18:53:16 (1788475996) [13504.603256] Lustre: DEBUG MARKER: == sanity test 56Aa: lfs find --size under striped dir === 18:53:28 (1788476008) [13556.219586] Lustre: DEBUG MARKER: == sanity test 56ab: lfs find --blocks =================== 18:54:19 (1788476059) [13568.028288] Lustre: DEBUG MARKER: == sanity test 56aca: check lfs find -perm with octal representation ========================================================== 18:54:31 (1788476071) [13613.728406] Lustre: DEBUG MARKER: == sanity test 56acb: check lfs find -perm with symbolic representation ========================================================== 18:55:17 (1788476117) [13634.959620] Lustre: DEBUG MARKER: == sanity test 56acc: check parsing error for lfs find -perm ========================================================== 18:55:38 (1788476138) [13642.037531] Lustre: DEBUG MARKER: == sanity test 56Ba: test lfs find --component-end, -start, -count, and -flags ========================================================== 18:55:45 (1788476145) [13662.910975] Lustre: DEBUG MARKER: == sanity test 56Ca: check lfs find --mirror-count|-N and --mirror-state ========================================================== 18:56:06 (1788476166) [13674.782790] Lustre: DEBUG MARKER: == sanity test 56Da: test lfs find with long paths ======= 18:56:18 (1788476178) [13693.893963] Lustre: DEBUG MARKER: == sanity test 56Db: test 'lfs df -m' only shows MDT devices ========================================================== 18:56:37 (1788476197) [13701.149826] Lustre: DEBUG MARKER: == sanity test 56Dc: test 'lfs df -o' only shows OST devices ========================================================== 18:56:44 (1788476204) [13707.518878] Lustre: DEBUG MARKER: == sanity test 56Dd: test lfs find with mindepth argument ========================================================== 18:56:50 (1788476210) [13713.809140] Lustre: DEBUG MARKER: == sanity test 56Ea: test lfs find -printf option ======== 18:56:57 (1788476217) [13742.682272] Lustre: DEBUG MARKER: == sanity test 56Eaa: test lfs find -printf added functions ========================================================== 18:57:25 (1788476245) [13974.687927] Lustre: DEBUG MARKER: == sanity test 56Eab: test lfs find -ls function ========= 19:01:18 (1788476478) [13998.641350] Lustre: DEBUG MARKER: == sanity test 56Eb: check lfs getstripe on symlink ====== 19:01:41 (1788476501) [14009.001780] Lustre: DEBUG MARKER: == sanity test 56Ebb: check /home/green/git/lustre-release/lustre/utils/lfs getdirstripe for FIFO file ========================================================== 19:01:51 (1788476511) [14016.886764] Lustre: DEBUG MARKER: == sanity test 56Ec: check lfs getstripe,setstripe --hex --yaml ========================================================== 19:02:00 (1788476520) [14026.105904] Lustre: DEBUG MARKER: == sanity test 56Ed: verify new YAML format is valid and back-compatible ========================================================== 19:02:09 (1788476529) [14049.815677] Lustre: DEBUG MARKER: == sanity test 56Eda: check lfs find --links ============= 19:02:33 (1788476553) [14058.215139] Lustre: DEBUG MARKER: == sanity test 56Edb: check lfs find --links for directory striped on multiple MDTs ========================================================== 19:02:41 (1788476561) [14066.050659] Lustre: DEBUG MARKER: == sanity test 56Ef: lfs find with multiple paths ======== 19:02:49 (1788476569) [14073.128710] Lustre: DEBUG MARKER: == sanity test 56Eg: lfs find -xattr ===================== 19:02:56 (1788476576) [14081.875512] Lustre: DEBUG MARKER: == sanity test 56Eh: check lfs find --skip =============== 19:03:04 (1788476584) [14138.600670] Lustre: DEBUG MARKER: == sanity test 56Ei: test lfs find --printf prints correct projid for special files ========================================================== 19:04:02 (1788476642) [14146.823829] Lustre: DEBUG MARKER: == sanity test 56Ej: lfs migration --non-block copy ====== 19:04:10 (1788476650) [14154.788586] Lustre: DEBUG MARKER: == sanity test 56Ek: Test lfs find error handling with LLAPI_FAIL_LOC ========================================================== 19:04:18 (1788476658) [14164.967627] Lustre: DEBUG MARKER: == sanity test 57a: verify MDS filesystem created with large inodes ============================================================ 19:04:28 (1788476668) [14175.415628] Lustre: DEBUG MARKER: == sanity test 57b: default LOV EAs are stored inside large inodes ============================================================= 19:04:38 (1788476678) [14196.578808] Lustre: DEBUG MARKER: == sanity test 58: verify cross-platform wire constants ======================================================================== 19:05:00 (1788476700) [14203.746571] Lustre: DEBUG MARKER: == sanity test 59: verify cancellation of llog records async =================================================================== 19:05:07 (1788476707) [14251.602167] Lustre: DEBUG MARKER: == sanity test complete, duration 13947 sec ============== 19:05:54 (1788476754) [14253.357936] Lustre: DEBUG MARKER: === sanity: start cleanup 19:05:56 (1788476756) === [14439.765713] Lustre: DEBUG MARKER: === sanity: finish cleanup 19:09:02 (1788476942) === [14441.889411] Lustre: Failing over lustre-MDT0000 [14441.976341] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [14441.982531] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [14441.995249] Lustre: Skipped 2 previous similar messages [14442.002444] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [14442.009376] Lustre: Skipped 1 previous similar message [14445.331196] Lustre: lustre-MDT0000: Not available for connect from 192.168.206.42@tcp (stopping) [14449.092808] Lustre: server umount lustre-MDT0000 complete [14450.443907] LustreError: 6522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.42@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [14450.458034] LustreError: 6522:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 10 previous similar messages [14455.555873] LustreError: 127342:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.42@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [14455.579451] LustreError: 127342:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [14465.791883] LustreError: 127342:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.42@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [14465.805167] LustreError: 127342:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 9 previous similar messages [14467.555813] Lustre: 3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788476956/real 1788476956] req@ffff9a6ff5a9ea00 x1875338990824192/t0(0) o400->MGC192.168.206.142@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788476972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [14467.577348] Lustre: 3648:0:(client.c:2504:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [14467.587506] LustreError: MGC192.168.206.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [14474.553212] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [14476.832720] LustreError: 3645:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9a6fff75f100 x1875338990831744/t0(0) o250->MGC192.168.206.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [14477.230201] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [14477.237752] Lustre: Skipped 1 previous similar message [14477.302554] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [14477.311910] Lustre: Skipped 1 previous similar message [14478.038015] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [14478.046691] Lustre: Skipped 1 previous similar message [14481.586299] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [14482.414061] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [14482.433064] Lustre: Skipped 3 previous similar messages [14482.606124] Lustre: lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [14482.618071] Lustre: Skipped 1 previous similar message [14482.661088] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000402:6820 to 0x2c0000402:6913) [14482.662830] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000403:6863 to 0x280000403:6913) [14491.877676] Lustre: DEBUG MARKER: oleg642-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [14493.509447] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [14502.888333] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [14502.898651] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [14502.912591] Lustre: Skipped 5 previous similar messages [14502.926946] Lustre: Skipped 7 previous similar messages [14506.380371] Lustre: server umount lustre-MDT0000 complete [14508.005083] LustreError: 108096:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [14508.021564] LustreError: 108096:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 23 previous similar messages [14514.159221] LustreError: 6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788477019 with bad export cookie 14744425836331063207 [14514.165065] LustreError: MGC192.168.206.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [14514.168721] LustreError: 6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [14514.710372] Lustre: server umount lustre-MDT0001 complete [14530.906375] Lustre: server umount lustre-OST0000 complete [14534.113942] Lustre: 3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788477023/real 1788477023] req@ffff9a6ec79b9c00 x1875338990891520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788477039 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [14534.135202] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [14534.156059] Lustre: Skipped 1 previous similar message [14535.649379] Lustre: 3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788477024/real 1788477024] req@ffff9a6ec4895500 x1875338990891776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788477040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [14538.785175] Lustre: server umount lustre-OST0001 complete [14554.130329] Lustre: DEBUG MARKER: oleg642-server.virtnet: executing unload_modules_local [14557.068704] Key type lgssc unregistered [14557.454548] LNet: 140653:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [14557.459511] LNetError: 140653:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [14557.485389] LNet: Removed LNI 192.168.206.142@tcp [14558.490184] Key type .llcrypt unregistered [14558.495143] Key type ._llcrypt unregistered