[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 479433238 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54d0-0x000f54df] [ 0.000000] RAMDISK: [mem 0xbcc64000-0xbffcffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52F0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2421 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22BD 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 00227D (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2331 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23C1 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE23F9 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22bd-0xbffe2330] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22bc] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2331-0xbffe23c0] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23c1-0xbffe23f8] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe23f9-0xbffe2420] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2640MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffd9fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4744 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059618 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829700K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.003255] x2apic enabled [ 0.004008] Switched APIC routing to physical x2apic. [ 0.005021] kvm-guest: setup PV IPIs [ 0.008733] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.009000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.009024] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.010016] pid_max: default: 32768 minimum: 301 [ 0.011135] LSM: Security Framework initializing [ 0.012052] Yama: becoming mindful. [ 0.013043] SELinux: Initializing. [ 0.014000] *** VALIDATE selinux *** [ 0.021855] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.026829] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.028102] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029106] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030111] *** VALIDATE tmpfs *** [ 0.032500] *** VALIDATE proc *** [ 0.034104] *** VALIDATE cgroup *** [ 0.035009] *** VALIDATE cgroup2 *** [ 0.036282] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.038125] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.039005] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.040027] Spectre V2 : User space: Vulnerable [ 0.041005] Speculative Store Bypass: Vulnerable [ 0.043806] debug: unmapping init [mem 0xffffffff8f459000-0xffffffff8f460fff] [ 0.046205] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.048094] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.049026] ... version: 2 [ 0.050009] ... bit width: 48 [ 0.051016] ... generic registers: 4 [ 0.052012] ... value mask: 0000ffffffffffff [ 0.053011] ... max period: 00007fffffffffff [ 0.054007] ... fixed-purpose events: 3 [ 0.055006] ... event mask: 000000070000000f [ 0.056321] rcu: Hierarchical SRCU implementation. [ 0.058754] smp: Bringing up secondary CPUs ... [ 0.059555] x86: Booting SMP configuration: [ 0.060029] .... node #0, CPUs: #1 #2 #3 [ 0.064450] smp: Brought up 1 node, 4 CPUs [ 0.066037] smpboot: Max logical packages: 1 [ 0.067027] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.119786] node 0 deferred pages initialised in 51ms [ 0.123099] devtmpfs: initialized [ 0.124270] x86/mm: Memory block size: 128MB [ 0.126969] gcov: version magic: 0x41383552 [ 0.129683] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.132093] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.133358] pinctrl core: initialized pinctrl subsystem [ 0.135110] [ 0.135598] ************************************************************* [ 0.137010] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.139025] ** ** [ 0.140008] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.142012] ** ** [ 0.144012] ** This means that this kernel is built to expose internal ** [ 0.145013] ** IOMMU data structures, which may compromise security on ** [ 0.147011] ** your system. ** [ 0.149009] ** ** [ 0.150007] ** If you see this message and you are not debugging the ** [ 0.152009] ** kernel, report this immediately to your vendor! ** [ 0.153008] ** ** [ 0.154008] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.156009] ************************************************************* [ 0.158784] NET: Registered protocol family 16 [ 0.159453] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.162068] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.164126] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.167169] cpuidle: using governor menu [ 0.168837] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.171658] PCI: Using configuration type 1 for base access [ 0.174156] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.184365] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.186027] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.190375] cryptd: max_cpu_qlen set to 1000 [ 0.193870] ACPI: Added _OSI(Module Device) [ 0.195013] ACPI: Added _OSI(Processor Device) [ 0.197094] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.198016] ACPI: Added _OSI(Processor Aggregator Device) [ 0.201441] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.207443] ACPI: Interpreter enabled [ 0.209067] ACPI: PM: (supports S0 S3 S4 S5) [ 0.210014] ACPI: Using IOAPIC for interrupt routing [ 0.211000] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.213562] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.226405] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.227043] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.230021] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.233089] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.251352] acpiphp: Slot [2] registered [ 0.252146] acpiphp: Slot [5] registered [ 0.256110] acpiphp: Slot [6] registered [ 0.258170] acpiphp: Slot [3] registered [ 0.260110] acpiphp: Slot [4] registered [ 0.262225] acpiphp: Slot [7] registered [ 0.264144] acpiphp: Slot [8] registered [ 0.265086] acpiphp: Slot [9] registered [ 0.266103] acpiphp: Slot [10] registered [ 0.268149] acpiphp: Slot [11] registered [ 0.269159] acpiphp: Slot [12] registered [ 0.271101] acpiphp: Slot [13] registered [ 0.273105] acpiphp: Slot [14] registered [ 0.274094] acpiphp: Slot [15] registered [ 0.276102] acpiphp: Slot [16] registered [ 0.277117] acpiphp: Slot [17] registered [ 0.277965] acpiphp: Slot [18] registered [ 0.279087] acpiphp: Slot [19] registered [ 0.282181] acpiphp: Slot [20] registered [ 0.284116] acpiphp: Slot [21] registered [ 0.285062] acpiphp: Slot [22] registered [ 0.286181] acpiphp: Slot [23] registered [ 0.289437] acpiphp: Slot [24] registered [ 0.318178] acpiphp: Slot [25] registered [ 0.322446] acpiphp: Slot [26] registered [ 0.325234] acpiphp: Slot [27] registered [ 0.327594] acpiphp: Slot [28] registered [ 0.331229] acpiphp: Slot [29] registered [ 0.334221] acpiphp: Slot [30] registered [ 0.336175] acpiphp: Slot [31] registered [ 0.338061] PCI host bridge to bus 0000:00 [ 0.340037] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.343039] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.344000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.344000] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.345026] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.346043] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.349627] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.354000] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.359085] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.372016] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.376467] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.378015] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.380031] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.384023] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.387820] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.391462] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.394038] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.397283] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.403022] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.418031] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.423015] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.430000] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.430000] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.432018] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.442016] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.453049] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.457015] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.462017] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.470021] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.480269] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.482552] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.485565] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.488676] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.491425] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.496254] iommu: Default domain type: Passthrough [ 0.499789] SCSI subsystem initialized [ 0.501494] ACPI: bus type USB registered [ 0.503198] usbcore: registered new interface driver usbfs [ 0.505253] usbcore: registered new interface driver hub [ 0.507157] usbcore: registered new device driver usb [ 0.509321] pps_core: LinuxPPS API ver. 1 registered [ 0.511021] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.515143] PTP clock support registered [ 0.518103] EDAC MC: Ver: 3.0.0 [ 0.520347] PCI: Using ACPI for IRQ routing [ 0.524078] NetLabel: Initializing [ 0.526018] NetLabel: domain hash size = 128 [ 0.529014] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.652108] NetLabel: unlabeled traffic allowed by default [ 0.654233] vgaarb: loaded [ 0.655439] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.657012] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.662579] clocksource: Switched to clocksource kvm-clock [ 0.786319] VFS: Disk quotas dquot_6.6.0 [ 0.787483] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.789271] *** VALIDATE ramfs *** [ 0.790116] *** VALIDATE hugetlbfs *** [ 0.791210] pnp: PnP ACPI init [ 0.793244] pnp: PnP ACPI: found 6 devices [ 0.809843] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.812391] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.814082] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.815778] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.817496] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.819193] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.821189] NET: Registered protocol family 2 [ 0.823246] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.827800] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.832499] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.837865] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.842374] TCP: Hash tables configured (established 65536 bind 65536) [ 0.845335] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.848451] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.851139] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.853967] NET: Registered protocol family 1 [ 0.856637] RPC: Registered named UNIX socket transport module. [ 0.858651] RPC: Registered udp transport module. [ 0.860175] RPC: Registered tcp transport module. [ 0.861502] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.863483] NET: Registered protocol family 44 [ 0.865197] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.867351] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.869143] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.870923] PCI: CLS 0 bytes, default 64 [ 0.872194] Unpacking initramfs... [ 4.104084] debug: unmapping init [mem 0xffff88a43cc64000-0xffff88a43ffcffff] [ 4.111384] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.121024] software IO TLB: mapped [mem 0x00000000a1000000-0x00000000a5000000] (64MB) [ 4.125243] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 4.806270] hrtimer: interrupt took 9207668 ns [ 6.364551] Initialise system trusted keyrings [ 6.380946] Key type blacklist registered [ 6.406738] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 6.429935] zbud: loaded [ 6.439144] *** VALIDATE nfs *** [ 6.442257] *** VALIDATE nfs4 *** [ 6.451180] pstore: using deflate compression [ 6.490775] Platform Keyring initialized [ 7.114820] NET: Registered protocol family 38 [ 7.117232] Key type asymmetric registered [ 7.119435] Asymmetric key parser 'x509' registered [ 7.125639] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 7.142845] io scheduler mq-deadline registered [ 7.145540] io scheduler kyber registered [ 7.159113] io scheduler bfq registered [ 7.161739] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 7.165938] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 7.169223] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 7.173710] ACPI: Power Button [PWRF] [ 7.182923] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 7.192455] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 7.205773] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 7.257548] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 7.315818] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 7.338168] Non-volatile memory driver v1.3 [ 7.341869] Linux agpgart interface v0.103 [ 7.450542] virtio_blk virtio1: [vda] 134032 512-byte logical blocks (68.6 MB/65.4 MiB) [ 7.458585] vda: detected capacity change from 0 to 68624384 [ 7.527983] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 7.537974] vdb: detected capacity change from 0 to 1073741824 [ 7.556974] libphy: Fixed MDIO Bus: probed [ 7.581391] usbcore: registered new interface driver usbserial_generic [ 7.585165] usbserial: USB Serial support registered for generic [ 7.589450] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 7.595116] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 7.597409] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 7.600686] mousedev: PS/2 mouse device common for all mice [ 7.610702] rtc_cmos 00:05: RTC can wake from S4 [ 7.612678] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 7.615643] rtc_cmos 00:05: registered as rtc0 [ 7.656137] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 7.658867] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 7.658910] intel_pstate: CPU model not supported [ 7.669503] hid: raw HID events driver (C) Jiri Kosina [ 7.702912] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 7.720957] usbcore: registered new interface driver usbhid [ 7.745635] usbhid: USB HID core driver [ 7.748965] drop_monitor: Initializing network drop monitor service [ 7.755839] Initializing XFRM netlink socket [ 7.761220] NET: Registered protocol family 10 [ 7.770111] Segment Routing with IPv6 [ 7.778519] NET: Registered protocol family 17 [ 7.786766] mpls_gso: MPLS GSO support [ 7.791580] RAS: Correctable Errors collector initialized. [ 7.794433] AVX version of gcm_enc/dec engaged. [ 7.796541] AES CTR mode by8 optimization enabled [ 8.086491] sched_clock: Marking stable (8086466998, 0)->(9111562396, -1025095398) [ 8.116921] registered taskstats version 1 [ 8.124474] Loading compiled-in X.509 certificates [ 8.137969] zswap: loaded using pool lzo/zbud [ 8.310718] Key type big_key registered [ 8.353352] Key type encrypted registered [ 8.357786] ima: No TPM chip found, activating TPM-bypass! [ 8.370951] ima: Allocated hash algorithm: sha1 [ 8.377146] ima: No architecture policies found [ 8.378985] evm: Initialising EVM extended attributes: [ 8.393239] evm: security.selinux [ 8.401842] evm: security.ima [ 8.408390] evm: security.capability [ 8.415704] evm: HMAC attrs: 0x1 [ 8.428410] rtc_cmos 00:05: setting system clock to 2026-01-22 09:10:16 UTC (1769073016) [ 8.454484] debug: unmapping init [mem 0xffffffff90403000-0xffffffff905fffff] [ 8.462562] debug: unmapping init [mem 0xffffffff8f182000-0xffffffff8f458fff] [ 8.494709] Write protecting the kernel read-only data: 28672k [ 8.512075] debug: unmapping init [mem 0xffffffff8d803000-0xffffffff8d9fffff] [ 8.535505] debug: unmapping init [mem 0xffffffff8e114000-0xffffffff8e1fffff] [ 8.806909] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 8.839782] systemd[1]: Detected virtualization kvm. [ 8.857201] systemd[1]: Detected architecture x86-64. [ 8.863483] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 8.995938] systemd[1]: No hostname configured. [ 8.997784] systemd[1]: Set hostname to . [ 9.007633] random: systemd: uninitialized urandom read (16 bytes read) [ 9.009577] systemd[1]: Initializing machine ID from random generator. [ 9.288859] random: ln: uninitialized urandom read (6 bytes read) [ 9.836632] random: systemd: uninitialized urandom read (16 bytes read) [ 9.855553] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 9.897910] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 9.950500] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ OK ] Reached target Paths. [ 10.011986] urandom_read: 3 callbacks suppressed [ 10.024980] random: systemd: uninitialized urandom read (16 bytes read) [ OK ] Reached target Local Encrypted Volumes. [ 10.077449] random: systemd: uninitialized urandom read (16 bytes read) [ OK ] Reached target Slices. [ 10.105935] random: systemd: uninitialized urandom read (16 bytes read) [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket. Starting Apply Kernel Variables... Starting Setup Virtual Console... Starting Create Volatile Files and Directories... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Memstrack Anylazing Service. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 14.648243] device-mapper: uevent: version 1.0.3 [ 14.661802] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted Kernel Configuration File System. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 18.933156] virtio_net virtio0 ens2: renamed from eth0 [ 19.610957] scsi host0: ata_piix [ 19.620362] scsi host1: ata_piix [ 19.621796] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 19.630259] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 21.101952] random: fast init done [ 24.962705] random: crng init done [ 24.964913] random: 1 urandom warning(s) missed due to ratelimiting [ 30.406727] dracut-initqueue[575]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 33.228629] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Timers. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 37.796524] printk: systemd: 26 output lines suppressed due to ratelimiting [ 39.260228] SELinux: Disabled at runtime. [ 39.586961] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 39.627639] systemd[1]: Detected virtualization kvm. [ 39.641613] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 42.768666] systemd[1]: initrd-switch-root.service: Succeeded. [ 42.771417] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 42.777946] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 42.780749] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 42.782929] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 42.811293] systemd[1]: Starting Journal Service... Starting Journal Service... [ 42.846911] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Created slice system-getty.slice. [ OK ] Listening on udev Control Socket. Activating swap /dev/disk/by-label/SWAP... Starting Remount Root and Kernel File Systems... [ OK ] Listening on Process Core Dump Socket. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ 43.127664] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS Starting Apply Kernel Variables... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target rpc_pipefs.target. Mounting Kernel Debug File System... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Slices. Starting udev Coldplug all Devices... Starting Create list of required st…ce nodes for the current kernel... Mounting POSIX Message Queue File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Mounting Huge Pages File System... [ OK ] Started Journal Service. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 45.123293] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 45.965591] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 46.029624] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 46.933783] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 47.042223] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (8s / no limit) [** ] A start job is running for Configur…-only root support (8s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…-only root support (9s / no limit)[ 52.630437] Key type dns_resolver registered [ *** ] A start job is running for Configur…only root support (10s / no limit)[ 53.095567] NFS: Registering the id_resolver key type [ 53.097072] Key type id_resolver registered [ 53.098295] Key type id_legacy registered [ ***] A start job is running for Configur…only root support (10s / no limit) [ **] A start job is running for Configur…only root support (11s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Load/Save Random Seed. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Login Service... [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started irqbalance daemon. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Login Service. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting System Logging Service... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg153-client login: [ 120.791412] libcfs: loading out-of-tree module taints kernel. [ 121.056257] Key type ._llcrypt registered [ 121.063795] Key type .llcrypt registered [ 121.535995] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 121.545567] alg: No test for adler32 (adler32-zlib) [ 122.893617] Lustre: Lustre: Build Version: 2.17.50_4_g8fdf1cc [ 123.917609] LNet: Added LNI 192.168.201.53@tcp [8/256/0/180] [ 125.696671] Key type lgssc registered [ 127.172257] Lustre: Echo OBD driver; http://www.lustre.org/ [ 287.768417] Lustre: Mounted lustre-client [ 294.673948] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 313.314941] Lustre: lustre-OST0000-osc-ffff88a488522800: disconnect after 23s idle [ 319.425561] Lustre: DEBUG MARKER: oleg153-client.virtnet: executing check_logdir /tmp/testlogs/ [ 327.482228] Lustre: DEBUG MARKER: oleg153-client.virtnet: executing yml_node [ 335.013212] Lustre: DEBUG MARKER: Client: 2.17.50.4 [ 339.087810] Lustre: DEBUG MARKER: MDS: 2.17.50.4 [ 343.084629] Lustre: DEBUG MARKER: OSS: 2.17.50.4 [ 345.983737] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Jan 22 04:15:51 EST 2026 [ 368.612343] Lustre: DEBUG MARKER: === sanity-pcc: start setup 04:16:14 (1769073374) === [ 369.517907] Lustre: Mounted lustre-client [ 374.529128] Lustre: DEBUG MARKER: oleg153-client.virtnet: executing check_config_client /mnt/lustre [ 401.455896] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 419.662211] Lustre: DEBUG MARKER: === sanity-pcc: finish setup 04:17:05 (1769073425) === [ 426.977469] Lustre: DEBUG MARKER: excepting tests: 33 [ 441.312463] Lustre: lustre-OST0000-osc-ffff88a488522800: disconnect after 21s idle [ 441.316321] Lustre: Skipped 1 previous similar message [ 457.425433] Lustre: DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:17:43 (1769073463) [ 459.150482] loop: module loaded [ 459.178305] loop0: detected capacity change from 0 to 52428800 [ 459.238894] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 483.484529] Lustre: DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:18:09 (1769073489) [ 485.247707] loop0: detected capacity change from 0 to 52428800 [ 485.287228] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 512.739961] Lustre: DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:18:38 (1769073518) [ 518.118559] Lustre: lustre-OST0001-osc-ffff88a488522800: disconnect after 22s idle [ 519.250290] LustreError: 13138:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a488522800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 519.288633] LustreError: 13138:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 519.382852] Lustre: Unmounted lustre-client [ 522.324816] LustreError: 13152:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a486365000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 522.338279] LustreError: 13152:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 522.349857] LustreError: 13152:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 522.352837] LustreError: 13152:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 522.418863] Lustre: Unmounted lustre-client [ 676.814074] Lustre: Mounted lustre-client [ 680.467717] Lustre: Mounted lustre-client [ 684.807749] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 700.035901] loop0: detected capacity change from 0 to 52428800 [ 700.059049] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 700.901088] Lustre: lustre-OST0000-osc-ffff88a483fb6800: disconnect after 21s idle [ 701.077692] Lustre: 15585:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 704.659342] Lustre: DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 [ 719.209404] Lustre: DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 04:22:05 (1769073725) [ 725.517843] LustreError: 16329:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a483fb6800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 725.539066] LustreError: 16329:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 725.556102] LustreError: 16329:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 725.570909] LustreError: 16329:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 725.666296] Lustre: Unmounted lustre-client [ 728.490101] LustreError: 16342:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a488524800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 728.496964] LustreError: 16342:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 728.508703] LustreError: 16342:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 728.517295] LustreError: 16342:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 728.605805] Lustre: Unmounted lustre-client [ 877.280517] Lustre: Mounted lustre-client [ 884.845270] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 896.831498] loop0: detected capacity change from 0 to 52428800 [ 896.864724] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 897.823248] Lustre: 18723:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 901.088412] Lustre: lustre-OST0001-osc-ffff88a4856e8800: disconnect after 22s idle [ 901.099399] Lustre: Skipped 3 previous similar messages [ 903.458921] Lustre: DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none [ 916.535990] Lustre: DEBUG MARKER: == sanity-pcc test 1e: Test RW-PCC with non-root user ==== 04:25:22 (1769073922) [ 917.820447] Lustre: 19517:0:(pcc.c:3514:pcc_file_reset_projid()) /tmp/arc1/sanity-pcc.test_1e/: cache fs project quota off, disabling: rc = -95 [ 933.857852] Lustre: DEBUG MARKER: == sanity-pcc test 1f: Test auto RW-PCC cache with non-root user ========================================================== 04:25:39 (1769073939) [ 938.797932] LustreError: 20307:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a4856e8800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 938.809563] LustreError: 20307:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 938.824345] LustreError: 20307:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 938.830870] LustreError: 20307:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 938.888958] Lustre: Unmounted lustre-client [ 1085.172076] Lustre: Mounted lustre-client [ 1085.174203] Lustre: Skipped 1 previous similar message [ 1092.931688] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1105.505037] loop0: detected capacity change from 0 to 52428800 [ 1105.544697] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1106.672360] Lustre: 22697:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 1108.448289] Lustre: lustre-OST0000-osc-ffff88a488521800: disconnect after 21s idle [ 1108.468772] Lustre: Skipped 2 previous similar messages [ 1124.584660] Lustre: DEBUG MARKER: == sanity-pcc test 1g: General permission test for RW-PCC ========================================================== 04:28:50 (1769074130) [ 1125.559799] loop0: detected capacity change from 0 to 52428800 [ 1125.579587] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1141.336783] Lustre: DEBUG MARKER: == sanity-pcc test 2a: Test multi open when creating ===== 04:29:07 (1769074147) [ 1147.568743] LustreError: 24282:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a488521800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1147.585535] LustreError: 24282:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages [ 1147.620977] LustreError: 24282:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 1147.631920] LustreError: 24282:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 1147.731744] Lustre: Unmounted lustre-client [ 1147.733372] Lustre: Skipped 1 previous similar message [ 1284.669445] Lustre: Mounted lustre-client [ 1284.679526] Lustre: Skipped 1 previous similar message [ 1292.107198] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1303.125221] loop0: detected capacity change from 0 to 52428800 [ 1303.168047] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1304.656693] Lustre: 26685:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d2a.sanity-pcc/d2a.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 1308.640698] Lustre: lustre-OST0000-osc-ffff88a4915b1800: disconnect after 21s idle [ 1308.648735] Lustre: Skipped 3 previous similar messages [ 1320.403485] Lustre: DEBUG MARKER: == sanity-pcc test 2b: Test multi remote open when creating ========================================================== 04:32:06 (1769074326) [ 1322.371329] Lustre: DEBUG MARKER: SKIP: sanity-pcc test_2b Need 2 or more clients, have 1 [ 1324.436644] Lustre: DEBUG MARKER: == sanity-pcc test 2c: Test multi open on different mount points when creating ========================================================== 04:32:10 (1769074330) [ 1329.447104] LustreError: 27751:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a4915b1800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1329.459430] LustreError: 27751:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages [ 1329.465907] LustreError: 27751:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 1329.468537] LustreError: 27751:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 1329.533563] Lustre: Unmounted lustre-client [ 1329.535542] Lustre: Skipped 1 previous similar message [ 1477.525134] Lustre: Mounted lustre-client [ 1477.528958] Lustre: Skipped 1 previous similar message [ 1485.638290] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1496.921733] loop0: detected capacity change from 0 to 52428800 [ 1496.978479] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1501.664787] Lustre: lustre-OST0000-osc-ffff88a4905a1000: disconnect after 21s idle [ 1501.675630] Lustre: Skipped 3 previous similar messages [ 1515.829367] Lustre: DEBUG MARKER: == sanity-pcc test 3a: Repeat attach/detach operations === 04:35:22 (1769074522) [ 1516.912549] Lustre: 30904:0:(pcc.c:3514:pcc_file_reset_projid()) /tmp/arc1/sanity-pcc.test_3a/: cache fs project quota off, disabling: rc = -95 [ 1528.248896] Lustre: DEBUG MARKER: == sanity-pcc test 3b: Repeat attach/detach operations on multiple clients ========================================================== 04:35:34 (1769074534) [ 1530.322564] Lustre: DEBUG MARKER: SKIP: sanity-pcc test_3b Need 3 or more clients, have 1 [ 1533.051703] Lustre: DEBUG MARKER: == sanity-pcc test 4: Auto cache test for mmap =========== 04:35:38 (1769074538) [ 1539.063210] LustreError: 31964:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a4905a1000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1539.075952] LustreError: 31964:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages [ 1539.104098] LustreError: 31964:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 1539.116991] LustreError: 31964:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 1539.201800] Lustre: Unmounted lustre-client [ 1539.207304] Lustre: Skipped 1 previous similar message [ 1671.304705] Lustre: Mounted lustre-client [ 1671.307532] Lustre: Skipped 1 previous similar message [ 1677.434802] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1687.190881] loop0: detected capacity change from 0 to 52428800 [ 1687.213871] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1687.832897] Lustre: 34348:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d4.sanity-pcc/d4.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 1710.989305] Lustre: DEBUG MARKER: == sanity-pcc test 5: Mmap [ 1712.184169] loop0: detected capacity change from 0 to 52428800 [ 1712.219112] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1715.168543] Lustre: lustre-OST0001-osc-ffff88a491599800: disconnect after 21s idle [ 1715.173471] Lustre: Skipped 3 previous similar messages [ 1727.569248] Lustre: DEBUG MARKER: == sanity-pcc test 6: Test mmap write on RW-PCC ========== 04:38:53 (1769074733) [ 1728.802432] loop0: detected capacity change from 0 to 52428800 [ 1728.845939] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1742.635839] Lustre: DEBUG MARKER: == sanity-pcc test 7a: Fake file detached between fault() and page_mkwrite() for RW-PCC ========================================================== 04:39:09 (1769074749) [ 1743.864252] loop0: detected capacity change from 0 to 52428800 [ 1743.894984] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1744.902428] Lustre: *** cfs_fail_loc=1412, val=0*** [ 1756.026962] Lustre: DEBUG MARKER: == sanity-pcc test 7b: Test the race with concurrent mkwrite and detach ========================================================== 04:39:22 (1769074762) [ 1757.501938] loop0: detected capacity change from 0 to 52428800 [ 1757.523275] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1758.984128] LustreError: 37484:0:(pcc.c:3207:pcc_page_mkwrite()) cfs_fail_timeout id 1413 sleeping for 20000ms [ 1779.008876] LustreError: 37484:0:(pcc.c:3207:pcc_page_mkwrite()) cfs_fail_timeout id 1413 awake [ 1780.128111] LustreError: 37484:0:(pcc.c:3207:pcc_page_mkwrite()) cfs_fail_timeout id 1413 sleeping for 20000ms [ 1800.160166] LustreError: 37484:0:(pcc.c:3207:pcc_page_mkwrite()) cfs_fail_timeout id 1413 awake [ 1812.744547] Lustre: DEBUG MARKER: == sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 04:40:19 (1769074819) [ 1814.043449] loop0: detected capacity change from 0 to 52428800 [ 1814.066969] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1815.302115] Lustre: *** cfs_fail_loc=1411, val=0*** [ 1825.251125] Lustre: DEBUG MARKER: == sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 04:40:31 (1769074831) [ 1826.039601] loop0: detected capacity change from 0 to 52428800 [ 1826.061657] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1839.915349] Lustre: DEBUG MARKER: == sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 04:40:46 (1769074846) [ 1841.557278] loop0: detected capacity change from 0 to 52428800 [ 1841.602732] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1841.909229] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1841.949342] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1859.586985] Lustre: DEBUG MARKER: == sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 04:41:06 (1769074866) [ 1861.164287] loop0: detected capacity change from 0 to 52428800 [ 1861.188534] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1861.354634] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1861.409247] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1877.837613] Lustre: DEBUG MARKER: == sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 04:41:24 (1769074884) [ 1879.649887] loop0: detected capacity change from 0 to 52428800 [ 1879.684148] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1879.942220] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1879.981701] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1894.832585] Lustre: DEBUG MARKER: == sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 04:41:41 (1769074901) [ 1896.166219] loop0: detected capacity change from 0 to 52428800 [ 1896.196746] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1896.345604] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1896.392742] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1909.138252] Lustre: DEBUG MARKER: == sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 04:41:55 (1769074915) [ 1910.619966] loop0: detected capacity change from 0 to 52428800 [ 1910.655814] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1910.895374] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1910.965995] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1923.855529] Lustre: DEBUG MARKER: == sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 04:42:10 (1769074930) [ 1925.584859] loop0: detected capacity change from 0 to 52428800 [ 1925.620083] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1925.786768] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1925.848552] EXT4-fs (loop0): re-mounted. Opts: (null) [ 1939.400362] Lustre: DEBUG MARKER: == sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 04:42:25 (1769074945) [ 1940.767734] loop0: detected capacity change from 0 to 52428800 [ 1940.799172] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 1943.333626] Lustre: 44638:0:(pcc.c:3324:pcc_inode_remove()) lustre: failed to unlink PCC file 0x2000032e1:0x33:0x0: rc = -21 [ 1952.434438] Lustre: DEBUG MARKER: == sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 04:42:39 (1769074959) [ 1953.245743] Lustre: 45310:0:(pcc.c:3514:pcc_file_reset_projid()) /tmp/arc1/sanity-pcc.test_12/: cache fs project quota off, disabling: rc = -95 [ 1954.620751] LustreError: 45337:0:(pcc.c:3837:pcc_readwrite_attach()) cfs_fail_timeout id 1414 sleeping for 20000ms [ 1974.712216] LustreError: 45337:0:(pcc.c:3837:pcc_readwrite_attach()) cfs_fail_timeout id 1414 awake [ 1981.698713] Lustre: DEBUG MARKER: == sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 04:43:08 (1769074988) [ 1995.962419] Lustre: DEBUG MARKER: == sanity-pcc test 13b: Test auto RW-PCC create caching for file name with wildcard ========================================================== 04:43:22 (1769075002) [ 2005.261282] Lustre: DEBUG MARKER: == sanity-pcc test 13c: Check auto RW-PCC create caching for UID/GID/ProjID/fname rule ========================================================== 04:43:31 (1769075011) [ 2010.803546] LustreError: 47602:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a48aac4000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2010.824270] LustreError: 47602:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages [ 2010.846210] LustreError: 47602:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 2010.852631] LustreError: 47602:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2010.933739] Lustre: Unmounted lustre-client [ 2010.936921] Lustre: Skipped 1 previous similar message [ 2148.777320] Lustre: Mounted lustre-client [ 2148.782983] Lustre: Skipped 1 previous similar message [ 2155.502359] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2166.726528] loop0: detected capacity change from 0 to 52428800 [ 2166.753083] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2168.261124] Lustre: 50015:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d13c.sanity-pcc/d13c.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 2168.270379] Lustre: 50015:0:(pcc.c:3514:pcc_file_reset_projid()) Skipped 3 previous similar messages [ 2172.385318] Lustre: lustre-OST0000-osc-ffff88a48aac4800: disconnect after 20s idle [ 2172.397321] Lustre: Skipped 2 previous similar messages [ 2181.655846] Lustre: DEBUG MARKER: == sanity-pcc test 14: Revocation of the layout lock should detach the file automatically ========================================================== 04:46:28 (1769075188) [ 2191.547945] Lustre: DEBUG MARKER: == sanity-pcc test 15: Test auto attach at open when file is still valid cached ========================================================== 04:46:38 (1769075198) [ 2193.455134] loop0: detected capacity change from 0 to 52428800 [ 2193.474214] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2213.887675] Lustre: DEBUG MARKER: == sanity-pcc test 16: Test detach with different options ========================================================== 04:47:00 (1769075220) [ 2214.846893] loop0: detected capacity change from 0 to 52428800 [ 2214.878478] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2231.445254] Lustre: DEBUG MARKER: == sanity-pcc test 17: Test auto attach for layout refresh ========================================================== 04:47:17 (1769075237) [ 2232.829847] loop0: detected capacity change from 0 to 52428800 [ 2232.888939] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2254.845364] Lustre: DEBUG MARKER: == sanity-pcc test 18: Verify size correctness after re-attach the file ========================================================== 04:47:41 (1769075261) [ 2256.480436] loop0: detected capacity change from 0 to 52428800 [ 2256.509610] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2272.166052] Lustre: DEBUG MARKER: == sanity-pcc test 19: Verify the file re-attach works as expected ========================================================== 04:47:58 (1769075278) [ 2273.563156] loop0: detected capacity change from 0 to 52428800 [ 2273.610590] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2286.278910] Lustre: DEBUG MARKER: == sanity-pcc test 20: Auto attach works after the inode was once evicted from cache ========================================================== 04:48:12 (1769075292) [ 2288.446298] loop0: detected capacity change from 0 to 125829120 [ 2288.496150] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2290.213597] bash (55988): drop_caches: 3 [ 2290.941786] bash (56007): drop_caches: 3 [ 2291.305875] bash (56013): drop_caches: 3 [ 2305.300508] Lustre: DEBUG MARKER: == sanity-pcc test 21a: PCC-RO storing as a plain HSM mirror component for plain layout ========================================================== 04:48:31 (1769075311) [ 2307.181143] loop0: detected capacity change from 0 to 52428800 [ 2307.221140] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2319.637358] Lustre: DEBUG MARKER: == sanity-pcc test 21b: PCC-RO stroing as a plain HSM mirror component for FLR layouts ========================================================== 04:48:46 (1769075326) [ 2321.264884] loop0: detected capacity change from 0 to 52428800 [ 2321.317386] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2333.105024] Lustre: DEBUG MARKER: == sanity-pcc test 21c: Verify HSM release works storing PCC-RO as HSM mirror component ========================================================== 04:48:59 (1769075339) [ 2334.916874] loop0: detected capacity change from 0 to 52428800 [ 2334.973534] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2348.448428] Lustre: DEBUG MARKER: == sanity-pcc test 21d: Write should invalidate PCC-RO caching ========================================================== 04:49:14 (1769075354) [ 2349.443237] loop0: detected capacity change from 0 to 52428800 [ 2349.467717] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2364.285884] Lustre: DEBUG MARKER: == sanity-pcc test 21e: Truncate should invalidate PCC-RO caching ========================================================== 04:49:30 (1769075370) [ 2366.215903] loop0: detected capacity change from 0 to 52428800 [ 2366.251531] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2378.178315] Lustre: DEBUG MARKER: == sanity-pcc test 21f: mmap write should invalidate PCC-RO caching ========================================================== 04:49:44 (1769075384) [ 2379.571933] loop0: detected capacity change from 0 to 52428800 [ 2379.612768] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2390.661693] Lustre: DEBUG MARKER: == sanity-pcc test 21g: PCC-RO for file under FLR write pending state ========================================================== 04:49:57 (1769075397) [ 2391.768346] loop0: detected capacity change from 0 to 52428800 [ 2391.787866] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2404.117348] Lustre: DEBUG MARKER: == sanity-pcc test 21h: Extend mirror once file was PCC-RO cached ========================================================== 04:50:10 (1769075410) [ 2405.838921] loop0: detected capacity change from 0 to 52428800 [ 2405.889295] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2418.100578] Lustre: DEBUG MARKER: == sanity-pcc test 21i: HSM release increase layout gen, should invalidate PCC-RO cache ========================================================== 04:50:24 (1769075424) [ 2419.964739] loop0: detected capacity change from 0 to 52428800 [ 2419.988178] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2434.179936] Lustre: DEBUG MARKER: == sanity-pcc test 21j: PCC-RO for encrypted file ======== 04:50:40 (1769075440) [ 2435.879237] loop0: detected capacity change from 0 to 52428800 [ 2435.916567] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2440.059562] LustreError: 63673:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a49eef9000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2440.070579] LustreError: 63673:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages [ 2440.090233] LustreError: 63673:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 2440.098364] LustreError: 63673:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2440.230278] Lustre: Unmounted lustre-client [ 2440.237477] Lustre: Skipped 1 previous similar message [ 2440.831294] Lustre: Test dummy encryption mode enabled [ 2440.855402] Lustre: Mounted lustre-client [ 2440.865937] Lustre: Skipped 1 previous similar message [ 2441.659938] llcrypt: AES-256-CTS-CBC using implementation "cts(cbc-aes-aesni)" [ 2442.680675] llcrypt: AES-256-XTS using implementation "xts-aes-aesni" [ 2444.184461] BUG: Bad page state in process lfs pfn:121514 [ 2444.189202] page:fffff70e44854500 refcount:0 mapcount:0 mapping:0000000000000000 index:0x1 [ 2444.193853] flags: 0x17ffffc000200c(referenced|uptodate|private_2|node=0|zone=2|lastcpupid=0x1fffff) [ 2444.204943] raw: 0017ffffc000200c fffff70e44627488 fffff70e448dcd48 0000000000000000 [ 2444.215741] raw: 0000000000000001 0000000000000000 00000000ffffffff 0000000000000000 [ 2444.224848] page dumped because: PAGE_FLAGS_CHECK_AT_FREE flag(s) set [ 2444.232661] Modules linked in: cts loop lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs crct10dif_pclmul crc32_pclmul crc32c_intel ata_generic ata_piix ghash_clmulni_intel serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [ 2444.288073] CPU: 2 PID: 63851 Comm: lfs Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 [ 2444.305661] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 2444.316319] Call Trace: [ 2444.317427] ? dump_stack+0xbb/0x10e [ 2444.323594] ? bad_page.cold.105+0x8b/0xde [ 2444.341900] ? check_free_page_bad+0x2e/0x40 [ 2444.344642] ? free_unref_page_prepare+0x62d/0x670 [ 2444.362296] ? free_unref_page_list+0x75/0x360 [ 2444.363764] ? release_pages+0x271/0x8c0 [ 2444.368172] ? __pagevec_release+0x23/0x50 [ 2444.369602] ? truncate_inode_pages_range+0x452/0xeb0 [ 2444.376169] ? snprintf+0x51/0x70 [ 2444.378586] ? do_raw_spin_unlock+0x75/0x190 [ 2444.383945] ? _raw_spin_unlock+0x12/0x30 [ 2444.385679] ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] [ 2444.390206] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] [ 2444.395990] ? debug_check_no_obj_freed+0x16f/0x2e8 [ 2444.404632] ? slab_free_freelist_hook.isra.49+0x107/0x220 [ 2444.412180] ? truncate_inode_pages_final+0x5e/0x80 [ 2444.417382] ? pcc_inode_put+0x11f/0x200 [lustre] [ 2444.426267] ? pcc_file_release+0x1c5/0x4a0 [lustre] [ 2444.434205] ? ll_file_release+0xd0/0xdd0 [lustre] [ 2444.447091] ? __fput+0x10d/0x440 [ 2444.452301] ? ____fput+0x12/0x20 [ 2444.454655] ? task_work_run+0xc6/0x110 [ 2444.455993] ? exit_to_usermode_loop+0x1dd/0x1f0 [ 2444.468936] ? do_syscall_64+0x3d6/0x440 [ 2444.478130] ? entry_SYSCALL_64_after_hwframe+0x49/0xae [ 2444.482064] Disabling lock debugging due to kernel taint [ 2444.490402] BUG: Bad page state in process lfs pfn:1189d2 [ 2444.500283] page:fffff70e44627480 refcount:0 mapcount:0 mapping:0000000000000000 index:0x0 [ 2444.513504] flags: 0x17ffffc000200c(referenced|uptodate|private_2|node=0|zone=2|lastcpupid=0x1fffff) [ 2444.533092] raw: 0017ffffc000200c ffffa4d8c1f57b70 fffff70e448dcd48 0000000000000000 [ 2444.550034] raw: 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000 [ 2444.561130] page dumped because: PAGE_FLAGS_CHECK_AT_FREE flag(s) set [ 2444.569153] Modules linked in: cts loop lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs crct10dif_pclmul crc32_pclmul crc32c_intel ata_generic ata_piix ghash_clmulni_intel serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [ 2444.628045] CPU: 2 PID: 63851 Comm: lfs Kdump: loaded Tainted: G B O -------- - - 4.18.0rh8.10-debug #2 [ 2444.642206] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 2444.648146] Call Trace: [ 2444.661512] ? dump_stack+0xbb/0x10e [ 2444.665648] ? bad_page.cold.105+0x8b/0xde [ 2444.673794] ? check_free_page_bad+0x2e/0x40 [ 2444.682241] ? free_unref_page_prepare+0x62d/0x670 [ 2444.688539] ? free_unref_page_list+0x75/0x360 [ 2444.695509] ? release_pages+0x271/0x8c0 [ 2444.698815] ? __pagevec_release+0x23/0x50 [ 2444.700577] ? truncate_inode_pages_range+0x452/0xeb0 [ 2444.702263] ? snprintf+0x51/0x70 [ 2444.707714] ? do_raw_spin_unlock+0x75/0x190 [ 2444.714825] ? _raw_spin_unlock+0x12/0x30 [ 2444.716832] ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] [ 2444.723527] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] [ 2444.729824] ? debug_check_no_obj_freed+0x16f/0x2e8 [ 2444.732933] ? slab_free_freelist_hook.isra.49+0x107/0x220 [ 2444.743508] ? truncate_inode_pages_final+0x5e/0x80 [ 2444.748967] ? pcc_inode_put+0x11f/0x200 [lustre] [ 2444.755412] ? pcc_file_release+0x1c5/0x4a0 [lustre] [ 2444.758671] ? ll_file_release+0xd0/0xdd0 [lustre] [ 2444.770422] ? __fput+0x10d/0x440 [ 2444.775454] ? ____fput+0x12/0x20 [ 2444.778397] ? task_work_run+0xc6/0x110 [ 2444.786405] ? exit_to_usermode_loop+0x1dd/0x1f0 [ 2444.791115] ? do_syscall_64+0x3d6/0x440 [ 2444.793487] ? entry_SYSCALL_64_after_hwframe+0x49/0xae [ 2446.957880] BUG: Bad page state in process ldlm_bl_02 pfn:12ce7c [ 2446.960233] page:fffff70e44b39f00 refcount:0 mapcount:0 mapping:0000000000000000 index:0x1 [ 2446.977435] flags: 0x17ffffc000200c(referenced|uptodate|private_2|node=0|zone=2|lastcpupid=0x1fffff) [ 2446.994164] raw: 0017ffffc000200c fffff70e448545c8 fffff70e4462fd08 0000000000000000 [ 2447.008287] raw: 0000000000000001 0000000000000000 00000000ffffffff 0000000000000000 [ 2447.021320] page dumped because: PAGE_FLAGS_CHECK_AT_FREE flag(s) set [ 2447.029909] Modules linked in: cts loop lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs crct10dif_pclmul crc32_pclmul crc32c_intel ata_generic ata_piix ghash_clmulni_intel serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [ 2447.077888] CPU: 3 PID: 49338 Comm: ldlm_bl_02 Kdump: loaded Tainted: G B O -------- - - 4.18.0rh8.10-debug #2 [ 2447.094404] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 2447.110527] Call Trace: [ 2447.115012] ? dump_stack+0xbb/0x10e [ 2447.119068] ? bad_page.cold.105+0x8b/0xde [ 2447.127118] ? check_free_page_bad+0x2e/0x40 [ 2447.134585] ? free_unref_page_prepare+0x62d/0x670 [ 2447.143424] ? free_unref_page_list+0x75/0x360 [ 2447.145899] ? release_pages+0x271/0x8c0 [ 2447.152304] ? __pagevec_release+0x23/0x50 [ 2447.157575] ? truncate_inode_pages_range+0x452/0xeb0 [ 2447.162750] ? string_nocheck+0x77/0xa0 [ 2447.167024] ? string+0x58/0x70 [ 2447.172570] ? vsnprintf+0x30a/0x7f0 [ 2447.176469] ? snprintf+0x51/0x70 [ 2447.177896] ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] [ 2447.185028] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] [ 2447.191590] ? truncate_inode_pages_final+0x5e/0x80 [ 2447.197921] ? pcc_inode_put+0x11f/0x200 [lustre] [ 2447.204465] ? pcc_layout_invalidate+0x1b5/0x780 [lustre] [ 2447.212146] ? vvp_conf_set+0xf4/0x130 [lustre] [ 2447.214296] ? cl_conf_set+0x15b/0x1c0 [obdclass] [ 2447.220239] ? ll_layout_conf+0x1f7/0x590 [lustre] [ 2447.228052] ? ll_lock_cancel_bits+0x532/0xe00 [lustre] [ 2447.234277] ? ll_lock_cancel_bits+0x532/0xe00 [lustre] [ 2447.241933] ? ll_md_blocking_ast+0x389/0x660 [lustre] [ 2447.250483] ? ldlm_cancel_callback+0x9b/0x3e0 [ptlrpc] [ 2447.256755] ? ldlm_cli_cancel_local+0xd2/0x620 [ptlrpc] [ 2447.259092] ? ldlm_cli_cancel_list_local+0x162/0x450 [ptlrpc] [ 2447.271226] ? ldlm_bl_thread_main+0xacb/0xcb0 [ptlrpc] [ 2447.280609] ? woken_wake_function+0x30/0x30 [ 2447.286480] ? ldlm_handle_bl_callback+0x520/0x520 [ptlrpc] [ 2447.292261] ? kthread+0x1d1/0x200 [ 2447.298251] ? set_kthread_struct+0x70/0x70 [ 2447.301936] ? ret_from_fork+0x1f/0x30 [ 2447.303453] BUG: Bad page state in process ldlm_bl_02 pfn:121517 [ 2447.323843] page:fffff70e448545c0 refcount:0 mapcount:0 mapping:0000000000000000 index:0x0 [ 2447.331897] flags: 0x17ffffc000200c(referenced|uptodate|private_2|node=0|zone=2|lastcpupid=0x1fffff) [ 2447.340884] raw: 0017ffffc000200c ffffa4d8c3263958 fffff70e4462fd08 0000000000000000 [ 2447.349984] raw: 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000 [ 2447.358472] page dumped because: PAGE_FLAGS_CHECK_AT_FREE flag(s) set [ 2447.377749] Modules linked in: cts loop lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs crct10dif_pclmul crc32_pclmul crc32c_intel ata_generic ata_piix ghash_clmulni_intel serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [ 2447.459272] CPU: 3 PID: 49338 Comm: ldlm_bl_02 Kdump: loaded Tainted: G B O -------- - - 4.18.0rh8.10-debug #2 [ 2447.473879] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 2447.484575] Call Trace: [ 2447.489065] ? dump_stack+0xbb/0x10e [ 2447.490268] ? bad_page.cold.105+0x8b/0xde [ 2447.494611] ? check_free_page_bad+0x2e/0x40 [ 2447.496114] ? free_unref_page_prepare+0x62d/0x670 [ 2447.503626] ? free_unref_page_list+0x75/0x360 [ 2447.509761] ? release_pages+0x271/0x8c0 [ 2447.514832] ? __pagevec_release+0x23/0x50 [ 2447.520296] ? truncate_inode_pages_range+0x452/0xeb0 [ 2447.525307] ? string_nocheck+0x77/0xa0 [ 2447.529256] ? string+0x58/0x70 [ 2447.534738] ? vsnprintf+0x30a/0x7f0 [ 2447.538772] ? snprintf+0x51/0x70 [ 2447.542313] ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] [ 2447.547301] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] [ 2447.555279] ? truncate_inode_pages_final+0x5e/0x80 [ 2447.561208] ? pcc_inode_put+0x11f/0x200 [lustre] [ 2447.566285] ? pcc_layout_invalidate+0x1b5/0x780 [lustre] [ 2447.576073] ? vvp_conf_set+0xf4/0x130 [lustre] [ 2447.581080] ? cl_conf_set+0x15b/0x1c0 [obdclass] [ 2447.587249] ? ll_layout_conf+0x1f7/0x590 [lustre] [ 2447.594589] ? ll_lock_cancel_bits+0x532/0xe00 [lustre] [ 2447.599539] ? ll_lock_cancel_bits+0x532/0xe00 [lustre] [ 2447.614450] ? ll_md_blocking_ast+0x389/0x660 [lustre] [ 2447.623553] ? ldlm_cancel_callback+0x9b/0x3e0 [ptlrpc] [ 2447.625876] ? ldlm_cli_cancel_local+0xd2/0x620 [ptlrpc] [ 2447.637471] ? ldlm_cli_cancel_list_local+0x162/0x450 [ptlrpc] [ 2447.641567] ? ldlm_bl_thread_main+0xacb/0xcb0 [ptlrpc] [ 2447.646880] ? woken_wake_function+0x30/0x30 [ 2447.649232] ? ldlm_handle_bl_callback+0x520/0x520 [ptlrpc] [ 2447.654330] ? kthread+0x1d1/0x200 [ 2447.660254] ? set_kthread_struct+0x70/0x70 [ 2447.662978] ? ret_from_fork+0x1f/0x30 [ 2463.369640] Lustre: DEBUG MARKER: == sanity-pcc test 22: Test RO-PCC attach for the HSM released file ========================================================== 04:51:09 (1769075469) [ 2464.905874] loop0: detected capacity change from 0 to 52428800 [ 2464.928464] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2484.384902] Lustre: DEBUG MARKER: == sanity-pcc test 23: Test write/truncate/mmap-write invalidating RO-PCC caching ========================================================== 04:51:30 (1769075490) [ 2486.398562] loop0: detected capacity change from 0 to 52428800 [ 2486.430465] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2494.953194] Lustre: lustre-OST0000-osc-ffff88a48aac4800: disconnect after 24s idle [ 2494.969966] Lustre: Skipped 3 previous similar messages [ 2502.128967] Lustre: DEBUG MARKER: == sanity-pcc test 24a: Test RO-PCC with non-root user === 04:51:48 (1769075508) [ 2503.375880] loop0: detected capacity change from 0 to 52428800 [ 2503.409827] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2516.813458] Lustre: DEBUG MARKER: == sanity-pcc test 24b: General permission test for RO-PCC ========================================================== 04:52:03 (1769075523) [ 2517.974833] loop0: detected capacity change from 0 to 52428800 [ 2518.001373] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2530.055628] Lustre: DEBUG MARKER: == sanity-pcc test 25: Tolerate fake read failure for RO-PCC ========================================================== 04:52:16 (1769075536) [ 2531.765628] loop0: detected capacity change from 0 to 52428800 [ 2531.781962] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2533.003715] Lustre: *** cfs_fail_loc=1411, val=0*** [ 2534.328102] Lustre: *** cfs_fail_loc=1411, val=0*** [ 2546.854513] Lustre: DEBUG MARKER: == sanity-pcc test 26: Repeat the attach/detach when the file has multiple openers ========================================================== 04:52:32 (1769075552) [ 2548.428881] loop0: detected capacity change from 0 to 52428800 [ 2548.475384] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2587.539365] Lustre: DEBUG MARKER: == sanity-pcc test 27: Auto attach at open when the file has multiple openers ========================================================== 04:53:13 (1769075593) [ 2589.018782] loop0: detected capacity change from 0 to 52428800 [ 2589.049688] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2627.927782] Lustre: DEBUG MARKER: == sanity-pcc test 28: RW-PCC attach should fail when the file has cluster-wide openers ========================================================== 04:53:54 (1769075634) [ 2629.497748] loop0: detected capacity change from 0 to 52428800 [ 2629.542369] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2647.655308] Lustre: DEBUG MARKER: == sanity-pcc test 29a: Auto readonly caching on RO-PCC backend for O_RDONLY open ========================================================== 04:54:14 (1769075654) [ 2797.217912] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2807.490135] loop0: detected capacity change from 0 to 52428800 [ 2807.529152] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2808.361380] Lustre: 74784:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d29a.sanity-pcc/d29a.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 2808.368853] Lustre: 74784:0:(pcc.c:3514:pcc_file_reset_projid()) Skipped 1 previous similar message [ 2819.917908] Lustre: DEBUG MARKER: == sanity-pcc test 29b: Auto PCC-RO attach in atomic_open ========================================================== 04:57:06 (1769075826) [ 2821.178116] loop0: detected capacity change from 0 to 52428800 [ 2821.208893] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2822.659891] sysctl (75586): drop_caches: 3 [ 2835.318932] Lustre: DEBUG MARKER: == sanity-pcc test 30: Test lctl pcc del command ========= 04:57:21 (1769075841) [ 2836.916900] loop0: detected capacity change from 0 to 52428800 [ 2836.954247] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2852.279081] Lustre: DEBUG MARKER: == sanity-pcc test 31: Test lctl pcc del command with --keep option ========================================================== 04:57:38 (1769075858) [ 2853.598514] loop0: detected capacity change from 0 to 52428800 [ 2853.649277] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2867.741872] Lustre: DEBUG MARKER: == sanity-pcc test 32: Test for RO-PCC when PCC copy is deleted ========================================================== 04:57:54 (1769075874) [ 2868.851917] loop0: detected capacity change from 0 to 52428800 [ 2868.878469] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 2893.016286] Lustre: DEBUG MARKER: SKIP: sanity-pcc test_33 skipping ALWAYS excluded test 33 [ 2894.587400] Lustre: DEBUG MARKER: == sanity-pcc test 34: Cache rule with comparator (>, <) for Project ID range ========================================================== 04:58:21 (1769075901) [ 2899.966298] LustreError: 78959:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a48aa19800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2899.986133] LustreError: 78959:0:(lov_obd.c:783:lov_cleanup()) Skipped 7 previous similar messages [ 2900.007743] LustreError: 78959:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 2900.014829] LustreError: 78959:0:(obd_class.h:479:obd_check_dev()) Skipped 33 previous similar messages [ 2900.097149] Lustre: Unmounted lustre-client [ 2900.104723] Lustre: Skipped 3 previous similar messages [ 3033.926173] Lustre: Mounted lustre-client [ 3033.928140] Lustre: Skipped 3 previous similar messages [ 3039.795509] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3049.098639] loop0: detected capacity change from 0 to 52428800 [ 3049.115326] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3057.121913] Lustre: lustre-OST0000-osc-ffff88a48ca64000: disconnect after 21s idle [ 3057.131889] Lustre: Skipped 3 previous similar messages [ 3063.798880] Lustre: DEBUG MARKER: == sanity-pcc test 35: mmap fault test =================== 05:01:10 (1769076070) [ 3065.405606] loop0: detected capacity change from 0 to 52428800 [ 3065.432215] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3075.889719] Lustre: DEBUG MARKER: == sanity-pcc test 36a: Stale RW-PCC copy should be deleted after remove the PCC backend ========================================================== 05:01:22 (1769076082) [ 3077.188431] loop0: detected capacity change from 0 to 52428800 [ 3077.217900] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3086.865433] Lustre: DEBUG MARKER: == sanity-pcc test 36b: Stale RO-PCC copy should be deleted after remove the PCC backend ========================================================== 05:01:33 (1769076093) [ 3088.365510] loop0: detected capacity change from 0 to 52428800 [ 3088.384278] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3097.110273] Lustre: DEBUG MARKER: == sanity-pcc test 37: Multiple readers on a shared file with PCC-RO mode ========================================================== 05:01:43 (1769076103) [ 3098.552754] loop0: detected capacity change from 0 to 52428800 [ 3098.577404] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3099.667107] loop1: detected capacity change from 0 to 52428800 [ 3099.687200] EXT4-fs (loop1): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3112.720305] Lustre: DEBUG MARKER: == sanity-pcc test 38: Verify LFS pcc state does not trigger prefetch for auto PCC-RO ========================================================== 05:01:59 (1769076119) [ 3255.637991] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3267.316255] loop0: detected capacity change from 0 to 52428800 [ 3267.339607] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3268.071389] Lustre: 87797:0:(pcc.c:3514:pcc_file_reset_projid()) /mnt/pcc.d38.sanity-pcc/d38.sanity-pcc: cache fs project quota off, disabling: rc = -95 [ 3268.089136] Lustre: 87797:0:(pcc.c:3514:pcc_file_reset_projid()) Skipped 3 previous similar messages [ 3279.799719] Lustre: DEBUG MARKER: == sanity-pcc test 39: Test Project quota on loop PCC device ========================================================== 05:04:46 (1769076286) [ 3433.581126] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3445.701966] loop0: detected capacity change from 0 to 52428800 [ 3445.738138] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: prjquota [ 3461.873560] Lustre: DEBUG MARKER: == sanity-pcc test 40: Test async open attach in the background for PCC-RO file ========================================================== 05:07:48 (1769076468) [ 3467.652612] LustreError: 91623:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a488c48000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3467.682335] LustreError: 91623:0:(lov_obd.c:783:lov_cleanup()) Skipped 11 previous similar messages [ 3467.696354] LustreError: 91623:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 3467.699125] LustreError: 91623:0:(obd_class.h:479:obd_check_dev()) Skipped 53 previous similar messages [ 3467.782386] Lustre: Unmounted lustre-client [ 3467.785939] Lustre: Skipped 5 previous similar messages [ 3621.865568] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3636.756322] loop0: detected capacity change from 0 to 209715200 [ 3636.793710] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3645.251742] bash (91426): drop_caches: 3 [ 3687.808459] Lustre: DEBUG MARKER: == sanity-pcc test 41: Test mtime rule for PCC-RO open attach with O_RDONLY mode ========================================================== 05:11:34 (1769076694) [ 3689.424984] loop0: detected capacity change from 0 to 52428800 [ 3689.446165] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3701.931637] Lustre: DEBUG MARKER: == sanity-pcc test 42: PCC attach without attach ID specified ========================================================== 05:11:48 (1769076708) [ 3703.804106] loop0: detected capacity change from 0 to 62914560 [ 3703.883437] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3717.078843] Lustre: DEBUG MARKER: == sanity-pcc test 43: Auto attach at open() should add capacity owner check ========================================================== 05:12:03 (1769076723) [ 3718.851922] loop0: detected capacity change from 0 to 62914560 [ 3718.930130] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3732.103830] Lustre: DEBUG MARKER: == sanity-pcc test 44: Verify valid auto attach without re-fetching the whole files ========================================================== 05:12:17 (1769076737) [ 3734.168223] loop0: detected capacity change from 0 to 62914560 [ 3734.194245] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3810.398739] Lustre: DEBUG MARKER: == sanity-pcc test 45: Concurrent read access from two mount points ========================================================== 05:13:36 (1769076816) [ 3812.417977] loop0: detected capacity change from 0 to 104857600 [ 3812.450506] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3814.335283] loop1: detected capacity change from 0 to 104857600 [ 3814.377374] EXT4-fs (loop1): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3892.568963] Lustre: DEBUG MARKER: == sanity-pcc test 46: Verify PCC mode setting works correctly ========================================================== 05:14:58 (1769076898) [ 3894.384530] loop0: detected capacity change from 0 to 62914560 [ 3894.414446] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3909.544727] Lustre: DEBUG MARKER: == sanity-pcc test 47: mtime should be kept once file attached into PCC ========================================================== 05:15:15 (1769076915) [ 3911.291960] loop0: detected capacity change from 0 to 62914560 [ 3911.327751] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3927.413698] Lustre: DEBUG MARKER: == sanity-pcc test 48: PCC state should check whether the file in local PCC cache ========================================================== 05:15:33 (1769076933) [ 3929.193079] loop0: detected capacity change from 0 to 62914560 [ 3929.215903] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 3942.577172] Lustre: DEBUG MARKER: == sanity-pcc test 96: Auto attach from multiple read process on a node ========================================================== 05:15:48 (1769076948) [ 3944.243869] loop0: detected capacity change from 0 to 62914560 [ 3944.266515] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4021.163556] Lustre: DEBUG MARKER: == sanity-pcc test 97: two mmap I/O and layout lock cancel ========================================================== 05:17:07 (1769077027) [ 4022.860401] loop0: detected capacity change from 0 to 62914560 [ 4022.903194] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4160.618731] Lustre: DEBUG MARKER: == sanity-pcc test 98: racer between auto attach and mmap I/O ========================================================== 05:19:26 (1769077166) [ 4162.012723] loop0: detected capacity change from 0 to 62914560 [ 4162.067413] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4186.084265] Lustre: lustre-OST0000-osc-ffff88a4863ad000: disconnect after 20s idle [ 4186.104350] Lustre: Skipped 11 previous similar messages [ 4241.092795] Lustre: DEBUG MARKER: == sanity-pcc test 99: race among unlink | mmap read | write | detach for PCC-RO file ========================================================== 05:20:47 (1769077247) [ 4242.266336] loop0: detected capacity change from 0 to 62914560 [ 4242.285813] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4319.198902] Lustre: DEBUG MARKER: == sanity-pcc test 99b: race among unlink | two readers | write | detach for PCC-RO file ========================================================== 05:22:05 (1769077325) [ 4321.292405] loop0: detected capacity change from 0 to 209715200 [ 4321.331064] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4397.743955] Lustre: DEBUG MARKER: == sanity-pcc test 100: race among PCC unlink | read | write | detach for PCC-RO file ========================================================== 05:23:24 (1769077404) [ 4399.192664] loop0: detected capacity change from 0 to 62914560 [ 4399.222818] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4475.306733] Lustre: DEBUG MARKER: == sanity-pcc test 101a: Test auto attach in mount namespace (simulated container) ========================================================== 05:24:41 (1769077481) [ 4478.699053] loop0: detected capacity change from 0 to 52428800 [ 4478.735818] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4500.041915] Lustre: DEBUG MARKER: == sanity-pcc test 102: PCC-RO should not hange for io_uring I/O engine ========================================================== 05:25:06 (1769077506) [ 4501.651792] Lustre: DEBUG MARKER: SKIP: sanity-pcc test_102 kernel does not support io_uring fully [ 4503.757478] Lustre: DEBUG MARKER: == sanity-pcc test 203: Verify attach/hit bytes statistics data ========================================================== 05:25:10 (1769077510) [ 4504.871545] loop0: detected capacity change from 0 to 10485760 [ 4504.887456] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4516.875088] Lustre: DEBUG MARKER: == sanity-pcc test 204a: pin/unpin pcc flag ============== 05:25:23 (1769077523) [ 4518.401280] loop0: detected capacity change from 0 to 52428800 [ 4518.439477] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4531.389645] Lustre: DEBUG MARKER: == sanity-pcc test 204b: Permission check for the pin/unpin operation ========================================================== 05:25:38 (1769077538) [ 4545.759339] Lustre: DEBUG MARKER: == sanity-pcc test 204c: PCC pin/unpin without attach ID specified ========================================================== 05:25:52 (1769077552) [ 4547.295167] loop0: detected capacity change from 0 to 62914560 [ 4547.335372] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: usrquota,grpquota [ 4557.804402] Lustre: DEBUG MARKER: == sanity-pcc test complete, duration 4210 sec =========== 05:26:04 (1769077564) [ 4559.933656] Lustre: DEBUG MARKER: === sanity-pcc: start cleanup 05:26:06 (1769077566) === [ 4567.623162] LustreError: 129991:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff88a4905c3000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4567.641772] LustreError: 129991:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages [ 4567.650674] LustreError: 129991:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 4567.656794] LustreError: 129991:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 4567.708356] Lustre: Unmounted lustre-client [ 4567.712586] Lustre: Skipped 1 previous similar message [ 4571.518841] Lustre: DEBUG MARKER: === sanity-pcc: finish cleanup 05:26:17 (1769077577) === [ 4640.982988] Key type lgssc unregistered [ 4641.415227] LNet: 130982:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4641.426749] LNetError: 130982:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4641.456916] LNet: Removed LNI 192.168.201.53@tcp [ 4642.465156] Key type .llcrypt unregistered [ 4642.467184] Key type ._llcrypt unregistered