Aug 15 09:20:35 oleg434-client kernel: Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 Aug 15 09:20:35 oleg434-client kernel: Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Aug 15 09:20:35 oleg434-client kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Aug 15 09:20:35 oleg434-client kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Aug 15 09:20:35 oleg434-client kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Aug 15 09:20:35 oleg434-client kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Aug 15 09:20:35 oleg434-client kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Aug 15 09:20:35 oleg434-client kernel: signal: max sigframe size: 1776 Aug 15 09:20:35 oleg434-client kernel: BIOS-provided physical RAM map: Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Aug 15 09:20:35 oleg434-client kernel: BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable Aug 15 09:20:35 oleg434-client kernel: NX (Execute Disable) protection: active Aug 15 09:20:35 oleg434-client kernel: SMBIOS 2.8 present. Aug 15 09:20:35 oleg434-client kernel: DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:20:35 oleg434-client kernel: Hypervisor detected: KVM Aug 15 09:20:35 oleg434-client kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Aug 15 09:20:35 oleg434-client kernel: kvm-clock: using sched offset of 456632165 cycles Aug 15 09:20:35 oleg434-client kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Aug 15 09:20:35 oleg434-client kernel: tsc: Detected 2400.000 MHz processor Aug 15 09:20:35 oleg434-client kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Aug 15 09:20:35 oleg434-client kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Aug 15 09:20:35 oleg434-client kernel: last_pfn = 0x146e00 max_arch_pfn = 0x400000000 Aug 15 09:20:35 oleg434-client kernel: MTRR default type: write-back Aug 15 09:20:35 oleg434-client kernel: MTRR fixed ranges enabled: Aug 15 09:20:35 oleg434-client kernel: 00000-9FFFF write-back Aug 15 09:20:35 oleg434-client kernel: A0000-BFFFF uncachable Aug 15 09:20:35 oleg434-client kernel: C0000-FFFFF write-protect Aug 15 09:20:35 oleg434-client kernel: MTRR variable ranges enabled: Aug 15 09:20:35 oleg434-client kernel: 0 base 0000C0000000 mask 3FFFC0000000 uncachable Aug 15 09:20:35 oleg434-client kernel: 1 disabled Aug 15 09:20:35 oleg434-client kernel: 2 disabled Aug 15 09:20:35 oleg434-client kernel: 3 disabled Aug 15 09:20:35 oleg434-client kernel: 4 disabled Aug 15 09:20:35 oleg434-client kernel: 5 disabled Aug 15 09:20:35 oleg434-client kernel: 6 disabled Aug 15 09:20:35 oleg434-client kernel: 7 disabled Aug 15 09:20:35 oleg434-client kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Aug 15 09:20:35 oleg434-client kernel: last_pfn = 0xbffda max_arch_pfn = 0x400000000 Aug 15 09:20:35 oleg434-client kernel: found SMP MP-table at [mem 0x000f54d0-0x000f54df] Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce01000, 0x10ce01fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce02000, 0x10ce02fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce03000, 0x10ce03fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce04000, 0x10ce04fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce05000, 0x10ce05fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce06000, 0x10ce06fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce07000, 0x10ce07fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce08000, 0x10ce08fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce09000, 0x10ce09fff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce0a000, 0x10ce0afff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce0b000, 0x10ce0bfff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: BRK [0x10ce0c000, 0x10ce0cfff] PGTABLE Aug 15 09:20:35 oleg434-client kernel: RAMDISK: [mem 0xbcc64000-0xbffcffff] Aug 15 09:20:35 oleg434-client kernel: ACPI: Early table checksum verification disabled Aug 15 09:20:35 oleg434-client kernel: ACPI: RSDP 0x00000000000F52F0 000014 (v00 BOCHS ) Aug 15 09:20:35 oleg434-client kernel: ACPI: RSDT 0x00000000BFFE2464 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) Aug 15 09:20:35 oleg434-client kernel: ACPI: FACP 0x00000000BFFE2300 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) Aug 15 09:20:35 oleg434-client kernel: ACPI: DSDT 0x00000000BFFE0040 0022C0 (v01 BOCHS BXPC 00000001 BXPC 00000001) Aug 15 09:20:35 oleg434-client kernel: ACPI: FACS 0x00000000BFFE0000 000040 Aug 15 09:20:35 oleg434-client kernel: ACPI: APIC 0x00000000BFFE2374 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) Aug 15 09:20:35 oleg434-client kernel: ACPI: HPET 0x00000000BFFE2404 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) Aug 15 09:20:35 oleg434-client kernel: ACPI: WAET 0x00000000BFFE243C 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) Aug 15 09:20:35 oleg434-client kernel: ACPI: Reserving FACP table memory at [mem 0xbffe2300-0xbffe2373] Aug 15 09:20:35 oleg434-client kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22ff] Aug 15 09:20:35 oleg434-client kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] Aug 15 09:20:35 oleg434-client kernel: ACPI: Reserving APIC table memory at [mem 0xbffe2374-0xbffe2403] Aug 15 09:20:35 oleg434-client kernel: ACPI: Reserving HPET table memory at [mem 0xbffe2404-0xbffe243b] Aug 15 09:20:35 oleg434-client kernel: ACPI: Reserving WAET table memory at [mem 0xbffe243c-0xbffe2463] Aug 15 09:20:35 oleg434-client kernel: ACPI: Local APIC address 0xfee00000 Aug 15 09:20:35 oleg434-client kernel: No NUMA configuration found Aug 15 09:20:35 oleg434-client kernel: Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] Aug 15 09:20:35 oleg434-client kernel: NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] Aug 15 09:20:35 oleg434-client kernel: Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) Aug 15 09:20:35 oleg434-client kernel: Zone ranges: Aug 15 09:20:35 oleg434-client kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Aug 15 09:20:35 oleg434-client kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Aug 15 09:20:35 oleg434-client kernel: Normal [mem 0x0000000100000000-0x0000000146dfffff] Aug 15 09:20:35 oleg434-client kernel: Device empty Aug 15 09:20:35 oleg434-client kernel: Movable zone start for each node Aug 15 09:20:35 oleg434-client kernel: Early memory node ranges Aug 15 09:20:35 oleg434-client kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Aug 15 09:20:35 oleg434-client kernel: node 0: [mem 0x0000000000100000-0x00000000bffd9fff] Aug 15 09:20:35 oleg434-client kernel: node 0: [mem 0x0000000100000000-0x0000000146dfffff] Aug 15 09:20:35 oleg434-client kernel: Zeroed struct page in unavailable ranges: 4744 pages Aug 15 09:20:35 oleg434-client kernel: Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] Aug 15 09:20:35 oleg434-client kernel: On node 0 totalpages: 1076600 Aug 15 09:20:35 oleg434-client kernel: DMA zone: 64 pages used for memmap Aug 15 09:20:35 oleg434-client kernel: DMA zone: 158 pages reserved Aug 15 09:20:35 oleg434-client kernel: DMA zone: 3998 pages, LIFO batch:0 Aug 15 09:20:35 oleg434-client kernel: DMA32 zone: 12224 pages used for memmap Aug 15 09:20:35 oleg434-client kernel: DMA32 zone: 782298 pages, LIFO batch:63 Aug 15 09:20:35 oleg434-client kernel: Normal zone: 4536 pages used for memmap Aug 15 09:20:35 oleg434-client kernel: Normal zone: 290304 pages, LIFO batch:63 Aug 15 09:20:35 oleg434-client kernel: ACPI: PM-Timer IO Port: 0x608 Aug 15 09:20:35 oleg434-client kernel: ACPI: Local APIC address 0xfee00000 Aug 15 09:20:35 oleg434-client kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Aug 15 09:20:35 oleg434-client kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Aug 15 09:20:35 oleg434-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Aug 15 09:20:35 oleg434-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Aug 15 09:20:35 oleg434-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Aug 15 09:20:35 oleg434-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Aug 15 09:20:35 oleg434-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Aug 15 09:20:35 oleg434-client kernel: ACPI: IRQ0 used by override. Aug 15 09:20:35 oleg434-client kernel: ACPI: IRQ5 used by override. Aug 15 09:20:35 oleg434-client kernel: ACPI: IRQ9 used by override. Aug 15 09:20:35 oleg434-client kernel: ACPI: IRQ10 used by override. Aug 15 09:20:35 oleg434-client kernel: ACPI: IRQ11 used by override. Aug 15 09:20:35 oleg434-client kernel: Using ACPI (MADT) for SMP configuration information Aug 15 09:20:35 oleg434-client kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000 Aug 15 09:20:35 oleg434-client kernel: TSC deadline timer available Aug 15 09:20:35 oleg434-client kernel: smpboot: Allowing 4 CPUs, 0 hotplug CPUs Aug 15 09:20:35 oleg434-client kernel: kvm-guest: KVM setup pv remote TLB flush Aug 15 09:20:35 oleg434-client kernel: kvm-guest: setup PV sched yield Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0x00000000-0x00000fff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000effff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] Aug 15 09:20:35 oleg434-client kernel: PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] Aug 15 09:20:35 oleg434-client kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices Aug 15 09:20:35 oleg434-client kernel: Booting paravirtualized kernel on KVM Aug 15 09:20:35 oleg434-client kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Aug 15 09:20:35 oleg434-client kernel: setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 Aug 15 09:20:35 oleg434-client kernel: percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 Aug 15 09:20:35 oleg434-client kernel: pcpu-alloc: s221184 r8192 d28672 u524288 alloc=1*2097152 Aug 15 09:20:35 oleg434-client kernel: pcpu-alloc: [0] 0 1 2 3 Aug 15 09:20:35 oleg434-client kernel: kvm-guest: PV spinlocks enabled Aug 15 09:20:35 oleg434-client kernel: PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) Aug 15 09:20:35 oleg434-client kernel: Built 1 zonelists, mobility grouping on. Total pages: 1059618 Aug 15 09:20:35 oleg434-client kernel: Policy zone: Normal Aug 15 09:20:35 oleg434-client kernel: Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Aug 15 09:20:35 oleg434-client kernel: Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. Aug 15 09:20:35 oleg434-client kernel: audit: disabled (until reboot) Aug 15 09:20:35 oleg434-client kernel: software IO TLB: area num 4. Aug 15 09:20:35 oleg434-client kernel: Memory: 2895288K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524588K reserved, 0K cma-reserved) Aug 15 09:20:35 oleg434-client kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 Aug 15 09:20:35 oleg434-client kernel: kmemleak: Kernel memory leak detector disabled Aug 15 09:20:35 oleg434-client kernel: ftrace: allocating 41240 entries in 162 pages Aug 15 09:20:35 oleg434-client kernel: ftrace: allocated 162 pages with 3 groups Aug 15 09:20:35 oleg434-client kernel: rcu: Hierarchical RCU implementation. Aug 15 09:20:35 oleg434-client kernel: rcu: #011RCU event tracing is enabled. Aug 15 09:20:35 oleg434-client kernel: rcu: #011RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. Aug 15 09:20:35 oleg434-client kernel: rcu: #011RCU callback double-/use-after-free debug enabled. Aug 15 09:20:35 oleg434-client kernel: #011Rude variant of Tasks RCU enabled. Aug 15 09:20:35 oleg434-client kernel: #011Tracing variant of Tasks RCU enabled. Aug 15 09:20:35 oleg434-client kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Aug 15 09:20:35 oleg434-client kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 Aug 15 09:20:35 oleg434-client kernel: NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 Aug 15 09:20:35 oleg434-client kernel: random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 Aug 15 09:20:35 oleg434-client kernel: Console: colour *CGA 80x25 Aug 15 09:20:35 oleg434-client kernel: printk: console [ttyS1] enabled Aug 15 09:20:35 oleg434-client kernel: ACPI: Core revision 20220331 Aug 15 09:20:35 oleg434-client kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns Aug 15 09:20:35 oleg434-client kernel: hpet clockevent registered Aug 15 09:20:35 oleg434-client kernel: APIC: Switch to symmetric I/O mode setup Aug 15 09:20:35 oleg434-client kernel: x2apic enabled Aug 15 09:20:35 oleg434-client kernel: Switched APIC routing to physical x2apic. Aug 15 09:20:35 oleg434-client kernel: kvm-guest: setup PV IPIs Aug 15 09:20:35 oleg434-client kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Aug 15 09:20:35 oleg434-client kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns Aug 15 09:20:35 oleg434-client kernel: Calibrating delay loop (skipped) preset value.. 4800.00 BogoMIPS (lpj=2400000) Aug 15 09:20:35 oleg434-client kernel: pid_max: default: 32768 minimum: 301 Aug 15 09:20:35 oleg434-client kernel: LSM: Security Framework initializing Aug 15 09:20:35 oleg434-client kernel: Yama: becoming mindful. Aug 15 09:20:35 oleg434-client kernel: SELinux: Initializing. Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE selinux *** Aug 15 09:20:35 oleg434-client kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE tmpfs *** Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE proc *** Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE cgroup *** Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE cgroup2 *** Aug 15 09:20:35 oleg434-client kernel: x86/cpu: User Mode Instruction Prevention (UMIP) activated Aug 15 09:20:35 oleg434-client kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Aug 15 09:20:35 oleg434-client kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 Aug 15 09:20:35 oleg434-client kernel: Spectre V2 : User space: Vulnerable Aug 15 09:20:35 oleg434-client kernel: Speculative Store Bypass: Vulnerable Aug 15 09:20:35 oleg434-client kernel: debug: unmapping init [mem 0xffffffff90059000-0xffffffff90060fff] Aug 15 09:20:35 oleg434-client kernel: smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) Aug 15 09:20:35 oleg434-client kernel: Performance Events: IvyBridge events, full-width counters, Intel PMU driver. Aug 15 09:20:35 oleg434-client kernel: ... version: 2 Aug 15 09:20:35 oleg434-client kernel: ... bit width: 48 Aug 15 09:20:35 oleg434-client kernel: ... generic registers: 4 Aug 15 09:20:35 oleg434-client kernel: ... value mask: 0000ffffffffffff Aug 15 09:20:35 oleg434-client kernel: ... max period: 00007fffffffffff Aug 15 09:20:35 oleg434-client kernel: ... fixed-purpose events: 3 Aug 15 09:20:35 oleg434-client kernel: ... event mask: 000000070000000f Aug 15 09:20:35 oleg434-client kernel: rcu: Hierarchical SRCU implementation. Aug 15 09:20:35 oleg434-client kernel: smp: Bringing up secondary CPUs ... Aug 15 09:20:35 oleg434-client kernel: x86: Booting SMP configuration: Aug 15 09:20:35 oleg434-client kernel: .... node #0, CPUs: #1 #2 #3 Aug 15 09:20:35 oleg434-client kernel: smp: Brought up 1 node, 4 CPUs Aug 15 09:20:35 oleg434-client kernel: smpboot: Max logical packages: 1 Aug 15 09:20:35 oleg434-client kernel: smpboot: Total of 4 processors activated (19200.00 BogoMIPS) Aug 15 09:20:35 oleg434-client kernel: node 0 deferred pages initialised in 129ms Aug 15 09:20:35 oleg434-client kernel: devtmpfs: initialized Aug 15 09:20:35 oleg434-client kernel: x86/mm: Memory block size: 128MB Aug 15 09:20:35 oleg434-client kernel: gcov: version magic: 0x41383552 Aug 15 09:20:35 oleg434-client kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Aug 15 09:20:35 oleg434-client kernel: futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: pinctrl core: initialized pinctrl subsystem Aug 15 09:20:35 oleg434-client kernel: Aug 15 09:20:35 oleg434-client kernel: ************************************************************* Aug 15 09:20:35 oleg434-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** Aug 15 09:20:35 oleg434-client kernel: ** ** Aug 15 09:20:35 oleg434-client kernel: ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** Aug 15 09:20:35 oleg434-client kernel: ** ** Aug 15 09:20:35 oleg434-client kernel: ** This means that this kernel is built to expose internal ** Aug 15 09:20:35 oleg434-client kernel: ** IOMMU data structures, which may compromise security on ** Aug 15 09:20:35 oleg434-client kernel: ** your system. ** Aug 15 09:20:35 oleg434-client kernel: ** ** Aug 15 09:20:35 oleg434-client kernel: ** If you see this message and you are not debugging the ** Aug 15 09:20:35 oleg434-client kernel: ** kernel, report this immediately to your vendor! ** Aug 15 09:20:35 oleg434-client kernel: ** ** Aug 15 09:20:35 oleg434-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** Aug 15 09:20:35 oleg434-client kernel: ************************************************************* Aug 15 09:20:35 oleg434-client kernel: NET: Registered protocol family 16 Aug 15 09:20:35 oleg434-client kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Aug 15 09:20:35 oleg434-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Aug 15 09:20:35 oleg434-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Aug 15 09:20:35 oleg434-client kernel: cpuidle: using governor menu Aug 15 09:20:35 oleg434-client kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Aug 15 09:20:35 oleg434-client kernel: PCI: Using configuration type 1 for base access Aug 15 09:20:35 oleg434-client kernel: core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on Aug 15 09:20:35 oleg434-client kernel: HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages Aug 15 09:20:35 oleg434-client kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Aug 15 09:20:35 oleg434-client kernel: cryptd: max_cpu_qlen set to 1000 Aug 15 09:20:35 oleg434-client kernel: ACPI: Added _OSI(Module Device) Aug 15 09:20:35 oleg434-client kernel: ACPI: Added _OSI(Processor Device) Aug 15 09:20:35 oleg434-client kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Aug 15 09:20:35 oleg434-client kernel: ACPI: Added _OSI(Processor Aggregator Device) Aug 15 09:20:35 oleg434-client kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Aug 15 09:20:35 oleg434-client kernel: ACPI: Interpreter enabled Aug 15 09:20:35 oleg434-client kernel: ACPI: PM: (supports S0 S3 S4 S5) Aug 15 09:20:35 oleg434-client kernel: ACPI: Using IOAPIC for interrupt routing Aug 15 09:20:35 oleg434-client kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Aug 15 09:20:35 oleg434-client kernel: ACPI: Enabled 2 GPEs in block 00 to 0F Aug 15 09:20:35 oleg434-client kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Aug 15 09:20:35 oleg434-client kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] Aug 15 09:20:35 oleg434-client kernel: acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] Aug 15 09:20:35 oleg434-client kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [2] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [5] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [6] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [3] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [4] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [7] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [8] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [9] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [10] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [11] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [12] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [13] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [14] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [15] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [16] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [17] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [18] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [19] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [20] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [21] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [22] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [23] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [24] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [25] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [26] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [27] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [28] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [29] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [30] registered Aug 15 09:20:35 oleg434-client kernel: acpiphp: Slot [31] registered Aug 15 09:20:35 oleg434-client kernel: PCI host bridge to bus 0000:00 Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] Aug 15 09:20:35 oleg434-client kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Aug 15 09:20:35 oleg434-client kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Aug 15 09:20:35 oleg434-client kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Aug 15 09:20:35 oleg434-client kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Aug 15 09:20:35 oleg434-client kernel: ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Aug 15 09:20:35 oleg434-client kernel: iommu: Default domain type: Passthrough Aug 15 09:20:35 oleg434-client kernel: SCSI subsystem initialized Aug 15 09:20:35 oleg434-client kernel: ACPI: bus type USB registered Aug 15 09:20:35 oleg434-client kernel: usbcore: registered new interface driver usbfs Aug 15 09:20:35 oleg434-client kernel: usbcore: registered new interface driver hub Aug 15 09:20:35 oleg434-client kernel: usbcore: registered new device driver usb Aug 15 09:20:35 oleg434-client kernel: pps_core: LinuxPPS API ver. 1 registered Aug 15 09:20:35 oleg434-client kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Aug 15 09:20:35 oleg434-client kernel: PTP clock support registered Aug 15 09:20:35 oleg434-client kernel: EDAC MC: Ver: 3.0.0 Aug 15 09:20:35 oleg434-client kernel: PCI: Using ACPI for IRQ routing Aug 15 09:20:35 oleg434-client kernel: PCI: pci_cache_line_size set to 64 bytes Aug 15 09:20:35 oleg434-client kernel: e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Aug 15 09:20:35 oleg434-client kernel: e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] Aug 15 09:20:35 oleg434-client kernel: e820: reserve RAM buffer [mem 0x146e00000-0x147ffffff] Aug 15 09:20:35 oleg434-client kernel: NetLabel: Initializing Aug 15 09:20:35 oleg434-client kernel: NetLabel: domain hash size = 128 Aug 15 09:20:35 oleg434-client kernel: NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Aug 15 09:20:35 oleg434-client kernel: NetLabel: unlabeled traffic allowed by default Aug 15 09:20:35 oleg434-client kernel: vgaarb: loaded Aug 15 09:20:35 oleg434-client kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 Aug 15 09:20:35 oleg434-client kernel: hpet0: 3 comparators, 64-bit 100.000000 MHz counter Aug 15 09:20:35 oleg434-client kernel: clocksource: Switched to clocksource kvm-clock Aug 15 09:20:35 oleg434-client kernel: VFS: Disk quotas dquot_6.6.0 Aug 15 09:20:35 oleg434-client kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE ramfs *** Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE hugetlbfs *** Aug 15 09:20:35 oleg434-client kernel: pnp: PnP ACPI init Aug 15 09:20:35 oleg434-client kernel: pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) Aug 15 09:20:35 oleg434-client kernel: pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) Aug 15 09:20:35 oleg434-client kernel: pnp 00:02: [dma 2] Aug 15 09:20:35 oleg434-client kernel: pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) Aug 15 09:20:35 oleg434-client kernel: pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) Aug 15 09:20:35 oleg434-client kernel: pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) Aug 15 09:20:35 oleg434-client kernel: pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) Aug 15 09:20:35 oleg434-client kernel: pnp: PnP ACPI: found 6 devices Aug 15 09:20:35 oleg434-client kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Aug 15 09:20:35 oleg434-client kernel: pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] Aug 15 09:20:35 oleg434-client kernel: NET: Registered protocol family 2 Aug 15 09:20:35 oleg434-client kernel: IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: TCP: Hash tables configured (established 65536 bind 65536) Aug 15 09:20:35 oleg434-client kernel: MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) Aug 15 09:20:35 oleg434-client kernel: NET: Registered protocol family 1 Aug 15 09:20:35 oleg434-client kernel: RPC: Registered named UNIX socket transport module. Aug 15 09:20:35 oleg434-client kernel: RPC: Registered udp transport module. Aug 15 09:20:35 oleg434-client kernel: RPC: Registered tcp transport module. Aug 15 09:20:35 oleg434-client kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Aug 15 09:20:35 oleg434-client kernel: NET: Registered protocol family 44 Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release Aug 15 09:20:35 oleg434-client kernel: pci 0000:00:01.0: Activating ISA DMA hang workarounds Aug 15 09:20:35 oleg434-client kernel: PCI: CLS 0 bytes, default 64 Aug 15 09:20:35 oleg434-client kernel: Unpacking initramfs... Aug 15 09:20:35 oleg434-client kernel: debug: unmapping init [mem 0xffff898e3cc64000-0xffff898e3ffcffff] Aug 15 09:20:35 oleg434-client kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Aug 15 09:20:35 oleg434-client kernel: software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) Aug 15 09:20:35 oleg434-client kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns Aug 15 09:20:35 oleg434-client kernel: Initialise system trusted keyrings Aug 15 09:20:35 oleg434-client kernel: Key type blacklist registered Aug 15 09:20:35 oleg434-client kernel: workingset: timestamp_bits=36 max_order=20 bucket_order=0 Aug 15 09:20:35 oleg434-client kernel: zbud: loaded Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE nfs *** Aug 15 09:20:35 oleg434-client kernel: *** VALIDATE nfs4 *** Aug 15 09:20:35 oleg434-client kernel: pstore: using deflate compression Aug 15 09:20:35 oleg434-client kernel: Platform Keyring initialized Aug 15 09:20:35 oleg434-client kernel: NET: Registered protocol family 38 Aug 15 09:20:35 oleg434-client kernel: Key type asymmetric registered Aug 15 09:20:35 oleg434-client kernel: Asymmetric key parser 'x509' registered Aug 15 09:20:35 oleg434-client kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) Aug 15 09:20:35 oleg434-client kernel: io scheduler mq-deadline registered Aug 15 09:20:35 oleg434-client kernel: io scheduler kyber registered Aug 15 09:20:35 oleg434-client kernel: io scheduler bfq registered Aug 15 09:20:35 oleg434-client kernel: atomic64_test: passed for x86-64 platform with CX8 and with SSE Aug 15 09:20:35 oleg434-client kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Aug 15 09:20:35 oleg434-client kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Aug 15 09:20:35 oleg434-client kernel: ACPI: Power Button [PWRF] Aug 15 09:20:35 oleg434-client kernel: ACPI: \_SB_.LNKB: Enabled at IRQ 10 Aug 15 09:20:35 oleg434-client kernel: ACPI: \_SB_.LNKA: Enabled at IRQ 11 Aug 15 09:20:35 oleg434-client kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Aug 15 09:20:35 oleg434-client kernel: 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A Aug 15 09:20:35 oleg434-client kernel: 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Aug 15 09:20:35 oleg434-client kernel: Non-volatile memory driver v1.3 Aug 15 09:20:35 oleg434-client kernel: Linux agpgart interface v0.103 Aug 15 09:20:35 oleg434-client kernel: virtio_blk virtio1: [vda] 145904 512-byte logical blocks (74.7 MB/71.2 MiB) Aug 15 09:20:35 oleg434-client kernel: vda: detected capacity change from 0 to 74702848 Aug 15 09:20:35 oleg434-client kernel: virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) Aug 15 09:20:35 oleg434-client kernel: vdb: detected capacity change from 0 to 1073741824 Aug 15 09:20:35 oleg434-client kernel: libphy: Fixed MDIO Bus: probed Aug 15 09:20:35 oleg434-client kernel: usbcore: registered new interface driver usbserial_generic Aug 15 09:20:35 oleg434-client kernel: usbserial: USB Serial support registered for generic Aug 15 09:20:35 oleg434-client kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Aug 15 09:20:35 oleg434-client kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Aug 15 09:20:35 oleg434-client kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Aug 15 09:20:35 oleg434-client kernel: mousedev: PS/2 mouse device common for all mice Aug 15 09:20:35 oleg434-client kernel: rtc_cmos 00:05: RTC can wake from S4 Aug 15 09:20:35 oleg434-client kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 Aug 15 09:20:35 oleg434-client kernel: rtc_cmos 00:05: registered as rtc0 Aug 15 09:20:35 oleg434-client kernel: rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs Aug 15 09:20:35 oleg434-client kernel: intel_pstate: CPU model not supported Aug 15 09:20:35 oleg434-client kernel: hid: raw HID events driver (C) Jiri Kosina Aug 15 09:20:35 oleg434-client kernel: usbcore: registered new interface driver usbhid Aug 15 09:20:35 oleg434-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 Aug 15 09:20:35 oleg434-client kernel: usbhid: USB HID core driver Aug 15 09:20:35 oleg434-client kernel: drop_monitor: Initializing network drop monitor service Aug 15 09:20:35 oleg434-client kernel: Initializing XFRM netlink socket Aug 15 09:20:35 oleg434-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 Aug 15 09:20:35 oleg434-client kernel: NET: Registered protocol family 10 Aug 15 09:20:35 oleg434-client kernel: Segment Routing with IPv6 Aug 15 09:20:35 oleg434-client kernel: NET: Registered protocol family 17 Aug 15 09:20:35 oleg434-client kernel: mpls_gso: MPLS GSO support Aug 15 09:20:35 oleg434-client kernel: start plist test Aug 15 09:20:35 oleg434-client kernel: end plist test Aug 15 09:20:35 oleg434-client kernel: RAS: Correctable Errors collector initialized. Aug 15 09:20:35 oleg434-client kernel: AVX version of gcm_enc/dec engaged. Aug 15 09:20:35 oleg434-client kernel: AES CTR mode by8 optimization enabled Aug 15 09:20:35 oleg434-client kernel: sched_clock: Marking stable (3326620160, 0)->(4225084870, -898464710) Aug 15 09:20:35 oleg434-client kernel: registered taskstats version 1 Aug 15 09:20:35 oleg434-client kernel: Loading compiled-in X.509 certificates Aug 15 09:20:35 oleg434-client kernel: zswap: loaded using pool lzo/zbud Aug 15 09:20:35 oleg434-client kernel: Key type big_key registered Aug 15 09:20:35 oleg434-client kernel: Key type encrypted registered Aug 15 09:20:35 oleg434-client kernel: ima: No TPM chip found, activating TPM-bypass! Aug 15 09:20:35 oleg434-client kernel: ima: Allocated hash algorithm: sha1 Aug 15 09:20:35 oleg434-client kernel: ima: No architecture policies found Aug 15 09:20:35 oleg434-client kernel: evm: Initialising EVM extended attributes: Aug 15 09:20:35 oleg434-client kernel: evm: security.selinux Aug 15 09:20:35 oleg434-client kernel: evm: security.ima Aug 15 09:20:35 oleg434-client kernel: evm: security.capability Aug 15 09:20:35 oleg434-client kernel: evm: HMAC attrs: 0x1 Aug 15 09:20:35 oleg434-client kernel: rtc_cmos 00:05: setting system clock to 2026-08-15 13:20:35 UTC (1786800035) Aug 15 09:20:35 oleg434-client kernel: debug: unmapping init [mem 0xffffffff91003000-0xffffffff911fffff] Aug 15 09:20:35 oleg434-client kernel: debug: unmapping init [mem 0xffffffff8fd82000-0xffffffff90058fff] Aug 15 09:20:35 oleg434-client kernel: Write protecting the kernel read-only data: 28672k Aug 15 09:20:35 oleg434-client kernel: debug: unmapping init [mem 0xffffffff8e403000-0xffffffff8e5fffff] Aug 15 09:20:35 oleg434-client kernel: debug: unmapping init [mem 0xffffffff8ed14000-0xffffffff8edfffff] Aug 15 09:20:35 oleg434-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Aug 15 09:20:35 oleg434-client systemd[1]: Detected virtualization kvm. Aug 15 09:20:35 oleg434-client systemd[1]: Detected architecture x86-64. Aug 15 09:20:35 oleg434-client systemd[1]: Running in initial RAM disk. Aug 15 09:20:35 oleg434-client systemd[1]: No hostname configured. Aug 15 09:20:35 oleg434-client systemd[1]: Set hostname to . Aug 15 09:20:35 oleg434-client kernel: random: systemd: uninitialized urandom read (16 bytes read) Aug 15 09:20:35 oleg434-client systemd[1]: Initializing machine ID from random generator. Aug 15 09:20:35 oleg434-client kernel: random: ln: uninitialized urandom read (6 bytes read) Aug 15 09:20:35 oleg434-client kernel: random: systemd: uninitialized urandom read (16 bytes read) Aug 15 09:20:35 oleg434-client systemd[1]: Listening on Journal Socket. Aug 15 09:20:35 oleg434-client systemd[1]: Listening on udev Control Socket. Aug 15 09:20:35 oleg434-client systemd[1]: Reached target Initrd Root Device. Aug 15 09:20:35 oleg434-client systemd-journald[244]: Journal started Aug 15 09:20:35 oleg434-client systemd-journald[244]: Runtime journal (/run/log/journal/10ba88af61b64ee786d36099d9ba833b) is 8.0M, max 184.6M, 176.6M free. Aug 15 09:20:35 oleg434-client systemd-vconsole-setup[236]: KD_FONT_OP_GET failed while trying to get the font metadata: Invalid argument Aug 15 09:20:35 oleg434-client systemd-vconsole-setup[236]: Fonts will not be copied to remaining consoles Aug 15 09:20:35 oleg434-client dracut-cmdline[254]: dracut-8.10 (Green Obsidian) dracut-049-233.git20240115.el8 Aug 15 09:20:35 oleg434-client dracut-cmdline[254]: Using kernel command line parameters: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Aug 15 09:20:36 oleg434-client systemd[1]: Started dracut cmdline hook. Aug 15 09:20:36 oleg434-client systemd[1]: Starting dracut pre-udev hook... Aug 15 09:20:36 oleg434-client kernel: device-mapper: uevent: version 1.0.3 Aug 15 09:20:36 oleg434-client kernel: device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com Aug 15 09:20:36 oleg434-client rpc.statd[387]: Version 2.3.3 starting Aug 15 09:20:36 oleg434-client rpc.statd[387]: Initializing NSM state Aug 15 09:20:36 oleg434-client rpc.idmapd[392]: Setting log level to 0 Aug 15 09:20:36 oleg434-client systemd[1]: Started dracut pre-udev hook. Aug 15 09:20:36 oleg434-client systemd[1]: Starting udev Kernel Device Manager... Aug 15 09:20:36 oleg434-client systemd[1]: Started udev Kernel Device Manager. Aug 15 09:20:36 oleg434-client systemd[1]: Starting dracut pre-trigger hook... Aug 15 09:20:36 oleg434-client systemd[1]: Started dracut pre-trigger hook. Aug 15 09:20:36 oleg434-client systemd[1]: Starting udev Coldplug all Devices... Aug 15 09:20:36 oleg434-client systemd[1]: Mounting Kernel Configuration File System... Aug 15 09:20:36 oleg434-client systemd[1]: Mounted Kernel Configuration File System. Aug 15 09:20:36 oleg434-client systemd[1]: Started udev Coldplug all Devices. Aug 15 09:20:36 oleg434-client systemd[1]: Reached target System Initialization. Aug 15 09:20:36 oleg434-client systemd[1]: Reached target Basic System. Aug 15 09:20:36 oleg434-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. Aug 15 09:20:36 oleg434-client systemd[1]: Starting dracut initqueue hook... Aug 15 09:20:37 oleg434-client rngd[439]: Disabling 7: PKCS11 Entropy generator (pkcs11) Aug 15 09:20:37 oleg434-client rngd[439]: Disabling 5: NIST Network Entropy Beacon (nist) Aug 15 09:20:37 oleg434-client rngd[439]: Disabling 9: Qrypt quantum entropy beacon (qrypt) Aug 15 09:20:37 oleg434-client rngd[439]: Initializing available sources Aug 15 09:20:37 oleg434-client rngd[439]: [hwrng ]: Initialization Failed Aug 15 09:20:37 oleg434-client rngd[439]: [rdrand]: Enabling RDRAND rng support Aug 15 09:20:37 oleg434-client rngd[439]: [rdrand]: Initialized Aug 15 09:20:37 oleg434-client rngd[439]: [jitter]: JITTER timeout set to 5 sec Aug 15 09:20:37 oleg434-client systemd-udevd[431]: Using default interface naming scheme 'rhel-8.0'. Aug 15 09:20:37 oleg434-client systemd-udevd[431]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Aug 15 09:20:37 oleg434-client kernel: virtio_net virtio0 ens2: renamed from eth0 Aug 15 09:20:37 oleg434-client kernel: libata version 3.00 loaded. Aug 15 09:20:37 oleg434-client kernel: ata_piix 0000:00:01.1: version 2.13 Aug 15 09:20:37 oleg434-client kernel: scsi host0: ata_piix Aug 15 09:20:37 oleg434-client kernel: scsi host1: ata_piix Aug 15 09:20:37 oleg434-client kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 Aug 15 09:20:37 oleg434-client kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 Aug 15 09:20:37 oleg434-client systemd-udevd[460]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Aug 15 09:20:37 oleg434-client rngd[439]: [jitter]: Initializing AES buffer Aug 15 09:20:37 oleg434-client systemd-udevd[433]: Using default interface naming scheme 'rhel-8.0'. Aug 15 09:20:37 oleg434-client dracut-initqueue[499]: Starting dhcp for interface ens2 Aug 15 09:20:38 oleg434-client dracut-initqueue[532]: dhcp: PREINIT ens2 up Aug 15 09:20:38 oleg434-client kernel: random: fast init done Aug 15 09:20:38 oleg434-client dhclient[531]: Created duid "\000\004\020\272\210\257a\266N\347\206\323`\231\331\272\203;". Aug 15 09:20:38 oleg434-client dhclient[531]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 8 (xid=0x9c13a477) Aug 15 09:20:38 oleg434-client dhclient[531]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0x9c13a477) Aug 15 09:20:38 oleg434-client dhclient[531]: DHCPOFFER from 192.168.204.254 Aug 15 09:20:38 oleg434-client dhclient[531]: DHCPACK from 192.168.204.254 (xid=0x9c13a477) Aug 15 09:20:38 oleg434-client dracut-initqueue[550]: dhcp: BOND setting ens2 Aug 15 09:20:40 oleg434-client dhclient[531]: bound to 192.168.204.34 -- renewal in 27146 seconds. Aug 15 09:20:40 oleg434-client dracut-initqueue[578]: RTNETLINK answers: File exists Aug 15 09:20:41 oleg434-client systemd[1]: Reloading. Aug 15 09:20:42 oleg434-client rngd[439]: [jitter]: Unable to obtain AES key, disabling JITTER source Aug 15 09:20:42 oleg434-client kernel: random: crng init done Aug 15 09:20:42 oleg434-client kernel: random: 7 urandom warning(s) missed due to ratelimiting Aug 15 09:20:42 oleg434-client rngd[439]: [jitter]: Initialization Failed Aug 15 09:20:42 oleg434-client systemd[612]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. Aug 15 09:20:42 oleg434-client systemd[1]: Starting nbd nbd0... Aug 15 09:20:42 oleg434-client nbd-client[647]: Negotiation: ..size = 30720MB Aug 15 09:20:42 oleg434-client nbd-client[647]: Connected /dev/nbd0 Aug 15 09:20:42 oleg434-client systemd[1]: nbd0.service: Succeeded. Aug 15 09:20:42 oleg434-client systemd[1]: Started nbd nbd0. Aug 15 09:20:42 oleg434-client systemd[1]: Started dracut initqueue hook. Aug 15 09:20:42 oleg434-client systemd[1]: Reached target Remote File Systems (Pre). Aug 15 09:20:42 oleg434-client systemd[1]: Reached target Remote File Systems. Aug 15 09:20:42 oleg434-client systemd[1]: Mounting /sysroot... Aug 15 09:20:42 oleg434-client kernel: EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) Aug 15 09:20:42 oleg434-client systemd[1]: Mounted /sysroot. Aug 15 09:20:42 oleg434-client systemd[1]: Reached target Initrd Root File System. Aug 15 09:20:42 oleg434-client systemd[1]: Starting Reload Configuration from the Real Root... Aug 15 09:20:42 oleg434-client systemd[1]: Reloading. Aug 15 09:20:42 oleg434-client systemd[669]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. Aug 15 09:20:42 oleg434-client systemd[1]: initrd-parse-etc.service: Succeeded. Aug 15 09:20:42 oleg434-client systemd[1]: Started Reload Configuration from the Real Root. Aug 15 09:20:42 oleg434-client systemd[1]: Reached target Initrd File Systems. Aug 15 09:20:42 oleg434-client systemd[1]: Reached target Initrd Default Target. Aug 15 09:20:42 oleg434-client systemd[1]: Starting dracut pre-pivot and cleanup hook... Aug 15 09:20:43 oleg434-client systemd[1]: var-lib-nfs-rpc_pipefs.mount: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Started dracut pre-pivot and cleanup hook. Aug 15 09:20:43 oleg434-client systemd[1]: Starting Cleaning Up and Shutting Down Daemons... Aug 15 09:20:43 oleg434-client rngd[439]: [rdrand]: Shutting down Aug 15 09:20:43 oleg434-client systemd[1]: Stopping Hardware RNG Entropy Gatherer Daemon... Aug 15 09:20:43 oleg434-client systemd[1]: dracut-pre-pivot.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped dracut pre-pivot and cleanup hook. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Remote File Systems. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Remote File Systems (Pre). Aug 15 09:20:43 oleg434-client systemd[1]: dracut-initqueue.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped dracut initqueue hook. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Timers. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Initrd Default Target. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Initrd Root Device. Aug 15 09:20:43 oleg434-client systemd[1]: rngd.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped Hardware RNG Entropy Gatherer Daemon. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Basic System. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Sockets. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Paths. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Slices. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target System Initialization. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-sysctl.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped Apply Kernel Variables. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Local Encrypted Volumes. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-ask-password-console.path: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-udev-trigger.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped udev Coldplug all Devices. Aug 15 09:20:43 oleg434-client systemd[1]: dracut-pre-trigger.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped dracut pre-trigger hook. Aug 15 09:20:43 oleg434-client systemd[1]: Stopping udev Kernel Device Manager... Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Swap. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-tmpfiles-setup.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped Create Volatile Files and Directories. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped target Local File Systems. Aug 15 09:20:43 oleg434-client systemd[1]: initrd-cleanup.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Started Cleaning Up and Shutting Down Daemons. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-udevd.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped udev Kernel Device Manager. Aug 15 09:20:43 oleg434-client systemd[1]: dracut-pre-udev.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped dracut pre-udev hook. Aug 15 09:20:43 oleg434-client systemd[1]: dracut-cmdline.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped dracut cmdline hook. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-tmpfiles-setup-dev.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped Create Static Device Nodes in /dev. Aug 15 09:20:43 oleg434-client systemd[1]: kmod-static-nodes.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Stopped Create list of required static device nodes for the current kernel. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-udevd-kernel.socket: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Closed udev Kernel Socket. Aug 15 09:20:43 oleg434-client systemd[1]: systemd-udevd-control.socket: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Closed udev Control Socket. Aug 15 09:20:43 oleg434-client systemd[1]: Starting Cleanup udevd DB... Aug 15 09:20:43 oleg434-client systemd[1]: initrd-udevadm-cleanup-db.service: Succeeded. Aug 15 09:20:43 oleg434-client systemd[1]: Started Cleanup udevd DB. Aug 15 09:20:43 oleg434-client systemd[1]: Reached target Switch Root. Aug 15 09:20:43 oleg434-client systemd[1]: Starting Switch Root... Aug 15 09:20:43 oleg434-client systemd[1]: Switching root. Aug 15 09:20:43 oleg434-client systemd-journald[244]: Journal stopped Aug 15 09:20:44 oleg434-client kernel: printk: systemd: 26 output lines suppressed due to ratelimiting Aug 15 09:20:44 oleg434-client kernel: SELinux: Disabled at runtime. Aug 15 09:20:44 oleg434-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Aug 15 09:20:44 oleg434-client systemd[1]: Detected virtualization kvm. Aug 15 09:20:44 oleg434-client systemd[1]: Detected architecture x86-64. Aug 15 09:20:44 oleg434-client systemd[1]: initrd-switch-root.service: Succeeded. Aug 15 09:20:44 oleg434-client systemd[1]: Stopped Switch Root. Aug 15 09:20:44 oleg434-client systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. Aug 15 09:20:44 oleg434-client systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Aug 15 09:20:44 oleg434-client systemd[1]: Stopped Journal Service. Aug 15 09:20:44 oleg434-client systemd[1]: Starting Journal Service... Aug 15 09:20:44 oleg434-client systemd[1]: Listening on udev Kernel Socket. Aug 15 09:20:44 oleg434-client kernel: Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS Aug 15 09:20:44 oleg434-client systemd-journald[784]: Journal started Aug 15 09:20:44 oleg434-client systemd-journald[784]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. Aug 15 09:20:44 oleg434-client systemd[1]: systemd-journald.service: Succeeded. Aug 15 09:20:44 oleg434-client systemd-remount-fs[791]: mount.nfs: access denied by server while mounting 192.168.10.1:/exports/rhel8.5-nfsroot Aug 15 09:20:44 oleg434-client systemd-remount-fs[786]: /usr/bin/mount for / exited with exit status 32. Aug 15 09:20:44 oleg434-client systemd[1]: Activated swap /dev/disk/by-label/SWAP. Aug 15 09:20:44 oleg434-client systemd[1]: systemd-remount-fs.service: Main process exited, code=exited, status=1/FAILURE Aug 15 09:20:44 oleg434-client systemd[1]: systemd-remount-fs.service: Failed with result 'exit-code'. Aug 15 09:20:44 oleg434-client systemd[1]: Failed to start Remount Root and Kernel File Systems. Aug 15 09:20:44 oleg434-client systemd[1]: Mounted Huge Pages File System. Aug 15 09:20:44 oleg434-client systemd[1]: Mounted POSIX Message Queue File System. Aug 15 09:20:44 oleg434-client systemd[1]: Started Apply Kernel Variables. Aug 15 09:20:44 oleg434-client systemd[1]: Mounted Kernel Debug File System. Aug 15 09:20:44 oleg434-client systemd[1]: Started Create list of required static device nodes for the current kernel. Aug 15 09:20:44 oleg434-client systemd[1]: Starting Configure read-only root support... Aug 15 09:20:44 oleg434-client systemd[1]: Starting Create Static Device Nodes in /dev... Aug 15 09:20:44 oleg434-client systemd[1]: Reached target Swap. Aug 15 09:20:44 oleg434-client systemd[1]: Starting Flush Journal to Persistent Storage... Aug 15 09:20:44 oleg434-client systemd-journald[784]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. Aug 15 09:20:44 oleg434-client systemd[1]: Started Flush Journal to Persistent Storage. Aug 15 09:20:44 oleg434-client systemd[1]: Started Create Static Device Nodes in /dev. Aug 15 09:20:44 oleg434-client systemd[1]: Starting udev Kernel Device Manager... Aug 15 09:20:44 oleg434-client systemd[1]: Reached target Local File Systems (Pre). Aug 15 09:20:44 oleg434-client systemd[1]: Mounting /mnt... Aug 15 09:20:44 oleg434-client systemd[1]: Mounting /home/green/git/lustre-release... Aug 15 09:20:44 oleg434-client systemd[1]: Started udev Coldplug all Devices. Aug 15 09:20:44 oleg434-client systemd[1]: Mounted /mnt. Aug 15 09:20:45 oleg434-client kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Aug 15 09:20:45 oleg434-client systemd[1]: Mounted /home/green/git/lustre-release. Aug 15 09:20:45 oleg434-client systemd[1]: Started udev Kernel Device Manager. Aug 15 09:20:45 oleg434-client kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Aug 15 09:20:45 oleg434-client kernel: input: PC Speaker as /devices/platform/pcspkr/input/input5 Aug 15 09:20:45 oleg434-client kernel: RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer Aug 15 09:20:45 oleg434-client kernel: EDAC sbridge: Seeking for: PCI ID 8086:0ea0 Aug 15 09:20:45 oleg434-client kernel: EDAC sbridge: Ver: 1.1.2 Aug 15 09:20:45 oleg434-client systemd-udevd[851]: Using default interface naming scheme 'rhel-8.0'. Aug 15 09:20:45 oleg434-client systemd-udevd[851]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Aug 15 09:20:45 oleg434-client systemd-udevd[849]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Aug 15 09:20:46 oleg434-client kernel: Key type dns_resolver registered Aug 15 09:20:46 oleg434-client kernel: NFS: Registering the id_resolver key type Aug 15 09:20:46 oleg434-client kernel: Key type id_resolver registered Aug 15 09:20:46 oleg434-client kernel: Key type id_legacy registered Aug 15 09:20:46 oleg434-client nfsrahead[980]: setting /var/lib/stateless/state readahead to 128 Aug 15 09:20:47 oleg434-client systemd[1]: Started Configure read-only root support. Aug 15 09:20:47 oleg434-client systemd[1]: Starting Load/Save Random Seed... Aug 15 09:20:47 oleg434-client systemd[1]: Reached target Local File Systems. Aug 15 09:20:47 oleg434-client systemd[1]: Starting Rebuild Dynamic Linker Cache... Aug 15 09:20:47 oleg434-client systemd[1]: Starting Mark the need to relabel after reboot... Aug 15 09:20:47 oleg434-client touch[994]: /bin/touch: cannot touch '/.autorelabel': Read-only file system Aug 15 09:20:47 oleg434-client systemd[1]: Starting Create Volatile Files and Directories... Aug 15 09:20:47 oleg434-client systemd[1]: Started Load/Save Random Seed. Aug 15 09:20:47 oleg434-client systemd[1]: Started Mark the need to relabel after reboot. Aug 15 09:20:47 oleg434-client systemd-tmpfiles[996]: rm(/var/lib/rpm/__db.003): Read-only file system Aug 15 09:20:47 oleg434-client systemd-tmpfiles[996]: rm(/var/lib/rpm/__db.002): Read-only file system Aug 15 09:20:47 oleg434-client systemd-tmpfiles[996]: rm(/var/lib/rpm/__db.001): Read-only file system Aug 15 09:20:47 oleg434-client systemd[1]: Started Create Volatile Files and Directories. Aug 15 09:20:47 oleg434-client systemd[1]: Starting RPC Bind... Aug 15 09:20:47 oleg434-client systemd[1]: Starting Update UTMP about System Boot/Shutdown... Aug 15 09:20:47 oleg434-client systemd[1]: Started Update UTMP about System Boot/Shutdown. Aug 15 09:20:47 oleg434-client systemd[1]: Started RPC Bind. Aug 15 09:20:47 oleg434-client systemd[1]: Started Rebuild Dynamic Linker Cache. Aug 15 09:20:47 oleg434-client systemd[1]: Starting Update is Completed... Aug 15 09:20:48 oleg434-client systemd[1]: Started Update is Completed. Aug 15 09:20:48 oleg434-client systemd[1]: Reached target System Initialization. Aug 15 09:20:48 oleg434-client systemd[1]: Started Daily Cleanup of Temporary Directories. Aug 15 09:20:48 oleg434-client systemd[1]: Started daily update of the root trust anchor for DNSSEC. Aug 15 09:20:48 oleg434-client systemd[1]: Listening on D-Bus System Message Bus Socket. Aug 15 09:20:48 oleg434-client systemd[1]: Reached target Sockets. Aug 15 09:20:48 oleg434-client systemd[1]: Reached target Basic System. Aug 15 09:20:48 oleg434-client systemd[1]: Started irqbalance daemon. Aug 15 09:20:48 oleg434-client systemd[1]: Starting Restore /run/initramfs on shutdown... Aug 15 09:20:48 oleg434-client systemd[1]: Started D-Bus System Message Bus. Aug 15 09:20:48 oleg434-client systemd[1]: Starting Login Service... Aug 15 09:20:48 oleg434-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. Aug 15 09:20:48 oleg434-client systemd[1]: Starting Network Manager... Aug 15 09:20:48 oleg434-client systemd[1]: Reached target sshd-keygen.target. Aug 15 09:20:48 oleg434-client systemd[1]: Started dnf makecache --timer. Aug 15 09:20:48 oleg434-client systemd[1]: Reached target Timers. Aug 15 09:20:48 oleg434-client systemd[1]: Started Restore /run/initramfs on shutdown. Aug 15 09:20:48 oleg434-client rngd[1011]: Disabling 7: PKCS11 Entropy generator (pkcs11) Aug 15 09:20:48 oleg434-client rngd[1011]: Disabling 5: NIST Network Entropy Beacon (nist) Aug 15 09:20:48 oleg434-client rngd[1011]: Disabling 9: Qrypt quantum entropy beacon (qrypt) Aug 15 09:20:48 oleg434-client rngd[1011]: Initializing available sources Aug 15 09:20:48 oleg434-client rngd[1011]: [hwrng ]: Initialization Failed Aug 15 09:20:48 oleg434-client rngd[1011]: [rdrand]: Enabling RDRAND rng support Aug 15 09:20:48 oleg434-client rngd[1011]: [rdrand]: Initialized Aug 15 09:20:48 oleg434-client rngd[1011]: [jitter]: JITTER timeout set to 5 sec Aug 15 09:20:48 oleg434-client systemd-logind[1010]: Watching system buttons on /dev/input/event0 (Power Button) Aug 15 09:20:48 oleg434-client systemd-logind[1010]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Aug 15 09:20:48 oleg434-client systemd-logind[1010]: New seat seat0. Aug 15 09:20:48 oleg434-client systemd[1]: Started Login Service. Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.2215] NetworkManager (version 1.40.16-19.el8_10) is starting... (boot:b8402ae8-2aa2-4568-b85e-1ab0ee715d19) Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.2241] Read config: /etc/NetworkManager/NetworkManager.conf (run: 10-dracut-dhclient.conf) Aug 15 09:20:48 oleg434-client rngd[1011]: [jitter]: Initializing AES buffer Aug 15 09:20:48 oleg434-client systemd[1]: Started Network Manager. Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.2406] bus-manager: acquired D-Bus service "org.freedesktop.NetworkManager" Aug 15 09:20:48 oleg434-client systemd[1]: Reached target Network. Aug 15 09:20:48 oleg434-client systemd[1]: Starting GSSAPI Proxy Daemon... Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.2595] manager[0x564bd62cb020]: monitoring kernel firmware directory '/lib/firmware'. Aug 15 09:20:48 oleg434-client dbus-daemon[1008]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.2' (uid=0 pid=1012 comm="/usr/sbin/NetworkManager --no-daemon ") Aug 15 09:20:48 oleg434-client systemd[1]: Starting Dynamic System Tuning Daemon... Aug 15 09:20:48 oleg434-client systemd[1]: Starting OpenSSH server daemon... Aug 15 09:20:48 oleg434-client systemd[1]: Starting Network Manager Wait Online... Aug 15 09:20:48 oleg434-client systemd[1]: Started GSSAPI Proxy Daemon. Aug 15 09:20:48 oleg434-client systemd[1]: Starting Hostname Service... Aug 15 09:20:48 oleg434-client systemd[1]: Reached target NFS client services. Aug 15 09:20:48 oleg434-client systemd[1]: Reached target Remote File Systems (Pre). Aug 15 09:20:48 oleg434-client systemd[1]: Reached target Remote File Systems. Aug 15 09:20:48 oleg434-client systemd[1]: Starting Permit User Sessions... Aug 15 09:20:48 oleg434-client sshd[1030]: Server listening on 0.0.0.0 port 22. Aug 15 09:20:48 oleg434-client sshd[1030]: Server listening on :: port 22. Aug 15 09:20:48 oleg434-client systemd[1]: Started OpenSSH server daemon. Aug 15 09:20:48 oleg434-client systemd[1]: Started Permit User Sessions. Aug 15 09:20:48 oleg434-client systemd[1]: Started Getty on tty1. Aug 15 09:20:48 oleg434-client systemd[1]: Started Serial Getty on ttyS0. Aug 15 09:20:48 oleg434-client systemd[1]: Started Serial Getty on ttyS1. Aug 15 09:20:48 oleg434-client systemd[1]: Reached target Login Prompts. Aug 15 09:20:48 oleg434-client systemd[1]: Started Command Scheduler. Aug 15 09:20:48 oleg434-client crond[1048]: (CRON) STARTUP (1.5.2) Aug 15 09:20:48 oleg434-client crond[1048]: (CRON) INFO (RANDOM_DELAY will be scaled with factor 95% if used.) Aug 15 09:20:48 oleg434-client crond[1048]: (CRON) INFO (running with inotify support) Aug 15 09:20:48 oleg434-client dbus-daemon[1008]: [system] Successfully activated service 'org.freedesktop.hostname1' Aug 15 09:20:48 oleg434-client systemd[1]: Started Hostname Service. Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.7827] hostname: hostname: using hostnamed Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.7834] dns-mgr: init: dns=default,systemd-resolved rc-manager=symlink Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8058] Loaded device plugin: NMTeamFactory (/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-device-plugin-team.so) Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8059] manager: rfkill: Wi-Fi enabled by radio killswitch; enabled by state file Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8060] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8061] manager: Networking is enabled by state file Aug 15 09:20:48 oleg434-client dbus-daemon[1008]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.2' (uid=0 pid=1012 comm="/usr/sbin/NetworkManager --no-daemon ") Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8240] settings: Loaded settings plugin: ifcfg-rh ("/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-settings-plugin-ifcfg-rh.so") Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8244] settings: Loaded settings plugin: keyfile (internal) Aug 15 09:20:48 oleg434-client systemd[1]: Starting Network Manager Script Dispatcher Service... Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8415] dhcp: init: Using DHCP client 'dhclient' Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8419] device (lo): carrier: link connected Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8436] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1) Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8493] device (ens2): carrier: link connected Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8562] manager: (ens2): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2) Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8600] manager: (ens2): assume: will attempt to assume matching connection 'ens2' (b2c64239-12a6-4171-9ca3-7e63c483a85d) (guessed) Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8603] manager: (ens2): assume: taking over an initramfs-configured connection Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8603] device (ens2): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'assume') Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8746] device (ens2): state change: unavailable -> disconnected (reason 'connection-assumed', sys-iface-state: 'assume') Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8791] device (ens2): Activation: starting connection 'ens2' (b2c64239-12a6-4171-9ca3-7e63c483a85d) Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.8944] device (ens2): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'assume') Aug 15 09:20:48 oleg434-client dbus-daemon[1008]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher' Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.9022] device (ens2): state change: prepare -> config (reason 'none', sys-iface-state: 'assume') Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.9030] device (ens2): state change: config -> ip-config (reason 'none', sys-iface-state: 'assume') Aug 15 09:20:48 oleg434-client systemd[1]: Started Network Manager Script Dispatcher Service. Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.9084] dhcp4 (ens2): activation: beginning transaction (timeout in 45 seconds) Aug 15 09:20:48 oleg434-client NetworkManager[1012]: [1786800048.9311] dhcp4 (ens2): dhclient started with pid 1053 Aug 15 09:20:48 oleg434-client dbus-daemon[1008]: [system] Activating via systemd: service name='org.freedesktop.resolve1' unit='dbus-org.freedesktop.resolve1.service' requested by ':1.2' (uid=0 pid=1012 comm="/usr/sbin/NetworkManager --no-daemon ") Aug 15 09:20:48 oleg434-client dbus-daemon[1008]: [system] Activation via systemd failed for unit 'dbus-org.freedesktop.resolve1.service': Unit dbus-org.freedesktop.resolve1.service not found. Aug 15 09:20:49 oleg434-client dhclient[1053]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0x9e82035) Aug 15 09:20:49 oleg434-client dhclient[1053]: DHCPACK from 192.168.204.254 (xid=0x9e82035) Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1251] dhcp4 (ens2): address 192.168.204.34 Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1252] dhcp4 (ens2): plen 24 (255.255.255.0) Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1252] dhcp4 (ens2): gateway 192.168.204.254 Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1253] dhcp4 (ens2): lease time 60000 Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1253] dhcp4 (ens2): hostname 'oleg434-client.virtnet' Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1253] dhcp4 (ens2): nameserver '192.168.200.253' Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1253] dhcp4 (ens2): domain name 'virtnet' Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1254] dhcp4 (ens2): state changed new lease, address=192.168.204.34 Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1269] policy: set 'ens2' (ens2) as default for IPv4 routing and DNS Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1362] device (ens2): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'assume') Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1431] device (ens2): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'assume') Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1450] device (ens2): state change: secondaries -> activated (reason 'none', sys-iface-state: 'assume') Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1493] manager: NetworkManager state is now CONNECTED_SITE Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1543] device (ens2): Activation: successful, device activated. Aug 15 09:20:49 oleg434-client dhclient[1053]: bound to 192.168.204.34 -- renewal in 26543 seconds. Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1672] manager: NetworkManager state is now CONNECTED_GLOBAL Aug 15 09:20:49 oleg434-client NetworkManager[1012]: [1786800049.1711] manager: startup complete Aug 15 09:20:49 oleg434-client systemd[1]: Started Network Manager Wait Online. Aug 15 09:20:49 oleg434-client systemd[1]: Reached target Network is Online. Aug 15 09:20:49 oleg434-client systemd[1]: Starting Notify NFS peers of a restart... Aug 15 09:20:49 oleg434-client systemd[1]: Starting System Logging Service... Aug 15 09:20:49 oleg434-client systemd[1]: Starting Crash recovery kernel arming... Aug 15 09:20:49 oleg434-client sm-notify[1069]: Version 2.3.3 starting Aug 15 09:20:49 oleg434-client systemd[1]: Started Notify NFS peers of a restart. Aug 15 09:20:49 oleg434-client rsyslogd[1070]: [origin software="rsyslogd" swVersion="8.2102.0-15.el8_10.1" x-pid="1070" x-info="https://www.rsyslog.com"] start Aug 15 09:20:49 oleg434-client systemd[1]: Started System Logging Service. Aug 15 09:20:49 oleg434-client rsyslogd[1070]: imjournal: No statefile exists, /var/lib/rsyslog/imjournal.state will be created (ignore if this is first run): No such file or directory [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/2040 ] Aug 15 09:20:49 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 09:20:50 oleg434-client kdumpctl[1178]: basename: missing operand Aug 15 09:20:50 oleg434-client kdumpctl[1178]: Try 'basename --help' for more information. Aug 15 09:20:51 oleg434-client dbus-daemon[1008]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.7' (uid=0 pid=1028 comm="/usr/libexec/platform-python -Es /usr/sbin/tuned -") Aug 15 09:20:51 oleg434-client systemd[1]: Starting Authorization Manager... Aug 15 09:20:51 oleg434-client polkitd[1356]: Started polkitd version 0.115 Aug 15 09:20:51 oleg434-client systemd[1]: Started Dynamic System Tuning Daemon. Aug 15 09:20:51 oleg434-client systemd[1]: Reached target Multi-User System. Aug 15 09:20:51 oleg434-client systemd[1]: Reached target Graphical Interface. Aug 15 09:20:51 oleg434-client systemd[1]: Starting Update UTMP about System Runlevel Changes... Aug 15 09:20:51 oleg434-client systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Aug 15 09:20:51 oleg434-client systemd[1]: Started Update UTMP about System Runlevel Changes. Aug 15 09:20:51 oleg434-client polkitd[1356]: Loading rules from directory /etc/polkit-1/rules.d Aug 15 09:20:51 oleg434-client polkitd[1356]: Loading rules from directory /usr/share/polkit-1/rules.d Aug 15 09:20:51 oleg434-client polkitd[1356]: Finished loading, compiling and executing 2 rules Aug 15 09:20:51 oleg434-client dbus-daemon[1008]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Aug 15 09:20:51 oleg434-client systemd[1]: Started Authorization Manager. Aug 15 09:20:51 oleg434-client polkitd[1356]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Aug 15 09:20:53 oleg434-client rngd[1011]: [jitter]: Unable to obtain AES key, disabling JITTER source Aug 15 09:20:53 oleg434-client rngd[1011]: [jitter]: Initialization Failed Aug 15 09:20:53 oleg434-client rngd[1011]: Process privileges have been dropped to 2:2 Aug 15 09:20:55 oleg434-client kdumpctl[1075]: kdump: kexec: loaded kdump kernel Aug 15 09:20:55 oleg434-client kdumpctl[1075]: kdump: Starting kdump: [OK] Aug 15 09:20:55 oleg434-client systemd[1]: Started Crash recovery kernel arming. Aug 15 09:20:55 oleg434-client systemd[1]: Startup finished in 3.438s (kernel) + 8.248s (initrd) + 12.001s (userspace) = 23.688s. Aug 15 09:20:59 oleg434-client systemd[1]: NetworkManager-dispatcher.service: Succeeded. Aug 15 09:21:00 oleg434-client sshd[1451]: Accepted publickey for root from 192.168.200.253 port 36122 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Aug 15 09:21:00 oleg434-client systemd[1]: Created slice User Slice of UID 0. Aug 15 09:21:00 oleg434-client systemd[1]: Starting User runtime directory /run/user/0... Aug 15 09:21:00 oleg434-client systemd-logind[1010]: New session 1 of user root. Aug 15 09:21:00 oleg434-client systemd[1]: Started User runtime directory /run/user/0. Aug 15 09:21:00 oleg434-client systemd[1]: Starting User Manager for UID 0... Aug 15 09:21:00 oleg434-client systemd[1466]: pam_unix(systemd-user:session): session opened for user root by (uid=0) Aug 15 09:21:00 oleg434-client systemd[1466]: Reached target Paths. Aug 15 09:21:00 oleg434-client systemd[1466]: Starting D-Bus User Message Bus Socket. Aug 15 09:21:00 oleg434-client systemd[1466]: Reached target Timers. Aug 15 09:21:00 oleg434-client systemd[1466]: Listening on D-Bus User Message Bus Socket. Aug 15 09:21:00 oleg434-client systemd[1466]: Reached target Sockets. Aug 15 09:21:00 oleg434-client systemd[1466]: Reached target Basic System. Aug 15 09:21:00 oleg434-client systemd[1466]: Reached target Default. Aug 15 09:21:00 oleg434-client systemd[1466]: Startup finished in 129ms. Aug 15 09:21:00 oleg434-client systemd[1]: Started User Manager for UID 0. Aug 15 09:21:00 oleg434-client systemd[1]: Started Session 1 of user root. Aug 15 09:21:00 oleg434-client sshd[1451]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:21:00 oleg434-client sshd[1477]: Received disconnect from 192.168.200.253 port 36122:11: disconnected by user Aug 15 09:21:00 oleg434-client sshd[1477]: Disconnected from user root 192.168.200.253 port 36122 Aug 15 09:21:00 oleg434-client sshd[1451]: pam_unix(sshd:session): session closed for user root Aug 15 09:21:00 oleg434-client systemd[1]: session-1.scope: Succeeded. Aug 15 09:21:00 oleg434-client systemd-logind[1010]: Session 1 logged out. Waiting for processes to exit. Aug 15 09:21:00 oleg434-client systemd-logind[1010]: Removed session 1. Aug 15 09:21:01 oleg434-client sshd[1513]: Accepted publickey for root from 192.168.200.253 port 36132 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Aug 15 09:21:01 oleg434-client systemd-logind[1010]: New session 3 of user root. Aug 15 09:21:01 oleg434-client systemd[1]: Started Session 3 of user root. Aug 15 09:21:01 oleg434-client sshd[1513]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:21:18 oleg434-client systemd[1]: systemd-hostnamed.service: Succeeded. Aug 15 09:21:26 oleg434-client systemd-logind[1010]: Watching system buttons on /dev/input/event0 (Power Button) Aug 15 09:21:26 oleg434-client systemd-udevd[2263]: Using default interface naming scheme 'rhel-8.0'. Aug 15 09:21:26 oleg434-client kernel: libcfs: loading out-of-tree module taints kernel. Aug 15 09:21:26 oleg434-client systemd-logind[1010]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Aug 15 09:21:26 oleg434-client kernel: Key type ._llcrypt registered Aug 15 09:21:26 oleg434-client kernel: Key type .llcrypt registered Aug 15 09:21:27 oleg434-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Aug 15 09:21:27 oleg434-client kernel: alg: No test for adler32 (adler32-zlib) Aug 15 09:21:28 oleg434-client kernel: Lustre: Lustre: Build Version: 2.17.57_1_g05abe65 Aug 15 09:21:29 oleg434-client kernel: LNet: Added LNI 192.168.204.34@tcp [8/256/0/180] Aug 15 09:21:31 oleg434-client kernel: Key type lgssc registered Aug 15 09:21:33 oleg434-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ Aug 15 09:22:02 oleg434-client kernel: hrtimer: interrupt took 6017950 ns Aug 15 09:22:44 oleg434-client systemd-logind[1010]: Watching system buttons on /dev/input/event0 (Power Button) Aug 15 09:22:44 oleg434-client systemd-udevd[4449]: Using default interface naming scheme 'rhel-8.0'. Aug 15 09:22:44 oleg434-client systemd-logind[1010]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Aug 15 09:24:13 oleg434-client kernel: Lustre: Mounted lustre-client - version 2.17.57_1_g05abe65 Aug 15 09:24:15 oleg434-client sshd[6220]: Accepted publickey for root from 192.168.204.34 port 56172 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:15 oleg434-client systemd-logind[1010]: New session 4 of user root. Aug 15 09:24:15 oleg434-client systemd[1]: Started Session 4 of user root. Aug 15 09:24:15 oleg434-client sshd[6220]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:16 oleg434-client sshd[6233]: Received disconnect from 192.168.204.34 port 56172:11: disconnected by user Aug 15 09:24:16 oleg434-client sshd[6233]: Disconnected from user root 192.168.204.34 port 56172 Aug 15 09:24:16 oleg434-client sshd[6220]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:16 oleg434-client systemd[1]: session-4.scope: Succeeded. Aug 15 09:24:16 oleg434-client systemd-logind[1010]: Session 4 logged out. Waiting for processes to exit. Aug 15 09:24:16 oleg434-client systemd-logind[1010]: Removed session 4. Aug 15 09:24:18 oleg434-client sshd[6397]: Accepted publickey for root from 192.168.204.34 port 56174 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:18 oleg434-client systemd[1]: Started Session 5 of user root. Aug 15 09:24:18 oleg434-client systemd-logind[1010]: New session 5 of user root. Aug 15 09:24:18 oleg434-client sshd[6397]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:18 oleg434-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Aug 15 09:24:18 oleg434-client sshd[6410]: Received disconnect from 192.168.204.34 port 56174:11: disconnected by user Aug 15 09:24:18 oleg434-client sshd[6410]: Disconnected from user root 192.168.204.34 port 56174 Aug 15 09:24:18 oleg434-client sshd[6397]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:19 oleg434-client systemd[1]: session-5.scope: Succeeded. Aug 15 09:24:19 oleg434-client systemd-logind[1010]: Session 5 logged out. Waiting for processes to exit. Aug 15 09:24:19 oleg434-client systemd-logind[1010]: Removed session 5. Aug 15 09:24:19 oleg434-client sshd[6531]: Accepted publickey for root from 192.168.204.34 port 56182 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:19 oleg434-client systemd[1]: Started Session 6 of user root. Aug 15 09:24:19 oleg434-client systemd-logind[1010]: New session 6 of user root. Aug 15 09:24:19 oleg434-client sshd[6531]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:20 oleg434-client sshd[6544]: Received disconnect from 192.168.204.34 port 56182:11: disconnected by user Aug 15 09:24:20 oleg434-client sshd[6544]: Disconnected from user root 192.168.204.34 port 56182 Aug 15 09:24:20 oleg434-client sshd[6531]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:20 oleg434-client systemd[1]: session-6.scope: Succeeded. Aug 15 09:24:20 oleg434-client systemd-logind[1010]: Session 6 logged out. Waiting for processes to exit. Aug 15 09:24:20 oleg434-client systemd-logind[1010]: Removed session 6. Aug 15 09:24:30 oleg434-client systemd-udevd[6723]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Aug 15 09:24:32 oleg434-client sshd[6840]: Accepted publickey for root from 192.168.204.34 port 53994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:32 oleg434-client systemd[1]: Started Session 7 of user root. Aug 15 09:24:32 oleg434-client systemd-logind[1010]: New session 7 of user root. Aug 15 09:24:32 oleg434-client sshd[6840]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:35 oleg434-client kernel: Lustre: DEBUG MARKER: oleg434-client.virtnet: executing check_logdir /tmp/testlogs/ Aug 15 09:24:35 oleg434-client sshd[6853]: Received disconnect from 192.168.204.34 port 53994:11: disconnected by user Aug 15 09:24:35 oleg434-client sshd[6853]: Disconnected from user root 192.168.204.34 port 53994 Aug 15 09:24:35 oleg434-client sshd[6840]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:35 oleg434-client systemd[1]: session-7.scope: Succeeded. Aug 15 09:24:35 oleg434-client systemd-logind[1010]: Session 7 logged out. Waiting for processes to exit. Aug 15 09:24:35 oleg434-client systemd-logind[1010]: Removed session 7. Aug 15 09:24:37 oleg434-client sshd[7120]: Accepted publickey for root from 192.168.204.34 port 52114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:37 oleg434-client systemd-logind[1010]: New session 8 of user root. Aug 15 09:24:37 oleg434-client systemd[1]: Started Session 8 of user root. Aug 15 09:24:37 oleg434-client sshd[7120]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:39 oleg434-client kernel: Lustre: lustre-OST0000-osc-ffff898e8e663800: disconnect after 23s idle Aug 15 09:24:40 oleg434-client kernel: Lustre: DEBUG MARKER: oleg434-client.virtnet: executing yml_node Aug 15 09:24:41 oleg434-client sshd[7133]: Received disconnect from 192.168.204.34 port 52114:11: disconnected by user Aug 15 09:24:41 oleg434-client sshd[7133]: Disconnected from user root 192.168.204.34 port 52114 Aug 15 09:24:41 oleg434-client sshd[7120]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:41 oleg434-client systemd[1]: session-8.scope: Succeeded. Aug 15 09:24:41 oleg434-client systemd-logind[1010]: Session 8 logged out. Waiting for processes to exit. Aug 15 09:24:41 oleg434-client systemd-logind[1010]: Removed session 8. Aug 15 09:24:43 oleg434-client sshd[7719]: Accepted publickey for root from 192.168.204.34 port 52116 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:43 oleg434-client systemd[1]: Started Session 9 of user root. Aug 15 09:24:43 oleg434-client systemd-logind[1010]: New session 9 of user root. Aug 15 09:24:43 oleg434-client sshd[7719]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:43 oleg434-client kernel: Lustre: DEBUG MARKER: Client: 2.17.57.1 Aug 15 09:24:43 oleg434-client sshd[7732]: Received disconnect from 192.168.204.34 port 52116:11: disconnected by user Aug 15 09:24:43 oleg434-client sshd[7732]: Disconnected from user root 192.168.204.34 port 52116 Aug 15 09:24:43 oleg434-client sshd[7719]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:43 oleg434-client systemd[1]: session-9.scope: Succeeded. Aug 15 09:24:43 oleg434-client systemd-logind[1010]: Session 9 logged out. Waiting for processes to exit. Aug 15 09:24:43 oleg434-client systemd-logind[1010]: Removed session 9. Aug 15 09:24:45 oleg434-client sshd[7875]: Accepted publickey for root from 192.168.204.34 port 57270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:45 oleg434-client systemd-logind[1010]: New session 10 of user root. Aug 15 09:24:45 oleg434-client systemd[1]: Started Session 10 of user root. Aug 15 09:24:45 oleg434-client sshd[7875]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:45 oleg434-client kernel: Lustre: DEBUG MARKER: MDS: 2.17.57.1 Aug 15 09:24:45 oleg434-client sshd[7888]: Received disconnect from 192.168.204.34 port 57270:11: disconnected by user Aug 15 09:24:45 oleg434-client sshd[7888]: Disconnected from user root 192.168.204.34 port 57270 Aug 15 09:24:45 oleg434-client sshd[7875]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:46 oleg434-client systemd-logind[1010]: Session 10 logged out. Waiting for processes to exit. Aug 15 09:24:46 oleg434-client systemd[1]: session-10.scope: Succeeded. Aug 15 09:24:46 oleg434-client systemd-logind[1010]: Removed session 10. Aug 15 09:24:47 oleg434-client sshd[8031]: Accepted publickey for root from 192.168.204.34 port 57282 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:47 oleg434-client systemd[1]: Started Session 11 of user root. Aug 15 09:24:47 oleg434-client systemd-logind[1010]: New session 11 of user root. Aug 15 09:24:47 oleg434-client sshd[8031]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:47 oleg434-client kernel: Lustre: DEBUG MARKER: OSS: 2.17.57.1 Aug 15 09:24:47 oleg434-client sshd[8044]: Received disconnect from 192.168.204.34 port 57282:11: disconnected by user Aug 15 09:24:47 oleg434-client sshd[8044]: Disconnected from user root 192.168.204.34 port 57282 Aug 15 09:24:47 oleg434-client sshd[8031]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:47 oleg434-client systemd-logind[1010]: Session 11 logged out. Waiting for processes to exit. Aug 15 09:24:47 oleg434-client systemd[1]: session-11.scope: Succeeded. Aug 15 09:24:47 oleg434-client systemd-logind[1010]: Removed session 11. Aug 15 09:24:48 oleg434-client sshd[8178]: Accepted publickey for root from 192.168.204.34 port 57288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:24:48 oleg434-client systemd-logind[1010]: New session 12 of user root. Aug 15 09:24:48 oleg434-client systemd[1]: Started Session 12 of user root. Aug 15 09:24:48 oleg434-client sshd[8178]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:24:49 oleg434-client kernel: Lustre: DEBUG MARKER: -----============= acceptance-small: recovery-small ============----- Sat Aug 15 09:24:47 EDT 2026 Aug 15 09:24:49 oleg434-client sshd[8191]: Received disconnect from 192.168.204.34 port 57288:11: disconnected by user Aug 15 09:24:49 oleg434-client sshd[8191]: Disconnected from user root 192.168.204.34 port 57288 Aug 15 09:24:49 oleg434-client sshd[8178]: pam_unix(sshd:session): session closed for user root Aug 15 09:24:49 oleg434-client systemd-logind[1010]: Session 12 logged out. Waiting for processes to exit. Aug 15 09:24:49 oleg434-client systemd[1]: session-12.scope: Succeeded. Aug 15 09:24:49 oleg434-client systemd-logind[1010]: Removed session 12. Aug 15 09:25:04 oleg434-client sshd[8696]: Accepted publickey for root from 192.168.204.34 port 59862 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:04 oleg434-client systemd-logind[1010]: New session 13 of user root. Aug 15 09:25:04 oleg434-client systemd[1]: Started Session 13 of user root. Aug 15 09:25:04 oleg434-client sshd[8696]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:04 oleg434-client kernel: Lustre: DEBUG MARKER: excepting tests: 136 Aug 15 09:25:04 oleg434-client sshd[8709]: Received disconnect from 192.168.204.34 port 59862:11: disconnected by user Aug 15 09:25:04 oleg434-client sshd[8709]: Disconnected from user root 192.168.204.34 port 59862 Aug 15 09:25:04 oleg434-client sshd[8696]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:05 oleg434-client systemd[1]: session-13.scope: Succeeded. Aug 15 09:25:05 oleg434-client systemd-logind[1010]: Session 13 logged out. Waiting for processes to exit. Aug 15 09:25:05 oleg434-client systemd-logind[1010]: Removed session 13. Aug 15 09:25:06 oleg434-client sshd[8882]: Accepted publickey for root from 192.168.204.34 port 37488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:06 oleg434-client systemd-logind[1010]: New session 14 of user root. Aug 15 09:25:06 oleg434-client systemd[1]: Started Session 14 of user root. Aug 15 09:25:06 oleg434-client sshd[8882]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:07 oleg434-client kernel: Lustre: DEBUG MARKER: === recovery-small: start setup 09:25:05 (1786800305) === Aug 15 09:25:07 oleg434-client sshd[8895]: Received disconnect from 192.168.204.34 port 37488:11: disconnected by user Aug 15 09:25:07 oleg434-client sshd[8895]: Disconnected from user root 192.168.204.34 port 37488 Aug 15 09:25:07 oleg434-client sshd[8882]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:07 oleg434-client systemd-logind[1010]: Session 14 logged out. Waiting for processes to exit. Aug 15 09:25:07 oleg434-client systemd[1]: session-14.scope: Succeeded. Aug 15 09:25:07 oleg434-client systemd-logind[1010]: Removed session 14. Aug 15 09:25:12 oleg434-client sshd[9152]: Accepted publickey for root from 192.168.204.34 port 37496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:12 oleg434-client systemd-logind[1010]: New session 15 of user root. Aug 15 09:25:12 oleg434-client systemd[1]: Started Session 15 of user root. Aug 15 09:25:12 oleg434-client sshd[9152]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:13 oleg434-client kernel: Lustre: DEBUG MARKER: oleg434-client.virtnet: executing check_config_client /mnt/lustre Aug 15 09:25:13 oleg434-client sshd[9165]: Received disconnect from 192.168.204.34 port 37496:11: disconnected by user Aug 15 09:25:13 oleg434-client sshd[9165]: Disconnected from user root 192.168.204.34 port 37496 Aug 15 09:25:13 oleg434-client sshd[9152]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:13 oleg434-client systemd[1]: session-15.scope: Succeeded. Aug 15 09:25:13 oleg434-client systemd-logind[1010]: Session 15 logged out. Waiting for processes to exit. Aug 15 09:25:13 oleg434-client systemd-logind[1010]: Removed session 15. Aug 15 09:25:33 oleg434-client sshd[9890]: Accepted publickey for root from 192.168.204.34 port 46414 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:33 oleg434-client systemd-logind[1010]: New session 16 of user root. Aug 15 09:25:33 oleg434-client systemd[1]: Started Session 16 of user root. Aug 15 09:25:34 oleg434-client sshd[9890]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:34 oleg434-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Aug 15 09:25:34 oleg434-client sshd[9903]: Received disconnect from 192.168.204.34 port 46414:11: disconnected by user Aug 15 09:25:34 oleg434-client sshd[9903]: Disconnected from user root 192.168.204.34 port 46414 Aug 15 09:25:34 oleg434-client sshd[9890]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:34 oleg434-client systemd[1]: session-16.scope: Succeeded. Aug 15 09:25:34 oleg434-client systemd-logind[1010]: Session 16 logged out. Waiting for processes to exit. Aug 15 09:25:34 oleg434-client systemd-logind[1010]: Removed session 16. Aug 15 09:25:35 oleg434-client sshd[10024]: Accepted publickey for root from 192.168.204.34 port 36494 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:35 oleg434-client systemd-logind[1010]: New session 17 of user root. Aug 15 09:25:35 oleg434-client systemd[1]: Started Session 17 of user root. Aug 15 09:25:35 oleg434-client sshd[10024]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:36 oleg434-client sshd[10038]: Received disconnect from 192.168.204.34 port 36494:11: disconnected by user Aug 15 09:25:36 oleg434-client sshd[10038]: Disconnected from user root 192.168.204.34 port 36494 Aug 15 09:25:36 oleg434-client sshd[10024]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:36 oleg434-client systemd-logind[1010]: Session 17 logged out. Waiting for processes to exit. Aug 15 09:25:36 oleg434-client systemd[1]: session-17.scope: Succeeded. Aug 15 09:25:36 oleg434-client systemd-logind[1010]: Removed session 17. Aug 15 09:25:47 oleg434-client sshd[10485]: Accepted publickey for root from 192.168.204.34 port 44524 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:47 oleg434-client systemd[1]: Started Session 18 of user root. Aug 15 09:25:47 oleg434-client systemd-logind[1010]: New session 18 of user root. Aug 15 09:25:47 oleg434-client sshd[10485]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:48 oleg434-client sshd[10498]: Received disconnect from 192.168.204.34 port 44524:11: disconnected by user Aug 15 09:25:48 oleg434-client sshd[10498]: Disconnected from user root 192.168.204.34 port 44524 Aug 15 09:25:48 oleg434-client sshd[10485]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:48 oleg434-client systemd[1]: session-18.scope: Succeeded. Aug 15 09:25:48 oleg434-client systemd-logind[1010]: Session 18 logged out. Waiting for processes to exit. Aug 15 09:25:48 oleg434-client systemd-logind[1010]: Removed session 18. Aug 15 09:25:49 oleg434-client sshd[10624]: Accepted publickey for root from 192.168.204.34 port 44540 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:49 oleg434-client systemd-logind[1010]: New session 19 of user root. Aug 15 09:25:49 oleg434-client systemd[1]: Started Session 19 of user root. Aug 15 09:25:49 oleg434-client sshd[10624]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:50 oleg434-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish setup 09:25:48 (1786800348) === Aug 15 09:25:50 oleg434-client sshd[10637]: Received disconnect from 192.168.204.34 port 44540:11: disconnected by user Aug 15 09:25:50 oleg434-client sshd[10637]: Disconnected from user root 192.168.204.34 port 44540 Aug 15 09:25:50 oleg434-client sshd[10624]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:50 oleg434-client systemd[1]: session-19.scope: Succeeded. Aug 15 09:25:50 oleg434-client systemd-logind[1010]: Session 19 logged out. Waiting for processes to exit. Aug 15 09:25:50 oleg434-client systemd-logind[1010]: Removed session 19. Aug 15 09:25:51 oleg434-client sshd[10779]: Accepted publickey for root from 192.168.204.34 port 44546 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:25:51 oleg434-client systemd-logind[1010]: New session 20 of user root. Aug 15 09:25:51 oleg434-client systemd[1]: Started Session 20 of user root. Aug 15 09:25:51 oleg434-client sshd[10779]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:25:51 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 1: create, chmod, stat: drop req, drop rep ========================================================== 09:25:50 (1786800350) Aug 15 09:25:51 oleg434-client sshd[10792]: Received disconnect from 192.168.204.34 port 44546:11: disconnected by user Aug 15 09:25:51 oleg434-client sshd[10792]: Disconnected from user root 192.168.204.34 port 44546 Aug 15 09:25:51 oleg434-client sshd[10779]: pam_unix(sshd:session): session closed for user root Aug 15 09:25:51 oleg434-client systemd[1]: session-20.scope: Succeeded. Aug 15 09:25:51 oleg434-client systemd-logind[1010]: Session 20 logged out. Waiting for processes to exit. Aug 15 09:25:51 oleg434-client systemd-logind[1010]: Removed session 20. Aug 15 09:26:09 oleg434-client kernel: Lustre: 10841:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800353/real 1786800353] req@ffff898ea8d2ce00 x1873595690138624/t0(0) o700->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:30/10 lens 264/248 e 0 to 1 dl 1786800369 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 Aug 15 09:26:09 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:26:09 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:26:28 oleg434-client kernel: Lustre: 10862:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800372/real 1786800372] req@ffff898e83108e00 x1873595690140928/t0(0) o36->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 520/576 e 0 to 1 dl 1786800388 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 Aug 15 09:26:28 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:26:28 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:26:48 oleg434-client kernel: Lustre: 10905:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800392/real 1786800392] req@ffff898e83108e00 x1873595690143872/t0(0) o36->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 488/512 e 0 to 1 dl 1786800408 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:4294967295 Aug 15 09:26:48 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:26:48 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:27:07 oleg434-client kernel: Lustre: 10931:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800411/real 1786800411] req@ffff898ea8d2dc00 x1873595690145664/t0(0) o34->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 472/728 e 0 to 1 dl 1786800427 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 Aug 15 09:27:07 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:27:07 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:27:25 oleg434-client kernel: Lustre: 10952:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800429/real 1786800429] req@ffff898e84da8000 x1873595690147456/t0(0) o34->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 472/728 e 0 to 1 dl 1786800445 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 Aug 15 09:27:25 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:27:25 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:27:28 oleg434-client sshd[11050]: Accepted publickey for root from 192.168.204.34 port 49454 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:27:28 oleg434-client systemd[1]: Started Session 21 of user root. Aug 15 09:27:28 oleg434-client systemd-logind[1010]: New session 21 of user root. Aug 15 09:27:28 oleg434-client sshd[11050]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:27:28 oleg434-client sshd[11064]: Received disconnect from 192.168.204.34 port 49454:11: disconnected by user Aug 15 09:27:28 oleg434-client sshd[11064]: Disconnected from user root 192.168.204.34 port 49454 Aug 15 09:27:28 oleg434-client sshd[11050]: pam_unix(sshd:session): session closed for user root Aug 15 09:27:29 oleg434-client systemd-logind[1010]: Session 21 logged out. Waiting for processes to exit. Aug 15 09:27:29 oleg434-client systemd[1]: session-21.scope: Succeeded. Aug 15 09:27:29 oleg434-client systemd-logind[1010]: Removed session 21. Aug 15 09:27:30 oleg434-client sshd[11190]: Accepted publickey for root from 192.168.204.34 port 49456 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:27:30 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 09:27:30 oleg434-client systemd-logind[1010]: New session 22 of user root. Aug 15 09:27:30 oleg434-client systemd[1]: Started Session 22 of user root. Aug 15 09:27:30 oleg434-client sshd[11190]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:27:30 oleg434-client sshd[11204]: Received disconnect from 192.168.204.34 port 49456:11: disconnected by user Aug 15 09:27:31 oleg434-client sshd[11204]: Disconnected from user root 192.168.204.34 port 49456 Aug 15 09:27:31 oleg434-client sshd[11190]: pam_unix(sshd:session): session closed for user root Aug 15 09:27:31 oleg434-client systemd[1]: session-22.scope: Succeeded. Aug 15 09:27:31 oleg434-client systemd-logind[1010]: Session 22 logged out. Waiting for processes to exit. Aug 15 09:27:31 oleg434-client systemd-logind[1010]: Removed session 22. Aug 15 09:27:32 oleg434-client sshd[11338]: Accepted publickey for root from 192.168.204.34 port 49458 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:27:32 oleg434-client systemd-logind[1010]: New session 23 of user root. Aug 15 09:27:32 oleg434-client systemd[1]: Started Session 23 of user root. Aug 15 09:27:32 oleg434-client sshd[11338]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:27:33 oleg434-client sshd[11351]: Received disconnect from 192.168.204.34 port 49458:11: disconnected by user Aug 15 09:27:33 oleg434-client sshd[11351]: Disconnected from user root 192.168.204.34 port 49458 Aug 15 09:27:33 oleg434-client sshd[11338]: pam_unix(sshd:session): session closed for user root Aug 15 09:27:33 oleg434-client systemd[1]: session-23.scope: Succeeded. Aug 15 09:27:33 oleg434-client systemd-logind[1010]: Session 23 logged out. Waiting for processes to exit. Aug 15 09:27:33 oleg434-client systemd-logind[1010]: Removed session 23. Aug 15 09:27:35 oleg434-client sshd[11494]: Accepted publickey for root from 192.168.204.34 port 49468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:27:35 oleg434-client systemd-logind[1010]: New session 24 of user root. Aug 15 09:27:35 oleg434-client systemd[1]: Started Session 24 of user root. Aug 15 09:27:35 oleg434-client sshd[11494]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:27:35 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 4: open: drop req, drop rep ======= 09:27:33 (1786800453) Aug 15 09:27:35 oleg434-client sshd[11507]: Received disconnect from 192.168.204.34 port 49468:11: disconnected by user Aug 15 09:27:35 oleg434-client sshd[11507]: Disconnected from user root 192.168.204.34 port 49468 Aug 15 09:27:35 oleg434-client sshd[11494]: pam_unix(sshd:session): session closed for user root Aug 15 09:27:35 oleg434-client systemd[1]: session-24.scope: Succeeded. Aug 15 09:27:35 oleg434-client systemd-logind[1010]: Session 24 logged out. Waiting for processes to exit. Aug 15 09:27:35 oleg434-client systemd-logind[1010]: Removed session 24. Aug 15 09:27:53 oleg434-client kernel: Lustre: 11564:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800457/real 1786800457] req@ffff898e880eca80 x1873595690150656/t0(0) o101->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 576/1152 e 0 to 1 dl 1786800473 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 Aug 15 09:27:53 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:27:53 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:27:57 oleg434-client sshd[11680]: Accepted publickey for root from 192.168.204.34 port 60496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:27:57 oleg434-client systemd-logind[1010]: New session 25 of user root. Aug 15 09:27:57 oleg434-client systemd[1]: Started Session 25 of user root. Aug 15 09:27:57 oleg434-client sshd[11680]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:27:57 oleg434-client sshd[11693]: Received disconnect from 192.168.204.34 port 60496:11: disconnected by user Aug 15 09:27:57 oleg434-client sshd[11693]: Disconnected from user root 192.168.204.34 port 60496 Aug 15 09:27:57 oleg434-client sshd[11680]: pam_unix(sshd:session): session closed for user root Aug 15 09:27:58 oleg434-client systemd[1]: session-25.scope: Succeeded. Aug 15 09:27:58 oleg434-client systemd-logind[1010]: Session 25 logged out. Waiting for processes to exit. Aug 15 09:27:58 oleg434-client systemd-logind[1010]: Removed session 25. Aug 15 09:27:58 oleg434-client sshd[11819]: Accepted publickey for root from 192.168.204.34 port 60500 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:27:59 oleg434-client systemd-logind[1010]: New session 26 of user root. Aug 15 09:27:59 oleg434-client systemd[1]: Started Session 26 of user root. Aug 15 09:27:59 oleg434-client sshd[11819]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:27:59 oleg434-client sshd[11832]: Received disconnect from 192.168.204.34 port 60500:11: disconnected by user Aug 15 09:27:59 oleg434-client sshd[11832]: Disconnected from user root 192.168.204.34 port 60500 Aug 15 09:27:59 oleg434-client sshd[11819]: pam_unix(sshd:session): session closed for user root Aug 15 09:27:59 oleg434-client systemd[1]: session-26.scope: Succeeded. Aug 15 09:27:59 oleg434-client systemd-logind[1010]: Session 26 logged out. Waiting for processes to exit. Aug 15 09:27:59 oleg434-client systemd-logind[1010]: Removed session 26. Aug 15 09:28:00 oleg434-client sshd[11965]: Accepted publickey for root from 192.168.204.34 port 60514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:28:01 oleg434-client systemd-logind[1010]: New session 27 of user root. Aug 15 09:28:01 oleg434-client systemd[1]: Started Session 27 of user root. Aug 15 09:28:01 oleg434-client sshd[11965]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:28:01 oleg434-client sshd[11978]: Received disconnect from 192.168.204.34 port 60514:11: disconnected by user Aug 15 09:28:01 oleg434-client sshd[11978]: Disconnected from user root 192.168.204.34 port 60514 Aug 15 09:28:01 oleg434-client sshd[11965]: pam_unix(sshd:session): session closed for user root Aug 15 09:28:01 oleg434-client systemd[1]: session-27.scope: Succeeded. Aug 15 09:28:01 oleg434-client systemd-logind[1010]: Session 27 logged out. Waiting for processes to exit. Aug 15 09:28:01 oleg434-client systemd-logind[1010]: Removed session 27. Aug 15 09:28:02 oleg434-client sshd[12121]: Accepted publickey for root from 192.168.204.34 port 60520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:28:02 oleg434-client systemd[1]: Started Session 28 of user root. Aug 15 09:28:02 oleg434-client systemd-logind[1010]: New session 28 of user root. Aug 15 09:28:02 oleg434-client sshd[12121]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:28:02 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 5: rename: drop req, drop rep ===== 09:28:01 (1786800481) Aug 15 09:28:02 oleg434-client sshd[12134]: Received disconnect from 192.168.204.34 port 60520:11: disconnected by user Aug 15 09:28:02 oleg434-client sshd[12134]: Disconnected from user root 192.168.204.34 port 60520 Aug 15 09:28:02 oleg434-client sshd[12121]: pam_unix(sshd:session): session closed for user root Aug 15 09:28:03 oleg434-client systemd[1]: session-28.scope: Succeeded. Aug 15 09:28:03 oleg434-client systemd-logind[1010]: Session 28 logged out. Waiting for processes to exit. Aug 15 09:28:03 oleg434-client systemd-logind[1010]: Removed session 28. Aug 15 09:28:20 oleg434-client kernel: Lustre: 12189:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800484/real 1786800484] req@ffff898ea8d2dc00 x1873595690156160/t0(0) o101->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 576/1152 e 0 to 1 dl 1786800500 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'mv.0' uid:0 gid:0 projid:0 Aug 15 09:28:20 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:28:20 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:28:42 oleg434-client sshd[12321]: Accepted publickey for root from 192.168.204.34 port 34620 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:28:42 oleg434-client systemd-logind[1010]: New session 29 of user root. Aug 15 09:28:42 oleg434-client systemd[1]: Started Session 29 of user root. Aug 15 09:28:42 oleg434-client sshd[12321]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:28:42 oleg434-client sshd[12334]: Received disconnect from 192.168.204.34 port 34620:11: disconnected by user Aug 15 09:28:42 oleg434-client sshd[12334]: Disconnected from user root 192.168.204.34 port 34620 Aug 15 09:28:42 oleg434-client sshd[12321]: pam_unix(sshd:session): session closed for user root Aug 15 09:28:42 oleg434-client systemd[1]: session-29.scope: Succeeded. Aug 15 09:28:42 oleg434-client systemd-logind[1010]: Session 29 logged out. Waiting for processes to exit. Aug 15 09:28:42 oleg434-client systemd-logind[1010]: Removed session 29. Aug 15 09:28:43 oleg434-client sshd[12461]: Accepted publickey for root from 192.168.204.34 port 34626 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:28:43 oleg434-client systemd[1]: Started Session 30 of user root. Aug 15 09:28:43 oleg434-client systemd-logind[1010]: New session 30 of user root. Aug 15 09:28:43 oleg434-client sshd[12461]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:28:43 oleg434-client sshd[12474]: Received disconnect from 192.168.204.34 port 34626:11: disconnected by user Aug 15 09:28:43 oleg434-client sshd[12474]: Disconnected from user root 192.168.204.34 port 34626 Aug 15 09:28:43 oleg434-client sshd[12461]: pam_unix(sshd:session): session closed for user root Aug 15 09:28:43 oleg434-client systemd[1]: session-30.scope: Succeeded. Aug 15 09:28:43 oleg434-client systemd-logind[1010]: Session 30 logged out. Waiting for processes to exit. Aug 15 09:28:43 oleg434-client systemd-logind[1010]: Removed session 30. Aug 15 09:28:44 oleg434-client sshd[12608]: Accepted publickey for root from 192.168.204.34 port 34634 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:28:44 oleg434-client systemd-logind[1010]: New session 31 of user root. Aug 15 09:28:44 oleg434-client systemd[1]: Started Session 31 of user root. Aug 15 09:28:44 oleg434-client sshd[12608]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:28:45 oleg434-client sshd[12621]: Received disconnect from 192.168.204.34 port 34634:11: disconnected by user Aug 15 09:28:45 oleg434-client sshd[12621]: Disconnected from user root 192.168.204.34 port 34634 Aug 15 09:28:45 oleg434-client sshd[12608]: pam_unix(sshd:session): session closed for user root Aug 15 09:28:45 oleg434-client systemd[1]: session-31.scope: Succeeded. Aug 15 09:28:45 oleg434-client systemd-logind[1010]: Session 31 logged out. Waiting for processes to exit. Aug 15 09:28:45 oleg434-client systemd-logind[1010]: Removed session 31. Aug 15 09:28:46 oleg434-client sshd[12763]: Accepted publickey for root from 192.168.204.34 port 42466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:28:46 oleg434-client systemd-logind[1010]: New session 32 of user root. Aug 15 09:28:46 oleg434-client systemd[1]: Started Session 32 of user root. Aug 15 09:28:46 oleg434-client sshd[12763]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:28:46 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 6: link, unlink: drop req, drop rep ========================================================== 09:28:45 (1786800525) Aug 15 09:28:46 oleg434-client sshd[12776]: Received disconnect from 192.168.204.34 port 42466:11: disconnected by user Aug 15 09:28:46 oleg434-client sshd[12776]: Disconnected from user root 192.168.204.34 port 42466 Aug 15 09:28:47 oleg434-client sshd[12763]: pam_unix(sshd:session): session closed for user root Aug 15 09:28:47 oleg434-client systemd[1]: session-32.scope: Succeeded. Aug 15 09:28:47 oleg434-client systemd-logind[1010]: Session 32 logged out. Waiting for processes to exit. Aug 15 09:28:47 oleg434-client systemd-logind[1010]: Removed session 32. Aug 15 09:29:04 oleg434-client kernel: Lustre: 12832:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800528/real 1786800528] req@ffff898e83109180 x1873595690164992/t0(0) o101->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 576/1152 e 0 to 1 dl 1786800544 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'link.0' uid:0 gid:0 projid:0 Aug 15 09:29:04 oleg434-client kernel: Lustre: 12832:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 1 previous similar message Aug 15 09:29:04 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:29:04 oleg434-client kernel: Lustre: Skipped 1 previous similar message Aug 15 09:29:04 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:29:04 oleg434-client kernel: Lustre: Skipped 1 previous similar message Aug 15 09:29:09 oleg434-client kernel: Lustre: lustre-OST0000-osc-ffff898e8e663800: disconnect after 23s idle Aug 15 09:29:09 oleg434-client kernel: Lustre: Skipped 1 previous similar message Aug 15 09:30:04 oleg434-client sshd[13006]: Accepted publickey for root from 192.168.204.34 port 39284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:04 oleg434-client systemd[1]: Started Session 33 of user root. Aug 15 09:30:04 oleg434-client systemd-logind[1010]: New session 33 of user root. Aug 15 09:30:04 oleg434-client sshd[13006]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:04 oleg434-client sshd[13019]: Received disconnect from 192.168.204.34 port 39284:11: disconnected by user Aug 15 09:30:04 oleg434-client sshd[13019]: Disconnected from user root 192.168.204.34 port 39284 Aug 15 09:30:04 oleg434-client sshd[13006]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:05 oleg434-client systemd-logind[1010]: Session 33 logged out. Waiting for processes to exit. Aug 15 09:30:05 oleg434-client systemd[1]: session-33.scope: Succeeded. Aug 15 09:30:05 oleg434-client systemd-logind[1010]: Removed session 33. Aug 15 09:30:05 oleg434-client sshd[13146]: Accepted publickey for root from 192.168.204.34 port 46412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:05 oleg434-client systemd-logind[1010]: New session 34 of user root. Aug 15 09:30:05 oleg434-client systemd[1]: Started Session 34 of user root. Aug 15 09:30:05 oleg434-client sshd[13146]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:06 oleg434-client sshd[13159]: Received disconnect from 192.168.204.34 port 46412:11: disconnected by user Aug 15 09:30:06 oleg434-client sshd[13159]: Disconnected from user root 192.168.204.34 port 46412 Aug 15 09:30:06 oleg434-client sshd[13146]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:06 oleg434-client systemd-logind[1010]: Session 34 logged out. Waiting for processes to exit. Aug 15 09:30:06 oleg434-client systemd[1]: session-34.scope: Succeeded. Aug 15 09:30:06 oleg434-client systemd-logind[1010]: Removed session 34. Aug 15 09:30:07 oleg434-client sshd[13292]: Accepted publickey for root from 192.168.204.34 port 46418 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:07 oleg434-client systemd-logind[1010]: New session 35 of user root. Aug 15 09:30:07 oleg434-client systemd[1]: Started Session 35 of user root. Aug 15 09:30:07 oleg434-client sshd[13292]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:08 oleg434-client sshd[13305]: Received disconnect from 192.168.204.34 port 46418:11: disconnected by user Aug 15 09:30:08 oleg434-client sshd[13305]: Disconnected from user root 192.168.204.34 port 46418 Aug 15 09:30:08 oleg434-client sshd[13292]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:08 oleg434-client systemd[1]: session-35.scope: Succeeded. Aug 15 09:30:08 oleg434-client systemd-logind[1010]: Session 35 logged out. Waiting for processes to exit. Aug 15 09:30:08 oleg434-client systemd-logind[1010]: Removed session 35. Aug 15 09:30:09 oleg434-client sshd[13448]: Accepted publickey for root from 192.168.204.34 port 46434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:10 oleg434-client systemd[1]: Started Session 36 of user root. Aug 15 09:30:10 oleg434-client systemd-logind[1010]: New session 36 of user root. Aug 15 09:30:10 oleg434-client sshd[13448]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:10 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 8: touch: drop rep (bug 1423) ===== 09:30:08 (1786800608) Aug 15 09:30:10 oleg434-client sshd[13461]: Received disconnect from 192.168.204.34 port 46434:11: disconnected by user Aug 15 09:30:10 oleg434-client sshd[13461]: Disconnected from user root 192.168.204.34 port 46434 Aug 15 09:30:10 oleg434-client sshd[13448]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:10 oleg434-client systemd[1]: session-36.scope: Succeeded. Aug 15 09:30:10 oleg434-client systemd-logind[1010]: Session 36 logged out. Waiting for processes to exit. Aug 15 09:30:10 oleg434-client systemd-logind[1010]: Removed session 36. Aug 15 09:30:27 oleg434-client kernel: Lustre: 13504:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800611/real 1786800611] req@ffff898ea8d2f480 x1873595690178304/t0(0) o36->lustre-MDT0000-mdc-ffff898e8e663800@192.168.204.134@tcp:12/10 lens 488/512 e 0 to 1 dl 1786800627 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 Aug 15 09:30:27 oleg434-client kernel: Lustre: 13504:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Aug 15 09:30:27 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:30:27 oleg434-client kernel: Lustre: Skipped 3 previous similar messages Aug 15 09:30:27 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:30:27 oleg434-client kernel: Lustre: Skipped 3 previous similar messages Aug 15 09:30:30 oleg434-client sshd[13603]: Accepted publickey for root from 192.168.204.34 port 42520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:30 oleg434-client systemd[1]: Started Session 37 of user root. Aug 15 09:30:30 oleg434-client systemd-logind[1010]: New session 37 of user root. Aug 15 09:30:30 oleg434-client sshd[13603]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:30 oleg434-client sshd[13616]: Received disconnect from 192.168.204.34 port 42520:11: disconnected by user Aug 15 09:30:30 oleg434-client sshd[13616]: Disconnected from user root 192.168.204.34 port 42520 Aug 15 09:30:31 oleg434-client sshd[13603]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:31 oleg434-client systemd[1]: session-37.scope: Succeeded. Aug 15 09:30:31 oleg434-client systemd-logind[1010]: Session 37 logged out. Waiting for processes to exit. Aug 15 09:30:31 oleg434-client systemd-logind[1010]: Removed session 37. Aug 15 09:30:32 oleg434-client sshd[13742]: Accepted publickey for root from 192.168.204.34 port 42530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:32 oleg434-client systemd-logind[1010]: New session 38 of user root. Aug 15 09:30:32 oleg434-client systemd[1]: Started Session 38 of user root. Aug 15 09:30:32 oleg434-client sshd[13742]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:32 oleg434-client sshd[13755]: Received disconnect from 192.168.204.34 port 42530:11: disconnected by user Aug 15 09:30:32 oleg434-client sshd[13755]: Disconnected from user root 192.168.204.34 port 42530 Aug 15 09:30:32 oleg434-client sshd[13742]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:32 oleg434-client systemd-logind[1010]: Session 38 logged out. Waiting for processes to exit. Aug 15 09:30:32 oleg434-client systemd[1]: session-38.scope: Succeeded. Aug 15 09:30:32 oleg434-client systemd-logind[1010]: Removed session 38. Aug 15 09:30:33 oleg434-client sshd[13889]: Accepted publickey for root from 192.168.204.34 port 42542 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:33 oleg434-client systemd-logind[1010]: New session 39 of user root. Aug 15 09:30:33 oleg434-client systemd[1]: Started Session 39 of user root. Aug 15 09:30:33 oleg434-client sshd[13889]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:33 oleg434-client sshd[13902]: Received disconnect from 192.168.204.34 port 42542:11: disconnected by user Aug 15 09:30:33 oleg434-client sshd[13902]: Disconnected from user root 192.168.204.34 port 42542 Aug 15 09:30:34 oleg434-client sshd[13889]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:34 oleg434-client systemd[1]: session-39.scope: Succeeded. Aug 15 09:30:34 oleg434-client systemd-logind[1010]: Session 39 logged out. Waiting for processes to exit. Aug 15 09:30:34 oleg434-client systemd-logind[1010]: Removed session 39. Aug 15 09:30:35 oleg434-client sshd[14044]: Accepted publickey for root from 192.168.204.34 port 53534 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:35 oleg434-client systemd-logind[1010]: New session 40 of user root. Aug 15 09:30:35 oleg434-client systemd[1]: Started Session 40 of user root. Aug 15 09:30:35 oleg434-client sshd[14044]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:35 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 9: pause bulk on OST (bug 1420) === 09:30:34 (1786800634) Aug 15 09:30:35 oleg434-client sshd[14058]: Received disconnect from 192.168.204.34 port 53534:11: disconnected by user Aug 15 09:30:35 oleg434-client sshd[14058]: Disconnected from user root 192.168.204.34 port 53534 Aug 15 09:30:35 oleg434-client sshd[14044]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:35 oleg434-client systemd[1]: session-40.scope: Succeeded. Aug 15 09:30:35 oleg434-client systemd-logind[1010]: Session 40 logged out. Waiting for processes to exit. Aug 15 09:30:35 oleg434-client systemd-logind[1010]: Removed session 40. Aug 15 09:30:45 oleg434-client sshd[14283]: Accepted publickey for root from 192.168.204.34 port 54590 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:45 oleg434-client systemd-logind[1010]: New session 41 of user root. Aug 15 09:30:45 oleg434-client systemd[1]: Started Session 41 of user root. Aug 15 09:30:45 oleg434-client sshd[14283]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:46 oleg434-client sshd[14296]: Received disconnect from 192.168.204.34 port 54590:11: disconnected by user Aug 15 09:30:46 oleg434-client sshd[14296]: Disconnected from user root 192.168.204.34 port 54590 Aug 15 09:30:46 oleg434-client sshd[14283]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:46 oleg434-client systemd[1]: session-41.scope: Succeeded. Aug 15 09:30:46 oleg434-client systemd-logind[1010]: Session 41 logged out. Waiting for processes to exit. Aug 15 09:30:46 oleg434-client systemd-logind[1010]: Removed session 41. Aug 15 09:30:47 oleg434-client sshd[14423]: Accepted publickey for root from 192.168.204.34 port 54596 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:47 oleg434-client systemd-logind[1010]: New session 42 of user root. Aug 15 09:30:47 oleg434-client systemd[1]: Started Session 42 of user root. Aug 15 09:30:47 oleg434-client sshd[14423]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:47 oleg434-client sshd[14436]: Received disconnect from 192.168.204.34 port 54596:11: disconnected by user Aug 15 09:30:47 oleg434-client sshd[14436]: Disconnected from user root 192.168.204.34 port 54596 Aug 15 09:30:47 oleg434-client sshd[14423]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:48 oleg434-client systemd[1]: session-42.scope: Succeeded. Aug 15 09:30:48 oleg434-client systemd-logind[1010]: Session 42 logged out. Waiting for processes to exit. Aug 15 09:30:48 oleg434-client systemd-logind[1010]: Removed session 42. Aug 15 09:30:49 oleg434-client sshd[14569]: Accepted publickey for root from 192.168.204.34 port 54610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:49 oleg434-client systemd-logind[1010]: New session 43 of user root. Aug 15 09:30:49 oleg434-client systemd[1]: Started Session 43 of user root. Aug 15 09:30:49 oleg434-client sshd[14569]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:49 oleg434-client sshd[14582]: Received disconnect from 192.168.204.34 port 54610:11: disconnected by user Aug 15 09:30:49 oleg434-client sshd[14582]: Disconnected from user root 192.168.204.34 port 54610 Aug 15 09:30:49 oleg434-client sshd[14569]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:49 oleg434-client systemd[1]: session-43.scope: Succeeded. Aug 15 09:30:49 oleg434-client systemd-logind[1010]: Session 43 logged out. Waiting for processes to exit. Aug 15 09:30:49 oleg434-client systemd-logind[1010]: Removed session 43. Aug 15 09:30:51 oleg434-client sshd[14725]: Accepted publickey for root from 192.168.204.34 port 54624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:30:51 oleg434-client systemd[1]: Started Session 44 of user root. Aug 15 09:30:51 oleg434-client systemd-logind[1010]: New session 44 of user root. Aug 15 09:30:51 oleg434-client sshd[14725]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:30:51 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10a: finish request on server after client eviction (bug 1521) ========================================================== 09:30:50 (1786800650) Aug 15 09:30:51 oleg434-client sshd[14738]: Received disconnect from 192.168.204.34 port 54624:11: disconnected by user Aug 15 09:30:51 oleg434-client sshd[14738]: Disconnected from user root 192.168.204.34 port 54624 Aug 15 09:30:51 oleg434-client sshd[14725]: pam_unix(sshd:session): session closed for user root Aug 15 09:30:51 oleg434-client systemd-logind[1010]: Session 44 logged out. Waiting for processes to exit. Aug 15 09:30:51 oleg434-client systemd[1]: session-44.scope: Succeeded. Aug 15 09:30:51 oleg434-client systemd-logind[1010]: Removed session 44. Aug 15 09:30:52 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:31:07 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:31:13 oleg434-client kernel: Lustre: lustre-OST0000-osc-ffff898e8e663800: disconnect after 24s idle Aug 15 09:31:23 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:31:40 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:31:55 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:32:12 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:32:28 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:32:45 oleg434-client kernel: LustreError: lustre-MDT0000-mdc-ffff898e8e663800: operation ldlm_enqueue to node 192.168.204.134@tcp failed: rc = -107 Aug 15 09:32:45 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:32:45 oleg434-client kernel: LustreError: lustre-MDT0000-mdc-ffff898e8e663800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Aug 15 09:32:45 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e8e663800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:32:49 oleg434-client sshd[14982]: Accepted publickey for root from 192.168.204.34 port 52990 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:32:49 oleg434-client systemd-logind[1010]: New session 45 of user root. Aug 15 09:32:49 oleg434-client systemd[1]: Started Session 45 of user root. Aug 15 09:32:49 oleg434-client sshd[14982]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:32:50 oleg434-client sshd[14995]: Received disconnect from 192.168.204.34 port 52990:11: disconnected by user Aug 15 09:32:50 oleg434-client sshd[14995]: Disconnected from user root 192.168.204.34 port 52990 Aug 15 09:32:50 oleg434-client sshd[14982]: pam_unix(sshd:session): session closed for user root Aug 15 09:32:50 oleg434-client systemd-logind[1010]: Session 45 logged out. Waiting for processes to exit. Aug 15 09:32:50 oleg434-client systemd[1]: session-45.scope: Succeeded. Aug 15 09:32:50 oleg434-client systemd-logind[1010]: Removed session 45. Aug 15 09:32:51 oleg434-client sshd[15122]: Accepted publickey for root from 192.168.204.34 port 52998 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:32:51 oleg434-client systemd[1]: Started Session 46 of user root. Aug 15 09:32:51 oleg434-client systemd-logind[1010]: New session 46 of user root. Aug 15 09:32:51 oleg434-client sshd[15122]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:32:51 oleg434-client sshd[15135]: Received disconnect from 192.168.204.34 port 52998:11: disconnected by user Aug 15 09:32:51 oleg434-client sshd[15135]: Disconnected from user root 192.168.204.34 port 52998 Aug 15 09:32:51 oleg434-client sshd[15122]: pam_unix(sshd:session): session closed for user root Aug 15 09:32:51 oleg434-client systemd[1]: session-46.scope: Succeeded. Aug 15 09:32:51 oleg434-client systemd-logind[1010]: Session 46 logged out. Waiting for processes to exit. Aug 15 09:32:51 oleg434-client systemd-logind[1010]: Removed session 46. Aug 15 09:32:53 oleg434-client sshd[15268]: Accepted publickey for root from 192.168.204.34 port 53006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:32:53 oleg434-client systemd-logind[1010]: New session 47 of user root. Aug 15 09:32:53 oleg434-client systemd[1]: Started Session 47 of user root. Aug 15 09:32:53 oleg434-client sshd[15268]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:32:54 oleg434-client sshd[15281]: Received disconnect from 192.168.204.34 port 53006:11: disconnected by user Aug 15 09:32:54 oleg434-client sshd[15281]: Disconnected from user root 192.168.204.34 port 53006 Aug 15 09:32:54 oleg434-client sshd[15268]: pam_unix(sshd:session): session closed for user root Aug 15 09:32:54 oleg434-client systemd-logind[1010]: Session 47 logged out. Waiting for processes to exit. Aug 15 09:32:54 oleg434-client systemd[1]: session-47.scope: Succeeded. Aug 15 09:32:54 oleg434-client systemd-logind[1010]: Removed session 47. Aug 15 09:32:55 oleg434-client sshd[15424]: Accepted publickey for root from 192.168.204.34 port 47506 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:32:55 oleg434-client systemd[1]: Started Session 48 of user root. Aug 15 09:32:55 oleg434-client systemd-logind[1010]: New session 48 of user root. Aug 15 09:32:55 oleg434-client sshd[15424]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:32:56 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10b: re-send BL AST =============== 09:32:54 (1786800774) Aug 15 09:32:56 oleg434-client sshd[15437]: Received disconnect from 192.168.204.34 port 47506:11: disconnected by user Aug 15 09:32:56 oleg434-client sshd[15437]: Disconnected from user root 192.168.204.34 port 47506 Aug 15 09:32:56 oleg434-client sshd[15424]: pam_unix(sshd:session): session closed for user root Aug 15 09:32:56 oleg434-client systemd[1]: session-48.scope: Succeeded. Aug 15 09:32:56 oleg434-client systemd-logind[1010]: Session 48 logged out. Waiting for processes to exit. Aug 15 09:32:56 oleg434-client systemd-logind[1010]: Removed session 48. Aug 15 09:33:11 oleg434-client kernel: Lustre: lustre-OST0000-osc-ffff898e8e663800: disconnect after 20s idle Aug 15 09:33:14 oleg434-client sshd[15633]: Accepted publickey for root from 192.168.204.34 port 36196 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:14 oleg434-client systemd-logind[1010]: New session 49 of user root. Aug 15 09:33:14 oleg434-client systemd[1]: Started Session 49 of user root. Aug 15 09:33:15 oleg434-client sshd[15633]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:15 oleg434-client sshd[15647]: Received disconnect from 192.168.204.34 port 36196:11: disconnected by user Aug 15 09:33:15 oleg434-client sshd[15647]: Disconnected from user root 192.168.204.34 port 36196 Aug 15 09:33:15 oleg434-client sshd[15633]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:15 oleg434-client systemd[1]: session-49.scope: Succeeded. Aug 15 09:33:15 oleg434-client systemd-logind[1010]: Session 49 logged out. Waiting for processes to exit. Aug 15 09:33:15 oleg434-client systemd-logind[1010]: Removed session 49. Aug 15 09:33:17 oleg434-client sshd[15773]: Accepted publickey for root from 192.168.204.34 port 35692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:17 oleg434-client systemd-logind[1010]: New session 50 of user root. Aug 15 09:33:17 oleg434-client systemd[1]: Started Session 50 of user root. Aug 15 09:33:17 oleg434-client sshd[15773]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:17 oleg434-client sshd[15786]: Received disconnect from 192.168.204.34 port 35692:11: disconnected by user Aug 15 09:33:17 oleg434-client sshd[15786]: Disconnected from user root 192.168.204.34 port 35692 Aug 15 09:33:17 oleg434-client sshd[15773]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:17 oleg434-client systemd-logind[1010]: Session 50 logged out. Waiting for processes to exit. Aug 15 09:33:17 oleg434-client systemd[1]: session-50.scope: Succeeded. Aug 15 09:33:17 oleg434-client systemd-logind[1010]: Removed session 50. Aug 15 09:33:18 oleg434-client sshd[15919]: Accepted publickey for root from 192.168.204.34 port 35700 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:18 oleg434-client systemd-logind[1010]: New session 51 of user root. Aug 15 09:33:18 oleg434-client systemd[1]: Started Session 51 of user root. Aug 15 09:33:18 oleg434-client sshd[15919]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:18 oleg434-client sshd[15932]: Received disconnect from 192.168.204.34 port 35700:11: disconnected by user Aug 15 09:33:18 oleg434-client sshd[15932]: Disconnected from user root 192.168.204.34 port 35700 Aug 15 09:33:18 oleg434-client sshd[15919]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:19 oleg434-client systemd[1]: session-51.scope: Succeeded. Aug 15 09:33:19 oleg434-client systemd-logind[1010]: Session 51 logged out. Waiting for processes to exit. Aug 15 09:33:19 oleg434-client systemd-logind[1010]: Removed session 51. Aug 15 09:33:20 oleg434-client sshd[16074]: Accepted publickey for root from 192.168.204.34 port 35714 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:20 oleg434-client systemd-logind[1010]: New session 52 of user root. Aug 15 09:33:20 oleg434-client systemd[1]: Started Session 52 of user root. Aug 15 09:33:20 oleg434-client sshd[16074]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:21 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10c: re-send BL AST vs reconnect race (LU-5569) ========================================================== 09:33:19 (1786800799) Aug 15 09:33:21 oleg434-client sshd[16087]: Received disconnect from 192.168.204.34 port 35714:11: disconnected by user Aug 15 09:33:21 oleg434-client sshd[16087]: Disconnected from user root 192.168.204.34 port 35714 Aug 15 09:33:21 oleg434-client sshd[16074]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:21 oleg434-client systemd[1]: session-52.scope: Succeeded. Aug 15 09:33:21 oleg434-client systemd-logind[1010]: Session 52 logged out. Waiting for processes to exit. Aug 15 09:33:21 oleg434-client systemd-logind[1010]: Removed session 52. Aug 15 09:33:21 oleg434-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Aug 15 09:33:21 oleg434-client kernel: Lustre: Skipped 1 previous similar message Aug 15 09:33:24 oleg434-client sshd[16276]: Accepted publickey for root from 192.168.204.34 port 35728 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:24 oleg434-client systemd-logind[1010]: New session 53 of user root. Aug 15 09:33:24 oleg434-client systemd[1]: Started Session 53 of user root. Aug 15 09:33:24 oleg434-client sshd[16276]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:24 oleg434-client sshd[16289]: Received disconnect from 192.168.204.34 port 35728:11: disconnected by user Aug 15 09:33:24 oleg434-client sshd[16289]: Disconnected from user root 192.168.204.34 port 35728 Aug 15 09:33:24 oleg434-client sshd[16276]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:25 oleg434-client systemd-logind[1010]: Session 53 logged out. Waiting for processes to exit. Aug 15 09:33:25 oleg434-client systemd[1]: session-53.scope: Succeeded. Aug 15 09:33:25 oleg434-client systemd-logind[1010]: Removed session 53. Aug 15 09:33:26 oleg434-client sshd[16415]: Accepted publickey for root from 192.168.204.34 port 47068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:26 oleg434-client systemd-logind[1010]: New session 54 of user root. Aug 15 09:33:26 oleg434-client systemd[1]: Started Session 54 of user root. Aug 15 09:33:26 oleg434-client sshd[16415]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:26 oleg434-client sshd[16428]: Received disconnect from 192.168.204.34 port 47068:11: disconnected by user Aug 15 09:33:26 oleg434-client sshd[16428]: Disconnected from user root 192.168.204.34 port 47068 Aug 15 09:33:26 oleg434-client sshd[16415]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:27 oleg434-client systemd[1]: session-54.scope: Succeeded. Aug 15 09:33:27 oleg434-client systemd-logind[1010]: Session 54 logged out. Waiting for processes to exit. Aug 15 09:33:27 oleg434-client systemd-logind[1010]: Removed session 54. Aug 15 09:33:27 oleg434-client sshd[16561]: Accepted publickey for root from 192.168.204.34 port 47080 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:27 oleg434-client systemd-logind[1010]: New session 55 of user root. Aug 15 09:33:27 oleg434-client systemd[1]: Started Session 55 of user root. Aug 15 09:33:27 oleg434-client sshd[16561]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:28 oleg434-client sshd[16574]: Received disconnect from 192.168.204.34 port 47080:11: disconnected by user Aug 15 09:33:28 oleg434-client sshd[16574]: Disconnected from user root 192.168.204.34 port 47080 Aug 15 09:33:28 oleg434-client sshd[16561]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:28 oleg434-client systemd[1]: session-55.scope: Succeeded. Aug 15 09:33:28 oleg434-client systemd-logind[1010]: Session 55 logged out. Waiting for processes to exit. Aug 15 09:33:28 oleg434-client systemd-logind[1010]: Removed session 55. Aug 15 09:33:29 oleg434-client sshd[16717]: Accepted publickey for root from 192.168.204.34 port 47086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:29 oleg434-client systemd-logind[1010]: New session 56 of user root. Aug 15 09:33:29 oleg434-client systemd[1]: Started Session 56 of user root. Aug 15 09:33:29 oleg434-client sshd[16717]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:30 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10d: test failed blocking ast ===== 09:33:28 (1786800808) Aug 15 09:33:30 oleg434-client sshd[16730]: Received disconnect from 192.168.204.34 port 47086:11: disconnected by user Aug 15 09:33:30 oleg434-client sshd[16730]: Disconnected from user root 192.168.204.34 port 47086 Aug 15 09:33:30 oleg434-client sshd[16717]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:30 oleg434-client systemd[1]: session-56.scope: Succeeded. Aug 15 09:33:30 oleg434-client systemd-logind[1010]: Session 56 logged out. Waiting for processes to exit. Aug 15 09:33:30 oleg434-client systemd-logind[1010]: Removed session 56. Aug 15 09:33:34 oleg434-client systemd[1]: mnt-lustre.mount: Succeeded. Aug 15 09:33:34 oleg434-client kernel: Lustre: Unmounted lustre-client Aug 15 09:33:34 oleg434-client systemd-udevd[16829]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Aug 15 09:33:35 oleg434-client kernel: Lustre: Mounted lustre-client - version 2.17.57_1_g05abe65 Aug 15 09:33:35 oleg434-client systemd-udevd[16865]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Aug 15 09:33:36 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: operation ost_statfs to node 192.168.204.134@tcp failed: rc = -107 Aug 15 09:33:36 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Aug 15 09:33:37 oleg434-client kernel: Lustre: 2390:0:(llite_lib.c:4340:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.134@tcp:/lustre/fid: [0x200000404:0x1:0x0]/ may get corrupted (rc -108) Aug 15 09:33:38 oleg434-client systemd[1]: mnt-lustre2.mount: Succeeded. Aug 15 09:33:38 oleg434-client kernel: Lustre: Unmounted lustre-client Aug 15 09:33:40 oleg434-client sshd[17069]: Accepted publickey for root from 192.168.204.34 port 53102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:40 oleg434-client systemd-logind[1010]: New session 57 of user root. Aug 15 09:33:40 oleg434-client systemd[1]: Started Session 57 of user root. Aug 15 09:33:40 oleg434-client sshd[17069]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:40 oleg434-client sshd[17082]: Received disconnect from 192.168.204.34 port 53102:11: disconnected by user Aug 15 09:33:40 oleg434-client sshd[17082]: Disconnected from user root 192.168.204.34 port 53102 Aug 15 09:33:40 oleg434-client sshd[17069]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:40 oleg434-client systemd[1]: session-57.scope: Succeeded. Aug 15 09:33:40 oleg434-client systemd-logind[1010]: Session 57 logged out. Waiting for processes to exit. Aug 15 09:33:40 oleg434-client systemd-logind[1010]: Removed session 57. Aug 15 09:33:41 oleg434-client sshd[17208]: Accepted publickey for root from 192.168.204.34 port 53118 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:41 oleg434-client systemd-logind[1010]: New session 58 of user root. Aug 15 09:33:41 oleg434-client systemd[1]: Started Session 58 of user root. Aug 15 09:33:41 oleg434-client sshd[17208]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:42 oleg434-client sshd[17221]: Received disconnect from 192.168.204.34 port 53118:11: disconnected by user Aug 15 09:33:42 oleg434-client sshd[17221]: Disconnected from user root 192.168.204.34 port 53118 Aug 15 09:33:42 oleg434-client sshd[17208]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:42 oleg434-client systemd-logind[1010]: Session 58 logged out. Waiting for processes to exit. Aug 15 09:33:42 oleg434-client systemd[1]: session-58.scope: Succeeded. Aug 15 09:33:42 oleg434-client systemd-logind[1010]: Removed session 58. Aug 15 09:33:43 oleg434-client sshd[17355]: Accepted publickey for root from 192.168.204.34 port 53124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:43 oleg434-client systemd-logind[1010]: New session 59 of user root. Aug 15 09:33:43 oleg434-client systemd[1]: Started Session 59 of user root. Aug 15 09:33:43 oleg434-client sshd[17355]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:44 oleg434-client sshd[17368]: Received disconnect from 192.168.204.34 port 53124:11: disconnected by user Aug 15 09:33:44 oleg434-client sshd[17368]: Disconnected from user root 192.168.204.34 port 53124 Aug 15 09:33:44 oleg434-client sshd[17355]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:44 oleg434-client systemd[1]: session-59.scope: Succeeded. Aug 15 09:33:44 oleg434-client systemd-logind[1010]: Session 59 logged out. Waiting for processes to exit. Aug 15 09:33:44 oleg434-client systemd-logind[1010]: Removed session 59. Aug 15 09:33:45 oleg434-client sshd[17510]: Accepted publickey for root from 192.168.204.34 port 57142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:45 oleg434-client systemd-logind[1010]: New session 60 of user root. Aug 15 09:33:45 oleg434-client systemd[1]: Started Session 60 of user root. Aug 15 09:33:45 oleg434-client sshd[17510]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:45 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10e: re-send BL AST vs reconnect race 2 ========================================================== 09:33:44 (1786800824) Aug 15 09:33:45 oleg434-client sshd[17523]: Received disconnect from 192.168.204.34 port 57142:11: disconnected by user Aug 15 09:33:45 oleg434-client sshd[17523]: Disconnected from user root 192.168.204.34 port 57142 Aug 15 09:33:45 oleg434-client sshd[17510]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:45 oleg434-client systemd-logind[1010]: Session 60 logged out. Waiting for processes to exit. Aug 15 09:33:45 oleg434-client systemd[1]: session-60.scope: Succeeded. Aug 15 09:33:45 oleg434-client systemd-logind[1010]: Removed session 60. Aug 15 09:33:47 oleg434-client sshd[17652]: Accepted publickey for root from 192.168.204.34 port 57144 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:47 oleg434-client systemd-logind[1010]: New session 61 of user root. Aug 15 09:33:47 oleg434-client systemd[1]: Started Session 61 of user root. Aug 15 09:33:47 oleg434-client sshd[17652]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:47 oleg434-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_10e need two clients Aug 15 09:33:47 oleg434-client sshd[17665]: Received disconnect from 192.168.204.34 port 57144:11: disconnected by user Aug 15 09:33:47 oleg434-client sshd[17665]: Disconnected from user root 192.168.204.34 port 57144 Aug 15 09:33:47 oleg434-client sshd[17652]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:47 oleg434-client systemd[1]: session-61.scope: Succeeded. Aug 15 09:33:47 oleg434-client systemd-logind[1010]: Session 61 logged out. Waiting for processes to exit. Aug 15 09:33:47 oleg434-client systemd-logind[1010]: Removed session 61. Aug 15 09:33:49 oleg434-client sshd[17806]: Accepted publickey for root from 192.168.204.34 port 57156 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:33:49 oleg434-client systemd[1]: Started Session 62 of user root. Aug 15 09:33:49 oleg434-client systemd-logind[1010]: New session 62 of user root. Aug 15 09:33:49 oleg434-client sshd[17806]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:33:49 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 11: wake up a thread waiting for completion after eviction (b=2460) ========================================================== 09:33:47 (1786800827) Aug 15 09:33:49 oleg434-client sshd[17819]: Received disconnect from 192.168.204.34 port 57156:11: disconnected by user Aug 15 09:33:49 oleg434-client sshd[17819]: Disconnected from user root 192.168.204.34 port 57156 Aug 15 09:33:49 oleg434-client sshd[17806]: pam_unix(sshd:session): session closed for user root Aug 15 09:33:50 oleg434-client systemd[1]: session-62.scope: Succeeded. Aug 15 09:33:50 oleg434-client systemd-logind[1010]: Session 62 logged out. Waiting for processes to exit. Aug 15 09:33:50 oleg434-client systemd-logind[1010]: Removed session 62. Aug 15 09:34:09 oleg434-client sshd[17928]: Accepted publickey for root from 192.168.204.34 port 44570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:09 oleg434-client systemd-logind[1010]: New session 63 of user root. Aug 15 09:34:09 oleg434-client systemd[1]: Started Session 63 of user root. Aug 15 09:34:09 oleg434-client sshd[17928]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:09 oleg434-client sshd[17941]: Received disconnect from 192.168.204.34 port 44570:11: disconnected by user Aug 15 09:34:09 oleg434-client sshd[17941]: Disconnected from user root 192.168.204.34 port 44570 Aug 15 09:34:09 oleg434-client sshd[17928]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:09 oleg434-client systemd[1]: session-63.scope: Succeeded. Aug 15 09:34:09 oleg434-client systemd-logind[1010]: Session 63 logged out. Waiting for processes to exit. Aug 15 09:34:09 oleg434-client systemd-logind[1010]: Removed session 63. Aug 15 09:34:10 oleg434-client sshd[18060]: Accepted publickey for root from 192.168.204.34 port 44582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:10 oleg434-client systemd[1]: Started Session 64 of user root. Aug 15 09:34:10 oleg434-client systemd-logind[1010]: New session 64 of user root. Aug 15 09:34:10 oleg434-client sshd[18060]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:10 oleg434-client sshd[18073]: Received disconnect from 192.168.204.34 port 44582:11: disconnected by user Aug 15 09:34:10 oleg434-client sshd[18073]: Disconnected from user root 192.168.204.34 port 44582 Aug 15 09:34:10 oleg434-client sshd[18060]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:10 oleg434-client systemd[1]: session-64.scope: Succeeded. Aug 15 09:34:10 oleg434-client systemd-logind[1010]: Session 64 logged out. Waiting for processes to exit. Aug 15 09:34:10 oleg434-client systemd-logind[1010]: Removed session 64. Aug 15 09:34:12 oleg434-client sshd[18199]: Accepted publickey for root from 192.168.204.34 port 44588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:12 oleg434-client systemd-logind[1010]: New session 65 of user root. Aug 15 09:34:12 oleg434-client systemd[1]: Started Session 65 of user root. Aug 15 09:34:12 oleg434-client sshd[18199]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:12 oleg434-client sshd[18212]: Received disconnect from 192.168.204.34 port 44588:11: disconnected by user Aug 15 09:34:12 oleg434-client sshd[18212]: Disconnected from user root 192.168.204.34 port 44588 Aug 15 09:34:12 oleg434-client sshd[18199]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:13 oleg434-client systemd-logind[1010]: Session 65 logged out. Waiting for processes to exit. Aug 15 09:34:13 oleg434-client systemd[1]: session-65.scope: Succeeded. Aug 15 09:34:13 oleg434-client systemd-logind[1010]: Removed session 65. Aug 15 09:34:13 oleg434-client sshd[18346]: Accepted publickey for root from 192.168.204.34 port 44600 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:14 oleg434-client systemd-logind[1010]: New session 66 of user root. Aug 15 09:34:14 oleg434-client systemd[1]: Started Session 66 of user root. Aug 15 09:34:14 oleg434-client sshd[18346]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:14 oleg434-client sshd[18359]: Received disconnect from 192.168.204.34 port 44600:11: disconnected by user Aug 15 09:34:14 oleg434-client sshd[18359]: Disconnected from user root 192.168.204.34 port 44600 Aug 15 09:34:14 oleg434-client sshd[18346]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:14 oleg434-client systemd[1]: session-66.scope: Succeeded. Aug 15 09:34:14 oleg434-client systemd-logind[1010]: Session 66 logged out. Waiting for processes to exit. Aug 15 09:34:14 oleg434-client systemd-logind[1010]: Removed session 66. Aug 15 09:34:15 oleg434-client sshd[18501]: Accepted publickey for root from 192.168.204.34 port 48484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:15 oleg434-client systemd[1]: Started Session 67 of user root. Aug 15 09:34:15 oleg434-client systemd-logind[1010]: New session 67 of user root. Aug 15 09:34:15 oleg434-client sshd[18501]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:15 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 12: recover from timed out resend in ptlrpcd (b=2494) ========================================================== 09:34:14 (1786800854) Aug 15 09:34:15 oleg434-client sshd[18514]: Received disconnect from 192.168.204.34 port 48484:11: disconnected by user Aug 15 09:34:15 oleg434-client sshd[18514]: Disconnected from user root 192.168.204.34 port 48484 Aug 15 09:34:15 oleg434-client sshd[18501]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:15 oleg434-client kernel: Lustre: DEBUG MARKER: multiop /mnt/lustre/f12.recovery-small OS_c Aug 15 09:34:15 oleg434-client systemd-logind[1010]: Session 67 logged out. Waiting for processes to exit. Aug 15 09:34:15 oleg434-client systemd[1]: session-67.scope: Succeeded. Aug 15 09:34:16 oleg434-client systemd-logind[1010]: Removed session 67. Aug 15 09:34:33 oleg434-client kernel: Lustre: 18561:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786800857/real 1786800857] req@ffff898e84da9880 x1873595690250880/t0(0) o35->lustre-MDT0000-mdc-ffff898e829ef800@192.168.204.134@tcp:23/10 lens 392/624 e 0 to 1 dl 1786800873 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 Aug 15 09:34:35 oleg434-client sshd[18579]: Accepted publickey for root from 192.168.204.34 port 37652 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:35 oleg434-client systemd-logind[1010]: New session 68 of user root. Aug 15 09:34:35 oleg434-client systemd[1]: Started Session 68 of user root. Aug 15 09:34:35 oleg434-client sshd[18579]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:36 oleg434-client sshd[18592]: Received disconnect from 192.168.204.34 port 37652:11: disconnected by user Aug 15 09:34:36 oleg434-client sshd[18592]: Disconnected from user root 192.168.204.34 port 37652 Aug 15 09:34:36 oleg434-client sshd[18579]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:36 oleg434-client systemd-logind[1010]: Session 68 logged out. Waiting for processes to exit. Aug 15 09:34:36 oleg434-client systemd[1]: session-68.scope: Succeeded. Aug 15 09:34:36 oleg434-client systemd-logind[1010]: Removed session 68. Aug 15 09:34:37 oleg434-client sshd[18712]: Accepted publickey for root from 192.168.204.34 port 37662 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:37 oleg434-client systemd-logind[1010]: New session 69 of user root. Aug 15 09:34:37 oleg434-client systemd[1]: Started Session 69 of user root. Aug 15 09:34:37 oleg434-client sshd[18712]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:37 oleg434-client sshd[18725]: Received disconnect from 192.168.204.34 port 37662:11: disconnected by user Aug 15 09:34:37 oleg434-client sshd[18725]: Disconnected from user root 192.168.204.34 port 37662 Aug 15 09:34:37 oleg434-client sshd[18712]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:38 oleg434-client systemd-logind[1010]: Session 69 logged out. Waiting for processes to exit. Aug 15 09:34:38 oleg434-client systemd[1]: session-69.scope: Succeeded. Aug 15 09:34:38 oleg434-client systemd-logind[1010]: Removed session 69. Aug 15 09:34:39 oleg434-client sshd[18852]: Accepted publickey for root from 192.168.204.34 port 37666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:39 oleg434-client systemd[1]: Started Session 70 of user root. Aug 15 09:34:39 oleg434-client systemd-logind[1010]: New session 70 of user root. Aug 15 09:34:39 oleg434-client sshd[18852]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:40 oleg434-client sshd[18865]: Received disconnect from 192.168.204.34 port 37666:11: disconnected by user Aug 15 09:34:40 oleg434-client sshd[18865]: Disconnected from user root 192.168.204.34 port 37666 Aug 15 09:34:40 oleg434-client sshd[18852]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:40 oleg434-client systemd-logind[1010]: Session 70 logged out. Waiting for processes to exit. Aug 15 09:34:40 oleg434-client systemd[1]: session-70.scope: Succeeded. Aug 15 09:34:40 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 09:34:40 oleg434-client systemd-logind[1010]: Removed session 70. Aug 15 09:34:41 oleg434-client sshd[18999]: Accepted publickey for root from 192.168.204.34 port 37670 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:34:41 oleg434-client systemd-logind[1010]: New session 71 of user root. Aug 15 09:34:41 oleg434-client systemd[1]: Started Session 71 of user root. Aug 15 09:34:41 oleg434-client sshd[18999]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:34:42 oleg434-client sshd[19012]: Received disconnect from 192.168.204.34 port 37670:11: disconnected by user Aug 15 09:34:42 oleg434-client sshd[19012]: Disconnected from user root 192.168.204.34 port 37670 Aug 15 09:34:42 oleg434-client sshd[18999]: pam_unix(sshd:session): session closed for user root Aug 15 09:34:42 oleg434-client systemd-logind[1010]: Session 71 logged out. Waiting for processes to exit. Aug 15 09:34:42 oleg434-client systemd[1]: session-71.scope: Succeeded. Aug 15 09:34:42 oleg434-client systemd-logind[1010]: Removed session 71. Aug 15 09:35:00 oleg434-client sshd[19164]: Accepted publickey for root from 192.168.204.34 port 54958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:00 oleg434-client systemd[1]: Started Session 72 of user root. Aug 15 09:35:00 oleg434-client systemd-logind[1010]: New session 72 of user root. Aug 15 09:35:00 oleg434-client sshd[19164]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:00 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 13: mdc_readpage restart test (bug 1138) ========================================================== 09:34:59 (1786800899) Aug 15 09:35:00 oleg434-client sshd[19178]: Received disconnect from 192.168.204.34 port 54958:11: disconnected by user Aug 15 09:35:00 oleg434-client sshd[19178]: Disconnected from user root 192.168.204.34 port 54958 Aug 15 09:35:00 oleg434-client sshd[19164]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:01 oleg434-client systemd-logind[1010]: Session 72 logged out. Waiting for processes to exit. Aug 15 09:35:01 oleg434-client systemd[1]: session-72.scope: Succeeded. Aug 15 09:35:01 oleg434-client systemd-logind[1010]: Removed session 72. Aug 15 09:35:20 oleg434-client sshd[19324]: Accepted publickey for root from 192.168.204.34 port 50084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:20 oleg434-client systemd-logind[1010]: New session 73 of user root. Aug 15 09:35:20 oleg434-client systemd[1]: Started Session 73 of user root. Aug 15 09:35:20 oleg434-client sshd[19324]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:21 oleg434-client sshd[19337]: Received disconnect from 192.168.204.34 port 50084:11: disconnected by user Aug 15 09:35:21 oleg434-client sshd[19337]: Disconnected from user root 192.168.204.34 port 50084 Aug 15 09:35:21 oleg434-client sshd[19324]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:21 oleg434-client systemd[1]: session-73.scope: Succeeded. Aug 15 09:35:21 oleg434-client systemd-logind[1010]: Session 73 logged out. Waiting for processes to exit. Aug 15 09:35:21 oleg434-client systemd-logind[1010]: Removed session 73. Aug 15 09:35:22 oleg434-client sshd[19463]: Accepted publickey for root from 192.168.204.34 port 50088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:22 oleg434-client systemd-logind[1010]: New session 74 of user root. Aug 15 09:35:22 oleg434-client systemd[1]: Started Session 74 of user root. Aug 15 09:35:22 oleg434-client sshd[19463]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:22 oleg434-client sshd[19476]: Received disconnect from 192.168.204.34 port 50088:11: disconnected by user Aug 15 09:35:22 oleg434-client sshd[19476]: Disconnected from user root 192.168.204.34 port 50088 Aug 15 09:35:22 oleg434-client sshd[19463]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:23 oleg434-client systemd[1]: session-74.scope: Succeeded. Aug 15 09:35:23 oleg434-client systemd-logind[1010]: Session 74 logged out. Waiting for processes to exit. Aug 15 09:35:23 oleg434-client systemd-logind[1010]: Removed session 74. Aug 15 09:35:24 oleg434-client sshd[19609]: Accepted publickey for root from 192.168.204.34 port 50090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:24 oleg434-client systemd-logind[1010]: New session 75 of user root. Aug 15 09:35:24 oleg434-client systemd[1]: Started Session 75 of user root. Aug 15 09:35:24 oleg434-client sshd[19609]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:24 oleg434-client sshd[19622]: Received disconnect from 192.168.204.34 port 50090:11: disconnected by user Aug 15 09:35:24 oleg434-client sshd[19622]: Disconnected from user root 192.168.204.34 port 50090 Aug 15 09:35:24 oleg434-client sshd[19609]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:24 oleg434-client systemd[1]: session-75.scope: Succeeded. Aug 15 09:35:24 oleg434-client systemd-logind[1010]: Session 75 logged out. Waiting for processes to exit. Aug 15 09:35:24 oleg434-client systemd-logind[1010]: Removed session 75. Aug 15 09:35:26 oleg434-client sshd[19765]: Accepted publickey for root from 192.168.204.34 port 40368 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:26 oleg434-client systemd[1]: Started Session 76 of user root. Aug 15 09:35:26 oleg434-client systemd-logind[1010]: New session 76 of user root. Aug 15 09:35:26 oleg434-client sshd[19765]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:26 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 14: mdc_readpage resend test (bug 1138) ========================================================== 09:35:25 (1786800925) Aug 15 09:35:26 oleg434-client sshd[19778]: Received disconnect from 192.168.204.34 port 40368:11: disconnected by user Aug 15 09:35:26 oleg434-client sshd[19778]: Disconnected from user root 192.168.204.34 port 40368 Aug 15 09:35:26 oleg434-client sshd[19765]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:26 oleg434-client systemd[1]: session-76.scope: Succeeded. Aug 15 09:35:26 oleg434-client systemd-logind[1010]: Session 76 logged out. Waiting for processes to exit. Aug 15 09:35:26 oleg434-client systemd-logind[1010]: Removed session 76. Aug 15 09:35:29 oleg434-client sshd[19918]: Accepted publickey for root from 192.168.204.34 port 40378 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:29 oleg434-client systemd-logind[1010]: New session 77 of user root. Aug 15 09:35:29 oleg434-client systemd[1]: Started Session 77 of user root. Aug 15 09:35:29 oleg434-client sshd[19918]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:29 oleg434-client sshd[19931]: Received disconnect from 192.168.204.34 port 40378:11: disconnected by user Aug 15 09:35:29 oleg434-client sshd[19931]: Disconnected from user root 192.168.204.34 port 40378 Aug 15 09:35:29 oleg434-client sshd[19918]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:30 oleg434-client systemd[1]: session-77.scope: Succeeded. Aug 15 09:35:30 oleg434-client systemd-logind[1010]: Session 77 logged out. Waiting for processes to exit. Aug 15 09:35:30 oleg434-client systemd-logind[1010]: Removed session 77. Aug 15 09:35:31 oleg434-client sshd[20057]: Accepted publickey for root from 192.168.204.34 port 40392 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:31 oleg434-client systemd-logind[1010]: New session 78 of user root. Aug 15 09:35:31 oleg434-client systemd[1]: Started Session 78 of user root. Aug 15 09:35:31 oleg434-client sshd[20057]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:31 oleg434-client sshd[20070]: Received disconnect from 192.168.204.34 port 40392:11: disconnected by user Aug 15 09:35:31 oleg434-client sshd[20070]: Disconnected from user root 192.168.204.34 port 40392 Aug 15 09:35:31 oleg434-client sshd[20057]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:31 oleg434-client systemd[1]: session-78.scope: Succeeded. Aug 15 09:35:31 oleg434-client systemd-logind[1010]: Session 78 logged out. Waiting for processes to exit. Aug 15 09:35:31 oleg434-client systemd-logind[1010]: Removed session 78. Aug 15 09:35:32 oleg434-client systemd[1]: Starting Cleanup of Temporary Directories... Aug 15 09:35:32 oleg434-client sshd[20205]: Accepted publickey for root from 192.168.204.34 port 40394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:32 oleg434-client systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Aug 15 09:35:32 oleg434-client systemd[1]: Started Cleanup of Temporary Directories. Aug 15 09:35:32 oleg434-client systemd-logind[1010]: New session 79 of user root. Aug 15 09:35:32 oleg434-client systemd[1]: Started Session 79 of user root. Aug 15 09:35:32 oleg434-client sshd[20205]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:33 oleg434-client sshd[20220]: Received disconnect from 192.168.204.34 port 40394:11: disconnected by user Aug 15 09:35:33 oleg434-client sshd[20220]: Disconnected from user root 192.168.204.34 port 40394 Aug 15 09:35:33 oleg434-client sshd[20205]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:33 oleg434-client systemd[1]: session-79.scope: Succeeded. Aug 15 09:35:33 oleg434-client systemd-logind[1010]: Session 79 logged out. Waiting for processes to exit. Aug 15 09:35:33 oleg434-client systemd-logind[1010]: Removed session 79. Aug 15 09:35:34 oleg434-client sshd[20362]: Accepted publickey for root from 192.168.204.34 port 40396 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:34 oleg434-client systemd-logind[1010]: New session 80 of user root. Aug 15 09:35:34 oleg434-client systemd[1]: Started Session 80 of user root. Aug 15 09:35:34 oleg434-client sshd[20362]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:35 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 15: failed open (-ENOMEM) ========= 09:35:33 (1786800933) Aug 15 09:35:35 oleg434-client sshd[20375]: Received disconnect from 192.168.204.34 port 40396:11: disconnected by user Aug 15 09:35:35 oleg434-client sshd[20375]: Disconnected from user root 192.168.204.34 port 40396 Aug 15 09:35:35 oleg434-client sshd[20362]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:35 oleg434-client systemd-logind[1010]: Session 80 logged out. Waiting for processes to exit. Aug 15 09:35:35 oleg434-client systemd[1]: session-80.scope: Succeeded. Aug 15 09:35:35 oleg434-client systemd-logind[1010]: Removed session 80. Aug 15 09:35:38 oleg434-client sshd[20505]: Accepted publickey for root from 192.168.204.34 port 39146 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:38 oleg434-client systemd[1]: Started Session 81 of user root. Aug 15 09:35:38 oleg434-client systemd-logind[1010]: New session 81 of user root. Aug 15 09:35:38 oleg434-client sshd[20505]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:38 oleg434-client sshd[20518]: Received disconnect from 192.168.204.34 port 39146:11: disconnected by user Aug 15 09:35:38 oleg434-client sshd[20518]: Disconnected from user root 192.168.204.34 port 39146 Aug 15 09:35:38 oleg434-client sshd[20505]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:38 oleg434-client systemd[1]: session-81.scope: Succeeded. Aug 15 09:35:38 oleg434-client systemd-logind[1010]: Session 81 logged out. Waiting for processes to exit. Aug 15 09:35:38 oleg434-client systemd-logind[1010]: Removed session 81. Aug 15 09:35:39 oleg434-client sshd[20644]: Accepted publickey for root from 192.168.204.34 port 39160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:39 oleg434-client systemd-logind[1010]: New session 82 of user root. Aug 15 09:35:39 oleg434-client systemd[1]: Started Session 82 of user root. Aug 15 09:35:39 oleg434-client sshd[20644]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:40 oleg434-client sshd[20658]: Received disconnect from 192.168.204.34 port 39160:11: disconnected by user Aug 15 09:35:40 oleg434-client sshd[20658]: Disconnected from user root 192.168.204.34 port 39160 Aug 15 09:35:40 oleg434-client sshd[20644]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:40 oleg434-client systemd[1]: session-82.scope: Succeeded. Aug 15 09:35:40 oleg434-client systemd-logind[1010]: Session 82 logged out. Waiting for processes to exit. Aug 15 09:35:40 oleg434-client systemd-logind[1010]: Removed session 82. Aug 15 09:35:41 oleg434-client sshd[20791]: Accepted publickey for root from 192.168.204.34 port 39176 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:41 oleg434-client systemd-logind[1010]: New session 83 of user root. Aug 15 09:35:41 oleg434-client systemd[1]: Started Session 83 of user root. Aug 15 09:35:41 oleg434-client sshd[20791]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:41 oleg434-client sshd[20804]: Received disconnect from 192.168.204.34 port 39176:11: disconnected by user Aug 15 09:35:41 oleg434-client sshd[20804]: Disconnected from user root 192.168.204.34 port 39176 Aug 15 09:35:41 oleg434-client sshd[20791]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:41 oleg434-client systemd-logind[1010]: Session 83 logged out. Waiting for processes to exit. Aug 15 09:35:41 oleg434-client systemd[1]: session-83.scope: Succeeded. Aug 15 09:35:41 oleg434-client systemd-logind[1010]: Removed session 83. Aug 15 09:35:43 oleg434-client sshd[20949]: Accepted publickey for root from 192.168.204.34 port 39186 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:35:43 oleg434-client systemd[1]: Started Session 84 of user root. Aug 15 09:35:43 oleg434-client systemd-logind[1010]: New session 84 of user root. Aug 15 09:35:43 oleg434-client sshd[20949]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:35:43 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 16: timeout bulk put, don't evict client (2732) ========================================================== 09:35:42 (1786800942) Aug 15 09:35:43 oleg434-client sshd[20962]: Received disconnect from 192.168.204.34 port 39186:11: disconnected by user Aug 15 09:35:43 oleg434-client sshd[20962]: Disconnected from user root 192.168.204.34 port 39186 Aug 15 09:35:43 oleg434-client sshd[20949]: pam_unix(sshd:session): session closed for user root Aug 15 09:35:43 oleg434-client systemd-logind[1010]: Session 84 logged out. Waiting for processes to exit. Aug 15 09:35:43 oleg434-client systemd[1]: session-84.scope: Succeeded. Aug 15 09:35:43 oleg434-client systemd-logind[1010]: Removed session 84. Aug 15 09:36:25 oleg434-client sshd[21171]: Accepted publickey for root from 192.168.204.34 port 49200 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:36:26 oleg434-client systemd-logind[1010]: New session 85 of user root. Aug 15 09:36:26 oleg434-client systemd[1]: Started Session 85 of user root. Aug 15 09:36:26 oleg434-client sshd[21171]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:36:26 oleg434-client sshd[21184]: Received disconnect from 192.168.204.34 port 49200:11: disconnected by user Aug 15 09:36:26 oleg434-client sshd[21184]: Disconnected from user root 192.168.204.34 port 49200 Aug 15 09:36:26 oleg434-client sshd[21171]: pam_unix(sshd:session): session closed for user root Aug 15 09:36:26 oleg434-client systemd[1]: session-85.scope: Succeeded. Aug 15 09:36:26 oleg434-client systemd-logind[1010]: Session 85 logged out. Waiting for processes to exit. Aug 15 09:36:26 oleg434-client systemd-logind[1010]: Removed session 85. Aug 15 09:36:28 oleg434-client sshd[21311]: Accepted publickey for root from 192.168.204.34 port 49214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:36:28 oleg434-client systemd-logind[1010]: New session 86 of user root. Aug 15 09:36:28 oleg434-client systemd[1]: Started Session 86 of user root. Aug 15 09:36:28 oleg434-client sshd[21311]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:36:28 oleg434-client sshd[21324]: Received disconnect from 192.168.204.34 port 49214:11: disconnected by user Aug 15 09:36:28 oleg434-client sshd[21324]: Disconnected from user root 192.168.204.34 port 49214 Aug 15 09:36:28 oleg434-client sshd[21311]: pam_unix(sshd:session): session closed for user root Aug 15 09:36:29 oleg434-client systemd-logind[1010]: Session 86 logged out. Waiting for processes to exit. Aug 15 09:36:29 oleg434-client systemd[1]: session-86.scope: Succeeded. Aug 15 09:36:29 oleg434-client systemd-logind[1010]: Removed session 86. Aug 15 09:36:29 oleg434-client sshd[21457]: Accepted publickey for root from 192.168.204.34 port 49216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:36:29 oleg434-client systemd-logind[1010]: New session 87 of user root. Aug 15 09:36:29 oleg434-client systemd[1]: Started Session 87 of user root. Aug 15 09:36:29 oleg434-client sshd[21457]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:36:30 oleg434-client sshd[21470]: Received disconnect from 192.168.204.34 port 49216:11: disconnected by user Aug 15 09:36:30 oleg434-client sshd[21470]: Disconnected from user root 192.168.204.34 port 49216 Aug 15 09:36:30 oleg434-client sshd[21457]: pam_unix(sshd:session): session closed for user root Aug 15 09:36:30 oleg434-client systemd[1]: session-87.scope: Succeeded. Aug 15 09:36:30 oleg434-client systemd-logind[1010]: Session 87 logged out. Waiting for processes to exit. Aug 15 09:36:30 oleg434-client systemd-logind[1010]: Removed session 87. Aug 15 09:36:31 oleg434-client sshd[21612]: Accepted publickey for root from 192.168.204.34 port 49230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:36:31 oleg434-client systemd[1]: Started Session 88 of user root. Aug 15 09:36:31 oleg434-client systemd-logind[1010]: New session 88 of user root. Aug 15 09:36:31 oleg434-client sshd[21612]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:36:32 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17a: timeout bulk get, don't evict client (2732) ========================================================== 09:36:30 (1786800990) Aug 15 09:36:32 oleg434-client sshd[21625]: Received disconnect from 192.168.204.34 port 49230:11: disconnected by user Aug 15 09:36:32 oleg434-client sshd[21625]: Disconnected from user root 192.168.204.34 port 49230 Aug 15 09:36:32 oleg434-client sshd[21612]: pam_unix(sshd:session): session closed for user root Aug 15 09:36:32 oleg434-client systemd[1]: session-88.scope: Succeeded. Aug 15 09:36:32 oleg434-client systemd-logind[1010]: Session 88 logged out. Waiting for processes to exit. Aug 15 09:36:32 oleg434-client systemd-logind[1010]: Removed session 88. Aug 15 09:37:20 oleg434-client sshd[21967]: Accepted publickey for root from 192.168.204.34 port 55756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:20 oleg434-client systemd-logind[1010]: New session 89 of user root. Aug 15 09:37:20 oleg434-client systemd[1]: Started Session 89 of user root. Aug 15 09:37:20 oleg434-client sshd[21967]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:21 oleg434-client sshd[21981]: Received disconnect from 192.168.204.34 port 55756:11: disconnected by user Aug 15 09:37:21 oleg434-client sshd[21981]: Disconnected from user root 192.168.204.34 port 55756 Aug 15 09:37:21 oleg434-client sshd[21967]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:21 oleg434-client systemd[1]: session-89.scope: Succeeded. Aug 15 09:37:21 oleg434-client systemd-logind[1010]: Session 89 logged out. Waiting for processes to exit. Aug 15 09:37:21 oleg434-client systemd-logind[1010]: Removed session 89. Aug 15 09:37:22 oleg434-client sshd[22107]: Accepted publickey for root from 192.168.204.34 port 55758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:22 oleg434-client systemd-logind[1010]: New session 90 of user root. Aug 15 09:37:22 oleg434-client systemd[1]: Started Session 90 of user root. Aug 15 09:37:22 oleg434-client sshd[22107]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:23 oleg434-client sshd[22120]: Received disconnect from 192.168.204.34 port 55758:11: disconnected by user Aug 15 09:37:23 oleg434-client sshd[22120]: Disconnected from user root 192.168.204.34 port 55758 Aug 15 09:37:23 oleg434-client sshd[22107]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:23 oleg434-client systemd[1]: session-90.scope: Succeeded. Aug 15 09:37:23 oleg434-client systemd-logind[1010]: Session 90 logged out. Waiting for processes to exit. Aug 15 09:37:23 oleg434-client systemd-logind[1010]: Removed session 90. Aug 15 09:37:24 oleg434-client sshd[22253]: Accepted publickey for root from 192.168.204.34 port 55764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:24 oleg434-client systemd[1]: Started Session 91 of user root. Aug 15 09:37:24 oleg434-client systemd-logind[1010]: New session 91 of user root. Aug 15 09:37:24 oleg434-client sshd[22253]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:24 oleg434-client sshd[22266]: Received disconnect from 192.168.204.34 port 55764:11: disconnected by user Aug 15 09:37:24 oleg434-client sshd[22266]: Disconnected from user root 192.168.204.34 port 55764 Aug 15 09:37:24 oleg434-client sshd[22253]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:24 oleg434-client systemd[1]: session-91.scope: Succeeded. Aug 15 09:37:24 oleg434-client systemd-logind[1010]: Session 91 logged out. Waiting for processes to exit. Aug 15 09:37:24 oleg434-client systemd-logind[1010]: Removed session 91. Aug 15 09:37:26 oleg434-client sshd[22408]: Accepted publickey for root from 192.168.204.34 port 54428 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:26 oleg434-client systemd-logind[1010]: New session 92 of user root. Aug 15 09:37:26 oleg434-client systemd[1]: Started Session 92 of user root. Aug 15 09:37:26 oleg434-client sshd[22408]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:26 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17b: timeout bulk get, dont evict client (3582) ========================================================== 09:37:25 (1786801045) Aug 15 09:37:26 oleg434-client sshd[22421]: Received disconnect from 192.168.204.34 port 54428:11: disconnected by user Aug 15 09:37:26 oleg434-client sshd[22421]: Disconnected from user root 192.168.204.34 port 54428 Aug 15 09:37:26 oleg434-client sshd[22408]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:27 oleg434-client systemd[1]: session-92.scope: Succeeded. Aug 15 09:37:27 oleg434-client systemd-logind[1010]: Session 92 logged out. Waiting for processes to exit. Aug 15 09:37:27 oleg434-client systemd-logind[1010]: Removed session 92. Aug 15 09:37:28 oleg434-client sshd[22546]: Accepted publickey for root from 192.168.204.34 port 54440 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:28 oleg434-client systemd[1]: Started Session 93 of user root. Aug 15 09:37:28 oleg434-client systemd-logind[1010]: New session 93 of user root. Aug 15 09:37:28 oleg434-client sshd[22546]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:28 oleg434-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_17b Needs multiple clients Aug 15 09:37:28 oleg434-client sshd[22560]: Received disconnect from 192.168.204.34 port 54440:11: disconnected by user Aug 15 09:37:28 oleg434-client sshd[22560]: Disconnected from user root 192.168.204.34 port 54440 Aug 15 09:37:28 oleg434-client sshd[22546]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:28 oleg434-client systemd[1]: session-93.scope: Succeeded. Aug 15 09:37:28 oleg434-client systemd-logind[1010]: Session 93 logged out. Waiting for processes to exit. Aug 15 09:37:28 oleg434-client systemd-logind[1010]: Removed session 93. Aug 15 09:37:29 oleg434-client sshd[22701]: Accepted publickey for root from 192.168.204.34 port 54442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:29 oleg434-client systemd-logind[1010]: New session 94 of user root. Aug 15 09:37:29 oleg434-client systemd[1]: Started Session 94 of user root. Aug 15 09:37:29 oleg434-client sshd[22701]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:30 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18a: manual ost invalidate clears page cache immediately ========================================================== 09:37:28 (1786801048) Aug 15 09:37:30 oleg434-client sshd[22714]: Received disconnect from 192.168.204.34 port 54442:11: disconnected by user Aug 15 09:37:30 oleg434-client sshd[22714]: Disconnected from user root 192.168.204.34 port 54442 Aug 15 09:37:30 oleg434-client sshd[22701]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:30 oleg434-client systemd[1]: session-94.scope: Succeeded. Aug 15 09:37:30 oleg434-client systemd-logind[1010]: Session 94 logged out. Waiting for processes to exit. Aug 15 09:37:30 oleg434-client systemd-logind[1010]: Removed session 94. Aug 15 09:37:31 oleg434-client kernel: Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request Aug 15 09:37:31 oleg434-client kernel: Lustre: lustre-OST0001-osc-ffff898e829ef800: Connection to lustre-OST0001 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:37:31 oleg434-client kernel: Lustre: Skipped 5 previous similar messages Aug 15 09:37:31 oleg434-client kernel: LustreError: lustre-OST0001-osc-ffff898e829ef800: This client was evicted by lustre-OST0001; in progress operations using this service will fail. Aug 15 09:37:32 oleg434-client sshd[22879]: Accepted publickey for root from 192.168.204.34 port 54446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:32 oleg434-client systemd-logind[1010]: New session 95 of user root. Aug 15 09:37:32 oleg434-client systemd[1]: Started Session 95 of user root. Aug 15 09:37:32 oleg434-client sshd[22879]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:32 oleg434-client sshd[22892]: Received disconnect from 192.168.204.34 port 54446:11: disconnected by user Aug 15 09:37:32 oleg434-client sshd[22892]: Disconnected from user root 192.168.204.34 port 54446 Aug 15 09:37:32 oleg434-client sshd[22879]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:32 oleg434-client systemd[1]: session-95.scope: Succeeded. Aug 15 09:37:32 oleg434-client systemd-logind[1010]: Session 95 logged out. Waiting for processes to exit. Aug 15 09:37:32 oleg434-client systemd-logind[1010]: Removed session 95. Aug 15 09:37:33 oleg434-client sshd[23019]: Accepted publickey for root from 192.168.204.34 port 54448 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:33 oleg434-client systemd-logind[1010]: New session 96 of user root. Aug 15 09:37:33 oleg434-client systemd[1]: Started Session 96 of user root. Aug 15 09:37:33 oleg434-client sshd[23019]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:34 oleg434-client sshd[23032]: Received disconnect from 192.168.204.34 port 54448:11: disconnected by user Aug 15 09:37:34 oleg434-client sshd[23032]: Disconnected from user root 192.168.204.34 port 54448 Aug 15 09:37:34 oleg434-client sshd[23019]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:34 oleg434-client systemd[1]: session-96.scope: Succeeded. Aug 15 09:37:34 oleg434-client systemd-logind[1010]: Session 96 logged out. Waiting for processes to exit. Aug 15 09:37:34 oleg434-client systemd-logind[1010]: Removed session 96. Aug 15 09:37:35 oleg434-client sshd[23165]: Accepted publickey for root from 192.168.204.34 port 34902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:35 oleg434-client systemd-logind[1010]: New session 97 of user root. Aug 15 09:37:35 oleg434-client systemd[1]: Started Session 97 of user root. Aug 15 09:37:35 oleg434-client sshd[23165]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:35 oleg434-client sshd[23178]: Received disconnect from 192.168.204.34 port 34902:11: disconnected by user Aug 15 09:37:35 oleg434-client sshd[23178]: Disconnected from user root 192.168.204.34 port 34902 Aug 15 09:37:36 oleg434-client sshd[23165]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:36 oleg434-client systemd[1]: session-97.scope: Succeeded. Aug 15 09:37:36 oleg434-client systemd-logind[1010]: Session 97 logged out. Waiting for processes to exit. Aug 15 09:37:36 oleg434-client systemd-logind[1010]: Removed session 97. Aug 15 09:37:37 oleg434-client sshd[23320]: Accepted publickey for root from 192.168.204.34 port 34910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:37:37 oleg434-client systemd[1]: Started Session 98 of user root. Aug 15 09:37:37 oleg434-client systemd-logind[1010]: New session 98 of user root. Aug 15 09:37:37 oleg434-client sshd[23320]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:37:38 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18b: eviction and reconnect clears page cache (2766) ========================================================== 09:37:36 (1786801056) Aug 15 09:37:38 oleg434-client sshd[23333]: Received disconnect from 192.168.204.34 port 34910:11: disconnected by user Aug 15 09:37:38 oleg434-client sshd[23333]: Disconnected from user root 192.168.204.34 port 34910 Aug 15 09:37:38 oleg434-client sshd[23320]: pam_unix(sshd:session): session closed for user root Aug 15 09:37:38 oleg434-client systemd[1]: session-98.scope: Succeeded. Aug 15 09:37:38 oleg434-client systemd-logind[1010]: Session 98 logged out. Waiting for processes to exit. Aug 15 09:37:38 oleg434-client systemd-logind[1010]: Removed session 98. Aug 15 09:37:44 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Aug 15 09:37:44 oleg434-client kernel: Lustre: lustre-OST0000-osc-ffff898e829ef800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:37:44 oleg434-client kernel: Lustre: Skipped 4 previous similar messages Aug 15 09:38:03 oleg434-client sshd[23539]: Accepted publickey for root from 192.168.204.34 port 56510 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:03 oleg434-client systemd[1]: Started Session 99 of user root. Aug 15 09:38:03 oleg434-client systemd-logind[1010]: New session 99 of user root. Aug 15 09:38:03 oleg434-client sshd[23539]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:03 oleg434-client sshd[23552]: Received disconnect from 192.168.204.34 port 56510:11: disconnected by user Aug 15 09:38:03 oleg434-client sshd[23552]: Disconnected from user root 192.168.204.34 port 56510 Aug 15 09:38:03 oleg434-client sshd[23539]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:03 oleg434-client systemd-logind[1010]: Session 99 logged out. Waiting for processes to exit. Aug 15 09:38:03 oleg434-client systemd[1]: session-99.scope: Succeeded. Aug 15 09:38:03 oleg434-client systemd-logind[1010]: Removed session 99. Aug 15 09:38:05 oleg434-client sshd[23678]: Accepted publickey for root from 192.168.204.34 port 53466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:05 oleg434-client systemd-logind[1010]: New session 100 of user root. Aug 15 09:38:05 oleg434-client systemd[1]: Started Session 100 of user root. Aug 15 09:38:05 oleg434-client sshd[23678]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:05 oleg434-client sshd[23691]: Received disconnect from 192.168.204.34 port 53466:11: disconnected by user Aug 15 09:38:05 oleg434-client sshd[23691]: Disconnected from user root 192.168.204.34 port 53466 Aug 15 09:38:05 oleg434-client sshd[23678]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:05 oleg434-client systemd-logind[1010]: Session 100 logged out. Waiting for processes to exit. Aug 15 09:38:05 oleg434-client systemd[1]: session-100.scope: Succeeded. Aug 15 09:38:05 oleg434-client systemd-logind[1010]: Removed session 100. Aug 15 09:38:06 oleg434-client sshd[23824]: Accepted publickey for root from 192.168.204.34 port 53472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:06 oleg434-client systemd-logind[1010]: New session 101 of user root. Aug 15 09:38:06 oleg434-client systemd[1]: Started Session 101 of user root. Aug 15 09:38:06 oleg434-client sshd[23824]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:06 oleg434-client sshd[23837]: Received disconnect from 192.168.204.34 port 53472:11: disconnected by user Aug 15 09:38:06 oleg434-client sshd[23837]: Disconnected from user root 192.168.204.34 port 53472 Aug 15 09:38:06 oleg434-client sshd[23824]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:06 oleg434-client systemd-logind[1010]: Session 101 logged out. Waiting for processes to exit. Aug 15 09:38:06 oleg434-client systemd[1]: session-101.scope: Succeeded. Aug 15 09:38:06 oleg434-client systemd-logind[1010]: Removed session 101. Aug 15 09:38:08 oleg434-client sshd[23980]: Accepted publickey for root from 192.168.204.34 port 53488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:08 oleg434-client systemd-logind[1010]: New session 102 of user root. Aug 15 09:38:08 oleg434-client systemd[1]: Started Session 102 of user root. Aug 15 09:38:08 oleg434-client sshd[23980]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:08 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18c: Dropped connect reply after eviction handing (14755) ========================================================== 09:38:07 (1786801087) Aug 15 09:38:08 oleg434-client sshd[23993]: Received disconnect from 192.168.204.34 port 53488:11: disconnected by user Aug 15 09:38:08 oleg434-client sshd[23993]: Disconnected from user root 192.168.204.34 port 53488 Aug 15 09:38:08 oleg434-client sshd[23980]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:08 oleg434-client systemd-logind[1010]: Session 102 logged out. Waiting for processes to exit. Aug 15 09:38:08 oleg434-client systemd[1]: session-102.scope: Succeeded. Aug 15 09:38:08 oleg434-client systemd-logind[1010]: Removed session 102. Aug 15 09:38:10 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Aug 15 09:38:25 oleg434-client sshd[24206]: Accepted publickey for root from 192.168.204.34 port 42354 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:25 oleg434-client systemd-logind[1010]: New session 103 of user root. Aug 15 09:38:25 oleg434-client systemd[1]: Started Session 103 of user root. Aug 15 09:38:25 oleg434-client sshd[24206]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:26 oleg434-client sshd[24219]: Received disconnect from 192.168.204.34 port 42354:11: disconnected by user Aug 15 09:38:26 oleg434-client sshd[24219]: Disconnected from user root 192.168.204.34 port 42354 Aug 15 09:38:26 oleg434-client sshd[24206]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:26 oleg434-client systemd[1]: session-103.scope: Succeeded. Aug 15 09:38:26 oleg434-client systemd-logind[1010]: Session 103 logged out. Waiting for processes to exit. Aug 15 09:38:26 oleg434-client systemd-logind[1010]: Removed session 103. Aug 15 09:38:28 oleg434-client sshd[24345]: Accepted publickey for root from 192.168.204.34 port 42364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:28 oleg434-client systemd[1]: Started Session 104 of user root. Aug 15 09:38:28 oleg434-client systemd-logind[1010]: New session 104 of user root. Aug 15 09:38:28 oleg434-client sshd[24345]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:28 oleg434-client sshd[24358]: Received disconnect from 192.168.204.34 port 42364:11: disconnected by user Aug 15 09:38:28 oleg434-client sshd[24358]: Disconnected from user root 192.168.204.34 port 42364 Aug 15 09:38:28 oleg434-client sshd[24345]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:28 oleg434-client systemd[1]: session-104.scope: Succeeded. Aug 15 09:38:28 oleg434-client systemd-logind[1010]: Session 104 logged out. Waiting for processes to exit. Aug 15 09:38:28 oleg434-client systemd-logind[1010]: Removed session 104. Aug 15 09:38:29 oleg434-client sshd[24492]: Accepted publickey for root from 192.168.204.34 port 42380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:29 oleg434-client systemd-logind[1010]: New session 105 of user root. Aug 15 09:38:29 oleg434-client systemd[1]: Started Session 105 of user root. Aug 15 09:38:29 oleg434-client sshd[24492]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:30 oleg434-client sshd[24505]: Received disconnect from 192.168.204.34 port 42380:11: disconnected by user Aug 15 09:38:30 oleg434-client sshd[24505]: Disconnected from user root 192.168.204.34 port 42380 Aug 15 09:38:30 oleg434-client sshd[24492]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:30 oleg434-client systemd-logind[1010]: Session 105 logged out. Waiting for processes to exit. Aug 15 09:38:30 oleg434-client systemd[1]: session-105.scope: Succeeded. Aug 15 09:38:30 oleg434-client systemd-logind[1010]: Removed session 105. Aug 15 09:38:31 oleg434-client sshd[24647]: Accepted publickey for root from 192.168.204.34 port 42382 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:38:31 oleg434-client systemd-logind[1010]: New session 106 of user root. Aug 15 09:38:31 oleg434-client systemd[1]: Started Session 106 of user root. Aug 15 09:38:31 oleg434-client sshd[24647]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:38:32 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19a: test expired_lock_main on mds (2867) ========================================================== 09:38:30 (1786801110) Aug 15 09:38:32 oleg434-client sshd[24660]: Received disconnect from 192.168.204.34 port 42382:11: disconnected by user Aug 15 09:38:32 oleg434-client sshd[24660]: Disconnected from user root 192.168.204.34 port 42382 Aug 15 09:38:32 oleg434-client sshd[24647]: pam_unix(sshd:session): session closed for user root Aug 15 09:38:32 oleg434-client systemd-logind[1010]: Session 106 logged out. Waiting for processes to exit. Aug 15 09:38:32 oleg434-client systemd[1]: session-106.scope: Succeeded. Aug 15 09:38:32 oleg434-client systemd-logind[1010]: Removed session 106. Aug 15 09:38:32 oleg434-client systemd-udevd[24716]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Aug 15 09:38:33 oleg434-client kernel: Lustre: Mounted lustre-client - version 2.17.57_1_g05abe65 Aug 15 09:38:33 oleg434-client kernel: Lustre: Skipped 1 previous similar message Aug 15 09:38:51 oleg434-client kernel: Lustre: 2390:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786801115/real 1786801115] req@ffff898ea8d2e680 x1873595690317312/t0(0) o103->lustre-MDT0000-mdc-ffff898e829ef800@192.168.204.134@tcp:17/18 lens 328/224 e 0 to 1 dl 1786801131 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 Aug 15 09:38:51 oleg434-client kernel: Lustre: 2390:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Aug 15 09:38:51 oleg434-client systemd[1]: Starting dnf makecache... Aug 15 09:38:58 oleg434-client dnf[24827]: Failed determining last makecache time. Aug 15 09:38:58 oleg434-client dnf[24827]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' Aug 15 09:38:58 oleg434-client dnf[24827]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' Aug 15 09:38:59 oleg434-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE Aug 15 09:38:59 oleg434-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. Aug 15 09:38:59 oleg434-client systemd[1]: Failed to start dnf makecache. Aug 15 09:40:19 oleg434-client kernel: LustreError: lustre-MDT0000-mdc-ffff898e829ef800: operation ldlm_enqueue to node 192.168.204.134@tcp failed: rc = -107 Aug 15 09:40:19 oleg434-client kernel: LustreError: lustre-MDT0000-mdc-ffff898e829ef800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Aug 15 09:40:19 oleg434-client kernel: LustreError: 24895:0:(file.c:6156:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 Aug 15 09:40:21 oleg434-client systemd[1]: mnt-lustre2.mount: Succeeded. Aug 15 09:40:21 oleg434-client kernel: Lustre: Unmounted lustre-client Aug 15 09:40:23 oleg434-client sshd[25013]: Accepted publickey for root from 192.168.204.34 port 57758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:40:23 oleg434-client systemd-logind[1010]: New session 107 of user root. Aug 15 09:40:23 oleg434-client systemd[1]: Started Session 107 of user root. Aug 15 09:40:23 oleg434-client sshd[25013]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:40:23 oleg434-client sshd[25026]: Received disconnect from 192.168.204.34 port 57758:11: disconnected by user Aug 15 09:40:23 oleg434-client sshd[25026]: Disconnected from user root 192.168.204.34 port 57758 Aug 15 09:40:24 oleg434-client sshd[25013]: pam_unix(sshd:session): session closed for user root Aug 15 09:40:24 oleg434-client systemd-logind[1010]: Session 107 logged out. Waiting for processes to exit. Aug 15 09:40:24 oleg434-client systemd[1]: session-107.scope: Succeeded. Aug 15 09:40:24 oleg434-client systemd-logind[1010]: Removed session 107. Aug 15 09:40:25 oleg434-client sshd[25152]: Accepted publickey for root from 192.168.204.34 port 49058 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:40:25 oleg434-client systemd-logind[1010]: New session 108 of user root. Aug 15 09:40:25 oleg434-client systemd[1]: Started Session 108 of user root. Aug 15 09:40:25 oleg434-client sshd[25152]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:40:26 oleg434-client sshd[25165]: Received disconnect from 192.168.204.34 port 49058:11: disconnected by user Aug 15 09:40:26 oleg434-client sshd[25165]: Disconnected from user root 192.168.204.34 port 49058 Aug 15 09:40:26 oleg434-client sshd[25152]: pam_unix(sshd:session): session closed for user root Aug 15 09:40:26 oleg434-client systemd[1]: session-108.scope: Succeeded. Aug 15 09:40:26 oleg434-client systemd-logind[1010]: Session 108 logged out. Waiting for processes to exit. Aug 15 09:40:26 oleg434-client systemd-logind[1010]: Removed session 108. Aug 15 09:40:27 oleg434-client sshd[25298]: Accepted publickey for root from 192.168.204.34 port 49074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:40:27 oleg434-client systemd-logind[1010]: New session 109 of user root. Aug 15 09:40:27 oleg434-client systemd[1]: Started Session 109 of user root. Aug 15 09:40:27 oleg434-client sshd[25298]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:40:27 oleg434-client sshd[25311]: Received disconnect from 192.168.204.34 port 49074:11: disconnected by user Aug 15 09:40:27 oleg434-client sshd[25311]: Disconnected from user root 192.168.204.34 port 49074 Aug 15 09:40:27 oleg434-client sshd[25298]: pam_unix(sshd:session): session closed for user root Aug 15 09:40:28 oleg434-client systemd-logind[1010]: Session 109 logged out. Waiting for processes to exit. Aug 15 09:40:28 oleg434-client systemd[1]: session-109.scope: Succeeded. Aug 15 09:40:28 oleg434-client systemd-logind[1010]: Removed session 109. Aug 15 09:40:29 oleg434-client sshd[25454]: Accepted publickey for root from 192.168.204.34 port 49082 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:40:29 oleg434-client systemd-logind[1010]: New session 110 of user root. Aug 15 09:40:29 oleg434-client systemd[1]: Started Session 110 of user root. Aug 15 09:40:29 oleg434-client sshd[25454]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:40:29 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19b: test expired_lock_main on ost (2867) ========================================================== 09:40:28 (1786801228) Aug 15 09:40:29 oleg434-client sshd[25467]: Received disconnect from 192.168.204.34 port 49082:11: disconnected by user Aug 15 09:40:29 oleg434-client sshd[25467]: Disconnected from user root 192.168.204.34 port 49082 Aug 15 09:40:29 oleg434-client sshd[25454]: pam_unix(sshd:session): session closed for user root Aug 15 09:40:29 oleg434-client systemd-logind[1010]: Session 110 logged out. Waiting for processes to exit. Aug 15 09:40:29 oleg434-client systemd[1]: session-110.scope: Succeeded. Aug 15 09:40:30 oleg434-client systemd-logind[1010]: Removed session 110. Aug 15 09:40:30 oleg434-client systemd-udevd[25520]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Aug 15 09:40:30 oleg434-client kernel: Lustre: Mounted lustre-client - version 2.17.57_1_g05abe65 Aug 15 09:42:19 oleg434-client kernel: LustreError: lustre-OST0001-osc-ffff898e829ef800: This client was evicted by lustre-OST0001; in progress operations using this service will fail. Aug 15 09:42:20 oleg434-client systemd[1]: mnt-lustre2.mount: Succeeded. Aug 15 09:42:20 oleg434-client kernel: Lustre: Unmounted lustre-client Aug 15 09:42:22 oleg434-client sshd[25810]: Accepted publickey for root from 192.168.204.34 port 33682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:22 oleg434-client systemd-logind[1010]: New session 111 of user root. Aug 15 09:42:22 oleg434-client systemd[1]: Started Session 111 of user root. Aug 15 09:42:22 oleg434-client sshd[25810]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:23 oleg434-client sshd[25823]: Received disconnect from 192.168.204.34 port 33682:11: disconnected by user Aug 15 09:42:23 oleg434-client sshd[25823]: Disconnected from user root 192.168.204.34 port 33682 Aug 15 09:42:23 oleg434-client sshd[25810]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:23 oleg434-client systemd[1]: session-111.scope: Succeeded. Aug 15 09:42:23 oleg434-client systemd-logind[1010]: Session 111 logged out. Waiting for processes to exit. Aug 15 09:42:23 oleg434-client systemd-logind[1010]: Removed session 111. Aug 15 09:42:25 oleg434-client sshd[25950]: Accepted publickey for root from 192.168.204.34 port 46392 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:25 oleg434-client systemd-logind[1010]: New session 112 of user root. Aug 15 09:42:25 oleg434-client systemd[1]: Started Session 112 of user root. Aug 15 09:42:25 oleg434-client sshd[25950]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:25 oleg434-client sshd[25963]: Received disconnect from 192.168.204.34 port 46392:11: disconnected by user Aug 15 09:42:25 oleg434-client sshd[25963]: Disconnected from user root 192.168.204.34 port 46392 Aug 15 09:42:25 oleg434-client sshd[25950]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:25 oleg434-client systemd[1]: session-112.scope: Succeeded. Aug 15 09:42:25 oleg434-client systemd-logind[1010]: Session 112 logged out. Waiting for processes to exit. Aug 15 09:42:25 oleg434-client systemd-logind[1010]: Removed session 112. Aug 15 09:42:27 oleg434-client sshd[26097]: Accepted publickey for root from 192.168.204.34 port 46404 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:27 oleg434-client systemd-logind[1010]: New session 113 of user root. Aug 15 09:42:27 oleg434-client systemd[1]: Started Session 113 of user root. Aug 15 09:42:27 oleg434-client sshd[26097]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:27 oleg434-client sshd[26110]: Received disconnect from 192.168.204.34 port 46404:11: disconnected by user Aug 15 09:42:27 oleg434-client sshd[26110]: Disconnected from user root 192.168.204.34 port 46404 Aug 15 09:42:27 oleg434-client sshd[26097]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:27 oleg434-client systemd[1]: session-113.scope: Succeeded. Aug 15 09:42:27 oleg434-client systemd-logind[1010]: Session 113 logged out. Waiting for processes to exit. Aug 15 09:42:27 oleg434-client systemd-logind[1010]: Removed session 113. Aug 15 09:42:28 oleg434-client sshd[26253]: Accepted publickey for root from 192.168.204.34 port 46410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:28 oleg434-client systemd-logind[1010]: New session 114 of user root. Aug 15 09:42:28 oleg434-client systemd[1]: Started Session 114 of user root. Aug 15 09:42:28 oleg434-client sshd[26253]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:29 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19c: check reconnect and lock resend do not trigger expired_lock_main ========================================================== 09:42:27 (1786801347) Aug 15 09:42:29 oleg434-client sshd[26266]: Received disconnect from 192.168.204.34 port 46410:11: disconnected by user Aug 15 09:42:29 oleg434-client sshd[26266]: Disconnected from user root 192.168.204.34 port 46410 Aug 15 09:42:29 oleg434-client sshd[26253]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:29 oleg434-client systemd[1]: session-114.scope: Succeeded. Aug 15 09:42:29 oleg434-client systemd-logind[1010]: Session 114 logged out. Waiting for processes to exit. Aug 15 09:42:29 oleg434-client systemd-logind[1010]: Removed session 114. Aug 15 09:42:29 oleg434-client systemd-udevd[26322]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Aug 15 09:42:29 oleg434-client kernel: Lustre: Mounted lustre-client - version 2.17.57_1_g05abe65 Aug 15 09:42:36 oleg434-client systemd[1]: mnt-lustre2.mount: Succeeded. Aug 15 09:42:36 oleg434-client kernel: Lustre: Unmounted lustre-client Aug 15 09:42:42 oleg434-client sshd[26470]: Accepted publickey for root from 192.168.204.34 port 54296 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:42 oleg434-client systemd-logind[1010]: New session 115 of user root. Aug 15 09:42:42 oleg434-client systemd[1]: Started Session 115 of user root. Aug 15 09:42:42 oleg434-client sshd[26470]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:43 oleg434-client sshd[26483]: Received disconnect from 192.168.204.34 port 54296:11: disconnected by user Aug 15 09:42:43 oleg434-client sshd[26483]: Disconnected from user root 192.168.204.34 port 54296 Aug 15 09:42:43 oleg434-client sshd[26470]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:43 oleg434-client systemd-logind[1010]: Session 115 logged out. Waiting for processes to exit. Aug 15 09:42:43 oleg434-client systemd[1]: session-115.scope: Succeeded. Aug 15 09:42:43 oleg434-client systemd-logind[1010]: Removed session 115. Aug 15 09:42:45 oleg434-client sshd[26609]: Accepted publickey for root from 192.168.204.34 port 51830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:45 oleg434-client systemd-logind[1010]: New session 116 of user root. Aug 15 09:42:45 oleg434-client systemd[1]: Started Session 116 of user root. Aug 15 09:42:45 oleg434-client sshd[26609]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:45 oleg434-client sshd[26622]: Received disconnect from 192.168.204.34 port 51830:11: disconnected by user Aug 15 09:42:45 oleg434-client sshd[26622]: Disconnected from user root 192.168.204.34 port 51830 Aug 15 09:42:45 oleg434-client sshd[26609]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:45 oleg434-client systemd[1]: session-116.scope: Succeeded. Aug 15 09:42:45 oleg434-client systemd-logind[1010]: Session 116 logged out. Waiting for processes to exit. Aug 15 09:42:45 oleg434-client systemd-logind[1010]: Removed session 116. Aug 15 09:42:46 oleg434-client sshd[26755]: Accepted publickey for root from 192.168.204.34 port 51844 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:47 oleg434-client systemd-logind[1010]: New session 117 of user root. Aug 15 09:42:47 oleg434-client systemd[1]: Started Session 117 of user root. Aug 15 09:42:47 oleg434-client sshd[26755]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:47 oleg434-client sshd[26768]: Received disconnect from 192.168.204.34 port 51844:11: disconnected by user Aug 15 09:42:47 oleg434-client sshd[26768]: Disconnected from user root 192.168.204.34 port 51844 Aug 15 09:42:47 oleg434-client sshd[26755]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:47 oleg434-client systemd[1]: session-117.scope: Succeeded. Aug 15 09:42:47 oleg434-client systemd-logind[1010]: Session 117 logged out. Waiting for processes to exit. Aug 15 09:42:47 oleg434-client systemd-logind[1010]: Removed session 117. Aug 15 09:42:48 oleg434-client sshd[26911]: Accepted publickey for root from 192.168.204.34 port 51860 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:48 oleg434-client systemd-logind[1010]: New session 118 of user root. Aug 15 09:42:48 oleg434-client systemd[1]: Started Session 118 of user root. Aug 15 09:42:48 oleg434-client sshd[26911]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:49 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20a: ldlm_handle_enqueue error (should return error) ========================================================== 09:42:47 (1786801367) Aug 15 09:42:49 oleg434-client sshd[26924]: Received disconnect from 192.168.204.34 port 51860:11: disconnected by user Aug 15 09:42:49 oleg434-client sshd[26924]: Disconnected from user root 192.168.204.34 port 51860 Aug 15 09:42:49 oleg434-client sshd[26911]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:49 oleg434-client systemd[1]: session-118.scope: Succeeded. Aug 15 09:42:49 oleg434-client systemd-logind[1010]: Session 118 logged out. Waiting for processes to exit. Aug 15 09:42:49 oleg434-client systemd-logind[1010]: Removed session 118. Aug 15 09:42:49 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 09:42:51 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: operation ldlm_enqueue to node 192.168.204.134@tcp failed: rc = -12 Aug 15 09:42:52 oleg434-client sshd[27095]: Accepted publickey for root from 192.168.204.34 port 51868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:52 oleg434-client systemd-logind[1010]: New session 119 of user root. Aug 15 09:42:52 oleg434-client systemd[1]: Started Session 119 of user root. Aug 15 09:42:52 oleg434-client sshd[27095]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:53 oleg434-client sshd[27108]: Received disconnect from 192.168.204.34 port 51868:11: disconnected by user Aug 15 09:42:53 oleg434-client sshd[27108]: Disconnected from user root 192.168.204.34 port 51868 Aug 15 09:42:53 oleg434-client sshd[27095]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:53 oleg434-client systemd[1]: session-119.scope: Succeeded. Aug 15 09:42:53 oleg434-client systemd-logind[1010]: Session 119 logged out. Waiting for processes to exit. Aug 15 09:42:53 oleg434-client systemd-logind[1010]: Removed session 119. Aug 15 09:42:54 oleg434-client sshd[27235]: Accepted publickey for root from 192.168.204.34 port 51880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:54 oleg434-client systemd-logind[1010]: New session 120 of user root. Aug 15 09:42:54 oleg434-client systemd[1]: Started Session 120 of user root. Aug 15 09:42:54 oleg434-client sshd[27235]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:55 oleg434-client sshd[27249]: Received disconnect from 192.168.204.34 port 51880:11: disconnected by user Aug 15 09:42:55 oleg434-client sshd[27249]: Disconnected from user root 192.168.204.34 port 51880 Aug 15 09:42:55 oleg434-client sshd[27235]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:55 oleg434-client systemd-logind[1010]: Session 120 logged out. Waiting for processes to exit. Aug 15 09:42:55 oleg434-client systemd[1]: session-120.scope: Succeeded. Aug 15 09:42:55 oleg434-client systemd-logind[1010]: Removed session 120. Aug 15 09:42:56 oleg434-client sshd[27382]: Accepted publickey for root from 192.168.204.34 port 53036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:56 oleg434-client systemd-logind[1010]: New session 121 of user root. Aug 15 09:42:56 oleg434-client systemd[1]: Started Session 121 of user root. Aug 15 09:42:56 oleg434-client sshd[27382]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:56 oleg434-client sshd[27395]: Received disconnect from 192.168.204.34 port 53036:11: disconnected by user Aug 15 09:42:56 oleg434-client sshd[27395]: Disconnected from user root 192.168.204.34 port 53036 Aug 15 09:42:56 oleg434-client sshd[27382]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:57 oleg434-client systemd[1]: session-121.scope: Succeeded. Aug 15 09:42:57 oleg434-client systemd-logind[1010]: Session 121 logged out. Waiting for processes to exit. Aug 15 09:42:57 oleg434-client systemd-logind[1010]: Removed session 121. Aug 15 09:42:58 oleg434-client sshd[27537]: Accepted publickey for root from 192.168.204.34 port 53038 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:42:58 oleg434-client systemd-logind[1010]: New session 122 of user root. Aug 15 09:42:58 oleg434-client systemd[1]: Started Session 122 of user root. Aug 15 09:42:58 oleg434-client sshd[27537]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:42:59 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20b: ldlm_handle_enqueue error (should return error) ========================================================== 09:42:57 (1786801377) Aug 15 09:42:59 oleg434-client sshd[27550]: Received disconnect from 192.168.204.34 port 53038:11: disconnected by user Aug 15 09:42:59 oleg434-client sshd[27550]: Disconnected from user root 192.168.204.34 port 53038 Aug 15 09:42:59 oleg434-client sshd[27537]: pam_unix(sshd:session): session closed for user root Aug 15 09:42:59 oleg434-client systemd[1]: session-122.scope: Succeeded. Aug 15 09:42:59 oleg434-client systemd-logind[1010]: Session 122 logged out. Waiting for processes to exit. Aug 15 09:42:59 oleg434-client systemd-logind[1010]: Removed session 122. Aug 15 09:43:00 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: operation ldlm_enqueue to node 192.168.204.134@tcp failed: rc = -12 Aug 15 09:43:02 oleg434-client sshd[27719]: Accepted publickey for root from 192.168.204.34 port 53048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:02 oleg434-client systemd[1]: Started Session 123 of user root. Aug 15 09:43:02 oleg434-client systemd-logind[1010]: New session 123 of user root. Aug 15 09:43:02 oleg434-client sshd[27719]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:02 oleg434-client sshd[27732]: Received disconnect from 192.168.204.34 port 53048:11: disconnected by user Aug 15 09:43:02 oleg434-client sshd[27732]: Disconnected from user root 192.168.204.34 port 53048 Aug 15 09:43:02 oleg434-client sshd[27719]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:02 oleg434-client systemd-logind[1010]: Session 123 logged out. Waiting for processes to exit. Aug 15 09:43:02 oleg434-client systemd[1]: session-123.scope: Succeeded. Aug 15 09:43:02 oleg434-client systemd-logind[1010]: Removed session 123. Aug 15 09:43:03 oleg434-client sshd[27858]: Accepted publickey for root from 192.168.204.34 port 53062 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:03 oleg434-client systemd-logind[1010]: New session 124 of user root. Aug 15 09:43:03 oleg434-client systemd[1]: Started Session 124 of user root. Aug 15 09:43:03 oleg434-client sshd[27858]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:04 oleg434-client sshd[27871]: Received disconnect from 192.168.204.34 port 53062:11: disconnected by user Aug 15 09:43:04 oleg434-client sshd[27871]: Disconnected from user root 192.168.204.34 port 53062 Aug 15 09:43:04 oleg434-client sshd[27858]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:04 oleg434-client systemd[1]: session-124.scope: Succeeded. Aug 15 09:43:04 oleg434-client systemd-logind[1010]: Session 124 logged out. Waiting for processes to exit. Aug 15 09:43:04 oleg434-client systemd-logind[1010]: Removed session 124. Aug 15 09:43:05 oleg434-client sshd[28004]: Accepted publickey for root from 192.168.204.34 port 45164 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:05 oleg434-client systemd[1]: Started Session 125 of user root. Aug 15 09:43:05 oleg434-client systemd-logind[1010]: New session 125 of user root. Aug 15 09:43:05 oleg434-client sshd[28004]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:06 oleg434-client sshd[28017]: Received disconnect from 192.168.204.34 port 45164:11: disconnected by user Aug 15 09:43:06 oleg434-client sshd[28017]: Disconnected from user root 192.168.204.34 port 45164 Aug 15 09:43:06 oleg434-client sshd[28004]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:06 oleg434-client systemd-logind[1010]: Session 125 logged out. Waiting for processes to exit. Aug 15 09:43:06 oleg434-client systemd[1]: session-125.scope: Succeeded. Aug 15 09:43:06 oleg434-client systemd-logind[1010]: Removed session 125. Aug 15 09:43:07 oleg434-client sshd[28159]: Accepted publickey for root from 192.168.204.34 port 45168 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:07 oleg434-client systemd-logind[1010]: New session 126 of user root. Aug 15 09:43:07 oleg434-client systemd[1]: Started Session 126 of user root. Aug 15 09:43:08 oleg434-client sshd[28159]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:08 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21a: drop close request while close and open are both in flight ========================================================== 09:43:06 (1786801386) Aug 15 09:43:08 oleg434-client sshd[28172]: Received disconnect from 192.168.204.34 port 45168:11: disconnected by user Aug 15 09:43:08 oleg434-client sshd[28172]: Disconnected from user root 192.168.204.34 port 45168 Aug 15 09:43:08 oleg434-client sshd[28159]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:08 oleg434-client systemd[1]: session-126.scope: Succeeded. Aug 15 09:43:08 oleg434-client systemd-logind[1010]: Session 126 logged out. Waiting for processes to exit. Aug 15 09:43:08 oleg434-client systemd-logind[1010]: Removed session 126. Aug 15 09:43:32 oleg434-client sshd[28346]: Accepted publickey for root from 192.168.204.34 port 35310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:32 oleg434-client systemd-logind[1010]: New session 127 of user root. Aug 15 09:43:32 oleg434-client systemd[1]: Started Session 127 of user root. Aug 15 09:43:32 oleg434-client sshd[28346]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:33 oleg434-client sshd[28359]: Received disconnect from 192.168.204.34 port 35310:11: disconnected by user Aug 15 09:43:33 oleg434-client sshd[28359]: Disconnected from user root 192.168.204.34 port 35310 Aug 15 09:43:33 oleg434-client sshd[28346]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:33 oleg434-client systemd-logind[1010]: Session 127 logged out. Waiting for processes to exit. Aug 15 09:43:33 oleg434-client systemd[1]: session-127.scope: Succeeded. Aug 15 09:43:33 oleg434-client systemd-logind[1010]: Removed session 127. Aug 15 09:43:34 oleg434-client sshd[28486]: Accepted publickey for root from 192.168.204.34 port 35326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:34 oleg434-client systemd-logind[1010]: New session 128 of user root. Aug 15 09:43:34 oleg434-client systemd[1]: Started Session 128 of user root. Aug 15 09:43:35 oleg434-client sshd[28486]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:35 oleg434-client sshd[28499]: Received disconnect from 192.168.204.34 port 35326:11: disconnected by user Aug 15 09:43:35 oleg434-client sshd[28499]: Disconnected from user root 192.168.204.34 port 35326 Aug 15 09:43:35 oleg434-client sshd[28486]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:35 oleg434-client systemd-logind[1010]: Session 128 logged out. Waiting for processes to exit. Aug 15 09:43:35 oleg434-client systemd[1]: session-128.scope: Succeeded. Aug 15 09:43:35 oleg434-client systemd-logind[1010]: Removed session 128. Aug 15 09:43:37 oleg434-client sshd[28632]: Accepted publickey for root from 192.168.204.34 port 37352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:37 oleg434-client systemd[1]: Started Session 129 of user root. Aug 15 09:43:37 oleg434-client systemd-logind[1010]: New session 129 of user root. Aug 15 09:43:37 oleg434-client sshd[28632]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:37 oleg434-client sshd[28645]: Received disconnect from 192.168.204.34 port 37352:11: disconnected by user Aug 15 09:43:37 oleg434-client sshd[28645]: Disconnected from user root 192.168.204.34 port 37352 Aug 15 09:43:37 oleg434-client sshd[28632]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:38 oleg434-client systemd-logind[1010]: Session 129 logged out. Waiting for processes to exit. Aug 15 09:43:38 oleg434-client systemd[1]: session-129.scope: Succeeded. Aug 15 09:43:38 oleg434-client systemd-logind[1010]: Removed session 129. Aug 15 09:43:39 oleg434-client sshd[28788]: Accepted publickey for root from 192.168.204.34 port 37366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:43:39 oleg434-client systemd[1]: Started Session 130 of user root. Aug 15 09:43:39 oleg434-client systemd-logind[1010]: New session 130 of user root. Aug 15 09:43:39 oleg434-client sshd[28788]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:43:40 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21b: drop open request while close and open are both in flight ========================================================== 09:43:38 (1786801418) Aug 15 09:43:40 oleg434-client sshd[28801]: Received disconnect from 192.168.204.34 port 37366:11: disconnected by user Aug 15 09:43:40 oleg434-client sshd[28801]: Disconnected from user root 192.168.204.34 port 37366 Aug 15 09:43:40 oleg434-client sshd[28788]: pam_unix(sshd:session): session closed for user root Aug 15 09:43:40 oleg434-client systemd[1]: session-130.scope: Succeeded. Aug 15 09:43:40 oleg434-client systemd-logind[1010]: Session 130 logged out. Waiting for processes to exit. Aug 15 09:43:40 oleg434-client systemd-logind[1010]: Removed session 130. Aug 15 09:46:00 oleg434-client sshd[28976]: Accepted publickey for root from 192.168.204.34 port 48146 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:00 oleg434-client systemd-logind[1010]: New session 131 of user root. Aug 15 09:46:00 oleg434-client systemd[1]: Started Session 131 of user root. Aug 15 09:46:00 oleg434-client sshd[28976]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:00 oleg434-client sshd[28989]: Received disconnect from 192.168.204.34 port 48146:11: disconnected by user Aug 15 09:46:00 oleg434-client sshd[28989]: Disconnected from user root 192.168.204.34 port 48146 Aug 15 09:46:00 oleg434-client sshd[28976]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:00 oleg434-client systemd[1]: session-131.scope: Succeeded. Aug 15 09:46:00 oleg434-client systemd-logind[1010]: Session 131 logged out. Waiting for processes to exit. Aug 15 09:46:00 oleg434-client systemd-logind[1010]: Removed session 131. Aug 15 09:46:02 oleg434-client sshd[29115]: Accepted publickey for root from 192.168.204.34 port 48156 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:03 oleg434-client systemd-logind[1010]: New session 132 of user root. Aug 15 09:46:03 oleg434-client systemd[1]: Started Session 132 of user root. Aug 15 09:46:03 oleg434-client sshd[29115]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:03 oleg434-client sshd[29128]: Received disconnect from 192.168.204.34 port 48156:11: disconnected by user Aug 15 09:46:03 oleg434-client sshd[29128]: Disconnected from user root 192.168.204.34 port 48156 Aug 15 09:46:03 oleg434-client sshd[29115]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:03 oleg434-client systemd-logind[1010]: Session 132 logged out. Waiting for processes to exit. Aug 15 09:46:03 oleg434-client systemd[1]: session-132.scope: Succeeded. Aug 15 09:46:03 oleg434-client systemd-logind[1010]: Removed session 132. Aug 15 09:46:04 oleg434-client sshd[29261]: Accepted publickey for root from 192.168.204.34 port 48170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:05 oleg434-client systemd[1]: Started Session 133 of user root. Aug 15 09:46:05 oleg434-client systemd-logind[1010]: New session 133 of user root. Aug 15 09:46:05 oleg434-client sshd[29261]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:05 oleg434-client sshd[29274]: Received disconnect from 192.168.204.34 port 48170:11: disconnected by user Aug 15 09:46:05 oleg434-client sshd[29274]: Disconnected from user root 192.168.204.34 port 48170 Aug 15 09:46:05 oleg434-client sshd[29261]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:05 oleg434-client systemd[1]: session-133.scope: Succeeded. Aug 15 09:46:05 oleg434-client systemd-logind[1010]: Session 133 logged out. Waiting for processes to exit. Aug 15 09:46:05 oleg434-client systemd-logind[1010]: Removed session 133. Aug 15 09:46:07 oleg434-client sshd[29417]: Accepted publickey for root from 192.168.204.34 port 39212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:07 oleg434-client systemd-logind[1010]: New session 134 of user root. Aug 15 09:46:07 oleg434-client systemd[1]: Started Session 134 of user root. Aug 15 09:46:07 oleg434-client sshd[29417]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:07 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21c: drop both request while close and open are both in flight ========================================================== 09:46:05 (1786801565) Aug 15 09:46:07 oleg434-client sshd[29430]: Received disconnect from 192.168.204.34 port 39212:11: disconnected by user Aug 15 09:46:07 oleg434-client sshd[29430]: Disconnected from user root 192.168.204.34 port 39212 Aug 15 09:46:07 oleg434-client sshd[29417]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:07 oleg434-client systemd[1]: session-134.scope: Succeeded. Aug 15 09:46:07 oleg434-client systemd-logind[1010]: Session 134 logged out. Waiting for processes to exit. Aug 15 09:46:07 oleg434-client systemd-logind[1010]: Removed session 134. Aug 15 09:46:30 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e829ef800: Connection to lustre-MDT0000 (at 192.168.204.134@tcp) was lost; in progress operations using this service will wait for recovery to complete Aug 15 09:46:30 oleg434-client kernel: Lustre: Skipped 18 previous similar messages Aug 15 09:46:30 oleg434-client kernel: Lustre: lustre-MDT0000-mdc-ffff898e829ef800: Connection restored to 192.168.204.134@tcp (at 192.168.204.134@tcp) Aug 15 09:46:30 oleg434-client kernel: Lustre: Skipped 16 previous similar messages Aug 15 09:46:33 oleg434-client sshd[29602]: Accepted publickey for root from 192.168.204.34 port 60902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:34 oleg434-client systemd[1]: Started Session 135 of user root. Aug 15 09:46:34 oleg434-client systemd-logind[1010]: New session 135 of user root. Aug 15 09:46:34 oleg434-client sshd[29602]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:34 oleg434-client sshd[29615]: Received disconnect from 192.168.204.34 port 60902:11: disconnected by user Aug 15 09:46:34 oleg434-client sshd[29615]: Disconnected from user root 192.168.204.34 port 60902 Aug 15 09:46:34 oleg434-client sshd[29602]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:34 oleg434-client systemd-logind[1010]: Session 135 logged out. Waiting for processes to exit. Aug 15 09:46:34 oleg434-client systemd[1]: session-135.scope: Succeeded. Aug 15 09:46:34 oleg434-client systemd-logind[1010]: Removed session 135. Aug 15 09:46:35 oleg434-client sshd[29742]: Accepted publickey for root from 192.168.204.34 port 58204 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:35 oleg434-client systemd-logind[1010]: New session 136 of user root. Aug 15 09:46:35 oleg434-client systemd[1]: Started Session 136 of user root. Aug 15 09:46:35 oleg434-client sshd[29742]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:36 oleg434-client sshd[29755]: Received disconnect from 192.168.204.34 port 58204:11: disconnected by user Aug 15 09:46:36 oleg434-client sshd[29755]: Disconnected from user root 192.168.204.34 port 58204 Aug 15 09:46:36 oleg434-client sshd[29742]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:36 oleg434-client systemd-logind[1010]: Session 136 logged out. Waiting for processes to exit. Aug 15 09:46:36 oleg434-client systemd[1]: session-136.scope: Succeeded. Aug 15 09:46:36 oleg434-client systemd-logind[1010]: Removed session 136. Aug 15 09:46:37 oleg434-client sshd[29888]: Accepted publickey for root from 192.168.204.34 port 58220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:38 oleg434-client systemd[1]: Started Session 137 of user root. Aug 15 09:46:38 oleg434-client systemd-logind[1010]: New session 137 of user root. Aug 15 09:46:38 oleg434-client sshd[29888]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:38 oleg434-client sshd[29901]: Received disconnect from 192.168.204.34 port 58220:11: disconnected by user Aug 15 09:46:38 oleg434-client sshd[29901]: Disconnected from user root 192.168.204.34 port 58220 Aug 15 09:46:38 oleg434-client sshd[29888]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:38 oleg434-client systemd-logind[1010]: Session 137 logged out. Waiting for processes to exit. Aug 15 09:46:38 oleg434-client systemd[1]: session-137.scope: Succeeded. Aug 15 09:46:38 oleg434-client systemd-logind[1010]: Removed session 137. Aug 15 09:46:40 oleg434-client sshd[30043]: Accepted publickey for root from 192.168.204.34 port 58232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:46:40 oleg434-client systemd-logind[1010]: New session 138 of user root. Aug 15 09:46:40 oleg434-client systemd[1]: Started Session 138 of user root. Aug 15 09:46:40 oleg434-client sshd[30043]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:46:40 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21d: drop close reply while close and open are both in flight ========================================================== 09:46:38 (1786801598) Aug 15 09:46:40 oleg434-client sshd[30056]: Received disconnect from 192.168.204.34 port 58232:11: disconnected by user Aug 15 09:46:40 oleg434-client sshd[30056]: Disconnected from user root 192.168.204.34 port 58232 Aug 15 09:46:40 oleg434-client sshd[30043]: pam_unix(sshd:session): session closed for user root Aug 15 09:46:40 oleg434-client systemd-logind[1010]: Session 138 logged out. Waiting for processes to exit. Aug 15 09:46:40 oleg434-client systemd[1]: session-138.scope: Succeeded. Aug 15 09:46:40 oleg434-client systemd-logind[1010]: Removed session 138. Aug 15 09:47:05 oleg434-client sshd[30229]: Accepted publickey for root from 192.168.204.34 port 53632 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:47:05 oleg434-client systemd-logind[1010]: New session 139 of user root. Aug 15 09:47:05 oleg434-client systemd[1]: Started Session 139 of user root. Aug 15 09:47:05 oleg434-client sshd[30229]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:47:05 oleg434-client sshd[30242]: Received disconnect from 192.168.204.34 port 53632:11: disconnected by user Aug 15 09:47:05 oleg434-client sshd[30242]: Disconnected from user root 192.168.204.34 port 53632 Aug 15 09:47:05 oleg434-client sshd[30229]: pam_unix(sshd:session): session closed for user root Aug 15 09:47:05 oleg434-client systemd[1]: session-139.scope: Succeeded. Aug 15 09:47:05 oleg434-client systemd-logind[1010]: Session 139 logged out. Waiting for processes to exit. Aug 15 09:47:05 oleg434-client systemd-logind[1010]: Removed session 139. Aug 15 09:47:07 oleg434-client sshd[30368]: Accepted publickey for root from 192.168.204.34 port 53638 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:47:07 oleg434-client systemd-logind[1010]: New session 140 of user root. Aug 15 09:47:07 oleg434-client systemd[1]: Started Session 140 of user root. Aug 15 09:47:07 oleg434-client sshd[30368]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:47:07 oleg434-client sshd[30381]: Received disconnect from 192.168.204.34 port 53638:11: disconnected by user Aug 15 09:47:07 oleg434-client sshd[30381]: Disconnected from user root 192.168.204.34 port 53638 Aug 15 09:47:07 oleg434-client sshd[30368]: pam_unix(sshd:session): session closed for user root Aug 15 09:47:07 oleg434-client systemd[1]: session-140.scope: Succeeded. Aug 15 09:47:07 oleg434-client systemd-logind[1010]: Session 140 logged out. Waiting for processes to exit. Aug 15 09:47:07 oleg434-client systemd-logind[1010]: Removed session 140. Aug 15 09:47:09 oleg434-client sshd[30515]: Accepted publickey for root from 192.168.204.34 port 53654 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:47:09 oleg434-client systemd-logind[1010]: New session 141 of user root. Aug 15 09:47:09 oleg434-client systemd[1]: Started Session 141 of user root. Aug 15 09:47:09 oleg434-client sshd[30515]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:47:09 oleg434-client sshd[30528]: Received disconnect from 192.168.204.34 port 53654:11: disconnected by user Aug 15 09:47:09 oleg434-client sshd[30528]: Disconnected from user root 192.168.204.34 port 53654 Aug 15 09:47:09 oleg434-client sshd[30515]: pam_unix(sshd:session): session closed for user root Aug 15 09:47:09 oleg434-client systemd[1]: session-141.scope: Succeeded. Aug 15 09:47:09 oleg434-client systemd-logind[1010]: Session 141 logged out. Waiting for processes to exit. Aug 15 09:47:09 oleg434-client systemd-logind[1010]: Removed session 141. Aug 15 09:47:11 oleg434-client sshd[30670]: Accepted publickey for root from 192.168.204.34 port 53656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:47:11 oleg434-client systemd[1]: Started Session 142 of user root. Aug 15 09:47:11 oleg434-client systemd-logind[1010]: New session 142 of user root. Aug 15 09:47:11 oleg434-client sshd[30670]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:47:12 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21e: drop open reply while close and open are both in flight ========================================================== 09:47:10 (1786801630) Aug 15 09:47:12 oleg434-client sshd[30683]: Received disconnect from 192.168.204.34 port 53656:11: disconnected by user Aug 15 09:47:12 oleg434-client sshd[30683]: Disconnected from user root 192.168.204.34 port 53656 Aug 15 09:47:12 oleg434-client sshd[30670]: pam_unix(sshd:session): session closed for user root Aug 15 09:47:12 oleg434-client systemd-logind[1010]: Session 142 logged out. Waiting for processes to exit. Aug 15 09:47:12 oleg434-client systemd[1]: session-142.scope: Succeeded. Aug 15 09:47:12 oleg434-client systemd-logind[1010]: Removed session 142. Aug 15 09:47:36 oleg434-client sshd[30839]: Accepted publickey for root from 192.168.204.34 port 58696 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:47:36 oleg434-client systemd-logind[1010]: New session 143 of user root. Aug 15 09:47:36 oleg434-client systemd[1]: Started Session 143 of user root. Aug 15 09:47:36 oleg434-client sshd[30839]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:47:37 oleg434-client sshd[30853]: Received disconnect from 192.168.204.34 port 58696:11: disconnected by user Aug 15 09:47:37 oleg434-client sshd[30853]: Disconnected from user root 192.168.204.34 port 58696 Aug 15 09:47:37 oleg434-client sshd[30839]: pam_unix(sshd:session): session closed for user root Aug 15 09:47:37 oleg434-client systemd-logind[1010]: Session 143 logged out. Waiting for processes to exit. Aug 15 09:47:37 oleg434-client systemd[1]: session-143.scope: Succeeded. Aug 15 09:47:37 oleg434-client systemd-logind[1010]: Removed session 143. Aug 15 09:47:39 oleg434-client sshd[30979]: Accepted publickey for root from 192.168.204.34 port 58700 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:47:39 oleg434-client systemd-logind[1010]: New session 144 of user root. Aug 15 09:47:39 oleg434-client systemd[1]: Started Session 144 of user root. Aug 15 09:47:39 oleg434-client sshd[30979]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:47:39 oleg434-client sshd[30992]: Received disconnect from 192.168.204.34 port 58700:11: disconnected by user Aug 15 09:47:39 oleg434-client sshd[30992]: Disconnected from user root 192.168.204.34 port 58700 Aug 15 09:47:39 oleg434-client sshd[30979]: pam_unix(sshd:session): session closed for user root Aug 15 09:47:39 oleg434-client systemd-logind[1010]: Session 144 logged out. Waiting for processes to exit. Aug 15 09:47:39 oleg434-client systemd[1]: session-144.scope: Succeeded. Aug 15 09:47:39 oleg434-client systemd-logind[1010]: Removed session 144. Aug 15 09:47:41 oleg434-client sshd[31126]: Accepted publickey for root from 192.168.204.34 port 58704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:47:41 oleg434-client systemd[1]: Started Session 145 of user root. Aug 15 09:47:41 oleg434-client systemd-logind[1010]: New session 145 of user root. Aug 15 09:47:41 oleg434-client sshd[31126]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:47:41 oleg434-client sshd[31139]: Received disconnect from 192.168.204.34 port 58704:11: disconnected by user Aug 15 09:47:41 oleg434-client sshd[31139]: Disconnected from user root 192.168.204.34 port 58704 Aug 15 09:47:41 oleg434-client sshd[31126]: pam_unix(sshd:session): session closed for user root Aug 15 09:47:41 oleg434-client systemd[1]: session-145.scope: Succeeded. Aug 15 09:47:41 oleg434-client systemd-logind[1010]: Session 145 logged out. Waiting for processes to exit. Aug 15 09:47:41 oleg434-client systemd-logind[1010]: Removed session 145. Aug 15 09:49:30 oleg434-client kernel: Lustre: 30731:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786801633/real 1786801633] req@ffff898ea8d2f480 x1873595690452864/t0(0) o36->lustre-MDT0000-mdc-ffff898e829ef800@192.168.204.134@tcp:12/10 lens 488/512 e 0 to 1 dl 1786801770 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 Aug 15 09:49:30 oleg434-client kernel: Lustre: 30731:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 15 previous similar messages Aug 15 09:49:32 oleg434-client sshd[31298]: Accepted publickey for root from 192.168.204.34 port 48586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:49:32 oleg434-client systemd[1]: Started Session 146 of user root. Aug 15 09:49:32 oleg434-client systemd-logind[1010]: New session 146 of user root. Aug 15 09:49:32 oleg434-client sshd[31298]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:49:32 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21f: drop both reply while close and open are both in flight ========================================================== 09:49:31 (1786801771) Aug 15 09:49:32 oleg434-client sshd[31311]: Received disconnect from 192.168.204.34 port 48586:11: disconnected by user Aug 15 09:49:32 oleg434-client sshd[31311]: Disconnected from user root 192.168.204.34 port 48586 Aug 15 09:49:32 oleg434-client sshd[31298]: pam_unix(sshd:session): session closed for user root Aug 15 09:49:32 oleg434-client systemd[1]: session-146.scope: Succeeded. Aug 15 09:49:32 oleg434-client systemd-logind[1010]: Session 146 logged out. Waiting for processes to exit. Aug 15 09:49:32 oleg434-client systemd-logind[1010]: Removed session 146. Aug 15 09:49:55 oleg434-client sshd[31483]: Accepted publickey for root from 192.168.204.34 port 35976 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:49:55 oleg434-client systemd-logind[1010]: New session 147 of user root. Aug 15 09:49:55 oleg434-client systemd[1]: Started Session 147 of user root. Aug 15 09:49:55 oleg434-client sshd[31483]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:49:55 oleg434-client sshd[31496]: Received disconnect from 192.168.204.34 port 35976:11: disconnected by user Aug 15 09:49:55 oleg434-client sshd[31496]: Disconnected from user root 192.168.204.34 port 35976 Aug 15 09:49:55 oleg434-client sshd[31483]: pam_unix(sshd:session): session closed for user root Aug 15 09:49:55 oleg434-client systemd[1]: session-147.scope: Succeeded. Aug 15 09:49:56 oleg434-client systemd-logind[1010]: Session 147 logged out. Waiting for processes to exit. Aug 15 09:49:56 oleg434-client systemd-logind[1010]: Removed session 147. Aug 15 09:49:56 oleg434-client sshd[31622]: Accepted publickey for root from 192.168.204.34 port 35988 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:49:56 oleg434-client systemd[1]: Started Session 148 of user root. Aug 15 09:49:56 oleg434-client systemd-logind[1010]: New session 148 of user root. Aug 15 09:49:56 oleg434-client sshd[31622]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:49:57 oleg434-client sshd[31635]: Received disconnect from 192.168.204.34 port 35988:11: disconnected by user Aug 15 09:49:57 oleg434-client sshd[31635]: Disconnected from user root 192.168.204.34 port 35988 Aug 15 09:49:57 oleg434-client sshd[31622]: pam_unix(sshd:session): session closed for user root Aug 15 09:49:57 oleg434-client systemd[1]: session-148.scope: Succeeded. Aug 15 09:49:57 oleg434-client systemd-logind[1010]: Session 148 logged out. Waiting for processes to exit. Aug 15 09:49:57 oleg434-client systemd-logind[1010]: Removed session 148. Aug 15 09:49:58 oleg434-client sshd[31769]: Accepted publickey for root from 192.168.204.34 port 35994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:49:58 oleg434-client systemd-logind[1010]: New session 149 of user root. Aug 15 09:49:58 oleg434-client systemd[1]: Started Session 149 of user root. Aug 15 09:49:58 oleg434-client sshd[31769]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:49:58 oleg434-client sshd[31782]: Received disconnect from 192.168.204.34 port 35994:11: disconnected by user Aug 15 09:49:58 oleg434-client sshd[31782]: Disconnected from user root 192.168.204.34 port 35994 Aug 15 09:49:58 oleg434-client sshd[31769]: pam_unix(sshd:session): session closed for user root Aug 15 09:49:58 oleg434-client systemd[1]: session-149.scope: Succeeded. Aug 15 09:49:58 oleg434-client systemd-logind[1010]: Session 149 logged out. Waiting for processes to exit. Aug 15 09:49:58 oleg434-client systemd-logind[1010]: Removed session 149. Aug 15 09:49:59 oleg434-client sshd[31924]: Accepted publickey for root from 192.168.204.34 port 36010 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:00 oleg434-client systemd-logind[1010]: New session 150 of user root. Aug 15 09:50:00 oleg434-client systemd[1]: Started Session 150 of user root. Aug 15 09:50:00 oleg434-client sshd[31924]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:00 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21g: drop open reply and close request while close and open are both in flight ========================================================== 09:49:59 (1786801799) Aug 15 09:50:00 oleg434-client sshd[31937]: Received disconnect from 192.168.204.34 port 36010:11: disconnected by user Aug 15 09:50:00 oleg434-client sshd[31937]: Disconnected from user root 192.168.204.34 port 36010 Aug 15 09:50:00 oleg434-client sshd[31924]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:00 oleg434-client systemd-logind[1010]: Session 150 logged out. Waiting for processes to exit. Aug 15 09:50:00 oleg434-client systemd[1]: session-150.scope: Succeeded. Aug 15 09:50:00 oleg434-client systemd-logind[1010]: Removed session 150. Aug 15 09:50:21 oleg434-client sshd[32110]: Accepted publickey for root from 192.168.204.34 port 38422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:21 oleg434-client systemd-logind[1010]: New session 151 of user root. Aug 15 09:50:21 oleg434-client systemd[1]: Started Session 151 of user root. Aug 15 09:50:22 oleg434-client sshd[32110]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:22 oleg434-client sshd[32123]: Received disconnect from 192.168.204.34 port 38422:11: disconnected by user Aug 15 09:50:22 oleg434-client sshd[32123]: Disconnected from user root 192.168.204.34 port 38422 Aug 15 09:50:22 oleg434-client sshd[32110]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:22 oleg434-client systemd[1]: session-151.scope: Succeeded. Aug 15 09:50:22 oleg434-client systemd-logind[1010]: Session 151 logged out. Waiting for processes to exit. Aug 15 09:50:22 oleg434-client systemd-logind[1010]: Removed session 151. Aug 15 09:50:23 oleg434-client sshd[32249]: Accepted publickey for root from 192.168.204.34 port 38430 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:23 oleg434-client systemd[1]: Started Session 152 of user root. Aug 15 09:50:23 oleg434-client systemd-logind[1010]: New session 152 of user root. Aug 15 09:50:23 oleg434-client sshd[32249]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:23 oleg434-client sshd[32262]: Received disconnect from 192.168.204.34 port 38430:11: disconnected by user Aug 15 09:50:23 oleg434-client sshd[32262]: Disconnected from user root 192.168.204.34 port 38430 Aug 15 09:50:23 oleg434-client sshd[32249]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:24 oleg434-client systemd[1]: session-152.scope: Succeeded. Aug 15 09:50:24 oleg434-client systemd-logind[1010]: Session 152 logged out. Waiting for processes to exit. Aug 15 09:50:24 oleg434-client systemd-logind[1010]: Removed session 152. Aug 15 09:50:24 oleg434-client sshd[32396]: Accepted publickey for root from 192.168.204.34 port 38434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:25 oleg434-client systemd-logind[1010]: New session 153 of user root. Aug 15 09:50:25 oleg434-client systemd[1]: Started Session 153 of user root. Aug 15 09:50:25 oleg434-client sshd[32396]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:25 oleg434-client sshd[32409]: Received disconnect from 192.168.204.34 port 38434:11: disconnected by user Aug 15 09:50:25 oleg434-client sshd[32409]: Disconnected from user root 192.168.204.34 port 38434 Aug 15 09:50:25 oleg434-client sshd[32396]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:25 oleg434-client systemd[1]: session-153.scope: Succeeded. Aug 15 09:50:25 oleg434-client systemd-logind[1010]: Session 153 logged out. Waiting for processes to exit. Aug 15 09:50:25 oleg434-client systemd-logind[1010]: Removed session 153. Aug 15 09:50:26 oleg434-client sshd[32551]: Accepted publickey for root from 192.168.204.34 port 58310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:26 oleg434-client systemd-logind[1010]: New session 154 of user root. Aug 15 09:50:26 oleg434-client systemd[1]: Started Session 154 of user root. Aug 15 09:50:26 oleg434-client sshd[32551]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:27 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21h: drop open request and close reply while close and open are both in flight ========================================================== 09:50:25 (1786801825) Aug 15 09:50:27 oleg434-client sshd[32564]: Received disconnect from 192.168.204.34 port 58310:11: disconnected by user Aug 15 09:50:27 oleg434-client sshd[32564]: Disconnected from user root 192.168.204.34 port 58310 Aug 15 09:50:27 oleg434-client sshd[32551]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:27 oleg434-client systemd-logind[1010]: Session 154 logged out. Waiting for processes to exit. Aug 15 09:50:27 oleg434-client systemd[1]: session-154.scope: Succeeded. Aug 15 09:50:27 oleg434-client systemd-logind[1010]: Removed session 154. Aug 15 09:50:47 oleg434-client sshd[32736]: Accepted publickey for root from 192.168.204.34 port 36004 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:47 oleg434-client systemd[1]: Started Session 155 of user root. Aug 15 09:50:47 oleg434-client systemd-logind[1010]: New session 155 of user root. Aug 15 09:50:47 oleg434-client sshd[32736]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:47 oleg434-client sshd[32749]: Received disconnect from 192.168.204.34 port 36004:11: disconnected by user Aug 15 09:50:47 oleg434-client sshd[32749]: Disconnected from user root 192.168.204.34 port 36004 Aug 15 09:50:47 oleg434-client sshd[32736]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:47 oleg434-client systemd-logind[1010]: Session 155 logged out. Waiting for processes to exit. Aug 15 09:50:47 oleg434-client systemd[1]: session-155.scope: Succeeded. Aug 15 09:50:47 oleg434-client systemd-logind[1010]: Removed session 155. Aug 15 09:50:48 oleg434-client sshd[32875]: Accepted publickey for root from 192.168.204.34 port 36006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:49 oleg434-client systemd-logind[1010]: New session 156 of user root. Aug 15 09:50:49 oleg434-client systemd[1]: Started Session 156 of user root. Aug 15 09:50:49 oleg434-client sshd[32875]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:49 oleg434-client sshd[32888]: Received disconnect from 192.168.204.34 port 36006:11: disconnected by user Aug 15 09:50:49 oleg434-client sshd[32888]: Disconnected from user root 192.168.204.34 port 36006 Aug 15 09:50:49 oleg434-client sshd[32875]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:49 oleg434-client systemd[1]: session-156.scope: Succeeded. Aug 15 09:50:49 oleg434-client systemd-logind[1010]: Session 156 logged out. Waiting for processes to exit. Aug 15 09:50:49 oleg434-client systemd-logind[1010]: Removed session 156. Aug 15 09:50:50 oleg434-client sshd[33021]: Accepted publickey for root from 192.168.204.34 port 36008 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:50 oleg434-client systemd-logind[1010]: New session 157 of user root. Aug 15 09:50:50 oleg434-client systemd[1]: Started Session 157 of user root. Aug 15 09:50:50 oleg434-client sshd[33021]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:50 oleg434-client sshd[33034]: Received disconnect from 192.168.204.34 port 36008:11: disconnected by user Aug 15 09:50:50 oleg434-client sshd[33034]: Disconnected from user root 192.168.204.34 port 36008 Aug 15 09:50:50 oleg434-client sshd[33021]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:51 oleg434-client systemd-logind[1010]: Session 157 logged out. Waiting for processes to exit. Aug 15 09:50:51 oleg434-client systemd[1]: session-157.scope: Succeeded. Aug 15 09:50:51 oleg434-client systemd-logind[1010]: Removed session 157. Aug 15 09:50:52 oleg434-client sshd[33177]: Accepted publickey for root from 192.168.204.34 port 36024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:50:52 oleg434-client systemd[1]: Started Session 158 of user root. Aug 15 09:50:52 oleg434-client systemd-logind[1010]: New session 158 of user root. Aug 15 09:50:52 oleg434-client sshd[33177]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:50:53 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 22: drop close request and do mknod ========================================================== 09:50:51 (1786801851) Aug 15 09:50:53 oleg434-client sshd[33190]: Received disconnect from 192.168.204.34 port 36024:11: disconnected by user Aug 15 09:50:53 oleg434-client sshd[33190]: Disconnected from user root 192.168.204.34 port 36024 Aug 15 09:50:53 oleg434-client sshd[33177]: pam_unix(sshd:session): session closed for user root Aug 15 09:50:53 oleg434-client systemd[1]: session-158.scope: Succeeded. Aug 15 09:50:53 oleg434-client systemd-logind[1010]: Session 158 logged out. Waiting for processes to exit. Aug 15 09:50:53 oleg434-client systemd-logind[1010]: Removed session 158. Aug 15 09:51:12 oleg434-client sshd[33342]: Accepted publickey for root from 192.168.204.34 port 36084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:51:12 oleg434-client systemd[1]: Started Session 159 of user root. Aug 15 09:51:12 oleg434-client systemd-logind[1010]: New session 159 of user root. Aug 15 09:51:12 oleg434-client sshd[33342]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:51:12 oleg434-client sshd[33355]: Received disconnect from 192.168.204.34 port 36084:11: disconnected by user Aug 15 09:51:12 oleg434-client sshd[33355]: Disconnected from user root 192.168.204.34 port 36084 Aug 15 09:51:12 oleg434-client sshd[33342]: pam_unix(sshd:session): session closed for user root Aug 15 09:51:12 oleg434-client systemd-logind[1010]: Session 159 logged out. Waiting for processes to exit. Aug 15 09:51:12 oleg434-client systemd[1]: session-159.scope: Succeeded. Aug 15 09:51:12 oleg434-client systemd-logind[1010]: Removed session 159. Aug 15 09:51:14 oleg434-client sshd[33482]: Accepted publickey for root from 192.168.204.34 port 36090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:51:14 oleg434-client systemd-logind[1010]: New session 160 of user root. Aug 15 09:51:14 oleg434-client systemd[1]: Started Session 160 of user root. Aug 15 09:51:14 oleg434-client sshd[33482]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:51:15 oleg434-client sshd[33495]: Received disconnect from 192.168.204.34 port 36090:11: disconnected by user Aug 15 09:51:15 oleg434-client sshd[33495]: Disconnected from user root 192.168.204.34 port 36090 Aug 15 09:51:15 oleg434-client sshd[33482]: pam_unix(sshd:session): session closed for user root Aug 15 09:51:15 oleg434-client systemd[1]: session-160.scope: Succeeded. Aug 15 09:51:15 oleg434-client systemd-logind[1010]: Session 160 logged out. Waiting for processes to exit. Aug 15 09:51:15 oleg434-client systemd-logind[1010]: Removed session 160. Aug 15 09:51:16 oleg434-client sshd[33628]: Accepted publickey for root from 192.168.204.34 port 60522 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:51:16 oleg434-client systemd-logind[1010]: New session 161 of user root. Aug 15 09:51:16 oleg434-client systemd[1]: Started Session 161 of user root. Aug 15 09:51:16 oleg434-client sshd[33628]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:51:16 oleg434-client sshd[33641]: Received disconnect from 192.168.204.34 port 60522:11: disconnected by user Aug 15 09:51:16 oleg434-client sshd[33641]: Disconnected from user root 192.168.204.34 port 60522 Aug 15 09:51:16 oleg434-client sshd[33628]: pam_unix(sshd:session): session closed for user root Aug 15 09:51:16 oleg434-client systemd-logind[1010]: Session 161 logged out. Waiting for processes to exit. Aug 15 09:51:16 oleg434-client systemd[1]: session-161.scope: Succeeded. Aug 15 09:51:16 oleg434-client systemd-logind[1010]: Removed session 161. Aug 15 09:51:17 oleg434-client sshd[33783]: Accepted publickey for root from 192.168.204.34 port 60528 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:51:17 oleg434-client systemd-logind[1010]: New session 162 of user root. Aug 15 09:51:17 oleg434-client systemd[1]: Started Session 162 of user root. Aug 15 09:51:17 oleg434-client sshd[33783]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:51:18 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 23: client hang when close a file after mds crash ========================================================== 09:51:16 (1786801876) Aug 15 09:51:18 oleg434-client sshd[33797]: Received disconnect from 192.168.204.34 port 60528:11: disconnected by user Aug 15 09:51:18 oleg434-client sshd[33797]: Disconnected from user root 192.168.204.34 port 60528 Aug 15 09:51:18 oleg434-client sshd[33783]: pam_unix(sshd:session): session closed for user root Aug 15 09:51:18 oleg434-client systemd[1]: session-162.scope: Succeeded. Aug 15 09:51:18 oleg434-client systemd-logind[1010]: Session 162 logged out. Waiting for processes to exit. Aug 15 09:51:18 oleg434-client systemd-logind[1010]: Removed session 162. Aug 15 09:51:47 oleg434-client kernel: LustreError: MGC192.168.204.134@tcp: Connection to MGS (at 192.168.204.134@tcp) was lost; in progress operations using this service will fail Aug 15 09:51:47 oleg434-client kernel: Lustre: Evicted from MGS (at 192.168.204.134@tcp) after server handle changed from 0xf004fe7c74fa1190 to 0xf004fe7c74fa3809 Aug 15 09:51:49 oleg434-client kernel: Lustre: 16817:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.204.134@tcp: IR log lustre-cliir failed, not fatal: rc = -2 Aug 15 09:52:04 oleg434-client sshd[34129]: Accepted publickey for root from 192.168.204.34 port 38422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:04 oleg434-client systemd-logind[1010]: New session 163 of user root. Aug 15 09:52:04 oleg434-client systemd[1]: Started Session 163 of user root. Aug 15 09:52:04 oleg434-client sshd[34129]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:04 oleg434-client sshd[34142]: Received disconnect from 192.168.204.34 port 38422:11: disconnected by user Aug 15 09:52:04 oleg434-client sshd[34142]: Disconnected from user root 192.168.204.34 port 38422 Aug 15 09:52:04 oleg434-client sshd[34129]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:04 oleg434-client systemd[1]: session-163.scope: Succeeded. Aug 15 09:52:04 oleg434-client systemd-logind[1010]: Session 163 logged out. Waiting for processes to exit. Aug 15 09:52:04 oleg434-client systemd-logind[1010]: Removed session 163. Aug 15 09:52:10 oleg434-client sshd[34394]: Accepted publickey for root from 192.168.204.34 port 46090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:10 oleg434-client systemd-logind[1010]: New session 164 of user root. Aug 15 09:52:10 oleg434-client systemd[1]: Started Session 164 of user root. Aug 15 09:52:10 oleg434-client sshd[34394]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:10 oleg434-client kernel: Lustre: DEBUG MARKER: oleg434-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 Aug 15 09:52:10 oleg434-client sshd[34407]: Received disconnect from 192.168.204.34 port 46090:11: disconnected by user Aug 15 09:52:10 oleg434-client sshd[34407]: Disconnected from user root 192.168.204.34 port 46090 Aug 15 09:52:10 oleg434-client sshd[34394]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:11 oleg434-client systemd[1]: session-164.scope: Succeeded. Aug 15 09:52:11 oleg434-client systemd-logind[1010]: Session 164 logged out. Waiting for processes to exit. Aug 15 09:52:11 oleg434-client systemd-logind[1010]: Removed session 164. Aug 15 09:52:11 oleg434-client sshd[34542]: Accepted publickey for root from 192.168.204.34 port 46106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:12 oleg434-client systemd[1]: Started Session 165 of user root. Aug 15 09:52:12 oleg434-client systemd-logind[1010]: New session 165 of user root. Aug 15 09:52:12 oleg434-client sshd[34542]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:12 oleg434-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Aug 15 09:52:12 oleg434-client sshd[34555]: Received disconnect from 192.168.204.34 port 46106:11: disconnected by user Aug 15 09:52:12 oleg434-client sshd[34555]: Disconnected from user root 192.168.204.34 port 46106 Aug 15 09:52:12 oleg434-client sshd[34542]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:12 oleg434-client systemd[1]: session-165.scope: Succeeded. Aug 15 09:52:12 oleg434-client systemd-logind[1010]: Session 165 logged out. Waiting for processes to exit. Aug 15 09:52:12 oleg434-client systemd-logind[1010]: Removed session 165. Aug 15 09:52:14 oleg434-client sshd[34597]: Accepted publickey for root from 192.168.204.34 port 46108 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:14 oleg434-client systemd-logind[1010]: New session 166 of user root. Aug 15 09:52:14 oleg434-client systemd[1]: Started Session 166 of user root. Aug 15 09:52:14 oleg434-client sshd[34597]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:14 oleg434-client sshd[34610]: Received disconnect from 192.168.204.34 port 46108:11: disconnected by user Aug 15 09:52:14 oleg434-client sshd[34610]: Disconnected from user root 192.168.204.34 port 46108 Aug 15 09:52:14 oleg434-client sshd[34597]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:14 oleg434-client systemd[1]: session-166.scope: Succeeded. Aug 15 09:52:14 oleg434-client systemd-logind[1010]: Session 166 logged out. Waiting for processes to exit. Aug 15 09:52:14 oleg434-client systemd-logind[1010]: Removed session 166. Aug 15 09:52:15 oleg434-client sshd[34729]: Accepted publickey for root from 192.168.204.34 port 51780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:15 oleg434-client systemd-logind[1010]: New session 167 of user root. Aug 15 09:52:15 oleg434-client systemd[1]: Started Session 167 of user root. Aug 15 09:52:15 oleg434-client sshd[34729]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:15 oleg434-client sshd[34742]: Received disconnect from 192.168.204.34 port 51780:11: disconnected by user Aug 15 09:52:15 oleg434-client sshd[34742]: Disconnected from user root 192.168.204.34 port 51780 Aug 15 09:52:15 oleg434-client sshd[34729]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:16 oleg434-client systemd[1]: session-167.scope: Succeeded. Aug 15 09:52:16 oleg434-client systemd-logind[1010]: Session 167 logged out. Waiting for processes to exit. Aug 15 09:52:16 oleg434-client systemd-logind[1010]: Removed session 167. Aug 15 09:52:17 oleg434-client sshd[34868]: Accepted publickey for root from 192.168.204.34 port 51784 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:17 oleg434-client systemd-logind[1010]: New session 168 of user root. Aug 15 09:52:17 oleg434-client systemd[1]: Started Session 168 of user root. Aug 15 09:52:17 oleg434-client sshd[34868]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:17 oleg434-client sshd[34881]: Received disconnect from 192.168.204.34 port 51784:11: disconnected by user Aug 15 09:52:17 oleg434-client sshd[34881]: Disconnected from user root 192.168.204.34 port 51784 Aug 15 09:52:17 oleg434-client sshd[34868]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:18 oleg434-client systemd[1]: session-168.scope: Succeeded. Aug 15 09:52:18 oleg434-client systemd-logind[1010]: Session 168 logged out. Waiting for processes to exit. Aug 15 09:52:18 oleg434-client systemd-logind[1010]: Removed session 168. Aug 15 09:52:18 oleg434-client sshd[35014]: Accepted publickey for root from 192.168.204.34 port 51792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:18 oleg434-client systemd-logind[1010]: New session 169 of user root. Aug 15 09:52:18 oleg434-client systemd[1]: Started Session 169 of user root. Aug 15 09:52:18 oleg434-client sshd[35014]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:19 oleg434-client sshd[35027]: Received disconnect from 192.168.204.34 port 51792:11: disconnected by user Aug 15 09:52:19 oleg434-client sshd[35027]: Disconnected from user root 192.168.204.34 port 51792 Aug 15 09:52:19 oleg434-client sshd[35014]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:19 oleg434-client systemd[1]: session-169.scope: Succeeded. Aug 15 09:52:19 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 09:52:19 oleg434-client systemd-logind[1010]: Session 169 logged out. Waiting for processes to exit. Aug 15 09:52:19 oleg434-client systemd-logind[1010]: Removed session 169. Aug 15 09:52:21 oleg434-client sshd[35171]: Accepted publickey for root from 192.168.204.34 port 51798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:21 oleg434-client systemd-logind[1010]: New session 170 of user root. Aug 15 09:52:21 oleg434-client systemd[1]: Started Session 170 of user root. Aug 15 09:52:21 oleg434-client sshd[35171]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:21 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24a: fsync error (should return error) ========================================================== 09:52:19 (1786801939) Aug 15 09:52:21 oleg434-client sshd[35184]: Received disconnect from 192.168.204.34 port 51798:11: disconnected by user Aug 15 09:52:21 oleg434-client sshd[35184]: Disconnected from user root 192.168.204.34 port 51798 Aug 15 09:52:21 oleg434-client sshd[35171]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:21 oleg434-client systemd[1]: session-170.scope: Succeeded. Aug 15 09:52:21 oleg434-client systemd-logind[1010]: Session 170 logged out. Waiting for processes to exit. Aug 15 09:52:21 oleg434-client systemd-logind[1010]: Removed session 170. Aug 15 09:52:23 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: operation ost_write to node 192.168.204.134@tcp failed: rc = -107 Aug 15 09:52:23 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Aug 15 09:52:23 oleg434-client kernel: Lustre: 2388:0:(llite_lib.c:4340:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.134@tcp:/lustre/fid: [0x240000402:0x8:0x0]// may get corrupted (rc -5) Aug 15 09:52:25 oleg434-client sshd[35369]: Accepted publickey for root from 192.168.204.34 port 43842 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:26 oleg434-client systemd-logind[1010]: New session 171 of user root. Aug 15 09:52:26 oleg434-client systemd[1]: Started Session 171 of user root. Aug 15 09:52:26 oleg434-client sshd[35369]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:26 oleg434-client sshd[35382]: Received disconnect from 192.168.204.34 port 43842:11: disconnected by user Aug 15 09:52:26 oleg434-client sshd[35382]: Disconnected from user root 192.168.204.34 port 43842 Aug 15 09:52:26 oleg434-client sshd[35369]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:26 oleg434-client systemd[1]: session-171.scope: Succeeded. Aug 15 09:52:26 oleg434-client systemd-logind[1010]: Session 171 logged out. Waiting for processes to exit. Aug 15 09:52:26 oleg434-client systemd-logind[1010]: Removed session 171. Aug 15 09:52:28 oleg434-client sshd[35509]: Accepted publickey for root from 192.168.204.34 port 43848 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:28 oleg434-client systemd[1]: Started Session 172 of user root. Aug 15 09:52:28 oleg434-client systemd-logind[1010]: New session 172 of user root. Aug 15 09:52:28 oleg434-client sshd[35509]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:28 oleg434-client sshd[35522]: Received disconnect from 192.168.204.34 port 43848:11: disconnected by user Aug 15 09:52:28 oleg434-client sshd[35522]: Disconnected from user root 192.168.204.34 port 43848 Aug 15 09:52:28 oleg434-client sshd[35509]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:28 oleg434-client systemd-logind[1010]: Session 172 logged out. Waiting for processes to exit. Aug 15 09:52:29 oleg434-client systemd[1]: session-172.scope: Succeeded. Aug 15 09:52:29 oleg434-client systemd-logind[1010]: Removed session 172. Aug 15 09:52:30 oleg434-client sshd[35655]: Accepted publickey for root from 192.168.204.34 port 43864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:30 oleg434-client systemd[1]: Started Session 173 of user root. Aug 15 09:52:30 oleg434-client systemd-logind[1010]: New session 173 of user root. Aug 15 09:52:30 oleg434-client sshd[35655]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:30 oleg434-client sshd[35668]: Received disconnect from 192.168.204.34 port 43864:11: disconnected by user Aug 15 09:52:30 oleg434-client sshd[35668]: Disconnected from user root 192.168.204.34 port 43864 Aug 15 09:52:30 oleg434-client sshd[35655]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:31 oleg434-client systemd-logind[1010]: Session 173 logged out. Waiting for processes to exit. Aug 15 09:52:31 oleg434-client systemd[1]: session-173.scope: Succeeded. Aug 15 09:52:31 oleg434-client systemd-logind[1010]: Removed session 173. Aug 15 09:52:33 oleg434-client sshd[35810]: Accepted publickey for root from 192.168.204.34 port 43880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:33 oleg434-client systemd[1]: Started Session 174 of user root. Aug 15 09:52:33 oleg434-client systemd-logind[1010]: New session 174 of user root. Aug 15 09:52:33 oleg434-client sshd[35810]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:33 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24b: test dirty page discard due to client eviction ========================================================== 09:52:31 (1786801951) Aug 15 09:52:33 oleg434-client sshd[35823]: Received disconnect from 192.168.204.34 port 43880:11: disconnected by user Aug 15 09:52:33 oleg434-client sshd[35823]: Disconnected from user root 192.168.204.34 port 43880 Aug 15 09:52:33 oleg434-client sshd[35810]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:33 oleg434-client systemd-logind[1010]: Session 174 logged out. Waiting for processes to exit. Aug 15 09:52:34 oleg434-client systemd[1]: session-174.scope: Succeeded. Aug 15 09:52:34 oleg434-client systemd-logind[1010]: Removed session 174. Aug 15 09:52:35 oleg434-client kernel: LustreError: lustre-OST0000-osc-ffff898e829ef800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Aug 15 09:52:35 oleg434-client kernel: Lustre: 2390:0:(llite_lib.c:4340:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.134@tcp:/lustre/fid: [0x200000405:0x2e:0x0]// may get corrupted (rc -5) Aug 15 09:52:35 oleg434-client kernel: Lustre: 2391:0:(llite_lib.c:4340:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.134@tcp:/lustre/fid: [0x200000405:0x2f:0x0]// may get corrupted (rc -108) Aug 15 09:52:36 oleg434-client sshd[36015]: Accepted publickey for root from 192.168.204.34 port 59158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:36 oleg434-client systemd[1]: Started Session 175 of user root. Aug 15 09:52:36 oleg434-client systemd-logind[1010]: New session 175 of user root. Aug 15 09:52:36 oleg434-client sshd[36015]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:37 oleg434-client sshd[36028]: Received disconnect from 192.168.204.34 port 59158:11: disconnected by user Aug 15 09:52:37 oleg434-client sshd[36028]: Disconnected from user root 192.168.204.34 port 59158 Aug 15 09:52:37 oleg434-client sshd[36015]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:37 oleg434-client systemd[1]: session-175.scope: Succeeded. Aug 15 09:52:37 oleg434-client systemd-logind[1010]: Session 175 logged out. Waiting for processes to exit. Aug 15 09:52:37 oleg434-client systemd-logind[1010]: Removed session 175. Aug 15 09:52:38 oleg434-client sshd[36154]: Accepted publickey for root from 192.168.204.34 port 59172 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:38 oleg434-client systemd-logind[1010]: New session 176 of user root. Aug 15 09:52:38 oleg434-client systemd[1]: Started Session 176 of user root. Aug 15 09:52:38 oleg434-client sshd[36154]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:38 oleg434-client sshd[36167]: Received disconnect from 192.168.204.34 port 59172:11: disconnected by user Aug 15 09:52:38 oleg434-client sshd[36167]: Disconnected from user root 192.168.204.34 port 59172 Aug 15 09:52:38 oleg434-client sshd[36154]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:38 oleg434-client systemd[1]: session-176.scope: Succeeded. Aug 15 09:52:38 oleg434-client systemd-logind[1010]: Session 176 logged out. Waiting for processes to exit. Aug 15 09:52:38 oleg434-client systemd-logind[1010]: Removed session 176. Aug 15 09:52:39 oleg434-client sshd[36301]: Accepted publickey for root from 192.168.204.34 port 59180 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:39 oleg434-client systemd-logind[1010]: New session 177 of user root. Aug 15 09:52:39 oleg434-client systemd[1]: Started Session 177 of user root. Aug 15 09:52:39 oleg434-client sshd[36301]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:40 oleg434-client sshd[36314]: Received disconnect from 192.168.204.34 port 59180:11: disconnected by user Aug 15 09:52:40 oleg434-client sshd[36314]: Disconnected from user root 192.168.204.34 port 59180 Aug 15 09:52:40 oleg434-client sshd[36301]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:40 oleg434-client systemd[1]: session-177.scope: Succeeded. Aug 15 09:52:40 oleg434-client systemd-logind[1010]: Session 177 logged out. Waiting for processes to exit. Aug 15 09:52:40 oleg434-client systemd-logind[1010]: Removed session 177. Aug 15 09:52:41 oleg434-client sshd[36457]: Accepted publickey for root from 192.168.204.34 port 59194 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:41 oleg434-client systemd[1]: Started Session 178 of user root. Aug 15 09:52:42 oleg434-client systemd-logind[1010]: New session 178 of user root. Aug 15 09:52:42 oleg434-client sshd[36457]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:42 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 09:52:40 (1786801960) Aug 15 09:52:42 oleg434-client sshd[36470]: Received disconnect from 192.168.204.34 port 59194:11: disconnected by user Aug 15 09:52:42 oleg434-client sshd[36470]: Disconnected from user root 192.168.204.34 port 59194 Aug 15 09:52:42 oleg434-client sshd[36457]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:42 oleg434-client systemd-logind[1010]: Session 178 logged out. Waiting for processes to exit. Aug 15 09:52:42 oleg434-client systemd[1]: session-178.scope: Succeeded. Aug 15 09:52:42 oleg434-client systemd-logind[1010]: Removed session 178. Aug 15 09:52:44 oleg434-client sshd[36691]: Accepted publickey for root from 192.168.204.34 port 59198 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:44 oleg434-client systemd-logind[1010]: New session 179 of user root. Aug 15 09:52:44 oleg434-client systemd[1]: Started Session 179 of user root. Aug 15 09:52:44 oleg434-client sshd[36691]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:45 oleg434-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node Aug 15 09:52:45 oleg434-client sshd[36704]: Received disconnect from 192.168.204.34 port 59198:11: disconnected by user Aug 15 09:52:45 oleg434-client sshd[36704]: Disconnected from user root 192.168.204.34 port 59198 Aug 15 09:52:45 oleg434-client sshd[36691]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:45 oleg434-client systemd[1]: session-179.scope: Succeeded. Aug 15 09:52:45 oleg434-client systemd-logind[1010]: Session 179 logged out. Waiting for processes to exit. Aug 15 09:52:45 oleg434-client systemd-logind[1010]: Removed session 179. Aug 15 09:52:46 oleg434-client sshd[36845]: Accepted publickey for root from 192.168.204.34 port 60602 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:46 oleg434-client systemd-logind[1010]: New session 180 of user root. Aug 15 09:52:46 oleg434-client systemd[1]: Started Session 180 of user root. Aug 15 09:52:46 oleg434-client sshd[36845]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:47 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 09:52:45 (1786801965) Aug 15 09:52:47 oleg434-client sshd[36858]: Received disconnect from 192.168.204.34 port 60602:11: disconnected by user Aug 15 09:52:47 oleg434-client sshd[36858]: Disconnected from user root 192.168.204.34 port 60602 Aug 15 09:52:47 oleg434-client sshd[36845]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:47 oleg434-client systemd-logind[1010]: Session 180 logged out. Waiting for processes to exit. Aug 15 09:52:47 oleg434-client systemd[1]: session-180.scope: Succeeded. Aug 15 09:52:47 oleg434-client systemd-logind[1010]: Removed session 180. Aug 15 09:52:48 oleg434-client sshd[37016]: Accepted publickey for root from 192.168.204.34 port 60610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:48 oleg434-client systemd-logind[1010]: New session 181 of user root. Aug 15 09:52:48 oleg434-client systemd[1]: Started Session 181 of user root. Aug 15 09:52:48 oleg434-client sshd[37016]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:49 oleg434-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node Aug 15 09:52:49 oleg434-client sshd[37030]: Received disconnect from 192.168.204.34 port 60610:11: disconnected by user Aug 15 09:52:49 oleg434-client sshd[37030]: Disconnected from user root 192.168.204.34 port 60610 Aug 15 09:52:49 oleg434-client sshd[37016]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:49 oleg434-client systemd[1]: session-181.scope: Succeeded. Aug 15 09:52:49 oleg434-client systemd-logind[1010]: Session 181 logged out. Waiting for processes to exit. Aug 15 09:52:49 oleg434-client systemd-logind[1010]: Removed session 181. Aug 15 09:52:50 oleg434-client sshd[37171]: Accepted publickey for root from 192.168.204.34 port 60624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Aug 15 09:52:51 oleg434-client systemd-logind[1010]: New session 182 of user root. Aug 15 09:52:51 oleg434-client systemd[1]: Started Session 182 of user root. Aug 15 09:52:51 oleg434-client sshd[37171]: pam_unix(sshd:session): session opened for user root by (uid=0) Aug 15 09:52:51 oleg434-client kernel: Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 09:52:49 (1786801969) Aug 15 09:52:51 oleg434-client sshd[37184]: Received disconnect from 192.168.204.34 port 60624:11: disconnected by user Aug 15 09:52:51 oleg434-client sshd[37184]: Disconnected from user root 192.168.204.34 port 60624 Aug 15 09:52:51 oleg434-client sshd[37171]: pam_unix(sshd:session): session closed for user root Aug 15 09:52:51 oleg434-client systemd[1]: session-182.scope: Succeeded. Aug 15 09:52:51 oleg434-client systemd-logind[1010]: Session 182 logged out. Waiting for processes to exit. Aug 15 09:52:51 oleg434-client systemd-logind[1010]: Removed session 182. Aug 15 09:52:55 oleg434-client kernel: LustreError: lustre-MDT0000-mdc-ffff898e829ef800: operation mds_reint to node 192.168.204.134@tcp failed: rc = -19 Aug 15 09:52:55 oleg434-client kernel: LustreError: Skipped 1 previous similar message Aug 15 09:53:15 oleg434-client kernel: LustreError: MGC192.168.204.134@tcp: Connection to MGS (at 192.168.204.134@tcp) was lost; in progress operations using this service will fail Aug 15 09:53:15 oleg434-client kernel: Lustre: Evicted from MGS (at 192.168.204.134@tcp) after server handle changed from 0xf004fe7c74fa3809 to 0xf004fe7c74fa523b Aug 15 09:53:17 oleg434-client kernel: Lustre: 16817:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.204.134@tcp: IR log lustre-cliir failed, not fatal: rc = -2 Aug 15 09:55:07 oleg434-client kernel: LustreError: lustre-MDT0000-mdc-ffff898e829ef800: operation mds_reint to node 192.168.204.134@tcp failed: rc = -19 Aug 15 09:55:24 oleg434-client kernel: LustreError: MGC192.168.204.134@tcp: Connection to MGS (at 192.168.204.134@tcp) was lost; in progress operations using this service will fail Aug 15 09:55:29 oleg434-client kernel: BUG: spinlock recursion on CPU#0, ptlrpcd_rcv/2387 Aug 15 09:55:29 oleg434-client kernel: lock: 0xffff898e84d1d2e0, .magic: dead4ead, .owner: ptlrpcd_rcv/2387, .owner_cpu: 0 Aug 15 09:55:29 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:55:29 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:55:29 oleg434-client kernel: Call Trace: Aug 15 09:55:29 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 09:55:29 oleg434-client kernel: ? spin_dump.cold.3+0x32/0x65 Aug 15 09:55:29 oleg434-client kernel: ? do_raw_spin_lock+0x10f/0x190 Aug 15 09:55:29 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 09:55:29 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:55:29 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:55:29 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:55:29 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:55:29 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 09:55:29 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:55:29 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 09:55:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 09:55:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 09:55:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) Aug 15 09:55:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:55:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:55:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:55:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 09:55:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 09:55:56 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:55:56 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:55:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:55:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:55:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:55:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:55:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:55:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:55:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:55:56 oleg434-client kernel: Call Trace: Aug 15 09:55:56 oleg434-client kernel: Aug 15 09:55:56 oleg434-client kernel: obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:55:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:55:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:55:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:55:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:55:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:55:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:55:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:55:56 oleg434-client kernel: Aug 15 09:55:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:55:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 09:55:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:55:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:55:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:55:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:55:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:55:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:55:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:55:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:55:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:55:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:55:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:55:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:55:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:55:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:55:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:55:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:55:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:55:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:55:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:55:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:55:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:55:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:55:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:55:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:55:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:55:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:55:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:55:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:55:56 oleg434-client kernel: RDX: 00000000000069bc RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:55:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:55:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:55:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:55:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:55:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:55:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:55:56 oleg434-client kernel: Call Trace: Aug 15 09:55:56 oleg434-client kernel: Aug 15 09:55:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:55:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:55:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:55:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:55:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:55:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:55:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:55:56 oleg434-client kernel: Aug 15 09:55:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:55:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:55:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:55:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:55:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:55:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:55:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:55:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:55:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:55:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:55:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:56:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 09:56:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:56:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:56:00 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 09:56:00 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 09:56:00 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:56:00 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:56:00 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:56:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:56:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:56:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:56:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:56:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:56:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:56:00 oleg434-client kernel: Call Trace: Aug 15 09:56:00 oleg434-client kernel: Aug 15 09:56:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:56:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:56:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:56:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:00 oleg434-client kernel: Aug 15 09:56:00 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:56:00 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 09:56:00 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:56:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:56:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:56:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:56:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:56:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:56:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:56:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:56:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:56:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:56:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 09:56:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 09:56:24 oleg434-client kernel: Modules linked in: Aug 15 09:56:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:56:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 09:56:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 09:56:24 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:56:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:56:24 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:56:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:56:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:56:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:56:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:56:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:56:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:56:24 oleg434-client kernel: Call Trace: Aug 15 09:56:24 oleg434-client kernel: Aug 15 09:56:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:56:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:56:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:56:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:24 oleg434-client kernel: Aug 15 09:56:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:56:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 09:56:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:56:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:56:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:56:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:56:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:56:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) Aug 15 09:56:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:56:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:56:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:56:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:56:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:56:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:56:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:56:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:56:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:56:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:56:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:56:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:56:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:56:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:56:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:56:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:56:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:56:24 oleg434-client kernel: lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:56:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 09:56:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 09:56:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:56:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:56:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:56:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:56:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:56:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:56:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:56:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:56:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:56:24 oleg434-client kernel: Call Trace: Aug 15 09:56:24 oleg434-client kernel: Aug 15 09:56:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:56:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:56:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:56:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:24 oleg434-client kernel: Aug 15 09:56:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:56:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 09:56:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:56:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:56:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:56:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:56:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:56:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:56:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:56:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:56:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:56:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:56:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 09:56:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:56:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:56:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:56:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:56:28 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:56:28 oleg434-client kernel: RAX: 0000000000002a0d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:56:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:56:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:56:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:56:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:56:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:56:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:56:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:56:28 oleg434-client kernel: Call Trace: Aug 15 09:56:28 oleg434-client kernel: Aug 15 09:56:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:56:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:56:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:56:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:28 oleg434-client kernel: Aug 15 09:56:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:56:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:56:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:56:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:56:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:56:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:56:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:56:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:56:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:56:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:56:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:56:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 09:56:30 oleg434-client kernel: rcu: #0110-....: (30892 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=10260 Aug 15 09:56:30 oleg434-client kernel: #011(t=60000 jiffies g=297885 q=2241) Aug 15 09:56:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 09:56:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:30 oleg434-client kernel: Call Trace: Aug 15 09:56:30 oleg434-client kernel: Aug 15 09:56:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 09:56:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 09:56:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 09:56:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 09:56:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 09:56:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 09:56:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 09:56:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 09:56:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 09:56:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 09:56:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 09:56:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 09:56:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:30 oleg434-client kernel: Aug 15 09:56:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:56:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:56:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 09:56:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 09:56:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:56:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:56:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:56:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:56:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 09:56:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:56:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 09:56:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 09:56:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:56:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 09:56:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 09:56:52 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:56:52 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:56:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:56:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:56:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:56:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:56:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:56:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:56:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:56:52 oleg434-client kernel: Call Trace: Aug 15 09:56:52 oleg434-client kernel: Aug 15 09:56:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:56:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:56:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:56:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:52 oleg434-client kernel: Aug 15 09:56:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:56:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 09:56:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:56:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:56:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:56:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:56:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:56:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:56:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:56:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:56:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:56:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:56:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:56:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:56:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:56:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:56:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:56:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:56:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:56:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:56:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:56:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:56:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:56:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:56:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:56:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:56:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:56:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 09:56:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:56:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 09:56:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:56:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:56:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:56:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:56:56 oleg434-client kernel: RDX: 0000000000003bed RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:56:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:56:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:56:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:56:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:56:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:56:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:56:56 oleg434-client kernel: Call Trace: Aug 15 09:56:56 oleg434-client kernel: Aug 15 09:56:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:56:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:56:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:56:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:56 oleg434-client kernel: Aug 15 09:56:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:56:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:56:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:56:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:56:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:56:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:56:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:56:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:56:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:56:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:56:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:56:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:56:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:56:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:56:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:56:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:56:56 oleg434-client kernel: RAX: 0000000000005152 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:56:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:56:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:56:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:56:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:56:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:56:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:56:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:56:56 oleg434-client kernel: Call Trace: Aug 15 09:56:56 oleg434-client kernel: Aug 15 09:56:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:56:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:56:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:56:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:56:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:56:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:56:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:56:56 oleg434-client kernel: Aug 15 09:56:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:56:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:56:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:56:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:56:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:56:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:56:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:56:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:56:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:56:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:56:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:57:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 09:57:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:57:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:57:20 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 09:57:20 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 09:57:20 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:57:20 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:57:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:57:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:57:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:57:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:57:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:57:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:57:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:57:20 oleg434-client kernel: Call Trace: Aug 15 09:57:20 oleg434-client kernel: Aug 15 09:57:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:57:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:57:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:57:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:57:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:57:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:57:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:57:20 oleg434-client kernel: Aug 15 09:57:20 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:57:20 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 09:57:20 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:57:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:57:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:57:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:57:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:57:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:57:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:57:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:57:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:57:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:57:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:57:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:57:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:57:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:57:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:57:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:57:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:57:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:57:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:57:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:57:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:57:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:57:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:57:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:57:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:57:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 09:57:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 09:57:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:57:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:57:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:57:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:57:24 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:57:24 oleg434-client kernel: RAX: 0000000000007a08 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:57:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:57:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:57:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:57:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:57:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:57:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:57:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:57:24 oleg434-client kernel: Call Trace: Aug 15 09:57:24 oleg434-client kernel: Aug 15 09:57:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:57:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:57:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:57:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:57:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:57:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:57:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:57:24 oleg434-client kernel: Aug 15 09:57:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:57:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:57:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:57:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:57:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:57:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:57:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:57:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:57:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:57:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:57:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:57:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:57:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:57:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:57:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:57:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:57:24 oleg434-client kernel: RDX: 00000000000029dc RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:57:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:57:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:57:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:57:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:57:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:57:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:57:24 oleg434-client kernel: Call Trace: Aug 15 09:57:24 oleg434-client kernel: Aug 15 09:57:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:57:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:57:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:57:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:57:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:57:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:57:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:57:24 oleg434-client kernel: Aug 15 09:57:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:57:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:57:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:57:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:57:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:57:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:57:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:57:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:57:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:57:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:57:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:57:25 oleg434-client kernel: INFO: task writemany:37218 blocked for more than 120 seconds. Aug 15 09:57:25 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:25 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:57:25 oleg434-client kernel: task:writemany state:D stack:0 pid:37218 ppid:37213 flags:0x80000004 Aug 15 09:57:25 oleg434-client kernel: Call Trace: Aug 15 09:57:25 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:57:25 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:57:25 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:57:25 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:57:25 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:57:25 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:57:25 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:57:25 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:57:25 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:57:25 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:57:25 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:57:25 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:57:25 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:57:25 oleg434-client kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f33957fc10b Aug 15 09:57:25 oleg434-client kernel: RDX: 0000000000000000 RSI: 00007ffe42a47a64 RDI: 00007ffe42a47ae0 Aug 15 09:57:25 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9425c R09: 00007f3395b94260 Aug 15 09:57:25 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:57:25 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:57:25 oleg434-client kernel: INFO: task writemany:37220 blocked for more than 120 seconds. Aug 15 09:57:25 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:25 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:57:25 oleg434-client kernel: task:writemany state:D stack:0 pid:37220 ppid:37213 flags:0x80000004 Aug 15 09:57:25 oleg434-client kernel: Call Trace: Aug 15 09:57:25 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:57:25 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:57:25 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:57:25 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:57:25 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:57:25 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:57:25 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:57:25 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:57:25 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:57:25 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:57:25 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:57:25 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:57:25 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:57:25 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000011a178 RCX: 00007f33957fc10b Aug 15 09:57:25 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:57:25 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b94230 R09: 00007f3395b94260 Aug 15 09:57:25 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:57:25 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:57:25 oleg434-client kernel: INFO: task writemany:37221 blocked for more than 120 seconds. Aug 15 09:57:25 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:25 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:57:25 oleg434-client kernel: task:writemany state:D stack:0 pid:37221 ppid:37213 flags:0x80000004 Aug 15 09:57:25 oleg434-client kernel: Call Trace: Aug 15 09:57:25 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:57:25 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:57:25 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:57:25 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:57:25 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:57:25 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:57:25 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:57:25 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:57:25 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:57:25 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:57:25 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:57:25 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:57:25 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:57:25 oleg434-client kernel: RAX: ffffffffffffffda RBX: 00000000006789b8 RCX: 00007f33957fc10b Aug 15 09:57:25 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:57:25 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9423c R09: 00007f3395b94260 Aug 15 09:57:25 oleg434-client kernel: R10: 00007ffe42a47823 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:57:25 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:57:25 oleg434-client kernel: INFO: task writemany:37222 blocked for more than 120 seconds. Aug 15 09:57:25 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:25 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:57:25 oleg434-client kernel: task:writemany state:D stack:0 pid:37222 ppid:37213 flags:0x80000004 Aug 15 09:57:25 oleg434-client kernel: Call Trace: Aug 15 09:57:25 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:57:25 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:57:25 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:57:25 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:57:25 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:57:25 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:57:25 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:57:25 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:57:25 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:57:25 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:57:25 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:57:25 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:57:25 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:57:25 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000102a848 RCX: 00007f33957fc10b Aug 15 09:57:25 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:57:25 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b94254 R09: 00007f3395b94260 Aug 15 09:57:25 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:57:25 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:57:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 09:57:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:57:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:57:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:57:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:57:48 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:57:48 oleg434-client kernel: RAX: 0000000000000e82 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:57:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:57:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:57:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:57:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:57:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:57:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:57:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:57:48 oleg434-client kernel: Call Trace: Aug 15 09:57:48 oleg434-client kernel: Aug 15 09:57:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:57:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:57:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:57:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:57:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:57:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:57:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:57:48 oleg434-client kernel: Aug 15 09:57:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:57:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:57:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:57:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:57:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:57:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:57:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:57:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:57:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:57:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:57:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:57:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:57:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:57:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:57:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:57:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:57:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:57:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:57:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:57:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:57:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:57:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:57:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:57:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:57:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:57:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:57:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 09:57:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:57:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 09:57:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:57:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:57:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:57:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:57:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:57:52 oleg434-client kernel: RDX: 0000000000000d48 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:57:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:57:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:57:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:57:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:57:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:57:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:57:52 oleg434-client kernel: Call Trace: Aug 15 09:57:52 oleg434-client kernel: Aug 15 09:57:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:57:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:57:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:57:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:57:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:57:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:57:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:57:52 oleg434-client kernel: Aug 15 09:57:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:57:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:57:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:57:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:57:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:57:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix Aug 15 09:57:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:57:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:57:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:57:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:57:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:57:52 oleg434-client kernel: serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:57:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:57:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:57:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:57:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:57:52 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:57:52 oleg434-client kernel: RAX: 0000000000004a8f RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:57:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:57:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:57:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:57:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:57:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:57:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:57:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:57:52 oleg434-client kernel: Call Trace: Aug 15 09:57:52 oleg434-client kernel: Aug 15 09:57:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:57:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:57:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:57:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:57:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:57:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:57:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:57:52 oleg434-client kernel: Aug 15 09:57:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:57:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:57:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:57:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:57:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:57:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:57:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:57:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:57:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:57:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:57:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:58:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 09:58:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:58:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:58:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:58:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:58:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:58:16 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:58:16 oleg434-client kernel: RAX: 000000000000634f RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:58:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:58:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:58:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:58:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:58:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:58:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:58:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:58:16 oleg434-client kernel: Call Trace: Aug 15 09:58:16 oleg434-client kernel: Aug 15 09:58:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:58:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:58:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:58:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:58:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:58:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:58:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:58:16 oleg434-client kernel: Aug 15 09:58:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:58:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:58:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:58:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:58:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:58:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:58:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:58:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:58:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:58:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:58:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:58:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:58:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:58:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:58:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:58:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:58:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:58:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:58:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:58:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:58:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:58:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:58:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:58:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:58:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:58:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:58:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 09:58:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 09:58:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) Aug 15 09:58:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:58:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:58:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:58:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 09:58:20 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 09:58:20 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:58:20 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:58:20 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:58:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:58:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:58:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:58:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:58:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:58:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:58:20 oleg434-client kernel: Call Trace: Aug 15 09:58:20 oleg434-client kernel: Aug 15 09:58:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:58:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:58:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:58:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:58:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:58:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:58:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:58:20 oleg434-client kernel: Aug 15 09:58:20 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:58:20 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 09:58:20 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:58:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:58:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:58:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:58:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:58:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:58:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:58:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:58:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:58:20 oleg434-client kernel: ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:58:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:58:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:58:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:58:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:58:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:58:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:58:20 oleg434-client kernel: RDX: 0000000000002b38 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:58:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:58:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:58:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:58:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:58:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:58:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:58:20 oleg434-client kernel: Call Trace: Aug 15 09:58:20 oleg434-client kernel: Aug 15 09:58:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:58:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:58:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:58:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:58:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:58:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:58:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:58:20 oleg434-client kernel: Aug 15 09:58:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:58:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:58:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:58:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:58:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:58:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:58:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:58:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:58:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:58:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:58:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:58:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 09:58:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:58:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:58:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:58:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:58:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:58:44 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:58:44 oleg434-client kernel: RAX: 0000000000007796 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:58:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:58:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:58:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:58:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:58:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:58:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:58:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:58:44 oleg434-client kernel: Call Trace: Aug 15 09:58:44 oleg434-client kernel: Aug 15 09:58:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:58:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:58:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:58:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:58:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:58:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:58:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:58:44 oleg434-client kernel: Aug 15 09:58:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:58:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:58:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:58:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:58:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:58:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:58:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:58:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:58:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:58:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:58:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:58:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:58:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:58:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:58:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:58:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:58:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:58:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:58:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:58:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:58:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:58:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:58:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:58:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:58:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:58:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:58:44 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 09:58:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 09:58:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common Aug 15 09:58:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 09:58:48 oleg434-client kernel: sb_edac Aug 15 09:58:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:58:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:58:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:58:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:58:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:58:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:58:48 oleg434-client kernel: RAX: 0000000000000394 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:58:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:58:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:58:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:58:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:58:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:58:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:58:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:58:48 oleg434-client kernel: Call Trace: Aug 15 09:58:48 oleg434-client kernel: Aug 15 09:58:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:58:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:58:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:58:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:58:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:58:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:58:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:58:48 oleg434-client kernel: Aug 15 09:58:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:58:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:58:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:58:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:58:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:58:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:58:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:58:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:58:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:58:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:58:48 oleg434-client kernel: rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:58:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:58:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:58:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:58:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:58:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:58:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:58:48 oleg434-client kernel: RDX: 00000000000036a3 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:58:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:58:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:58:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:58:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:58:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:58:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:58:48 oleg434-client kernel: Call Trace: Aug 15 09:58:48 oleg434-client kernel: Aug 15 09:58:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:58:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:58:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:58:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:58:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:58:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:58:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:58:48 oleg434-client kernel: Aug 15 09:58:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:58:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:58:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:58:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:58:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:58:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:58:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:58:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:58:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:58:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:58:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:59:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 09:59:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:59:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:59:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:59:12 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:59:12 oleg434-client kernel: RAX: 0000000000005f6d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:59:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:59:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:59:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:59:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:59:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:59:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:59:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:59:12 oleg434-client kernel: Call Trace: Aug 15 09:59:12 oleg434-client kernel: Aug 15 09:59:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:59:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:59:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:59:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:59:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:59:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:59:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:59:12 oleg434-client kernel: Aug 15 09:59:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:59:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:59:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:59:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:59:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:59:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:59:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:59:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:59:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:59:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:59:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:59:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:59:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:59:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:59:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:59:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:59:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:59:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:59:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:59:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:59:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:59:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:59:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:59:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:59:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:59:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 09:59:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 09:59:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:59:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:59:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:59:16 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:59:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:59:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:59:16 oleg434-client kernel: RDX: 000000000000064a RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:59:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:59:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:59:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:59:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:59:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:59:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:59:16 oleg434-client kernel: Call Trace: Aug 15 09:59:16 oleg434-client kernel: Aug 15 09:59:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:59:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:59:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:59:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:59:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:59:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:59:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:59:16 oleg434-client kernel: Aug 15 09:59:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:59:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:59:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:59:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:59:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:59:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:59:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:59:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:59:16 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:59:16 oleg434-client kernel: RAX: 0000000000002711 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:59:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:59:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:59:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:59:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:59:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:59:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:59:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:59:16 oleg434-client kernel: Call Trace: Aug 15 09:59:16 oleg434-client kernel: Aug 15 09:59:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:59:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:59:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:59:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:59:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:59:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:59:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:59:16 oleg434-client kernel: Aug 15 09:59:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:59:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:59:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:59:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:59:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:59:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:59:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:59:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:59:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:59:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:59:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:59:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:59:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:59:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:59:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:59:27 oleg434-client kernel: INFO: task khugepaged:48 blocked for more than 120 seconds. Aug 15 09:59:27 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:27 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:59:27 oleg434-client kernel: task:khugepaged state:D stack:0 pid:48 ppid:2 flags:0x80004000 Aug 15 09:59:27 oleg434-client kernel: Call Trace: Aug 15 09:59:27 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:59:27 oleg434-client kernel: ? wait_for_completion+0xae/0x1e0 Aug 15 09:59:27 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:59:27 oleg434-client kernel: schedule_timeout+0x126/0x190 Aug 15 09:59:27 oleg434-client kernel: ? try_to_wake_up+0x80/0x710 Aug 15 09:59:27 oleg434-client kernel: ? __prepare_to_swait+0x5b/0x90 Aug 15 09:59:27 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:59:27 oleg434-client kernel: wait_for_completion+0xf0/0x1e0 Aug 15 09:59:27 oleg434-client kernel: flush_work+0x1f3/0x390 Aug 15 09:59:27 oleg434-client kernel: ? flush_workqueue_prep_pwqs+0x200/0x200 Aug 15 09:59:27 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:59:27 oleg434-client kernel: ? __pagevec_release+0x50/0x50 Aug 15 09:59:27 oleg434-client kernel: lru_add_drain_all+0x1d4/0x280 Aug 15 09:59:27 oleg434-client kernel: khugepaged+0xa2/0x16f0 Aug 15 09:59:27 oleg434-client kernel: ? woken_wake_function+0x30/0x30 Aug 15 09:59:27 oleg434-client kernel: ? collapse_pte_mapped_thp+0x8a0/0x8a0 Aug 15 09:59:27 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:59:27 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:59:27 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:59:28 oleg434-client kernel: INFO: task writemany:37218 blocked for more than 120 seconds. Aug 15 09:59:28 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:28 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:59:28 oleg434-client kernel: task:writemany state:D stack:0 pid:37218 ppid:37213 flags:0x80000004 Aug 15 09:59:28 oleg434-client kernel: Call Trace: Aug 15 09:59:28 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:59:28 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:59:28 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:59:28 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:59:28 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:59:28 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:59:28 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:59:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:59:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:59:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:59:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:59:28 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:59:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:59:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f33957fc10b Aug 15 09:59:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 00007ffe42a47a64 RDI: 00007ffe42a47ae0 Aug 15 09:59:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9425c R09: 00007f3395b94260 Aug 15 09:59:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:59:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:59:28 oleg434-client kernel: INFO: task writemany:37220 blocked for more than 120 seconds. Aug 15 09:59:28 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:28 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:59:28 oleg434-client kernel: task:writemany state:D stack:0 pid:37220 ppid:37213 flags:0x80000004 Aug 15 09:59:28 oleg434-client kernel: Call Trace: Aug 15 09:59:28 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:59:28 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:59:28 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:59:28 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:59:28 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:59:28 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:59:28 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:59:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:59:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:59:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:59:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:59:28 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:59:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:59:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000011a178 RCX: 00007f33957fc10b Aug 15 09:59:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:59:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b94230 R09: 00007f3395b94260 Aug 15 09:59:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:59:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:59:28 oleg434-client kernel: INFO: task writemany:37221 blocked for more than 120 seconds. Aug 15 09:59:28 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:28 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:59:28 oleg434-client kernel: task:writemany state:D stack:0 pid:37221 ppid:37213 flags:0x80000004 Aug 15 09:59:28 oleg434-client kernel: Call Trace: Aug 15 09:59:28 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:59:28 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:59:28 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:59:28 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:59:28 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:59:28 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:59:28 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:59:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:59:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:59:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:59:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:59:28 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:59:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:59:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 00000000006789b8 RCX: 00007f33957fc10b Aug 15 09:59:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:59:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9423c R09: 00007f3395b94260 Aug 15 09:59:28 oleg434-client kernel: R10: 00007ffe42a47823 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:59:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:59:28 oleg434-client kernel: INFO: task writemany:37222 blocked for more than 120 seconds. Aug 15 09:59:28 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:28 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 09:59:28 oleg434-client kernel: task:writemany state:D stack:0 pid:37222 ppid:37213 flags:0x80000004 Aug 15 09:59:28 oleg434-client kernel: Call Trace: Aug 15 09:59:28 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 09:59:28 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 09:59:28 oleg434-client kernel: schedule_preempt_disabled+0x21/0x40 Aug 15 09:59:28 oleg434-client kernel: rwsem_down_write_slowpath+0x5d7/0xa40 Aug 15 09:59:28 oleg434-client kernel: ? __might_sleep+0x59/0xc0 Aug 15 09:59:28 oleg434-client kernel: down_write+0x80/0xd0 Aug 15 09:59:28 oleg434-client kernel: do_unlinkat+0x184/0x460 Aug 15 09:59:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:59:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:59:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:59:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:59:28 oleg434-client kernel: Code: Unable to access opcode bytes at RIP 0x7f33957fc0e1. Aug 15 09:59:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:59:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000102a848 RCX: 00007f33957fc10b Aug 15 09:59:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:59:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b94254 R09: 00007f3395b94260 Aug 15 09:59:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:59:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:59:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 09:59:30 oleg434-client kernel: rcu: #0110-....: (131050 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=42856 Aug 15 09:59:30 oleg434-client kernel: #011(t=240003 jiffies g=297885 q=3169) Aug 15 09:59:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 09:59:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:59:30 oleg434-client kernel: Call Trace: Aug 15 09:59:30 oleg434-client kernel: Aug 15 09:59:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 09:59:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 09:59:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 09:59:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 09:59:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 09:59:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 09:59:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 09:59:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 09:59:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 09:59:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 09:59:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 09:59:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:59:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 09:59:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:59:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:59:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:59:30 oleg434-client kernel: Aug 15 09:59:30 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 09:59:30 oleg434-client kernel: ? kvm_wait+0xcd/0xe0 Aug 15 09:59:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:59:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 09:59:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 09:59:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:59:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:59:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:59:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:59:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 09:59:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:59:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 09:59:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 09:59:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:59:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:59:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:59:40 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:59:40 oleg434-client kernel: RAX: 000000000000512d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:59:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 09:59:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:59:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 09:59:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 09:59:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 09:59:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:59:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 09:59:40 oleg434-client kernel: Call Trace: Aug 15 09:59:40 oleg434-client kernel: Aug 15 09:59:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:59:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:59:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:59:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:59:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:59:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:59:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:59:40 oleg434-client kernel: Aug 15 09:59:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:59:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:59:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:59:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 09:59:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 09:59:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 09:59:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:59:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 09:59:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 09:59:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 09:59:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 09:59:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 09:59:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 09:59:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 09:59:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 09:59:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 09:59:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 09:59:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 09:59:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 09:59:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 09:59:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 09:59:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 09:59:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 09:59:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 09:59:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 09:59:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 09:59:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:59:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:59:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 09:59:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 09:59:44 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 09:59:44 oleg434-client kernel: RAX: 0000000000006289 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 09:59:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 09:59:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 09:59:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 09:59:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 09:59:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 09:59:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:59:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 09:59:44 oleg434-client kernel: Call Trace: Aug 15 09:59:44 oleg434-client kernel: Aug 15 09:59:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:59:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:59:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:59:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:59:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:59:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:59:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:59:44 oleg434-client kernel: Aug 15 09:59:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 09:59:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 09:59:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:59:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:59:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 09:59:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 09:59:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 09:59:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 09:59:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:59:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:59:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 09:59:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 09:59:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 09:59:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 09:59:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 09:59:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:59:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 09:59:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 09:59:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 09:59:56 oleg434-client kernel: RDX: 00000000000063fe RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 09:59:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 09:59:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 09:59:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 09:59:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 09:59:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 09:59:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 09:59:56 oleg434-client kernel: Call Trace: Aug 15 09:59:56 oleg434-client kernel: Aug 15 09:59:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 09:59:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 09:59:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 09:59:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 09:59:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 09:59:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 09:59:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 09:59:56 oleg434-client kernel: Aug 15 09:59:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 09:59:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 09:59:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 09:59:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 09:59:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 09:59:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 09:59:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 09:59:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 09:59:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 09:59:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 09:59:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:00:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:00:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:00:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:00:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:00:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:00:08 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:00:08 oleg434-client kernel: RAX: 0000000000001cac RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:00:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:00:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:00:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:00:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:00:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:00:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:00:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:00:08 oleg434-client kernel: Call Trace: Aug 15 10:00:08 oleg434-client kernel: Aug 15 10:00:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:00:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:00:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:00:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:00:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:00:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:00:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:00:08 oleg434-client kernel: Aug 15 10:00:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:00:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:00:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:00:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:00:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:00:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:00:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:00:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:00:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:00:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:00:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:00:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:00:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:00:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:00:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:00:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:00:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:00:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:00:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:00:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:00:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:00:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:00:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:00:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:00:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:00:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:00:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:00:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:00:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:00:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:00:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:00:12 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:00:12 oleg434-client kernel: RAX: 000000000000058a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:00:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:00:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:00:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:00:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:00:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:00:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:00:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:00:12 oleg434-client kernel: Call Trace: Aug 15 10:00:12 oleg434-client kernel: Aug 15 10:00:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:00:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:00:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:00:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:00:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:00:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:00:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:00:12 oleg434-client kernel: Aug 15 10:00:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:00:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:00:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:00:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:00:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:00:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:00:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:00:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:00:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:00:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:00:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:00:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:00:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:00:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:00:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:00:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:00:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:00:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:00:24 oleg434-client kernel: RDX: 0000000000001895 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:00:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:00:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:00:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:00:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:00:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:00:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:00:24 oleg434-client kernel: Call Trace: Aug 15 10:00:24 oleg434-client kernel: Aug 15 10:00:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:00:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:00:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:00:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:00:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:00:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:00:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:00:24 oleg434-client kernel: Aug 15 10:00:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:00:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:00:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:00:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:00:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:00:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:00:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:00:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:00:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:00:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:00:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:00:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:00:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:00:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:00:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:00:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:00:36 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:00:36 oleg434-client kernel: RAX: 0000000000007a97 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:00:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:00:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:00:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:00:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:00:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:00:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:00:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:00:36 oleg434-client kernel: Call Trace: Aug 15 10:00:36 oleg434-client kernel: Aug 15 10:00:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:00:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:00:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:00:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:00:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:00:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:00:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:00:36 oleg434-client kernel: Aug 15 10:00:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:00:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:00:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:00:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:00:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:00:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:00:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:00:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:00:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:00:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:00:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:00:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:00:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:00:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:00:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:00:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:00:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:00:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:00:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:00:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:00:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:00:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:00:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:00:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:00:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:00:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:00:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:00:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:00:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:00:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:00:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:00:40 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:00:40 oleg434-client kernel: RAX: 0000000000007f08 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:00:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:00:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:00:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:00:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:00:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:00:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:00:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:00:40 oleg434-client kernel: Call Trace: Aug 15 10:00:40 oleg434-client kernel: Aug 15 10:00:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:00:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:00:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:00:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:00:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:00:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:00:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:00:40 oleg434-client kernel: Aug 15 10:00:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:00:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:00:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:00:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:00:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:00:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:00:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:00:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:00:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:00:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:00:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:00:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:00:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:00:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:00:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:00:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:00:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:00:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:00:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:00:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:00:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:00:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:00:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:00:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:00:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:00:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:00:52 oleg434-client kernel: Call Trace: Aug 15 10:00:52 oleg434-client kernel: Aug 15 10:00:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:00:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:00:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:00:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:00:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:00:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:00:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:00:52 oleg434-client kernel: Aug 15 10:00:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:00:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:00:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:00:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:00:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:00:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:00:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:00:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:00:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:00:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:00:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:00:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:01:01 oleg434-client CROND[38096]: (root) CMD (run-parts /etc/cron.hourly) Aug 15 10:01:01 oleg434-client run-parts[38096]: (/etc/cron.hourly) starting 0anacron Aug 15 10:01:01 oleg434-client run-parts[38096]: (/etc/cron.hourly) finished 0anacron Aug 15 10:01:01 oleg434-client anacron[38105]: Anacron started on 2026-08-15 Aug 15 10:01:01 oleg434-client anacron[38105]: Will run job `cron.daily' in 27 min. Aug 15 10:01:01 oleg434-client anacron[38105]: Will run job `cron.weekly' in 47 min. Aug 15 10:01:01 oleg434-client anacron[38105]: Will run job `cron.monthly' in 67 min. Aug 15 10:01:01 oleg434-client anacron[38105]: Jobs will be executed sequentially Aug 15 10:01:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:01:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:01:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:01:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:01:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:01:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:01:04 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:01:04 oleg434-client kernel: RAX: 0000000000007997 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:01:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:01:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:01:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:01:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:01:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:01:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:01:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:01:04 oleg434-client kernel: Call Trace: Aug 15 10:01:04 oleg434-client kernel: Aug 15 10:01:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:01:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:01:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:01:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:01:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:01:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:01:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:01:04 oleg434-client kernel: Aug 15 10:01:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:01:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:01:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:01:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:01:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:01:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:01:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:01:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:01:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:01:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:01:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:01:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:01:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:01:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:01:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:01:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:01:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:01:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:01:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:01:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:01:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:01:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:01:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:01:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:01:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:01:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:01:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:01:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:01:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:01:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:01:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:01:08 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:01:08 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:01:08 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13 Aug 15 10:01:08 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:01:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:01:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:01:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:01:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:01:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:01:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:01:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:01:08 oleg434-client kernel: Call Trace: Aug 15 10:01:08 oleg434-client kernel: Aug 15 10:01:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:01:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:01:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:01:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:01:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:01:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:01:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:01:08 oleg434-client kernel: Aug 15 10:01:08 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:01:08 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:01:08 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:01:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:01:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:01:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:01:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:01:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:01:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:01:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:01:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:01:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:01:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:01:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:01:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:01:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:01:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:01:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:01:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:01:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:01:20 oleg434-client kernel: RDX: 0000000000007e1d RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:01:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:01:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:01:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:01:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:01:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:01:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:01:20 oleg434-client kernel: Call Trace: Aug 15 10:01:20 oleg434-client kernel: Aug 15 10:01:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:01:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:01:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:01:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:01:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:01:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:01:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:01:20 oleg434-client kernel: Aug 15 10:01:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:01:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:01:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:01:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:01:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:01:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:01:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:01:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:01:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:01:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:01:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:01:30 oleg434-client kernel: INFO: task khugepaged:48 blocked for more than 120 seconds. Aug 15 10:01:30 oleg434-client kernel: Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:01:30 oleg434-client kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 15 10:01:30 oleg434-client kernel: task:khugepaged state:D stack:0 pid:48 ppid:2 flags:0x80004000 Aug 15 10:01:30 oleg434-client kernel: Call Trace: Aug 15 10:01:30 oleg434-client kernel: __schedule+0x351/0xcb0 Aug 15 10:01:30 oleg434-client kernel: ? wait_for_completion+0xae/0x1e0 Aug 15 10:01:30 oleg434-client kernel: schedule+0xc0/0x180 Aug 15 10:01:30 oleg434-client kernel: schedule_timeout+0x126/0x190 Aug 15 10:01:30 oleg434-client kernel: ? try_to_wake_up+0x80/0x710 Aug 15 10:01:30 oleg434-client kernel: ? __prepare_to_swait+0x5b/0x90 Aug 15 10:01:30 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:01:30 oleg434-client kernel: wait_for_completion+0xf0/0x1e0 Aug 15 10:01:30 oleg434-client kernel: flush_work+0x1f3/0x390 Aug 15 10:01:30 oleg434-client kernel: ? flush_workqueue_prep_pwqs+0x200/0x200 Aug 15 10:01:30 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:01:30 oleg434-client kernel: ? __pagevec_release+0x50/0x50 Aug 15 10:01:30 oleg434-client kernel: lru_add_drain_all+0x1d4/0x280 Aug 15 10:01:30 oleg434-client kernel: khugepaged+0xa2/0x16f0 Aug 15 10:01:30 oleg434-client kernel: ? woken_wake_function+0x30/0x30 Aug 15 10:01:30 oleg434-client kernel: ? collapse_pte_mapped_thp+0x8a0/0x8a0 Aug 15 10:01:30 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:01:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:01:30 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:01:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:01:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:01:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:01:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:01:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:01:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:01:32 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:01:32 oleg434-client kernel: RAX: 0000000000005c6b RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:01:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:01:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:01:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:01:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:01:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:01:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:01:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:01:32 oleg434-client kernel: Call Trace: Aug 15 10:01:32 oleg434-client kernel: Aug 15 10:01:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:01:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:01:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:01:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:01:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:01:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:01:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:01:32 oleg434-client kernel: Aug 15 10:01:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:01:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:01:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:01:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:01:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:01:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:01:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:01:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:01:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:01:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:01:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:01:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:01:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:01:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:01:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:01:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:01:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:01:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:01:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:01:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:01:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:01:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:01:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:01:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:01:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:01:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:01:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:01:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:01:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:01:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:01:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:01:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:01:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:01:36 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:01:36 oleg434-client kernel: RAX: 000000000000546d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:01:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:01:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:01:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:01:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:01:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:01:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:01:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:01:36 oleg434-client kernel: Call Trace: Aug 15 10:01:36 oleg434-client kernel: Aug 15 10:01:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:01:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:01:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:01:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:01:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:01:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:01:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:01:36 oleg434-client kernel: Aug 15 10:01:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:01:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:01:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:01:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:01:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:01:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:01:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:01:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:01:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:01:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:01:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:01:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:01:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:01:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:01:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:01:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:01:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:01:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:01:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:01:48 oleg434-client kernel: RDX: 0000000000000731 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:01:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:01:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:01:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:01:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:01:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:01:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:01:48 oleg434-client kernel: Call Trace: Aug 15 10:01:48 oleg434-client kernel: Aug 15 10:01:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:01:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:01:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:01:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:01:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:01:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:01:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:01:48 oleg434-client kernel: Aug 15 10:01:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:01:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:01:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:01:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:01:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:01:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:01:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:01:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:01:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:01:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:01:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:02:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:02:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:02:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:00 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:02:00 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:02:00 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:02:00 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:02:00 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:02:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:02:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:02:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:02:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:02:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:02:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:02:00 oleg434-client kernel: Call Trace: Aug 15 10:02:00 oleg434-client kernel: Aug 15 10:02:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:02:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:02:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:02:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:00 oleg434-client kernel: Aug 15 10:02:00 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:02:00 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:02:00 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:02:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:02:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:02:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:02:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:02:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:02:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:02:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:02:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:02:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:02:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:02:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:02:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:02:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:02:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:02:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:02:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:02:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:02:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:02:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:02:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:02:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:02:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:02:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:02:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:02:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:02:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:02:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:02:04 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:02:04 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:02:04 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:02:04 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:02:04 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:02:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:02:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:02:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:02:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:02:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:02:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:02:04 oleg434-client kernel: Call Trace: Aug 15 10:02:04 oleg434-client kernel: Aug 15 10:02:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:02:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:02:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:02:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:04 oleg434-client kernel: Aug 15 10:02:04 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:02:04 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:02:04 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:02:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:02:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:02:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:02:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:02:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:02:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:02:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:02:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:02:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:02:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:02:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:02:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:02:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:02:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:02:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:02:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:02:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:02:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:02:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:02:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:02:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:02:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:02:16 oleg434-client kernel: Call Trace: Aug 15 10:02:16 oleg434-client kernel: Aug 15 10:02:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:02:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:02:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:02:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:16 oleg434-client kernel: Aug 15 10:02:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:02:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:02:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:02:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:02:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:02:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:02:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:02:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:02:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:02:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:02:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:02:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:02:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:02:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:02:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:28 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:02:28 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:02:28 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:02:28 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:02:28 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:02:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:02:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:02:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:02:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:02:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:02:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:02:28 oleg434-client kernel: Call Trace: Aug 15 10:02:28 oleg434-client kernel: Aug 15 10:02:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:02:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:02:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:02:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:28 oleg434-client kernel: Aug 15 10:02:28 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:02:28 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:02:28 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:02:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:02:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:02:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:02:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:02:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:02:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:02:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:02:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:02:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:02:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:02:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:02:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:02:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:02:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:02:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:02:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:02:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:02:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:02:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:02:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:02:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:02:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:02:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:02:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:02:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:02:30 oleg434-client kernel: rcu: #0110-....: (241343 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=76646 Aug 15 10:02:30 oleg434-client kernel: #011(t=420007 jiffies g=297885 q=4355) Aug 15 10:02:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:02:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:30 oleg434-client kernel: Call Trace: Aug 15 10:02:30 oleg434-client kernel: Aug 15 10:02:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:02:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:02:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:02:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:02:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:02:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:02:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:02:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:02:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:02:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:02:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:02:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:02:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:30 oleg434-client kernel: Aug 15 10:02:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:02:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:02:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:02:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:02:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:02:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:02:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:02:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:02:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:02:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:02:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:02:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:02:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:02:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:02:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:02:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:02:32 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:02:32 oleg434-client kernel: RAX: 0000000000007391 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:02:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:02:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:02:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:02:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:02:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:02:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:02:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:02:32 oleg434-client kernel: Call Trace: Aug 15 10:02:32 oleg434-client kernel: Aug 15 10:02:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:02:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:02:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:02:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:32 oleg434-client kernel: Aug 15 10:02:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:02:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:02:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:02:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:02:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:02:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:02:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:02:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:02:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:02:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:02:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:02:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:02:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:02:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) Aug 15 10:02:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:02:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:02:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:02:56 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:02:56 oleg434-client kernel: RAX: 00000000000057ab RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:02:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:02:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:02:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:02:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:02:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:02:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:02:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:02:56 oleg434-client kernel: Call Trace: Aug 15 10:02:56 oleg434-client kernel: Aug 15 10:02:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:02:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:02:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:02:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:56 oleg434-client kernel: Aug 15 10:02:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:02:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:02:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:02:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:02:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:02:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:02:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:02:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:02:56 oleg434-client kernel: mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:02:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:02:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:02:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:02:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:02:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:02:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:02:56 oleg434-client kernel: RDX: 0000000000007c8c RSI: 0000000000000008 RDI: ffffffff91001000 Aug 15 10:02:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:02:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:02:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:02:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:02:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:02:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:02:56 oleg434-client kernel: Call Trace: Aug 15 10:02:56 oleg434-client kernel: Aug 15 10:02:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:02:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:02:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:02:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:02:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:02:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:02:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:02:56 oleg434-client kernel: Aug 15 10:02:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:02:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x650/0x6d0 Aug 15 10:02:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:02:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:02:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:02:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:02:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:02:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:02:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:02:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:02:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:02:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:02:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:02:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:02:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:02:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:02:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:02:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:02:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:02:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:02:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:02:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:02:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:02:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:02:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:02:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:02:56 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:03:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:03:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:03:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:03:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:03:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:03:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:03:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:03:00 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:03:00 oleg434-client kernel: RAX: 0000000000006cc6 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:03:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:03:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:03:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:03:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:03:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:03:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:03:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:03:00 oleg434-client kernel: Call Trace: Aug 15 10:03:00 oleg434-client kernel: Aug 15 10:03:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:03:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:03:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:03:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:03:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:03:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:03:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:03:00 oleg434-client kernel: Aug 15 10:03:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:03:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:03:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:03:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:03:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:03:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:03:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:03:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:03:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:03:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:03:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:03:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:03:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:03:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:03:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:03:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:03:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:03:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:03:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:03:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:03:24 oleg434-client kernel: RDX: 0000000000004bf7 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:03:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:03:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:03:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:03:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:03:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:03:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:03:24 oleg434-client kernel: Call Trace: Aug 15 10:03:24 oleg434-client kernel: Aug 15 10:03:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:03:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:03:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:03:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:03:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:03:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:03:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:03:24 oleg434-client kernel: Aug 15 10:03:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:03:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:03:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:03:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:03:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:03:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:03:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:03:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:03:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:03:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:03:24 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:03:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:03:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:03:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:03:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:03:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:03:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:03:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:03:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:03:24 oleg434-client kernel: Call Trace: Aug 15 10:03:24 oleg434-client kernel: Aug 15 10:03:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:03:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:03:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:03:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:03:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:03:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:03:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:03:24 oleg434-client kernel: Aug 15 10:03:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:03:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:03:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:03:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:03:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:03:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:03:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:03:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:03:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:03:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:03:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:03:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:03:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:03:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:03:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:03:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:03:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:03:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:03:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:03:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:03:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:03:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:03:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:03:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:03:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:03:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:03:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:03:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:03:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:03:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:03:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:03:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:03:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:03:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:03:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:03:28 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:03:28 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:03:28 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:03:28 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:03:28 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:03:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:03:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:03:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:03:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:03:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:03:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:03:28 oleg434-client kernel: Call Trace: Aug 15 10:03:28 oleg434-client kernel: Aug 15 10:03:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:03:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:03:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:03:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:03:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:03:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:03:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:03:28 oleg434-client kernel: Aug 15 10:03:28 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:03:28 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:03:28 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:03:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:03:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:03:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:03:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:03:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:03:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:03:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:03:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:03:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:03:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:03:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:03:52 oleg434-client kernel: Modules linked in: Aug 15 10:03:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:03:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:03:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:03:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:03:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:03:52 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:03:52 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:03:52 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:03:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:03:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:03:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:03:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:03:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:03:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:03:52 oleg434-client kernel: Call Trace: Aug 15 10:03:52 oleg434-client kernel: Aug 15 10:03:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:03:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:03:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:03:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:03:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:03:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:03:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:03:52 oleg434-client kernel: lustre(O) Aug 15 10:03:52 oleg434-client kernel: Aug 15 10:03:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:03:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:03:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:03:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:03:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:03:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:03:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:03:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:03:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:03:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:03:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:03:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:03:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:03:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:03:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:03:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:03:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:03:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:03:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:03:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:03:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:03:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:03:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:03:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:03:52 oleg434-client kernel: osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:03:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:03:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:03:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:03:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:03:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:03:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:03:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:03:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:03:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:03:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:03:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:03:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:03:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:03:52 oleg434-client kernel: Call Trace: Aug 15 10:03:52 oleg434-client kernel: Aug 15 10:03:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:03:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:03:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:03:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:03:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:03:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:03:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:03:52 oleg434-client kernel: Aug 15 10:03:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:03:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:03:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:03:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:03:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:03:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:03:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:03:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:03:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:03:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:03:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:03:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:03:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:03:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:03:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:03:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:03:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:03:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:03:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:03:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:03:56 oleg434-client kernel: RAX: 000000000000597a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:03:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:03:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:03:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:03:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:03:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:03:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:03:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:03:56 oleg434-client kernel: Call Trace: Aug 15 10:03:56 oleg434-client kernel: Aug 15 10:03:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:03:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:03:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:03:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:03:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:03:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:03:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:03:56 oleg434-client kernel: Aug 15 10:03:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:03:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:03:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:03:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:03:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:03:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:03:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:03:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:03:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:03:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:03:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:04:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:04:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:04:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:04:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:04:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:04:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:04:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:04:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:04:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:04:20 oleg434-client kernel: RDX: 00000000000075b2 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:04:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:04:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:04:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:04:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:04:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:04:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:04:20 oleg434-client kernel: Call Trace: Aug 15 10:04:20 oleg434-client kernel: Aug 15 10:04:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:04:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:04:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:04:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:04:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:04:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:04:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:04:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:04:20 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:04:20 oleg434-client kernel: RAX: 000000000000658a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:04:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:04:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:04:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:04:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:04:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:04:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:04:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:04:20 oleg434-client kernel: Call Trace: Aug 15 10:04:20 oleg434-client kernel: Aug 15 10:04:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:04:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:04:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:04:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:04:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:04:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:04:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:04:20 oleg434-client kernel: Aug 15 10:04:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:04:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:04:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:04:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:04:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:04:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:04:20 oleg434-client kernel: Aug 15 10:04:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:04:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:04:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:04:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:04:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:04:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:04:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:04:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:04:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:04:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:04:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:04:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:04:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:04:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:04:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:04:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:04:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:04:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:04:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:04:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:04:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:04:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:04:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:04:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:04:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:04:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:04:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:04:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:04:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:04:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:04:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:04:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:04:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:04:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:04:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:04:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:04:24 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:04:24 oleg434-client kernel: RAX: 0000000000006188 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:04:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:04:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:04:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:04:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:04:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:04:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:04:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:04:24 oleg434-client kernel: Call Trace: Aug 15 10:04:24 oleg434-client kernel: Aug 15 10:04:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:04:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:04:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:04:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:04:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:04:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:04:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:04:24 oleg434-client kernel: Aug 15 10:04:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:04:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:04:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:04:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:04:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:04:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:04:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:04:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:04:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:04:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:04:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:04:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:04:48 oleg434-client kernel: Modules linked in: Aug 15 10:04:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:04:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:04:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:04:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:04:48 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:04:48 oleg434-client kernel: RAX: 00000000000009fd RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:04:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:04:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:04:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:04:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:04:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:04:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:04:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:04:48 oleg434-client kernel: Call Trace: Aug 15 10:04:48 oleg434-client kernel: Aug 15 10:04:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:04:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:04:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:04:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:04:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:04:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:04:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:04:48 oleg434-client kernel: Aug 15 10:04:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:04:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:04:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:04:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:04:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:04:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:04:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:04:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:04:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:04:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:04:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:04:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:04:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:04:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:04:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:04:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:04:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:04:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:04:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:04:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:04:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:04:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:04:48 oleg434-client kernel: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:04:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:04:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:04:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:04:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:04:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:04:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:04:48 oleg434-client kernel: RDX: 0000000000006ea2 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:04:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:04:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:04:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:04:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:04:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:04:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:04:48 oleg434-client kernel: Call Trace: Aug 15 10:04:48 oleg434-client kernel: Aug 15 10:04:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:04:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:04:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:04:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:04:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:04:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:04:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:04:48 oleg434-client kernel: Aug 15 10:04:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:04:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:04:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:04:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:04:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:04:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:04:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:04:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:04:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:04:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:04:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:04:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:04:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:04:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:04:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:04:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:04:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:04:52 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:04:52 oleg434-client kernel: RAX: 0000000000006f2c RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:04:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:04:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:04:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:04:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:04:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:04:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:04:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:04:52 oleg434-client kernel: Call Trace: Aug 15 10:04:52 oleg434-client kernel: Aug 15 10:04:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:04:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:04:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:04:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:04:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:04:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:04:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:04:52 oleg434-client kernel: Aug 15 10:04:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:04:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:04:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:04:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:04:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:04:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:04:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:04:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:04:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:04:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:04:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:05:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:05:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:05:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:05:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:05:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) Aug 15 10:05:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:05:16 oleg434-client kernel: mdc(O) lov(O) osc(O) lmv(O) Aug 15 10:05:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:05:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:05:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:05:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:05:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:05:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:05:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:05:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:05:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:05:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:05:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:05:16 oleg434-client kernel: Call Trace: Aug 15 10:05:16 oleg434-client kernel: Aug 15 10:05:16 oleg434-client kernel: ec(O) Aug 15 10:05:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:05:16 oleg434-client kernel: fid(O) Aug 15 10:05:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:05:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:05:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:05:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:05:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:05:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:05:16 oleg434-client kernel: Aug 15 10:05:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:05:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:05:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:05:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:05:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:05:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:05:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:05:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:05:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:05:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:05:16 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:05:16 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:05:16 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:05:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:05:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:05:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:05:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:05:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:05:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:05:16 oleg434-client kernel: Call Trace: Aug 15 10:05:16 oleg434-client kernel: Aug 15 10:05:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:05:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:05:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:05:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:05:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:05:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:05:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:05:16 oleg434-client kernel: Aug 15 10:05:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:05:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:05:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:05:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:05:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:05:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:05:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:05:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:05:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:05:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:05:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:05:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:05:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:05:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:05:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:05:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:05:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:05:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:05:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:05:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:05:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:05:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:05:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:05:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:05:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:05:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:05:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:05:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:05:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:05:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:05:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:05:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:05:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:05:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:05:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:05:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:05:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:05:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:05:20 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:05:20 oleg434-client kernel: RAX: 000000000000671f RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:05:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:05:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:05:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:05:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:05:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:05:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:05:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:05:20 oleg434-client kernel: Call Trace: Aug 15 10:05:20 oleg434-client kernel: Aug 15 10:05:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:05:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:05:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:05:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:05:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:05:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:05:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:05:20 oleg434-client kernel: Aug 15 10:05:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:05:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:05:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:05:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:05:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:05:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:05:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:05:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:05:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:05:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:05:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:05:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:05:30 oleg434-client kernel: rcu: #0110-....: (357419 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=110773 Aug 15 10:05:30 oleg434-client kernel: #011(t=600010 jiffies g=297885 q=5089) Aug 15 10:05:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:05:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:05:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:05:30 oleg434-client kernel: Call Trace: Aug 15 10:05:30 oleg434-client kernel: Aug 15 10:05:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:05:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:05:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:05:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:05:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:05:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:05:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:05:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:05:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:05:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:05:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:05:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:05:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:05:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:05:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:05:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:05:30 oleg434-client kernel: Aug 15 10:05:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:05:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:05:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:05:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:05:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:05:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:05:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:05:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:05:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:05:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:05:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:05:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:05:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:05:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:05:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:05:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:05:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:05:44 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:05:44 oleg434-client kernel: RAX: 0000000000007e07 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:05:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:05:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:05:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:05:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:05:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:05:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:05:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:05:44 oleg434-client kernel: Call Trace: Aug 15 10:05:44 oleg434-client kernel: Aug 15 10:05:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:05:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:05:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:05:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:05:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:05:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:05:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:05:44 oleg434-client kernel: Aug 15 10:05:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:05:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:05:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:05:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:05:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:05:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:05:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:05:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:05:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:05:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:05:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:05:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:05:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:05:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:05:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:05:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:05:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:05:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:05:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:05:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:05:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:05:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:05:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:05:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:05:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:05:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:05:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:05:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:05:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:05:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:05:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:05:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:05:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:05:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:05:48 oleg434-client kernel: RAX: 0000000000007e35 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:05:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:05:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:05:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:05:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:05:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:05:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:05:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:05:48 oleg434-client kernel: Call Trace: Aug 15 10:05:48 oleg434-client kernel: Aug 15 10:05:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:05:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:05:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:05:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:05:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:05:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:05:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:05:48 oleg434-client kernel: Aug 15 10:05:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:05:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:05:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:05:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:05:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:05:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:05:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:05:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:05:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:05:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:05:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:05:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:05:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:05:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:05:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:05:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:05:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:05:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:05:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:05:56 oleg434-client kernel: RDX: 00000000000011ee RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:05:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:05:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:05:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:05:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:05:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:05:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:05:56 oleg434-client kernel: Call Trace: Aug 15 10:05:56 oleg434-client kernel: Aug 15 10:05:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:05:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:05:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:05:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:05:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:05:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:05:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:05:56 oleg434-client kernel: Aug 15 10:05:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:05:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:05:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:05:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:05:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:05:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:05:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:05:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:05:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:05:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:05:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:06:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:06:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:06:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:06:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:06:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:06:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:06:12 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:06:12 oleg434-client kernel: RAX: 0000000000007481 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:06:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:06:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:06:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:06:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:06:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:06:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:06:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:06:12 oleg434-client kernel: Call Trace: Aug 15 10:06:12 oleg434-client kernel: Aug 15 10:06:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:06:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:06:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:06:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:06:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:06:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:06:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:06:12 oleg434-client kernel: Aug 15 10:06:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:06:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:06:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:06:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:06:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:06:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:06:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:06:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:06:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:06:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:06:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:06:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:06:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:06:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:06:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:06:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:06:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:06:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:06:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:06:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:06:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:06:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:06:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:06:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:06:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:06:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:06:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:06:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:06:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:06:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:06:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:06:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:06:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:06:16 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:06:16 oleg434-client kernel: RAX: 0000000000006b0d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:06:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:06:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:06:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:06:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:06:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:06:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:06:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:06:16 oleg434-client kernel: Call Trace: Aug 15 10:06:16 oleg434-client kernel: Aug 15 10:06:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:06:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:06:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:06:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:06:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:06:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:06:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:06:16 oleg434-client kernel: Aug 15 10:06:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:06:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:06:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:06:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:06:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:06:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:06:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:06:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:06:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:06:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:06:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:06:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:06:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:06:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:06:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:06:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:06:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:06:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:06:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:06:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:06:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:06:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:06:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:06:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:06:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:06:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:06:24 oleg434-client kernel: Call Trace: Aug 15 10:06:24 oleg434-client kernel: Aug 15 10:06:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:06:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:06:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:06:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:06:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:06:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:06:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:06:24 oleg434-client kernel: Aug 15 10:06:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:06:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:06:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:06:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:06:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:06:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:06:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:06:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:06:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:06:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:06:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:06:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:06:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:06:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:06:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:06:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:06:40 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:06:40 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:06:40 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:06:40 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:06:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:06:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:06:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:06:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:06:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:06:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:06:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:06:40 oleg434-client kernel: Call Trace: Aug 15 10:06:40 oleg434-client kernel: Aug 15 10:06:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:06:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:06:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:06:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:06:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:06:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:06:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:06:40 oleg434-client kernel: Aug 15 10:06:40 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:06:40 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:06:40 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:06:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:06:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:06:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:06:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:06:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:06:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:06:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:06:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:06:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:06:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:06:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:06:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:06:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:06:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:06:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:06:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:06:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:06:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:06:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:06:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:06:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:06:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:06:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:06:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:06:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:06:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:06:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:06:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:06:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:06:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:06:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:06:44 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:06:44 oleg434-client kernel: RAX: 0000000000007e5e RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:06:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:06:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:06:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:06:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:06:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:06:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:06:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:06:44 oleg434-client kernel: Call Trace: Aug 15 10:06:44 oleg434-client kernel: Aug 15 10:06:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:06:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:06:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:06:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:06:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:06:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:06:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:06:44 oleg434-client kernel: Aug 15 10:06:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:06:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:06:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:06:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:06:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:06:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:06:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:06:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:06:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:06:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:06:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:06:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:06:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:06:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:06:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:06:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:06:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:06:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:06:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:06:52 oleg434-client kernel: RDX: 00000000000052fb RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:06:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:06:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:06:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:06:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:06:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:06:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:06:52 oleg434-client kernel: Call Trace: Aug 15 10:06:52 oleg434-client kernel: Aug 15 10:06:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:06:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:06:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:06:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:06:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:06:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:06:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:06:52 oleg434-client kernel: Aug 15 10:06:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:06:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:06:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:06:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:06:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:06:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:06:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:06:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:06:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:06:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:06:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:07:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:07:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:07:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:07:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:07:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:07:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:07:08 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:07:08 oleg434-client kernel: RAX: 0000000000005394 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:07:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:07:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:07:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:07:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:07:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:07:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:07:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:07:08 oleg434-client kernel: Call Trace: Aug 15 10:07:08 oleg434-client kernel: Aug 15 10:07:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:07:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:07:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:07:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:07:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:07:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:07:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:07:08 oleg434-client kernel: Aug 15 10:07:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:07:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:07:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:07:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:07:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:07:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:07:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:07:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:07:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:07:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:07:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:07:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:07:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:07:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:07:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:07:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:07:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:07:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:07:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:07:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:07:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:07:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:07:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:07:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:07:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:07:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:07:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:07:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:07:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:07:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:07:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:07:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:07:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:07:12 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:07:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:07:12 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:07:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:07:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:07:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:07:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:07:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:07:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:07:12 oleg434-client kernel: Call Trace: Aug 15 10:07:12 oleg434-client kernel: Aug 15 10:07:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:07:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:07:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:07:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:07:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:07:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:07:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:07:12 oleg434-client kernel: Aug 15 10:07:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:07:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:07:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:07:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:07:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:07:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:07:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:07:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:07:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:07:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:07:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:07:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:07:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:07:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:07:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:07:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:07:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:07:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:07:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:07:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:07:20 oleg434-client kernel: RDX: 0000000000006b0f RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:07:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:07:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:07:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:07:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:07:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:07:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:07:20 oleg434-client kernel: Call Trace: Aug 15 10:07:20 oleg434-client kernel: Aug 15 10:07:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:07:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:07:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:07:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:07:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:07:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:07:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:07:20 oleg434-client kernel: Aug 15 10:07:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:07:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:07:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:07:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:07:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:07:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:07:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:07:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:07:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:07:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:07:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:07:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:07:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:07:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:07:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:07:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:07:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:07:36 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:07:36 oleg434-client kernel: RAX: 0000000000007989 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:07:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:07:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:07:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:07:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:07:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:07:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:07:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:07:36 oleg434-client kernel: Call Trace: Aug 15 10:07:36 oleg434-client kernel: Aug 15 10:07:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:07:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:07:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:07:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:07:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:07:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:07:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:07:36 oleg434-client kernel: Aug 15 10:07:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:07:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:07:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:07:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:07:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:07:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:07:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:07:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:07:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:07:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:07:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:07:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:07:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:07:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:07:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:07:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:07:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:07:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:07:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:07:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:07:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:07:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:07:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:07:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:07:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:07:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:07:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:07:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:07:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:07:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:07:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:07:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:07:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:07:40 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:07:40 oleg434-client kernel: RAX: 00000000000032b5 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:07:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:07:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:07:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:07:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:07:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:07:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:07:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:07:40 oleg434-client kernel: Call Trace: Aug 15 10:07:40 oleg434-client kernel: Aug 15 10:07:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:07:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:07:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:07:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:07:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:07:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:07:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:07:40 oleg434-client kernel: Aug 15 10:07:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:07:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:07:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:07:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:07:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:07:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:07:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:07:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:07:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:07:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:07:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:07:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:07:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:07:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:07:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:07:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:07:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:07:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:07:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:07:48 oleg434-client kernel: RDX: 0000000000000f3a RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:07:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:07:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:07:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:07:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:07:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:07:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:07:48 oleg434-client kernel: Call Trace: Aug 15 10:07:48 oleg434-client kernel: Aug 15 10:07:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:07:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:07:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:07:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:07:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:07:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:07:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:07:48 oleg434-client kernel: Aug 15 10:07:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:07:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:07:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:07:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:07:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:07:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:07:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:07:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:07:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:07:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:07:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:08:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:08:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:08:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:08:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:08:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:08:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:08:04 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:08:04 oleg434-client kernel: RAX: 000000000000448d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:08:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:08:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:08:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:08:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:08:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:08:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:08:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:08:04 oleg434-client kernel: Call Trace: Aug 15 10:08:04 oleg434-client kernel: Aug 15 10:08:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:08:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:08:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:08:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:08:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:08:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:08:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:08:04 oleg434-client kernel: Aug 15 10:08:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:08:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:08:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:08:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:08:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:08:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:08:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:08:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:08:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:08:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:08:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:08:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:08:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:08:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:08:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:08:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:08:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:08:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:08:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:08:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:08:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:08:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:08:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:08:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:08:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:08:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:08:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:08:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:08:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:08:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:08:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:08:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x328/0x6d0 Aug 15 10:08:08 oleg434-client kernel: Code: d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 83 e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 05 18 d4 dc 02 01 e0 48 83 05 06 d4 dc 02 01 48 83 05 be d5 dc 02 01 8b 45 08 85 Aug 15 10:08:08 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:08:08 oleg434-client kernel: RAX: 000000000000487b RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:08:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:08:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:08:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:08:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:08:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:08:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:08:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:08:08 oleg434-client kernel: Call Trace: Aug 15 10:08:08 oleg434-client kernel: Aug 15 10:08:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:08:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:08:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:08:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:08:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:08:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:08:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:08:08 oleg434-client kernel: Aug 15 10:08:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x328/0x6d0 Aug 15 10:08:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:08:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:08:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:08:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:08:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:08:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:08:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:08:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:08:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:08:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:08:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:08:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:08:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:08:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:08:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:08:16 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:08:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:08:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:08:16 oleg434-client kernel: RDX: 000000000000332f RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:08:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:08:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:08:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:08:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:08:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:08:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:08:16 oleg434-client kernel: Call Trace: Aug 15 10:08:16 oleg434-client kernel: Aug 15 10:08:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:08:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:08:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:08:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:08:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:08:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:08:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:08:16 oleg434-client kernel: Aug 15 10:08:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:08:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:08:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:08:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:08:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:08:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:08:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:08:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:08:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:08:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:08:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:08:16 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:08:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:08:30 oleg434-client kernel: rcu: #0110-....: (466027 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=143937 Aug 15 10:08:30 oleg434-client kernel: #011(t=780018 jiffies g=297885 q=5835) Aug 15 10:08:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:08:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:08:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:08:30 oleg434-client kernel: Call Trace: Aug 15 10:08:30 oleg434-client kernel: Aug 15 10:08:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:08:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:08:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:08:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:08:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:08:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:08:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:08:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:08:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:08:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:08:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:08:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:08:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:08:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:08:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:08:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:08:30 oleg434-client kernel: Aug 15 10:08:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:08:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:08:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:08:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:08:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:08:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:08:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:08:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:08:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:08:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:08:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:08:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:08:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:08:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:08:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:08:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:08:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:08:32 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:08:32 oleg434-client kernel: RAX: 000000000000059d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:08:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:08:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:08:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:08:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:08:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:08:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:08:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:08:32 oleg434-client kernel: Call Trace: Aug 15 10:08:32 oleg434-client kernel: Aug 15 10:08:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:08:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:08:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:08:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:08:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:08:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:08:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:08:32 oleg434-client kernel: Aug 15 10:08:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:08:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:08:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:08:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:08:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:08:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:08:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:08:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:08:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:08:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:08:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:08:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:08:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:08:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:08:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:08:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:08:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:08:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:08:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:08:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:08:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:08:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:08:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:08:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:08:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:08:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:08:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:08:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:08:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:08:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:08:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:08:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:08:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:08:36 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:08:36 oleg434-client kernel: RAX: 0000000000001b14 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:08:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:08:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:08:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:08:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:08:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:08:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:08:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:08:36 oleg434-client kernel: Call Trace: Aug 15 10:08:36 oleg434-client kernel: Aug 15 10:08:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:08:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:08:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:08:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:08:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:08:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:08:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:08:36 oleg434-client kernel: Aug 15 10:08:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:08:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:08:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:08:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:08:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:08:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:08:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:08:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:08:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:08:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:08:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:08:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:08:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:08:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:08:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:08:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:08:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:08:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:08:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:08:56 oleg434-client kernel: RDX: 0000000000006fbd RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:08:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:08:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:08:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:08:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:08:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:08:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:08:56 oleg434-client kernel: Call Trace: Aug 15 10:08:56 oleg434-client kernel: Aug 15 10:08:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:08:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:08:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:08:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:08:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:08:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:08:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:08:56 oleg434-client kernel: Aug 15 10:08:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:08:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:08:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:08:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:08:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:08:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:08:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:08:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:08:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:08:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:08:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:09:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:09:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:09:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:09:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:09:00 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:09:00 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:09:00 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:09:00 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:09:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:09:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:09:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:09:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:09:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:09:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:09:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:09:00 oleg434-client kernel: Call Trace: Aug 15 10:09:00 oleg434-client kernel: Aug 15 10:09:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:09:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:09:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:09:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:09:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:09:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:09:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:09:00 oleg434-client kernel: Aug 15 10:09:00 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:09:00 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:09:00 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:09:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:09:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:09:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:09:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:09:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:09:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:09:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:09:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:09:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:09:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:09:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:09:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:09:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:09:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:09:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:09:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:09:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:09:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:09:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:09:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:09:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:09:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:09:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:09:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:09:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:09:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:09:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:09:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:09:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:09:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:09:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:09:04 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:09:04 oleg434-client kernel: RAX: 0000000000005305 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:09:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:09:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:09:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:09:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:09:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:09:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:09:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:09:04 oleg434-client kernel: Call Trace: Aug 15 10:09:04 oleg434-client kernel: Aug 15 10:09:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:09:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:09:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:09:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:09:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:09:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:09:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:09:04 oleg434-client kernel: Aug 15 10:09:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:09:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:09:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:09:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:09:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:09:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:09:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:09:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:09:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:09:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:09:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:09:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:09:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:09:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:09:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:09:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:09:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:09:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:09:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:09:24 oleg434-client kernel: RDX: 000000000000204a RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:09:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:09:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:09:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:09:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:09:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:09:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:09:24 oleg434-client kernel: Call Trace: Aug 15 10:09:24 oleg434-client kernel: Aug 15 10:09:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:09:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:09:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:09:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:09:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:09:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:09:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:09:24 oleg434-client kernel: Aug 15 10:09:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:09:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:09:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:09:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:09:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:09:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:09:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:09:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:09:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:09:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:09:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:09:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:09:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:09:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:09:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:09:28 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:09:28 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:09:28 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:09:28 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:09:28 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:09:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:09:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:09:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:09:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:09:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:09:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:09:28 oleg434-client kernel: Call Trace: Aug 15 10:09:28 oleg434-client kernel: Aug 15 10:09:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:09:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:09:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:09:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:09:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:09:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:09:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:09:28 oleg434-client kernel: Aug 15 10:09:28 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:09:28 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:09:28 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:09:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:09:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:09:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:09:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:09:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:09:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:09:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:09:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:09:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:09:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:09:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:09:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:09:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:09:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:09:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:09:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:09:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:09:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:09:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:09:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:09:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:09:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:09:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:09:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:09:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:09:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:09:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:09:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:09:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:09:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:09:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:09:32 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:09:32 oleg434-client kernel: RAX: 0000000000003a18 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:09:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:09:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:09:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:09:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:09:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:09:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:09:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:09:32 oleg434-client kernel: Call Trace: Aug 15 10:09:32 oleg434-client kernel: Aug 15 10:09:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:09:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:09:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:09:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:09:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:09:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:09:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:09:32 oleg434-client kernel: Aug 15 10:09:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:09:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:09:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:09:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:09:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:09:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:09:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:09:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:09:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:09:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:09:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:09:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:09:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:09:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:09:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:09:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:09:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:09:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:09:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:09:52 oleg434-client kernel: RDX: 0000000000007061 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:09:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:09:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:09:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:09:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:09:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:09:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:09:52 oleg434-client kernel: Call Trace: Aug 15 10:09:52 oleg434-client kernel: Aug 15 10:09:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:09:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:09:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:09:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:09:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:09:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:09:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:09:52 oleg434-client kernel: Aug 15 10:09:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:09:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:09:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:09:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:09:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:09:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:09:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:09:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:09:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:09:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:09:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:09:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:09:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:09:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:09:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:09:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:09:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:09:56 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13 Aug 15 10:09:56 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:09:56 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:09:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:09:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:09:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:09:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:09:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:09:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:09:56 oleg434-client kernel: Call Trace: Aug 15 10:09:56 oleg434-client kernel: Aug 15 10:09:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:09:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:09:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:09:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:09:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:09:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:09:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:09:56 oleg434-client kernel: Aug 15 10:09:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:09:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:09:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:09:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:09:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:09:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:09:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:09:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:09:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:09:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:09:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:09:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:09:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:09:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:09:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:09:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:09:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:09:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:09:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:09:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:09:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:09:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:09:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:09:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:09:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:09:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:09:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:10:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:10:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:10:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:10:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:10:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:10:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:10:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:10:00 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:10:00 oleg434-client kernel: RAX: 000000000000779c RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:10:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:10:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:10:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:10:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:10:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:10:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:10:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:10:00 oleg434-client kernel: Call Trace: Aug 15 10:10:00 oleg434-client kernel: Aug 15 10:10:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:10:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:10:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:10:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:10:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:10:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:10:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:10:00 oleg434-client kernel: Aug 15 10:10:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:10:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:10:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:10:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:10:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:10:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:10:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:10:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:10:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:10:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:10:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:10:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:10:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:10:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:10:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:10:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:10:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:10:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:10:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:10:20 oleg434-client kernel: RDX: 000000000000423c RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:10:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:10:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:10:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:10:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:10:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:10:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:10:20 oleg434-client kernel: Call Trace: Aug 15 10:10:20 oleg434-client kernel: Aug 15 10:10:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:10:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:10:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:10:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:10:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:10:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:10:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:10:20 oleg434-client kernel: Aug 15 10:10:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:10:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:10:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:10:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:10:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:10:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:10:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:10:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:10:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:10:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:10:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:10:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:10:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:10:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:10:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:10:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:10:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:10:24 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:10:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:10:24 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:10:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:10:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:10:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:10:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:10:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:10:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:10:24 oleg434-client kernel: Call Trace: Aug 15 10:10:24 oleg434-client kernel: Aug 15 10:10:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:10:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:10:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:10:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:10:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:10:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:10:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:10:24 oleg434-client kernel: Aug 15 10:10:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:10:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:10:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:10:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:10:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:10:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:10:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:10:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:10:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:10:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:10:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:10:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:10:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:10:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:10:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:10:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:10:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:10:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:10:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:10:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:10:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:10:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:10:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:10:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:10:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:10:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:10:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:10:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:10:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:10:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:10:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:10:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:10:28 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:10:28 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:10:28 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:10:28 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:10:28 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:10:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:10:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:10:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:10:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:10:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:10:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:10:28 oleg434-client kernel: Call Trace: Aug 15 10:10:28 oleg434-client kernel: Aug 15 10:10:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:10:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:10:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:10:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:10:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:10:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:10:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:10:28 oleg434-client kernel: Aug 15 10:10:28 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:10:28 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:10:28 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:10:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:10:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:10:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:10:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:10:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:10:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:10:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:10:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:10:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:10:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:10:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:10:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:10:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:10:48 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:10:48 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:10:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:10:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:10:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:10:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:10:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:10:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:10:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:10:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:10:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:10:48 oleg434-client kernel: Call Trace: Aug 15 10:10:48 oleg434-client kernel: Aug 15 10:10:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:10:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:10:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:10:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:10:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:10:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:10:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:10:48 oleg434-client kernel: Aug 15 10:10:48 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:10:48 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:10:48 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:10:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:10:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:10:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:10:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:10:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:10:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:10:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:10:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:10:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:10:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:10:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:10:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:10:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:10:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:10:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:10:52 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:10:52 oleg434-client kernel: RAX: 000000000000385d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:10:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:10:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:10:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:10:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:10:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:10:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:10:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:10:52 oleg434-client kernel: Call Trace: Aug 15 10:10:52 oleg434-client kernel: Aug 15 10:10:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:10:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:10:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:10:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:10:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:10:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:10:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:10:52 oleg434-client kernel: Aug 15 10:10:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:10:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:10:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:10:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:10:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:10:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:10:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:10:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:10:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:10:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:10:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:10:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:10:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:10:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:10:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:10:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:10:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:10:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:10:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:10:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:10:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:10:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:10:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:10:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:10:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:10:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:10:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:10:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:10:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:10:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:10:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:10:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:10:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:10:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13 Aug 15 10:10:56 oleg434-client kernel: RAX: 0000000000003587 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:10:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:10:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:10:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:10:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:10:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:10:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:10:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:10:56 oleg434-client kernel: Call Trace: Aug 15 10:10:56 oleg434-client kernel: Aug 15 10:10:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:10:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:10:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:10:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:10:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:10:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:10:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:10:56 oleg434-client kernel: Aug 15 10:10:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:10:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:10:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:10:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:10:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:10:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:10:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:10:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:10:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:10:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:10:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:11:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:11:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:11:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:11:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:11:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:11:16 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:11:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:11:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:11:16 oleg434-client kernel: RDX: 0000000000007f87 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:11:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:11:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:11:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:11:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:11:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:11:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:11:16 oleg434-client kernel: Call Trace: Aug 15 10:11:16 oleg434-client kernel: Aug 15 10:11:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:11:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:11:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:11:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:11:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:11:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:11:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:11:16 oleg434-client kernel: Aug 15 10:11:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:11:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:11:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:11:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:11:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:11:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:11:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:11:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:11:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:11:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:11:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:11:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:11:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:11:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:11:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:11:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:11:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:11:20 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:11:20 oleg434-client kernel: RAX: 0000000000005b0a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:11:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:11:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:11:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:11:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:11:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:11:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:11:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:11:20 oleg434-client kernel: Call Trace: Aug 15 10:11:20 oleg434-client kernel: Aug 15 10:11:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:11:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:11:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:11:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:11:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:11:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:11:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:11:20 oleg434-client kernel: Aug 15 10:11:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:11:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:11:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:11:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:11:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:11:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:11:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:11:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:11:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:11:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:11:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:11:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:11:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:11:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:11:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:11:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:11:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:11:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:11:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:11:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:11:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:11:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:11:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:11:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:11:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:11:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:11:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:11:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:11:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:11:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:11:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:11:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:11:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:11:24 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:11:24 oleg434-client kernel: RAX: 0000000000001f11 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:11:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:11:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:11:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:11:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:11:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:11:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:11:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:11:24 oleg434-client kernel: Call Trace: Aug 15 10:11:24 oleg434-client kernel: Aug 15 10:11:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:11:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:11:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:11:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:11:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:11:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:11:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:11:24 oleg434-client kernel: Aug 15 10:11:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:11:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:11:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:11:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:11:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:11:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:11:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:11:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:11:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:11:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:11:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:11:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:11:30 oleg434-client kernel: rcu: #0110-....: (575407 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=177607 Aug 15 10:11:30 oleg434-client kernel: #011(t=960022 jiffies g=297885 q=6499) Aug 15 10:11:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:11:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:11:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:11:30 oleg434-client kernel: Call Trace: Aug 15 10:11:30 oleg434-client kernel: Aug 15 10:11:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:11:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:11:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:11:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:11:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:11:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:11:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:11:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:11:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:11:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:11:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:11:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:11:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:11:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:11:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:11:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:11:30 oleg434-client kernel: Aug 15 10:11:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:11:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:11:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:11:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:11:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:11:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:11:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:11:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:11:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:11:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:11:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:11:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:11:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:11:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:11:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:11:48 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:11:48 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:11:48 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:11:48 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:11:48 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:11:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:11:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:11:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:11:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:11:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:11:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:11:48 oleg434-client kernel: Call Trace: Aug 15 10:11:48 oleg434-client kernel: Aug 15 10:11:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:11:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:11:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:11:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:11:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:11:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:11:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:11:48 oleg434-client kernel: Aug 15 10:11:48 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:11:48 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:11:48 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:11:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:11:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:11:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:11:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:11:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:11:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:11:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:11:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:11:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:11:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:11:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:11:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:11:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:11:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:11:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:11:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:11:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:11:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:11:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:11:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:11:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:11:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:11:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:11:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:11:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:11:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:11:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:11:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:11:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:11:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:11:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:11:52 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:11:52 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:11:52 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:11:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:11:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:11:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:11:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:11:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:11:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:11:52 oleg434-client kernel: Call Trace: Aug 15 10:11:52 oleg434-client kernel: Aug 15 10:11:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:11:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:11:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:11:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:11:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:11:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:11:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:11:52 oleg434-client kernel: Aug 15 10:11:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:11:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:11:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:11:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:11:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:11:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:11:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:11:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:11:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:11:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:11:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:11:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:11:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:11:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:11:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:11:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:11:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:11:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:11:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:11:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:11:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:11:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:11:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:11:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:11:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:11:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:11:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:11:56 oleg434-client kernel: Call Trace: Aug 15 10:11:56 oleg434-client kernel: Aug 15 10:11:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:11:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:11:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:11:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:11:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:11:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:11:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:11:56 oleg434-client kernel: Aug 15 10:11:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:11:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:11:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:11:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:11:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:11:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:11:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:11:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:11:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:11:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:11:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:11:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:12:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:12:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:12:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:12:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:12:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:12:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:12:16 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:12:16 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:12:16 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:12:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:12:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:12:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:12:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:12:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:12:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:12:16 oleg434-client kernel: Call Trace: Aug 15 10:12:16 oleg434-client kernel: Aug 15 10:12:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:12:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:12:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:12:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:12:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:12:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:12:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:12:16 oleg434-client kernel: Aug 15 10:12:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:12:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:12:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:12:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:12:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:12:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:12:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:12:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:12:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:12:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:12:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:12:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:12:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:12:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:12:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:12:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:12:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:12:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:12:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:12:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:12:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:12:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:12:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:12:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:12:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:12:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:12:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:12:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:12:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:12:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:12:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:12:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:12:20 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:12:20 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:12:20 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:12:20 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:12:20 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:12:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:12:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:12:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:12:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:12:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:12:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:12:20 oleg434-client kernel: Call Trace: Aug 15 10:12:20 oleg434-client kernel: Aug 15 10:12:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:12:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:12:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:12:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:12:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:12:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:12:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:12:20 oleg434-client kernel: Aug 15 10:12:20 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:12:20 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:12:20 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:12:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:12:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:12:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:12:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:12:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:12:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:12:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:12:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:12:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:12:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:12:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:12:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:12:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:12:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:12:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:12:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:12:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:12:24 oleg434-client kernel: RDX: 0000000000002dd5 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:12:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:12:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:12:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:12:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:12:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:12:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:12:24 oleg434-client kernel: Call Trace: Aug 15 10:12:24 oleg434-client kernel: Aug 15 10:12:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:12:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:12:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:12:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:12:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:12:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:12:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:12:24 oleg434-client kernel: Aug 15 10:12:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:12:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:12:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:12:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:12:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:12:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:12:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:12:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:12:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:12:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:12:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:12:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:12:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:12:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:12:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:12:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:12:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:12:44 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:12:44 oleg434-client kernel: RAX: 0000000000001e4c RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:12:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:12:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:12:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:12:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:12:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:12:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:12:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:12:44 oleg434-client kernel: Call Trace: Aug 15 10:12:44 oleg434-client kernel: Aug 15 10:12:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:12:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:12:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:12:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:12:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:12:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:12:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:12:44 oleg434-client kernel: Aug 15 10:12:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:12:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:12:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:12:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:12:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:12:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:12:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:12:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:12:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:12:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:12:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:12:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:12:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:12:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:12:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:12:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:12:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:12:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:12:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:12:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:12:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:12:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:12:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:12:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:12:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:12:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:12:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:12:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:12:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:12:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:12:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:12:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:12:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:12:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:12:48 oleg434-client kernel: RAX: 0000000000006b49 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:12:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:12:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:12:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:12:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:12:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:12:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:12:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:12:48 oleg434-client kernel: Call Trace: Aug 15 10:12:48 oleg434-client kernel: Aug 15 10:12:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:12:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:12:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:12:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:12:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:12:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:12:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:12:48 oleg434-client kernel: Aug 15 10:12:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:12:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:12:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:12:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:12:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:12:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:12:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:12:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:12:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:12:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:12:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:12:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:12:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:12:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:12:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:12:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:12:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:12:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:12:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:12:52 oleg434-client kernel: RDX: 00000000000042ab RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:12:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:12:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:12:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:12:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:12:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:12:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:12:52 oleg434-client kernel: Call Trace: Aug 15 10:12:52 oleg434-client kernel: Aug 15 10:12:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:12:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:12:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:12:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:12:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:12:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:12:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:12:52 oleg434-client kernel: Aug 15 10:12:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:12:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:12:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:12:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:12:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:12:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:12:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:12:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:12:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:12:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:12:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:13:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:13:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:13:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:13:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:13:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:13:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:13:12 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:13:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:13:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:13:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:13:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:13:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:13:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:13:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:13:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:13:12 oleg434-client kernel: Call Trace: Aug 15 10:13:12 oleg434-client kernel: Aug 15 10:13:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:13:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:13:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:13:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:13:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:13:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:13:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:13:12 oleg434-client kernel: Aug 15 10:13:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:13:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:13:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:13:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:13:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:13:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:13:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:13:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:13:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:13:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:13:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:13:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:13:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:13:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:13:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:13:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:13:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:13:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:13:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:13:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:13:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:13:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:13:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:13:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:13:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:13:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:13:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:13:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:13:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:13:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:13:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:13:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:13:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:13:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:13:16 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:13:16 oleg434-client kernel: RAX: 00000000000062f8 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:13:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:13:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:13:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:13:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:13:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:13:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:13:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:13:16 oleg434-client kernel: Call Trace: Aug 15 10:13:16 oleg434-client kernel: Aug 15 10:13:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:13:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:13:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:13:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:13:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:13:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:13:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:13:16 oleg434-client kernel: Aug 15 10:13:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:13:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:13:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:13:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:13:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:13:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:13:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:13:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:13:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:13:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:13:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:13:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:13:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:13:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:13:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:13:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:13:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:13:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:13:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:13:20 oleg434-client kernel: RDX: 00000000000064f2 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:13:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:13:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:13:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:13:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:13:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:13:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:13:20 oleg434-client kernel: Call Trace: Aug 15 10:13:20 oleg434-client kernel: Aug 15 10:13:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:13:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:13:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:13:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:13:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:13:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:13:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:13:20 oleg434-client kernel: Aug 15 10:13:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:13:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:13:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:13:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:13:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:13:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:13:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:13:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:13:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:13:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:13:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:13:20 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:13:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:13:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:13:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:13:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:13:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:13:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:13:40 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:13:40 oleg434-client kernel: RAX: 0000000000003883 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:13:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:13:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:13:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:13:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:13:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:13:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:13:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:13:40 oleg434-client kernel: Call Trace: Aug 15 10:13:40 oleg434-client kernel: Aug 15 10:13:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:13:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:13:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:13:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:13:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:13:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:13:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:13:40 oleg434-client kernel: Aug 15 10:13:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:13:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:13:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:13:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:13:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:13:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:13:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:13:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:13:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:13:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:13:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:13:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:13:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:13:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:13:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:13:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:13:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:13:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:13:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:13:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:13:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:13:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:13:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:13:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:13:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:13:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:13:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:13:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:13:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:13:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:13:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:13:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:13:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:13:44 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:13:44 oleg434-client kernel: RAX: 0000000000000e6a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:13:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:13:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:13:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:13:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:13:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:13:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:13:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:13:44 oleg434-client kernel: Call Trace: Aug 15 10:13:44 oleg434-client kernel: Aug 15 10:13:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:13:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:13:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:13:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:13:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:13:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:13:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:13:44 oleg434-client kernel: Aug 15 10:13:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:13:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:13:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:13:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:13:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:13:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:13:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:13:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:13:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:13:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:13:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:13:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:13:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:13:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:13:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:13:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:13:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:13:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:13:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:13:48 oleg434-client kernel: RDX: 00000000000020e7 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:13:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:13:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:13:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:13:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:13:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:13:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:13:48 oleg434-client kernel: Call Trace: Aug 15 10:13:48 oleg434-client kernel: Aug 15 10:13:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:13:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:13:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:13:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:13:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:13:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:13:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:13:48 oleg434-client kernel: Aug 15 10:13:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:13:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:13:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:13:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:13:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:13:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:13:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:13:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:13:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:13:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:13:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:14:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:14:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:14:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:14:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:14:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:14:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:14:08 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:14:08 oleg434-client kernel: RAX: 0000000000004f31 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:14:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:14:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:14:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:14:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:14:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:14:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:14:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:14:08 oleg434-client kernel: Call Trace: Aug 15 10:14:08 oleg434-client kernel: Aug 15 10:14:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:14:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:14:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:14:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:14:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:14:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:14:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:14:08 oleg434-client kernel: Aug 15 10:14:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:14:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:14:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:14:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:14:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:14:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:14:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:14:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:14:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:14:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:14:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:14:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:14:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:14:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:14:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:14:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:14:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:14:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:14:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:14:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:14:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:14:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:14:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:14:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:14:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:14:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:14:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:14:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:14:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:14:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:14:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:14:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:14:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:14:12 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:14:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:14:12 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:14:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:14:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:14:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:14:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:14:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:14:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:14:12 oleg434-client kernel: Call Trace: Aug 15 10:14:12 oleg434-client kernel: Aug 15 10:14:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:14:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:14:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:14:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:14:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:14:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:14:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:14:12 oleg434-client kernel: Aug 15 10:14:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:14:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:14:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:14:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:14:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:14:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:14:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:14:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:14:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:14:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:14:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:14:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:14:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:14:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:14:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:14:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:14:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:14:16 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:14:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:14:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:14:16 oleg434-client kernel: RDX: 0000000000006a7f RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:14:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:14:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:14:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:14:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:14:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:14:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:14:16 oleg434-client kernel: Call Trace: Aug 15 10:14:16 oleg434-client kernel: Aug 15 10:14:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:14:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:14:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:14:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:14:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:14:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:14:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:14:16 oleg434-client kernel: Aug 15 10:14:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:14:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:14:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:14:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:14:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:14:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:14:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:14:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:14:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:14:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:14:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:14:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:14:30 oleg434-client kernel: rcu: #0110-....: (694366 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=212307 Aug 15 10:14:30 oleg434-client kernel: #011(t=1140031 jiffies g=297885 q=7234) Aug 15 10:14:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:14:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:14:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:14:30 oleg434-client kernel: Call Trace: Aug 15 10:14:30 oleg434-client kernel: Aug 15 10:14:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:14:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:14:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:14:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:14:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:14:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:14:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:14:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:14:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:14:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:14:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:14:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:14:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:14:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:14:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:14:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:14:30 oleg434-client kernel: Aug 15 10:14:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:14:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:14:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:14:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:14:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:14:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:14:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:14:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:14:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:14:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:14:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:14:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:14:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:14:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:14:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:14:36 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:14:36 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:14:36 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:14:36 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:14:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:14:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:14:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:14:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:14:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:14:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:14:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:14:36 oleg434-client kernel: Call Trace: Aug 15 10:14:36 oleg434-client kernel: Aug 15 10:14:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:14:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:14:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:14:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:14:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:14:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:14:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:14:36 oleg434-client kernel: Aug 15 10:14:36 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:14:36 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:14:36 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:14:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:14:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:14:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:14:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:14:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:14:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:14:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:14:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:14:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:14:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:14:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:14:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:14:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:14:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:14:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:14:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:14:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:14:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:14:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:14:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:14:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:14:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:14:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:14:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:14:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:14:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:14:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:14:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:14:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:14:40 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:14:40 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:14:40 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:14:40 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:14:40 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:14:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:14:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:14:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:14:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:14:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:14:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:14:40 oleg434-client kernel: Call Trace: Aug 15 10:14:40 oleg434-client kernel: Aug 15 10:14:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:14:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:14:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:14:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:14:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:14:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:14:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:14:40 oleg434-client kernel: Aug 15 10:14:40 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:14:40 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:14:40 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:14:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:14:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:14:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:14:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:14:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:14:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:14:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:14:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:14:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:14:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:14:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:14:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:14:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:14:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:14:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:14:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:14:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:14:56 oleg434-client kernel: RDX: 0000000000004db1 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:14:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:14:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:14:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:14:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:14:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:14:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:14:56 oleg434-client kernel: Call Trace: Aug 15 10:14:56 oleg434-client kernel: Aug 15 10:14:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:14:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:14:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:14:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:14:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:14:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:14:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:14:56 oleg434-client kernel: Aug 15 10:14:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:14:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:14:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:14:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:14:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:14:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:14:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:14:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:14:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:14:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:14:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:15:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:15:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:15:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:15:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:15:04 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:15:04 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:15:04 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:15:04 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:15:04 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:15:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:15:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:15:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:15:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:15:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:15:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:15:04 oleg434-client kernel: Call Trace: Aug 15 10:15:04 oleg434-client kernel: Aug 15 10:15:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:15:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:15:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:15:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:15:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:15:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:15:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:15:04 oleg434-client kernel: Aug 15 10:15:04 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:15:04 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:15:04 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:15:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:15:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:15:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:15:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:15:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:15:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:15:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:15:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:15:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:15:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:15:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:15:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:15:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:15:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:15:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:15:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:15:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:15:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:15:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:15:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:15:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:15:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:15:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:15:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:15:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:15:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:15:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:15:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:15:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:15:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:15:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:15:08 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:15:08 oleg434-client kernel: RAX: 0000000000007751 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:15:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:15:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:15:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:15:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:15:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:15:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:15:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:15:08 oleg434-client kernel: Call Trace: Aug 15 10:15:08 oleg434-client kernel: Aug 15 10:15:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:15:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:15:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:15:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:15:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:15:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:15:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:15:08 oleg434-client kernel: Aug 15 10:15:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:15:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:15:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:15:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:15:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:15:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:15:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:15:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:15:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:15:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:15:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:15:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:15:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:15:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:15:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:15:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:15:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:15:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:15:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:15:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:15:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:15:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:15:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:15:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:15:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:15:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:15:24 oleg434-client kernel: Call Trace: Aug 15 10:15:24 oleg434-client kernel: Aug 15 10:15:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:15:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:15:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:15:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:15:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:15:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:15:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:15:24 oleg434-client kernel: Aug 15 10:15:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:15:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:15:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:15:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:15:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:15:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:15:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:15:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:15:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:15:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:15:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:15:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:15:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:15:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:15:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:15:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:15:32 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:15:32 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:15:32 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:15:32 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:15:32 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:15:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:15:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:15:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:15:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:15:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:15:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:15:32 oleg434-client kernel: Call Trace: Aug 15 10:15:32 oleg434-client kernel: Aug 15 10:15:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:15:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:15:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:15:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:15:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:15:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:15:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:15:32 oleg434-client kernel: Aug 15 10:15:32 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:15:32 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:15:32 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:15:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:15:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:15:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:15:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:15:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:15:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:15:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:15:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:15:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:15:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:15:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:15:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:15:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:15:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:15:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:15:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:15:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:15:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:15:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:15:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:15:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:15:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:15:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:15:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:15:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:15:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:15:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:15:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:15:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:15:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:15:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:15:36 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:15:36 oleg434-client kernel: RAX: 0000000000007d80 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:15:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:15:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:15:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:15:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:15:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:15:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:15:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:15:36 oleg434-client kernel: Call Trace: Aug 15 10:15:36 oleg434-client kernel: Aug 15 10:15:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:15:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:15:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:15:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:15:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:15:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:15:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:15:36 oleg434-client kernel: Aug 15 10:15:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:15:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:15:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:15:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:15:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:15:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:15:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:15:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:15:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:15:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:15:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:15:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:15:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:15:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:15:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:15:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:15:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:15:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:15:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:15:52 oleg434-client kernel: RDX: 0000000000007e7c RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:15:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:15:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:15:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:15:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:15:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:15:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:15:52 oleg434-client kernel: Call Trace: Aug 15 10:15:52 oleg434-client kernel: Aug 15 10:15:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:15:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:15:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:15:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:15:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:15:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:15:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:15:52 oleg434-client kernel: Aug 15 10:15:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:15:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:15:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:15:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:15:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:15:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:15:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:15:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:15:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:15:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:15:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:16:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:16:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:16:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:16:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:16:00 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:16:00 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:16:00 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:16:00 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:16:00 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:16:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:16:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:16:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:16:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:16:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:16:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:16:00 oleg434-client kernel: Call Trace: Aug 15 10:16:00 oleg434-client kernel: Aug 15 10:16:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:16:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:16:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:16:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:16:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:16:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:16:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:16:00 oleg434-client kernel: Aug 15 10:16:00 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:16:00 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:16:00 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:16:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:16:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:16:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:16:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:16:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:16:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:16:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:16:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:16:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:16:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:16:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:16:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:16:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:16:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:16:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:16:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:16:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:16:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:16:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:16:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:16:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:16:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:16:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:16:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:16:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:16:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:16:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:16:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:16:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:16:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:16:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:16:04 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:16:04 oleg434-client kernel: RAX: 000000000000630d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:16:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:16:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:16:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:16:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:16:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:16:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:16:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:16:04 oleg434-client kernel: Call Trace: Aug 15 10:16:04 oleg434-client kernel: Aug 15 10:16:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:16:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:16:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:16:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:16:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:16:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:16:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:16:04 oleg434-client kernel: Aug 15 10:16:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:16:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:16:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:16:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:16:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:16:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:16:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:16:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:16:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:16:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:16:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:16:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:16:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:16:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:16:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:16:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:16:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:16:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:16:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:16:20 oleg434-client kernel: RDX: 000000000000148c RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:16:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:16:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:16:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:16:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:16:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:16:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:16:20 oleg434-client kernel: Call Trace: Aug 15 10:16:20 oleg434-client kernel: Aug 15 10:16:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:16:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:16:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:16:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:16:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:16:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:16:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:16:20 oleg434-client kernel: Aug 15 10:16:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:16:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:16:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:16:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:16:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:16:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:16:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:16:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:16:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:16:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:16:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:16:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:16:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:16:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:16:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:16:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:16:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:16:28 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:16:28 oleg434-client kernel: RAX: 0000000000001098 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:16:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:16:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:16:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:16:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:16:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:16:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:16:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:16:28 oleg434-client kernel: Call Trace: Aug 15 10:16:28 oleg434-client kernel: Aug 15 10:16:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:16:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:16:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:16:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:16:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:16:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:16:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:16:28 oleg434-client kernel: Aug 15 10:16:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:16:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:16:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:16:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:16:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:16:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:16:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:16:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:16:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:16:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:16:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:16:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:16:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:16:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:16:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:16:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:16:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:16:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:16:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:16:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:16:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:16:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:16:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:16:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:16:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:16:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:16:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:16:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:16:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:16:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:16:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:16:32 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:16:32 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:16:32 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:16:32 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:16:32 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:16:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:16:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:16:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:16:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:16:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:16:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:16:32 oleg434-client kernel: Call Trace: Aug 15 10:16:32 oleg434-client kernel: Aug 15 10:16:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:16:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:16:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:16:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:16:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:16:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:16:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:16:32 oleg434-client kernel: Aug 15 10:16:32 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:16:32 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:16:32 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:16:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:16:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:16:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:16:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:16:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:16:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:16:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:16:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:16:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:16:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:16:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:16:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:16:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:16:48 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:16:48 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:16:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:16:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:16:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:16:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:16:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:16:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:16:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:16:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:16:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:16:48 oleg434-client kernel: Call Trace: Aug 15 10:16:48 oleg434-client kernel: Aug 15 10:16:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:16:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:16:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:16:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:16:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:16:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:16:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:16:48 oleg434-client kernel: Aug 15 10:16:48 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:16:48 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:16:48 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:16:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:16:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:16:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:16:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:16:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:16:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:16:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:16:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:16:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:16:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:16:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:16:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:16:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:16:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:16:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:16:56 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:16:56 oleg434-client kernel: RAX: 0000000000007cde RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:16:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:16:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:16:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:16:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:16:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:16:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:16:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:16:56 oleg434-client kernel: Call Trace: Aug 15 10:16:56 oleg434-client kernel: Aug 15 10:16:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:16:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:16:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:16:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:16:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:16:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:16:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:16:56 oleg434-client kernel: Aug 15 10:16:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:16:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:16:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:16:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:16:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:16:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:16:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:16:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:16:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:16:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:16:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:16:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:16:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:16:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:16:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:16:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:16:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:16:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:16:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:16:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:16:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:16:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:16:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:16:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:16:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:16:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:17:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:17:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:17:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:17:00 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:17:00 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:17:00 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:17:00 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:17:00 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:17:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:17:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:17:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:17:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:17:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:17:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:17:00 oleg434-client kernel: Call Trace: Aug 15 10:17:00 oleg434-client kernel: Aug 15 10:17:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:17:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:17:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:17:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:00 oleg434-client kernel: Aug 15 10:17:00 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:17:00 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:17:00 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:17:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:17:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:17:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:17:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:17:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:17:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:17:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:17:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:17:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:17:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:17:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:17:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:17:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:17:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:17:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:17:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:17:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:17:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:17:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:17:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:17:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:17:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:17:16 oleg434-client kernel: Call Trace: Aug 15 10:17:16 oleg434-client kernel: Aug 15 10:17:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:17:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:17:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:17:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:16 oleg434-client kernel: Aug 15 10:17:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:17:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:17:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:17:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:17:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:17:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:17:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:17:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:17:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:17:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:17:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:17:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:17:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:17:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:17:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:17:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:17:24 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:17:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:17:24 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:17:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:17:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:17:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:17:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:17:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:17:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:17:24 oleg434-client kernel: Call Trace: Aug 15 10:17:24 oleg434-client kernel: Aug 15 10:17:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:17:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:17:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:17:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:24 oleg434-client kernel: Aug 15 10:17:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:17:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:17:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:17:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:17:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:17:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:17:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:17:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:17:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:17:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:17:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:17:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:17:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:17:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:17:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:17:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:17:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:17:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:17:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:17:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:17:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:17:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:17:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:17:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:17:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:17:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:17:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:17:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:17:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:17:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:17:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:17:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:17:28 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:17:28 oleg434-client kernel: RAX: 0000000000003329 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:17:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:17:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:17:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:17:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:17:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:17:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:17:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:17:28 oleg434-client kernel: Call Trace: Aug 15 10:17:28 oleg434-client kernel: Aug 15 10:17:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:17:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:17:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:17:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:28 oleg434-client kernel: Aug 15 10:17:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:17:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:17:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:17:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:17:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:17:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:17:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:17:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:17:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:17:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:17:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:17:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:17:30 oleg434-client kernel: rcu: #0110-....: (814468 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=247154 Aug 15 10:17:30 oleg434-client kernel: #011(t=1320034 jiffies g=297885 q=7925) Aug 15 10:17:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:17:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:30 oleg434-client kernel: Call Trace: Aug 15 10:17:30 oleg434-client kernel: Aug 15 10:17:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:17:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:17:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:17:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:17:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:17:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:17:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:17:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:17:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:17:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:17:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:17:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:17:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:30 oleg434-client kernel: Aug 15 10:17:30 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:17:30 oleg434-client kernel: ? kvm_wait+0xcd/0xe0 Aug 15 10:17:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:17:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:17:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:17:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:17:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:17:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:17:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:17:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:17:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:17:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:17:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:17:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:17:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:17:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:17:52 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:17:52 oleg434-client kernel: RAX: 0000000000007185 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:17:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:17:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:17:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:17:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:17:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:17:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:17:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:17:52 oleg434-client kernel: Call Trace: Aug 15 10:17:52 oleg434-client kernel: Aug 15 10:17:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:17:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:17:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:17:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:52 oleg434-client kernel: Aug 15 10:17:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:17:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:17:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:17:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:17:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:17:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:17:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:17:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:17:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:17:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:17:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:17:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:17:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:17:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:17:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:17:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:17:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:17:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:17:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:17:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:17:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:17:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:17:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:17:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:17:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:17:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:17:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:17:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:17:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:17:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:17:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:17:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:17:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:17:56 oleg434-client kernel: RDX: 0000000000002a1e RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:17:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:17:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:17:56 oleg434-client kernel: Modules linked in: Aug 15 10:17:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:17:56 oleg434-client kernel: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:17:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:17:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:17:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:17:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:17:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:17:56 oleg434-client kernel: RAX: 0000000000007b11 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:17:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:17:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:17:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:17:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:17:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:17:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:17:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:17:56 oleg434-client kernel: Call Trace: Aug 15 10:17:56 oleg434-client kernel: Aug 15 10:17:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:17:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:17:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:17:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:56 oleg434-client kernel: Aug 15 10:17:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:17:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:17:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:17:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:17:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:17:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:17:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:17:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:17:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:17:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:17:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:17:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:17:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:17:56 oleg434-client kernel: Call Trace: Aug 15 10:17:56 oleg434-client kernel: Aug 15 10:17:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:17:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:17:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:17:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:17:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:17:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:17:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:17:56 oleg434-client kernel: Aug 15 10:17:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:17:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:17:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:17:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:17:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:17:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:17:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:17:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:17:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:17:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:17:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:18:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:18:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:18:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:18:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:18:20 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:18:20 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:18:20 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:18:20 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:18:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:18:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:18:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:18:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:18:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:18:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:18:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:18:20 oleg434-client kernel: Call Trace: Aug 15 10:18:20 oleg434-client kernel: Aug 15 10:18:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:18:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:18:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:18:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:18:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:18:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:18:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:18:20 oleg434-client kernel: Aug 15 10:18:20 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:18:20 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:18:20 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:18:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:18:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:18:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:18:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:18:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:18:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:18:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:18:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:18:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:18:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:18:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:18:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:18:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:18:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:18:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:18:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:18:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:18:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:18:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:18:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:18:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:18:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:18:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:18:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:18:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:18:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:18:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:18:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:18:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:18:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:18:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:18:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:18:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:18:24 oleg434-client kernel: RDX: 00000000000008b5 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:18:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:18:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:18:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:18:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:18:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:18:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:18:24 oleg434-client kernel: Call Trace: Aug 15 10:18:24 oleg434-client kernel: Aug 15 10:18:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:18:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:18:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:18:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:18:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:18:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:18:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:18:24 oleg434-client kernel: Aug 15 10:18:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:18:24 oleg434-client kernel: Modules linked in: Aug 15 10:18:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:18:24 oleg434-client kernel: lustre(O) osp(O) Aug 15 10:18:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:18:24 oleg434-client kernel: ofd(O) Aug 15 10:18:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:18:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: lod(O) Aug 15 10:18:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:18:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:18:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:18:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:18:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:18:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:18:24 oleg434-client kernel: mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:18:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:18:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:18:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:18:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:18:24 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:18:24 oleg434-client kernel: RAX: 0000000000007e93 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:18:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:18:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:18:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:18:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:18:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:18:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:18:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:18:24 oleg434-client kernel: Call Trace: Aug 15 10:18:24 oleg434-client kernel: Aug 15 10:18:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:18:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:18:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:18:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:18:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:18:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:18:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:18:24 oleg434-client kernel: Aug 15 10:18:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:18:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:18:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:18:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:18:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:18:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:18:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:18:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:18:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:18:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:18:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:18:24 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:18:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:18:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:18:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:18:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:18:48 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:18:48 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:18:48 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:18:48 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:18:48 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:18:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:18:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:18:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:18:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:18:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:18:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:18:48 oleg434-client kernel: Call Trace: Aug 15 10:18:48 oleg434-client kernel: Aug 15 10:18:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:18:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:18:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:18:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:18:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:18:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:18:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:18:48 oleg434-client kernel: Aug 15 10:18:48 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:18:48 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:18:48 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:18:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:18:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:18:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:18:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:18:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:18:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:18:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:18:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:18:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:18:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:18:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:18:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:18:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:18:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:18:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:18:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:18:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:18:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:18:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:18:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:18:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:18:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:18:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:18:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:18:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:18:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:18:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:18:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:18:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:18:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:18:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:18:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:18:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:18:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:18:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:18:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:18:52 oleg434-client kernel: RDX: 00000000000060c3 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:18:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:18:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:18:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:18:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:18:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:18:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:18:52 oleg434-client kernel: Call Trace: Aug 15 10:18:52 oleg434-client kernel: Aug 15 10:18:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:18:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:18:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:18:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:18:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:18:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:18:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:18:52 oleg434-client kernel: Aug 15 10:18:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:18:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:18:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:18:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:18:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: Aug 15 10:18:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:18:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:18:52 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:18:52 oleg434-client kernel: RAX: 000000000000650f RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:18:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:18:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:18:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:18:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:18:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:18:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:18:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:18:52 oleg434-client kernel: Call Trace: Aug 15 10:18:52 oleg434-client kernel: Aug 15 10:18:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:18:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:18:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:18:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:18:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:18:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:18:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:18:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:18:52 oleg434-client kernel: Aug 15 10:18:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:18:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:18:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:18:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:18:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:18:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:18:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:18:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:18:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:18:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:18:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:18:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:18:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:18:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:18:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:18:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:19:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:19:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:19:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:19:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:19:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:19:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:19:16 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:19:16 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:19:16 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:19:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:19:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:19:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:19:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:19:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:19:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:19:16 oleg434-client kernel: Call Trace: Aug 15 10:19:16 oleg434-client kernel: Aug 15 10:19:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:19:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:19:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:19:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:19:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:19:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:19:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:19:16 oleg434-client kernel: Aug 15 10:19:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:19:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:19:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:19:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:19:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:19:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:19:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:19:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:19:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:19:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:19:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:19:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:19:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:19:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:19:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:19:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:19:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:19:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:19:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:19:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:19:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:19:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:19:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:19:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:19:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:19:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:19:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:19:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:19:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:19:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:19:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:19:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:19:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:19:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:19:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:19:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:19:20 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:19:20 oleg434-client kernel: RAX: 0000000000004f60 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:19:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:19:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:19:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:19:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:19:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:19:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:19:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:19:20 oleg434-client kernel: Call Trace: Aug 15 10:19:20 oleg434-client kernel: Aug 15 10:19:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:19:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:19:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:19:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:19:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:19:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:19:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:19:20 oleg434-client kernel: Aug 15 10:19:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:19:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:19:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:19:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:19:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:19:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:19:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:19:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:19:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:19:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:19:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:19:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:19:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:19:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:19:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:19:20 oleg434-client kernel: RDX: 0000000000003d56 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:19:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:19:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:19:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:19:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:19:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:19:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:19:20 oleg434-client kernel: Call Trace: Aug 15 10:19:20 oleg434-client kernel: Aug 15 10:19:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:19:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:19:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:19:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:19:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:19:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:19:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:19:20 oleg434-client kernel: Aug 15 10:19:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:19:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:19:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:19:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:19:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:19:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:19:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:19:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:19:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:19:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:19:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:19:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:19:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:19:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:19:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:19:44 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:19:44 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:19:44 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:19:44 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:19:44 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:19:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:19:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:19:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:19:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:19:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:19:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:19:44 oleg434-client kernel: Call Trace: Aug 15 10:19:44 oleg434-client kernel: Aug 15 10:19:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:19:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:19:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:19:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:19:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:19:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:19:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:19:44 oleg434-client kernel: Aug 15 10:19:44 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:19:44 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:19:44 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:19:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:19:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:19:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:19:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:19:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:19:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:19:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:19:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:19:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:19:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:19:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:19:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:19:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:19:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:19:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:19:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:19:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:19:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:19:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:19:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:19:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:19:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:19:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:19:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:19:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:19:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:19:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:19:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:19:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:19:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:19:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:19:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:19:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:19:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:19:48 oleg434-client kernel: RDX: 0000000000000bb4 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:19:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:19:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:19:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:19:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:19:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:19:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:19:48 oleg434-client kernel: Call Trace: Aug 15 10:19:48 oleg434-client kernel: Aug 15 10:19:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:19:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:19:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:19:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:19:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:19:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:19:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:19:48 oleg434-client kernel: Aug 15 10:19:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:19:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:19:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:19:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:19:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:19:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:19:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:19:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:19:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:19:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:19:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:19:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:19:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:19:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:19:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:19:48 oleg434-client kernel: RAX: 0000000000003987 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:19:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:19:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:19:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:19:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:19:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:19:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:19:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:19:48 oleg434-client kernel: Call Trace: Aug 15 10:19:48 oleg434-client kernel: Aug 15 10:19:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:19:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:19:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:19:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:19:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:19:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:19:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:19:48 oleg434-client kernel: Aug 15 10:19:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:19:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:19:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:19:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:19:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:19:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:19:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:19:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:19:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:19:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:19:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:20:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:20:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:20:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:20:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:20:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:20:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:20:12 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:20:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:20:12 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:20:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:20:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:20:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:20:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:20:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:20:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:20:12 oleg434-client kernel: Call Trace: Aug 15 10:20:12 oleg434-client kernel: Aug 15 10:20:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:20:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:20:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:20:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:20:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:20:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:20:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:20:12 oleg434-client kernel: Aug 15 10:20:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:20:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:20:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:20:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:20:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:20:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:20:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:20:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:20:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:20:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:20:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:20:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:20:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:20:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:20:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:20:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:20:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:20:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:20:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:20:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:20:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:20:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:20:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:20:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:20:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:20:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:20:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:20:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:20:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:20:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:20:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:20:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:20:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:20:16 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:20:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:20:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:20:16 oleg434-client kernel: RDX: 00000000000031b6 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:20:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:20:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:20:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:20:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:20:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:20:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:20:16 oleg434-client kernel: Call Trace: Aug 15 10:20:16 oleg434-client kernel: Aug 15 10:20:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:20:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:20:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:20:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:20:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:20:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:20:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:20:16 oleg434-client kernel: Aug 15 10:20:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:20:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:20:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:20:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:20:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:20:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:20:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:20:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:20:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:20:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:20:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:20:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:20:16 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:20:16 oleg434-client kernel: RAX: 0000000000007e9f RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:20:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:20:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:20:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:20:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:20:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:20:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:20:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:20:16 oleg434-client kernel: Call Trace: Aug 15 10:20:16 oleg434-client kernel: Aug 15 10:20:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:20:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:20:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:20:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:20:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:20:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:20:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:20:16 oleg434-client kernel: Aug 15 10:20:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:20:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:20:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:20:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:20:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:20:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:20:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:20:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:20:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:20:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:20:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:20:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:20:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:20:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:20:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:20:30 oleg434-client kernel: rcu: #0110-....: (930947 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=281732 Aug 15 10:20:30 oleg434-client kernel: #011(t=1500038 jiffies g=297885 q=8693) Aug 15 10:20:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:20:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:20:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:20:30 oleg434-client kernel: Call Trace: Aug 15 10:20:30 oleg434-client kernel: Aug 15 10:20:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:20:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:20:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:20:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:20:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:20:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:20:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:20:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:20:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:20:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:20:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:20:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:20:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:20:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:20:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:20:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:20:30 oleg434-client kernel: Aug 15 10:20:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:20:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:20:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:20:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:20:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:20:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:20:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:20:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:20:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:20:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:20:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:20:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:20:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:20:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:20:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:20:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30a/0x6d0 Aug 15 10:20:40 oleg434-client kernel: Code: 03 00 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 90 83 e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 Aug 15 10:20:40 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:20:40 oleg434-client kernel: RAX: 0000000000002f80 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:20:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:20:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:20:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:20:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:20:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:20:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:20:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:20:40 oleg434-client kernel: Call Trace: Aug 15 10:20:40 oleg434-client kernel: Aug 15 10:20:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:20:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:20:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:20:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:20:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:20:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:20:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:20:40 oleg434-client kernel: Aug 15 10:20:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30a/0x6d0 Aug 15 10:20:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:20:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:20:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:20:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:20:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:20:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:20:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:20:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:20:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:20:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:20:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:20:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:20:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:20:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:20:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:20:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:20:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:20:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:20:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:20:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:20:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:20:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:20:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:20:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:20:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:20:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:20:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:20:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:20:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:20:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:20:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:20:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:20:44 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:20:44 oleg434-client kernel: RAX: 0000000000003e63 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:20:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:20:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:20:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:20:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:20:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:20:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:20:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:20:44 oleg434-client kernel: Call Trace: Aug 15 10:20:44 oleg434-client kernel: Aug 15 10:20:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:20:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:20:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:20:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:20:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:20:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:20:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:20:44 oleg434-client kernel: Aug 15 10:20:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:20:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:20:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:20:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:20:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:20:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:20:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:20:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:20:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:20:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:20:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:20:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:20:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:20:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:20:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:20:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:20:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:20:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:20:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:20:56 oleg434-client kernel: RDX: 000000000000381d RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:20:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:20:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:20:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:20:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:20:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:20:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:20:56 oleg434-client kernel: Call Trace: Aug 15 10:20:56 oleg434-client kernel: Aug 15 10:20:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:20:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:20:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:20:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:20:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:20:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:20:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:20:56 oleg434-client kernel: Aug 15 10:20:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:20:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:20:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:20:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:20:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:20:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:20:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:20:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:20:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:20:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:20:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:21:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:21:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:21:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:21:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:21:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:21:08 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:21:08 oleg434-client kernel: RAX: 0000000000000d98 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:21:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:21:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:21:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:21:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:21:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:21:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:21:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:21:08 oleg434-client kernel: Call Trace: Aug 15 10:21:08 oleg434-client kernel: Aug 15 10:21:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:21:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:21:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:21:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:21:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:21:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:21:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:21:08 oleg434-client kernel: Aug 15 10:21:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:21:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:21:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:21:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:21:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:21:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:21:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:21:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:21:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:21:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:21:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:21:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:21:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:21:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:21:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:21:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:21:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:21:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:21:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:21:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:21:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:21:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:21:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:21:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:21:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:21:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:21:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:21:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:21:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:21:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:21:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:21:12 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:21:12 oleg434-client kernel: RAX: 0000000000005728 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:21:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:21:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:21:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:21:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:21:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:21:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:21:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:21:12 oleg434-client kernel: Call Trace: Aug 15 10:21:12 oleg434-client kernel: Aug 15 10:21:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:21:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:21:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:21:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:21:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:21:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:21:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:21:12 oleg434-client kernel: Aug 15 10:21:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:21:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:21:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:21:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:21:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:21:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:21:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:21:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:21:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:21:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:21:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:21:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:21:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:21:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:21:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:21:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:21:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:21:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:21:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:21:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:21:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:21:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:21:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:21:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:21:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:21:24 oleg434-client kernel: Call Trace: Aug 15 10:21:24 oleg434-client kernel: Aug 15 10:21:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:21:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:21:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:21:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:21:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:21:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:21:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:21:24 oleg434-client kernel: Aug 15 10:21:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:21:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:21:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:21:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:21:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:21:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:21:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:21:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:21:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:21:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:21:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:21:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:21:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:21:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:21:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:21:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:21:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:21:36 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:21:36 oleg434-client kernel: RAX: 0000000000003b49 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:21:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:21:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:21:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:21:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:21:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:21:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:21:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:21:36 oleg434-client kernel: Call Trace: Aug 15 10:21:36 oleg434-client kernel: Aug 15 10:21:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:21:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:21:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:21:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:21:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:21:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:21:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:21:36 oleg434-client kernel: Aug 15 10:21:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:21:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:21:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:21:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:21:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:21:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:21:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:21:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:21:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:21:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:21:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:21:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:21:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:21:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:21:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:21:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:21:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:21:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:21:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:21:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:21:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:21:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:21:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:21:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:21:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:21:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:21:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:21:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:21:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:21:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:21:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:21:40 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:21:40 oleg434-client kernel: RAX: 0000000000007f17 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:21:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:21:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:21:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:21:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:21:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:21:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:21:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:21:40 oleg434-client kernel: Call Trace: Aug 15 10:21:40 oleg434-client kernel: Aug 15 10:21:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:21:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:21:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:21:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:21:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:21:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:21:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:21:40 oleg434-client kernel: Aug 15 10:21:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:21:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:21:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:21:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:21:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:21:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:21:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:21:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:21:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:21:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:21:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:21:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:21:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:21:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:21:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:21:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:21:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:21:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:21:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:21:52 oleg434-client kernel: RDX: 0000000000007635 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:21:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:21:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:21:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:21:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:21:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:21:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:21:52 oleg434-client kernel: Call Trace: Aug 15 10:21:52 oleg434-client kernel: Aug 15 10:21:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:21:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:21:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:21:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:21:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:21:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:21:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:21:52 oleg434-client kernel: Aug 15 10:21:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:21:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:21:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:21:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:21:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:21:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:21:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:21:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:21:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:21:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:21:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:22:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:22:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:22:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:22:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:22:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:22:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:22:04 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:22:04 oleg434-client kernel: RAX: 0000000000005a37 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:22:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:22:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:22:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:22:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:22:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:22:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:22:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:22:04 oleg434-client kernel: Call Trace: Aug 15 10:22:04 oleg434-client kernel: Aug 15 10:22:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:22:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:22:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:22:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:22:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:22:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:22:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:22:04 oleg434-client kernel: Aug 15 10:22:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:22:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:22:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:22:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:22:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:22:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:22:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:22:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:22:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:22:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:22:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:22:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:22:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:22:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:22:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:22:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:22:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:22:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:22:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:22:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:22:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:22:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:22:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:22:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:22:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:22:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:22:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:22:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:22:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:22:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:22:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:22:08 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:22:08 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:22:08 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:22:08 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:22:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:22:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:22:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:22:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:22:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:22:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:22:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:22:08 oleg434-client kernel: Call Trace: Aug 15 10:22:08 oleg434-client kernel: Aug 15 10:22:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:22:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:22:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:22:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:22:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:22:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:22:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:22:08 oleg434-client kernel: Aug 15 10:22:08 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:22:08 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:22:08 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:22:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:22:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:22:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:22:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:22:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:22:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:22:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:22:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:22:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:22:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:22:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:22:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:22:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:22:20 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:22:20 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:22:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:22:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:22:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:22:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:22:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:22:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:22:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:22:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:22:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:22:20 oleg434-client kernel: Call Trace: Aug 15 10:22:20 oleg434-client kernel: Aug 15 10:22:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:22:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:22:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:22:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:22:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:22:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:22:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:22:20 oleg434-client kernel: Aug 15 10:22:20 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:22:20 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:22:20 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:22:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:22:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:22:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:22:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:22:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:22:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:22:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:22:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:22:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:22:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:22:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:22:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:22:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:22:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:22:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:22:32 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:22:32 oleg434-client kernel: RAX: 0000000000002489 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:22:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:22:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:22:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:22:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:22:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:22:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:22:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:22:32 oleg434-client kernel: Call Trace: Aug 15 10:22:32 oleg434-client kernel: Aug 15 10:22:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:22:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:22:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:22:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:22:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:22:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:22:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:22:32 oleg434-client kernel: Aug 15 10:22:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:22:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:22:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:22:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:22:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:22:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:22:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:22:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:22:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:22:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:22:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:22:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:22:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:22:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:22:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:22:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:22:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:22:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:22:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:22:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:22:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:22:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:22:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:22:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:22:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:22:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:22:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:22:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:22:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:22:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:22:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:22:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:22:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:22:36 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:22:36 oleg434-client kernel: RAX: 000000000000788d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:22:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:22:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:22:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:22:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:22:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:22:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:22:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:22:36 oleg434-client kernel: Call Trace: Aug 15 10:22:36 oleg434-client kernel: Aug 15 10:22:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:22:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:22:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:22:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:22:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:22:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:22:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:22:36 oleg434-client kernel: Aug 15 10:22:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:22:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:22:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:22:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:22:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:22:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:22:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:22:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:22:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:22:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:22:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:22:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:22:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:22:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:22:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:22:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:22:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:22:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:22:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:22:48 oleg434-client kernel: RDX: 0000000000007ebe RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:22:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:22:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:22:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:22:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:22:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:22:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:22:48 oleg434-client kernel: Call Trace: Aug 15 10:22:48 oleg434-client kernel: Aug 15 10:22:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:22:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:22:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:22:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:22:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:22:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:22:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:22:48 oleg434-client kernel: Aug 15 10:22:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:22:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:22:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:22:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:22:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:22:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:22:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:22:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:22:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:22:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:22:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:23:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:23:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:23:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:00 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:23:00 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:23:00 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:23:00 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:23:00 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:23:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:23:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:23:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:23:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:23:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:23:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:23:00 oleg434-client kernel: Call Trace: Aug 15 10:23:00 oleg434-client kernel: Aug 15 10:23:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:23:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:23:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:23:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:00 oleg434-client kernel: Aug 15 10:23:00 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:23:00 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:23:00 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:23:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:23:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:23:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:23:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:23:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:23:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:23:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:23:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:23:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:23:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:23:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:23:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:23:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:23:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:23:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:23:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:23:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:23:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:23:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:23:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:23:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:23:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:23:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:23:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:23:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:23:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:23:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:23:04 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:23:04 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:23:04 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:23:04 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:23:04 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:23:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:23:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:23:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:23:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:23:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:23:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:23:04 oleg434-client kernel: Call Trace: Aug 15 10:23:04 oleg434-client kernel: Aug 15 10:23:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:23:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:23:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:23:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:04 oleg434-client kernel: Aug 15 10:23:04 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:23:04 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:23:04 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:23:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:23:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:23:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:23:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:23:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:23:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:23:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:23:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:23:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:23:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:23:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:23:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:23:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:23:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:23:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:23:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:23:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:23:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:23:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:23:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:23:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:23:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:23:16 oleg434-client kernel: Call Trace: Aug 15 10:23:16 oleg434-client kernel: Aug 15 10:23:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:23:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:23:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:23:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:16 oleg434-client kernel: Aug 15 10:23:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:23:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:23:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:23:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:23:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:23:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:23:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:23:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:23:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:23:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:23:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:23:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:23:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:23:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:23:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:28 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:23:28 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:23:28 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:23:28 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:23:28 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:23:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:23:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:23:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:23:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:23:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:23:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:23:28 oleg434-client kernel: Call Trace: Aug 15 10:23:28 oleg434-client kernel: Aug 15 10:23:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:23:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:23:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:23:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:28 oleg434-client kernel: Aug 15 10:23:28 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:23:28 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:23:28 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:23:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:23:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:23:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:23:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:23:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:23:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:23:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:23:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:23:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:23:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:23:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:23:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:23:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:23:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:23:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:23:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:23:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:23:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:23:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:23:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:23:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:23:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:23:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:23:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:23:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:23:30 oleg434-client kernel: rcu: #0110-....: (1044874 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=316018 Aug 15 10:23:30 oleg434-client kernel: #011(t=1680041 jiffies g=297885 q=9341) Aug 15 10:23:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:23:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:30 oleg434-client kernel: Call Trace: Aug 15 10:23:30 oleg434-client kernel: Aug 15 10:23:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:23:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:23:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:23:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:23:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:23:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:23:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:23:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:23:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:23:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:23:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:23:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:23:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:30 oleg434-client kernel: Aug 15 10:23:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:23:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:23:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:23:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:23:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:23:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:23:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:23:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:23:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:23:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:23:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:23:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:23:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:23:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:23:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:23:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:23:32 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:23:32 oleg434-client kernel: RAX: 0000000000005e1a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:23:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:23:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:23:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:23:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:23:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:23:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:23:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:23:32 oleg434-client kernel: Call Trace: Aug 15 10:23:32 oleg434-client kernel: Aug 15 10:23:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:23:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:23:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:23:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:32 oleg434-client kernel: Aug 15 10:23:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:23:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:23:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:23:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:23:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:23:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:23:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:23:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:23:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:23:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:23:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:23:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:23:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:23:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) Aug 15 10:23:56 oleg434-client kernel: Modules linked in: lustre(O) Aug 15 10:23:56 oleg434-client kernel: libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:23:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:23:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:23:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:23:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:23:56 oleg434-client kernel: RDX: 00000000000004ea RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:23:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:23:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:23:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:23:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:23:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:23:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:23:56 oleg434-client kernel: Call Trace: Aug 15 10:23:56 oleg434-client kernel: Aug 15 10:23:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:23:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:23:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:23:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:56 oleg434-client kernel: Aug 15 10:23:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:23:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:23:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:23:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:23:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:23:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss Aug 15 10:23:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: nfsv4 Aug 15 10:23:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:23:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:23:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:23:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:23:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:23:56 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:23:56 oleg434-client kernel: dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:23:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:23:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:23:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:23:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:23:56 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:23:56 oleg434-client kernel: RAX: 0000000000002573 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:23:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:23:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:23:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:23:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:23:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:23:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:23:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:23:56 oleg434-client kernel: Call Trace: Aug 15 10:23:56 oleg434-client kernel: Aug 15 10:23:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:23:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:23:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:23:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:23:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:23:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:23:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:23:56 oleg434-client kernel: Aug 15 10:23:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:23:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:23:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:23:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:23:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:23:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:23:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:23:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:23:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:23:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:23:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:23:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:23:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:23:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:23:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:23:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:23:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:23:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:23:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:23:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:23:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:23:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:23:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:23:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:24:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:24:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:24:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:24:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:24:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:24:00 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:24:00 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:24:00 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:24:00 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:24:00 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:24:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:24:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:24:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:24:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:24:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:24:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:24:00 oleg434-client kernel: Call Trace: Aug 15 10:24:00 oleg434-client kernel: Aug 15 10:24:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:24:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:24:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:24:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:24:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:24:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:24:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:24:00 oleg434-client kernel: Aug 15 10:24:00 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:24:00 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:24:00 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:24:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:24:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:24:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:24:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:24:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:24:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:24:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:24:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:24:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:24:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:24:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:24:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:24:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:24:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:24:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:24:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:24:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:24:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:24:24 oleg434-client kernel: RDX: 0000000000001e62 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:24:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:24:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:24:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:24:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:24:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:24:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:24:24 oleg434-client kernel: Call Trace: Aug 15 10:24:24 oleg434-client kernel: Aug 15 10:24:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:24:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:24:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:24:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:24:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:24:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:24:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:24:24 oleg434-client kernel: Aug 15 10:24:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:24:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:24:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:24:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:24:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: Modules linked in: Aug 15 10:24:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:24:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) Aug 15 10:24:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:24:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:24:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:24:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30a/0x6d0 Aug 15 10:24:24 oleg434-client kernel: Code: 03 00 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 90 83 e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 Aug 15 10:24:24 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:24:24 oleg434-client kernel: RAX: 0000000000006890 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:24:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:24:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:24:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:24:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:24:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:24:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:24:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:24:24 oleg434-client kernel: Call Trace: Aug 15 10:24:24 oleg434-client kernel: Aug 15 10:24:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:24:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:24:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:24:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:24:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:24:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:24:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:24:24 oleg434-client kernel: Aug 15 10:24:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30a/0x6d0 Aug 15 10:24:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:24:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:24:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:24:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:24:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:24:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:24:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:24:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:24:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:24:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:24:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:24:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:24:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:24:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:24:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:24:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:24:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:24:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:24:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:24:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:24:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:24:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:24:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:24:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:24:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:24:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:24:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:24:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:24:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:24:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:24:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:24:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:24:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:24:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:24:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:24:28 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:24:28 oleg434-client kernel: RAX: 00000000000047a8 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:24:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:24:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:24:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:24:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:24:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:24:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:24:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:24:28 oleg434-client kernel: Call Trace: Aug 15 10:24:28 oleg434-client kernel: Aug 15 10:24:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:24:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:24:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:24:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:24:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:24:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:24:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:24:28 oleg434-client kernel: Aug 15 10:24:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:24:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:24:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:24:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:24:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:24:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:24:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:24:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:24:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:24:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:24:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:24:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:24:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:24:52 oleg434-client kernel: Modules linked in: Aug 15 10:24:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) Aug 15 10:24:52 oleg434-client kernel: lustre(O) Aug 15 10:24:52 oleg434-client kernel: osc(O) lmv(O) ec(O) fid(O) Aug 15 10:24:52 oleg434-client kernel: osp(O) Aug 15 10:24:52 oleg434-client kernel: fld(O) Aug 15 10:24:52 oleg434-client kernel: ofd(O) Aug 15 10:24:52 oleg434-client kernel: ptlrpc_gss(O) Aug 15 10:24:52 oleg434-client kernel: lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:24:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:24:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:24:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:24:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:24:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:24:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:24:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:24:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:24:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:24:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:24:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:24:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:24:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:24:52 oleg434-client kernel: Call Trace: Aug 15 10:24:52 oleg434-client kernel: Aug 15 10:24:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:24:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:24:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:24:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:24:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:24:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:24:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:24:52 oleg434-client kernel: Aug 15 10:24:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:24:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:24:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:24:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:24:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:24:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:24:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:24:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:24:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:24:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:24:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:24:52 oleg434-client kernel: ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:24:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:24:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:24:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:24:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:24:52 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:24:52 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:24:52 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:24:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:24:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:24:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:24:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:24:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:24:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:24:52 oleg434-client kernel: Call Trace: Aug 15 10:24:52 oleg434-client kernel: Aug 15 10:24:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:24:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:24:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:24:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:24:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:24:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:24:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:24:52 oleg434-client kernel: Aug 15 10:24:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:24:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:24:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:24:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:24:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:24:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:24:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:24:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:24:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:24:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:24:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:24:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:24:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:24:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:24:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:24:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:24:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:24:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:24:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:24:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:24:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:24:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:24:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:24:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:24:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:24:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:24:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:24:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:24:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:24:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:24:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:24:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:24:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:24:56 oleg434-client kernel: RAX: 0000000000005eba RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:24:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:24:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:24:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:24:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:24:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:24:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:24:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:24:56 oleg434-client kernel: Call Trace: Aug 15 10:24:56 oleg434-client kernel: Aug 15 10:24:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:24:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:24:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:24:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:24:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:24:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:24:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:24:56 oleg434-client kernel: Aug 15 10:24:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:24:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:24:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:24:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:24:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:24:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:24:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:24:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:24:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:24:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:24:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:25:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:25:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:25:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:25:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:25:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:25:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:25:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:25:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:25:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:25:20 oleg434-client kernel: RDX: 0000000000007d7c RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:25:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:25:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:25:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:25:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:25:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:25:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:25:20 oleg434-client kernel: Call Trace: Aug 15 10:25:20 oleg434-client kernel: Aug 15 10:25:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:25:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:25:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:25:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:25:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:25:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:25:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:25:20 oleg434-client kernel: Aug 15 10:25:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:25:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:25:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:25:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:25:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:25:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:25:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:25:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:25:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:25:20 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:25:20 oleg434-client kernel: RAX: 0000000000001f62 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:25:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:25:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:25:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:25:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:25:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:25:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:25:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:25:20 oleg434-client kernel: Call Trace: Aug 15 10:25:20 oleg434-client kernel: Aug 15 10:25:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:25:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:25:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:25:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:25:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:25:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:25:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:25:20 oleg434-client kernel: Aug 15 10:25:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:25:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:25:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:25:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:25:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:25:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:25:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:25:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:25:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:25:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:25:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:25:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:25:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:25:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:25:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:25:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:25:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:25:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:25:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:25:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:25:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:25:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:25:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:25:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:25:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:25:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:25:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:25:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:25:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:25:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:25:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:25:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:25:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:25:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:25:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:25:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:25:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:25:24 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:25:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:25:24 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:25:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:25:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:25:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:25:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:25:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:25:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:25:24 oleg434-client kernel: Call Trace: Aug 15 10:25:24 oleg434-client kernel: Aug 15 10:25:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:25:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:25:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:25:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:25:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:25:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:25:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:25:24 oleg434-client kernel: Aug 15 10:25:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:25:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:25:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:25:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:25:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:25:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:25:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:25:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:25:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:25:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:25:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:25:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:25:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:25:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:25:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:25:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:25:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:25:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:25:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:25:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:25:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:25:48 oleg434-client kernel: RDX: 0000000000000286 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:25:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:25:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:25:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:25:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:25:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:25:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:25:48 oleg434-client kernel: Call Trace: Aug 15 10:25:48 oleg434-client kernel: Aug 15 10:25:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:25:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:25:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:25:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:25:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:25:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:25:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:25:48 oleg434-client kernel: Aug 15 10:25:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:25:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:25:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:25:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:25:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: Modules linked in: Aug 15 10:25:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:25:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:25:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:25:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:25:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:25:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:25:48 oleg434-client kernel: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:25:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:25:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:25:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:25:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:25:48 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:25:48 oleg434-client kernel: RAX: 000000000000788a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:25:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:25:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:25:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:25:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:25:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:25:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:25:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:25:48 oleg434-client kernel: Call Trace: Aug 15 10:25:48 oleg434-client kernel: Aug 15 10:25:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:25:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:25:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:25:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:25:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:25:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:25:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:25:48 oleg434-client kernel: Aug 15 10:25:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:25:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:25:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:25:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:25:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:25:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:25:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:25:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:25:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:25:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:25:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:25:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:25:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:25:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:25:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:25:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:25:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:25:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:25:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:25:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:25:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:25:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:25:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:25:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:25:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:25:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:25:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:25:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:25:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:25:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:25:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:25:52 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:25:52 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:25:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:25:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:25:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:25:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:25:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:25:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:25:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:25:52 oleg434-client kernel: Call Trace: Aug 15 10:25:52 oleg434-client kernel: Aug 15 10:25:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:25:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:25:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:25:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:25:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:25:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:25:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:25:52 oleg434-client kernel: Aug 15 10:25:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:25:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:25:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:25:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:25:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:25:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:25:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:25:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:25:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:25:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:25:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:25:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:26:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:26:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:26:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:26:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:26:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:26:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:26:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:26:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:26:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:26:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:26:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:26:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:26:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:26:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:26:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:26:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:26:16 oleg434-client kernel: Call Trace: Aug 15 10:26:16 oleg434-client kernel: Aug 15 10:26:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:26:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:26:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:26:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:26:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:26:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:26:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:26:16 oleg434-client kernel: Aug 15 10:26:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:26:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:26:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:26:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:26:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:26:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:26:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:26:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:26:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:26:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:26:16 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:26:16 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:26:16 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:26:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:26:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:26:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:26:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:26:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:26:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:26:16 oleg434-client kernel: Call Trace: Aug 15 10:26:16 oleg434-client kernel: Aug 15 10:26:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:26:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:26:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:26:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:26:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:26:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:26:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:26:16 oleg434-client kernel: Aug 15 10:26:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:26:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:26:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:26:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:26:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:26:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:26:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:26:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:26:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:26:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:26:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:26:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:26:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:26:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:26:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:26:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:26:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:26:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:26:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:26:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:26:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:26:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:26:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:26:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:26:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:26:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:26:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:26:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:26:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:26:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:26:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:26:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:26:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:26:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:26:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:26:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:26:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:26:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:26:20 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:26:20 oleg434-client kernel: RAX: 0000000000007ca8 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:26:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:26:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:26:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:26:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:26:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:26:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:26:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:26:20 oleg434-client kernel: Call Trace: Aug 15 10:26:20 oleg434-client kernel: Aug 15 10:26:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:26:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:26:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:26:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:26:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:26:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:26:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:26:20 oleg434-client kernel: Aug 15 10:26:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:26:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:26:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:26:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:26:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:26:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:26:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:26:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:26:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:26:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:26:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:26:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:26:30 oleg434-client kernel: rcu: #0110-....: (1159198 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=350396 Aug 15 10:26:30 oleg434-client kernel: #011(t=1860044 jiffies g=297885 q=10104) Aug 15 10:26:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:26:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:26:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:26:30 oleg434-client kernel: Call Trace: Aug 15 10:26:30 oleg434-client kernel: Aug 15 10:26:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:26:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:26:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:26:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:26:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:26:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:26:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:26:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:26:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:26:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:26:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:26:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:26:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:26:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:26:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:26:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:26:30 oleg434-client kernel: Aug 15 10:26:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x17c/0x6d0 Aug 15 10:26:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:26:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:26:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:26:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:26:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:26:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:26:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:26:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:26:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:26:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:26:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:26:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:26:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:26:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:26:44 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:26:44 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:26:44 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:26:44 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:26:44 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:26:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:26:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:26:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:26:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:26:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:26:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:26:44 oleg434-client kernel: Call Trace: Aug 15 10:26:44 oleg434-client kernel: Aug 15 10:26:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:26:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:26:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:26:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:26:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:26:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:26:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:26:44 oleg434-client kernel: Aug 15 10:26:44 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:26:44 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:26:44 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:26:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:26:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:26:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:26:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:26:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:26:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:26:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:26:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:26:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:26:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:26:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:26:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:26:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:26:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:26:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:26:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:26:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:26:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:26:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:26:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:26:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:26:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:26:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:26:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:26:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:26:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:26:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:26:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:26:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:26:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:26:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:26:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:26:48 oleg434-client kernel: RAX: 0000000000000509 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:26:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:26:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:26:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:26:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:26:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:26:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:26:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:26:48 oleg434-client kernel: Call Trace: Aug 15 10:26:48 oleg434-client kernel: Aug 15 10:26:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:26:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:26:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:26:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:26:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:26:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:26:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:26:48 oleg434-client kernel: Aug 15 10:26:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:26:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:26:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:26:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:26:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:26:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:26:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:26:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:26:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:26:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:26:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:26:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:26:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:26:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:26:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:26:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:26:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:26:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:26:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:26:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:26:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:26:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:26:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:26:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:26:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:26:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:26:56 oleg434-client kernel: Call Trace: Aug 15 10:26:56 oleg434-client kernel: Aug 15 10:26:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:26:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:26:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:26:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:26:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:26:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:26:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:26:56 oleg434-client kernel: Aug 15 10:26:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:26:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:26:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:26:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:26:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:26:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:26:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:26:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:26:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:26:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:26:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:26:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:27:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:27:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:27:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:27:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:27:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:27:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:27:12 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:27:12 oleg434-client kernel: RAX: 0000000000006318 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:27:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:27:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:27:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:27:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:27:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:27:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:27:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:27:12 oleg434-client kernel: Call Trace: Aug 15 10:27:12 oleg434-client kernel: Aug 15 10:27:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:27:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:27:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:27:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:27:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:27:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:27:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:27:12 oleg434-client kernel: Aug 15 10:27:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:27:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:27:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:27:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:27:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:27:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:27:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:27:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:27:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:27:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:27:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:27:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:27:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:27:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:27:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:27:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:27:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:27:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:27:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:27:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:27:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:27:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:27:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:27:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:27:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:27:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:27:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:27:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:27:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:27:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:27:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:27:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:27:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:27:16 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:27:16 oleg434-client kernel: RAX: 0000000000004286 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:27:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:27:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:27:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:27:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:27:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:27:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:27:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:27:16 oleg434-client kernel: Call Trace: Aug 15 10:27:16 oleg434-client kernel: Aug 15 10:27:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:27:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:27:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:27:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:27:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:27:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:27:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:27:16 oleg434-client kernel: Aug 15 10:27:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:27:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:27:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:27:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:27:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:27:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:27:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:27:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:27:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:27:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:27:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:27:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:27:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:27:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:27:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:27:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:27:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:27:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:27:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:27:24 oleg434-client kernel: RDX: 0000000000000bc2 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:27:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:27:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:27:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:27:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:27:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:27:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:27:24 oleg434-client kernel: Call Trace: Aug 15 10:27:24 oleg434-client kernel: Aug 15 10:27:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:27:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:27:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:27:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:27:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:27:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:27:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:27:24 oleg434-client kernel: Aug 15 10:27:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:27:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:27:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:27:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:27:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:27:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:27:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:27:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:27:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:27:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:27:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:27:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:27:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:27:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:27:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:27:40 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:27:40 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:27:40 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:27:40 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:27:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:27:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:27:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:27:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:27:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:27:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:27:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:27:40 oleg434-client kernel: Call Trace: Aug 15 10:27:40 oleg434-client kernel: Aug 15 10:27:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:27:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:27:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:27:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:27:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:27:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:27:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:27:40 oleg434-client kernel: Aug 15 10:27:40 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:27:40 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:27:40 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:27:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:27:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:27:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:27:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:27:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:27:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:27:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:27:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:27:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:27:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:27:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:27:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:27:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:27:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:27:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:27:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:27:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:27:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:27:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:27:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:27:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:27:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:27:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:27:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:27:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:27:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:27:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:27:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:27:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:27:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:27:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:27:44 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:27:44 oleg434-client kernel: RAX: 0000000000007d95 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:27:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:27:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:27:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:27:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:27:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:27:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:27:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:27:44 oleg434-client kernel: Call Trace: Aug 15 10:27:44 oleg434-client kernel: Aug 15 10:27:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:27:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:27:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:27:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:27:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:27:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:27:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:27:44 oleg434-client kernel: Aug 15 10:27:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:27:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:27:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:27:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:27:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:27:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:27:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:27:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:27:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:27:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:27:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:27:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:27:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:27:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:27:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:27:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:27:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:27:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:27:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:27:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:27:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:27:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:27:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:27:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:27:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:27:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:27:52 oleg434-client kernel: Call Trace: Aug 15 10:27:52 oleg434-client kernel: Aug 15 10:27:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:27:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:27:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:27:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:27:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:27:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:27:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:27:52 oleg434-client kernel: Aug 15 10:27:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:27:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:27:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:27:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:27:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:27:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:27:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:27:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:27:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:27:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:27:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:27:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:28:01 oleg434-client anacron[38105]: Job `cron.daily' started Aug 15 10:28:01 oleg434-client run-parts[38113]: (/etc/cron.daily) starting logrotate Aug 15 10:28:01 oleg434-client run-parts[38113]: (/etc/cron.daily) finished logrotate Aug 15 10:28:01 oleg434-client anacron[38105]: Job `cron.daily' terminated Aug 15 10:28:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:28:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:28:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:28:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:28:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:28:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:28:08 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:28:08 oleg434-client kernel: RAX: 000000000000301a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:28:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:28:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:28:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:28:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:28:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:28:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:28:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:28:08 oleg434-client kernel: Call Trace: Aug 15 10:28:08 oleg434-client kernel: Aug 15 10:28:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:28:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:28:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:28:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:28:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:28:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:28:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:28:08 oleg434-client kernel: Aug 15 10:28:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:28:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:28:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:28:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:28:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:28:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:28:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:28:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:28:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:28:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:28:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:28:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:28:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:28:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:28:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:28:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:28:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:28:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:28:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:28:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:28:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:28:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:28:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:28:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:28:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:28:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:28:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:28:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:28:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:28:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:28:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:28:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:28:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:28:12 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:28:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:28:12 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:28:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:28:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:28:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:28:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:28:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:28:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:28:12 oleg434-client kernel: Call Trace: Aug 15 10:28:12 oleg434-client kernel: Aug 15 10:28:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:28:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:28:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:28:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:28:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:28:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:28:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:28:12 oleg434-client kernel: Aug 15 10:28:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:28:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:28:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:28:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:28:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:28:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:28:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:28:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:28:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:28:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:28:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:28:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:28:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:28:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:28:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:28:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:28:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:28:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:28:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:28:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:28:20 oleg434-client kernel: RDX: 00000000000043c2 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:28:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:28:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:28:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:28:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:28:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:28:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:28:20 oleg434-client kernel: Call Trace: Aug 15 10:28:20 oleg434-client kernel: Aug 15 10:28:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:28:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:28:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:28:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:28:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:28:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:28:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:28:20 oleg434-client kernel: Aug 15 10:28:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:28:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:28:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:28:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:28:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:28:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:28:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:28:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:28:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:28:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:28:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:28:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:28:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:28:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:28:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:28:36 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:28:36 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:28:36 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:28:36 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:28:36 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:28:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:28:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:28:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:28:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:28:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:28:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:28:36 oleg434-client kernel: Call Trace: Aug 15 10:28:36 oleg434-client kernel: Aug 15 10:28:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:28:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:28:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:28:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:28:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:28:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:28:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:28:36 oleg434-client kernel: Aug 15 10:28:36 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:28:36 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:28:36 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:28:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:28:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:28:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:28:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:28:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:28:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:28:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:28:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:28:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:28:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:28:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:28:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:28:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:28:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:28:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:28:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:28:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:28:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:28:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:28:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:28:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:28:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:28:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:28:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:28:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:28:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:28:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:28:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:28:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:28:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:28:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:28:40 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:28:40 oleg434-client kernel: RAX: 000000000000747c RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:28:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:28:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:28:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:28:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:28:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:28:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:28:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:28:40 oleg434-client kernel: Call Trace: Aug 15 10:28:40 oleg434-client kernel: Aug 15 10:28:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:28:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:28:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:28:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:28:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:28:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:28:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:28:40 oleg434-client kernel: Aug 15 10:28:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:28:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:28:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:28:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:28:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:28:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:28:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:28:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:28:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:28:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:28:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:28:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:28:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:28:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:28:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:28:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:28:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:28:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:28:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:28:48 oleg434-client kernel: RDX: 00000000000035e1 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:28:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:28:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:28:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:28:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:28:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:28:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:28:48 oleg434-client kernel: Call Trace: Aug 15 10:28:48 oleg434-client kernel: Aug 15 10:28:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:28:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:28:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:28:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:28:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:28:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:28:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:28:48 oleg434-client kernel: Aug 15 10:28:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:28:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:28:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:28:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:28:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:28:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:28:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:28:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:28:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:28:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:28:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:28:48 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:29:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:29:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:29:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:29:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:29:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:29:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:29:04 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:29:04 oleg434-client kernel: RAX: 0000000000007084 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:29:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:29:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:29:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:29:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:29:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:29:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:29:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:29:04 oleg434-client kernel: Call Trace: Aug 15 10:29:04 oleg434-client kernel: Aug 15 10:29:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:29:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:29:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:29:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:29:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:29:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:29:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:29:04 oleg434-client kernel: Aug 15 10:29:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:29:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:29:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:29:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:29:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:29:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:29:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:29:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:29:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:29:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:29:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:29:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:29:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:29:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:29:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:29:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:29:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:29:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:29:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:29:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:29:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:29:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:29:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:29:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:29:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:29:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:29:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:29:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:29:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:29:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:29:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:29:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:29:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:29:08 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:29:08 oleg434-client kernel: RAX: 0000000000004417 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:29:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:29:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:29:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:29:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:29:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:29:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:29:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:29:08 oleg434-client kernel: Call Trace: Aug 15 10:29:08 oleg434-client kernel: Aug 15 10:29:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:29:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:29:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:29:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:29:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:29:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:29:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:29:08 oleg434-client kernel: Aug 15 10:29:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:29:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:29:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:29:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:29:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:29:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:29:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:29:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:29:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:29:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:29:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:29:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:29:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:29:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:29:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:29:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:29:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:29:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:29:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:29:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:29:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:29:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:29:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:29:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:29:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:29:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:29:16 oleg434-client kernel: Call Trace: Aug 15 10:29:16 oleg434-client kernel: Aug 15 10:29:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:29:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:29:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:29:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:29:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:29:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:29:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:29:16 oleg434-client kernel: Aug 15 10:29:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:29:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:29:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:29:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:29:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:29:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:29:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:29:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:29:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:29:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:29:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:29:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:29:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:29:30 oleg434-client kernel: rcu: #0110-....: (1268117 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=383755 Aug 15 10:29:30 oleg434-client kernel: #011(t=2040048 jiffies g=297885 q=11313) Aug 15 10:29:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:29:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:29:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:29:30 oleg434-client kernel: Call Trace: Aug 15 10:29:30 oleg434-client kernel: Aug 15 10:29:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:29:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:29:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:29:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:29:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:29:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:29:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:29:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:29:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:29:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:29:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:29:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:29:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:29:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:29:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:29:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:29:30 oleg434-client kernel: Aug 15 10:29:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:29:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:29:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:29:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:29:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:29:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:29:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:29:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:29:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:29:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:29:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:29:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:29:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:29:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:29:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:29:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:29:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:29:32 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13 Aug 15 10:29:32 oleg434-client kernel: RAX: 0000000000004233 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:29:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:29:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:29:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:29:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:29:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:29:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:29:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:29:32 oleg434-client kernel: Call Trace: Aug 15 10:29:32 oleg434-client kernel: Aug 15 10:29:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:29:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:29:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:29:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:29:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:29:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:29:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:29:32 oleg434-client kernel: Aug 15 10:29:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:29:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:29:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:29:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:29:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:29:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:29:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:29:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:29:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:29:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:29:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:29:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:29:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:29:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:29:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:29:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:29:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:29:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:29:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:29:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:29:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:29:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:29:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:29:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:29:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:29:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:29:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:29:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:29:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:29:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:29:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:29:36 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:29:36 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:29:36 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:29:36 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:29:36 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:29:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:29:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:29:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:29:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:29:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:29:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:29:36 oleg434-client kernel: Call Trace: Aug 15 10:29:36 oleg434-client kernel: Aug 15 10:29:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:29:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:29:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:29:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:29:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:29:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:29:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:29:36 oleg434-client kernel: Aug 15 10:29:36 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:29:36 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:29:36 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:29:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:29:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:29:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:29:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:29:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:29:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:29:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:29:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:29:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:29:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:29:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:29:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:29:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:29:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:29:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:29:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:29:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:29:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:29:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:29:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:29:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:29:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:29:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:29:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:29:56 oleg434-client kernel: Call Trace: Aug 15 10:29:56 oleg434-client kernel: Aug 15 10:29:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:29:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:29:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:29:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:29:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:29:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:29:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:29:56 oleg434-client kernel: Aug 15 10:29:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:29:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:29:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:29:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:29:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:29:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:29:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:29:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:29:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:29:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:29:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:29:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:30:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:30:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:30:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:30:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:30:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:30:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:30:00 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:30:00 oleg434-client kernel: RAX: 0000000000004688 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:30:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:30:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:30:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:30:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:30:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:30:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:30:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:30:00 oleg434-client kernel: Call Trace: Aug 15 10:30:00 oleg434-client kernel: Aug 15 10:30:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:30:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:30:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:30:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:30:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:30:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:30:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:30:00 oleg434-client kernel: Aug 15 10:30:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:30:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:30:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:30:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:30:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:30:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:30:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:30:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:30:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:30:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:30:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:30:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:30:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:30:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:30:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:30:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:30:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:30:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:30:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:30:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:30:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:30:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:30:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:30:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:30:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:30:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:30:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:30:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:30:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:30:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:30:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:30:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:30:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:30:04 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:30:04 oleg434-client kernel: RAX: 000000000000330a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:30:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:30:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:30:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:30:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:30:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:30:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:30:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:30:04 oleg434-client kernel: Call Trace: Aug 15 10:30:04 oleg434-client kernel: Aug 15 10:30:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:30:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:30:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:30:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:30:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:30:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:30:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:30:04 oleg434-client kernel: Aug 15 10:30:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:30:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:30:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:30:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:30:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:30:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:30:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:30:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:30:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:30:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:30:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:30:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:30:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:30:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:30:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:30:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:30:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:30:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:30:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:30:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:30:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:30:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:30:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:30:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:30:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:30:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:30:24 oleg434-client kernel: Call Trace: Aug 15 10:30:24 oleg434-client kernel: Aug 15 10:30:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:30:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:30:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:30:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:30:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:30:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:30:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:30:24 oleg434-client kernel: Aug 15 10:30:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:30:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:30:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:30:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:30:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:30:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:30:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:30:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:30:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:30:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:30:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:30:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:30:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:30:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:30:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:30:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:30:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:30:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:30:28 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:30:28 oleg434-client kernel: RAX: 0000000000003d18 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:30:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:30:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:30:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:30:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:30:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:30:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:30:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:30:28 oleg434-client kernel: Call Trace: Aug 15 10:30:28 oleg434-client kernel: Aug 15 10:30:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:30:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:30:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:30:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:30:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:30:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:30:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:30:28 oleg434-client kernel: Aug 15 10:30:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:30:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:30:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:30:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:30:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:30:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:30:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:30:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:30:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:30:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:30:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:30:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:30:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:30:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:30:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:30:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:30:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:30:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:30:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:30:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:30:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:30:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:30:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:30:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:30:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:30:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:30:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:30:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:30:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:30:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:30:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:30:32 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:30:32 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:30:32 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:30:32 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:30:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:30:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:30:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:30:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:30:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:30:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:30:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:30:32 oleg434-client kernel: Call Trace: Aug 15 10:30:32 oleg434-client kernel: Aug 15 10:30:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:30:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:30:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:30:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:30:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:30:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:30:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:30:32 oleg434-client kernel: Aug 15 10:30:32 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:30:32 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:30:32 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:30:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:30:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:30:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:30:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:30:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:30:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:30:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:30:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:30:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:30:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:30:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:30:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:30:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:30:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:30:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:30:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:30:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:30:52 oleg434-client kernel: RDX: 000000000000706c RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:30:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:30:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:30:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:30:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:30:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:30:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:30:52 oleg434-client kernel: Call Trace: Aug 15 10:30:52 oleg434-client kernel: Aug 15 10:30:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:30:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:30:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:30:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:30:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:30:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:30:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:30:52 oleg434-client kernel: Aug 15 10:30:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:30:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:30:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:30:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:30:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:30:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:30:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:30:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:30:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:30:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:30:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:30:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:30:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:30:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:30:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:30:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:30:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:30:56 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:30:56 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:30:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:30:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:30:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:30:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:30:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:30:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:30:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:30:56 oleg434-client kernel: Call Trace: Aug 15 10:30:56 oleg434-client kernel: Aug 15 10:30:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:30:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:30:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:30:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:30:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:30:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:30:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:30:56 oleg434-client kernel: Aug 15 10:30:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:30:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:30:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:30:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:30:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:30:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:30:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:30:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:30:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:30:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:30:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:30:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:30:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:30:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:30:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:30:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:30:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:30:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:30:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:30:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:30:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:30:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:30:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:30:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:30:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:30:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:30:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:31:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:31:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:31:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:31:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:31:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:31:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:31:00 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:31:00 oleg434-client kernel: RAX: 0000000000007c1a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:31:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:31:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:31:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:31:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:31:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:31:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:31:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:31:00 oleg434-client kernel: Call Trace: Aug 15 10:31:00 oleg434-client kernel: Aug 15 10:31:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:31:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:31:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:31:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:31:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:31:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:31:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:31:00 oleg434-client kernel: Aug 15 10:31:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:31:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:31:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:31:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:31:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:31:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:31:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:31:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:31:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:31:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:31:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:31:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:31:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:31:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:31:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:31:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:31:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:31:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:31:20 oleg434-client kernel: RDX: 0000000000001447 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:31:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:31:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:31:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:31:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:31:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:31:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:31:20 oleg434-client kernel: Call Trace: Aug 15 10:31:20 oleg434-client kernel: Aug 15 10:31:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:31:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:31:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:31:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:31:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:31:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:31:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:31:20 oleg434-client kernel: Aug 15 10:31:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:31:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:31:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:31:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:31:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:31:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:31:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:31:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:31:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:31:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:31:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:31:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:31:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:31:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:31:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:31:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:31:24 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:31:24 oleg434-client kernel: RAX: 000000000000762d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:31:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:31:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:31:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:31:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:31:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:31:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:31:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:31:24 oleg434-client kernel: Call Trace: Aug 15 10:31:24 oleg434-client kernel: Aug 15 10:31:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:31:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:31:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:31:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:31:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:31:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:31:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:31:24 oleg434-client kernel: Aug 15 10:31:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:31:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:31:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:31:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:31:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:31:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:31:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:31:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:31:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:31:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:31:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:31:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:31:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:31:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:31:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:31:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:31:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:31:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:31:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:31:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:31:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:31:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:31:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:31:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:31:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:31:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:31:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:31:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:31:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:31:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:31:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:31:28 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:31:28 oleg434-client kernel: RAX: 000000000000070b RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:31:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:31:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:31:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:31:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:31:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:31:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:31:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:31:28 oleg434-client kernel: Call Trace: Aug 15 10:31:28 oleg434-client kernel: Aug 15 10:31:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:31:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:31:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:31:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:31:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:31:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:31:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:31:28 oleg434-client kernel: Aug 15 10:31:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:31:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:31:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:31:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:31:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:31:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:31:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:31:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:31:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:31:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:31:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:31:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:31:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:31:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:31:48 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:31:48 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:31:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:31:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:31:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:31:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:31:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:31:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:31:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:31:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:31:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:31:48 oleg434-client kernel: Call Trace: Aug 15 10:31:48 oleg434-client kernel: Aug 15 10:31:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:31:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:31:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:31:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:31:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:31:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:31:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:31:48 oleg434-client kernel: Aug 15 10:31:48 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:31:48 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:31:48 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:31:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:31:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:31:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:31:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:31:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:31:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:31:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:31:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:31:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:31:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:31:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:31:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:31:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:31:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:31:52 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:31:52 oleg434-client kernel: RAX: 0000000000005136 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:31:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:31:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:31:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:31:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:31:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:31:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:31:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:31:52 oleg434-client kernel: Call Trace: Aug 15 10:31:52 oleg434-client kernel: Aug 15 10:31:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:31:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:31:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:31:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:31:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:31:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:31:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:31:52 oleg434-client kernel: Aug 15 10:31:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:31:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:31:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:31:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:31:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:31:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:31:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:31:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:31:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:31:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:31:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:31:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:31:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:31:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:31:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:31:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:31:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:31:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:31:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:31:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:31:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:31:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:31:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:31:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:31:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:31:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:31:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:31:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:31:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:31:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:31:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:31:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:31:56 oleg434-client kernel: RAX: 0000000000007634 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:31:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:31:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:31:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:31:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:31:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:31:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:31:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:31:56 oleg434-client kernel: Call Trace: Aug 15 10:31:56 oleg434-client kernel: Aug 15 10:31:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:31:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:31:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:31:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:31:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:31:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:31:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:31:56 oleg434-client kernel: Aug 15 10:31:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:31:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:31:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:31:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:31:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:31:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:31:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:31:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:31:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:31:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:31:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:32:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:32:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:32:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:32:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:32:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:32:16 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:32:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:32:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:32:16 oleg434-client kernel: RDX: 000000000000158f RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:32:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:32:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:32:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:32:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:32:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:32:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:32:16 oleg434-client kernel: Call Trace: Aug 15 10:32:16 oleg434-client kernel: Aug 15 10:32:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:32:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:32:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:32:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:32:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:32:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:32:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:32:16 oleg434-client kernel: Aug 15 10:32:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:32:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:32:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:32:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:32:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:32:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:32:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:32:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:32:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:32:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:32:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:32:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:32:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:32:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:32:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:32:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:32:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:32:20 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:32:20 oleg434-client kernel: RAX: 0000000000006181 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:32:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:32:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:32:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:32:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:32:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:32:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:32:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:32:20 oleg434-client kernel: Call Trace: Aug 15 10:32:20 oleg434-client kernel: Aug 15 10:32:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:32:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:32:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:32:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:32:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:32:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:32:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:32:20 oleg434-client kernel: Aug 15 10:32:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:32:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:32:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:32:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:32:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:32:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:32:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:32:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:32:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:32:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:32:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:32:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:32:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:32:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:32:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:32:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:32:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:32:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:32:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:32:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:32:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:32:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:32:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:32:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:32:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:32:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:32:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:32:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:32:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:32:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:32:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:32:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:32:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:32:24 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:32:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:32:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:32:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:32:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:32:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:32:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:32:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:32:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:32:24 oleg434-client kernel: Call Trace: Aug 15 10:32:24 oleg434-client kernel: Aug 15 10:32:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:32:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:32:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:32:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:32:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:32:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:32:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:32:24 oleg434-client kernel: Aug 15 10:32:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:32:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:32:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:32:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:32:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:32:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:32:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:32:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:32:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:32:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:32:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:32:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:32:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:32:30 oleg434-client kernel: rcu: #0110-....: (1383149 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=418082 Aug 15 10:32:30 oleg434-client kernel: #011(t=2220052 jiffies g=297885 q=12008) Aug 15 10:32:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:32:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:32:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:32:30 oleg434-client kernel: Call Trace: Aug 15 10:32:30 oleg434-client kernel: Aug 15 10:32:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:32:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:32:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:32:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:32:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:32:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:32:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:32:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:32:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:32:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:32:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:32:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:32:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:32:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:32:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:32:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:32:30 oleg434-client kernel: Aug 15 10:32:30 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:32:30 oleg434-client kernel: ? kvm_wait+0xcd/0xe0 Aug 15 10:32:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:32:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:32:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:32:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:32:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:32:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:32:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:32:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:32:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:32:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:32:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:32:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:32:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:32:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:32:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:32:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:32:48 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:32:48 oleg434-client kernel: RAX: 0000000000003609 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:32:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:32:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:32:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:32:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:32:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:32:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:32:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:32:48 oleg434-client kernel: Call Trace: Aug 15 10:32:48 oleg434-client kernel: Aug 15 10:32:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:32:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:32:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:32:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:32:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:32:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:32:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:32:48 oleg434-client kernel: Aug 15 10:32:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:32:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:32:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:32:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:32:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:32:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:32:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:32:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:32:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:32:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:32:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:32:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:32:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:32:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:32:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:32:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:32:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:32:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:32:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:32:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:32:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:32:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:32:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:32:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:32:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:32:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:32:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:32:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:32:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:32:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:32:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:32:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30a/0x6d0 Aug 15 10:32:52 oleg434-client kernel: Code: 03 00 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 90 83 e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 Aug 15 10:32:52 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:32:52 oleg434-client kernel: RAX: 0000000000003348 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:32:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:32:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:32:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:32:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:32:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:32:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:32:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:32:52 oleg434-client kernel: Call Trace: Aug 15 10:32:52 oleg434-client kernel: Aug 15 10:32:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:32:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:32:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:32:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:32:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:32:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:32:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:32:52 oleg434-client kernel: Aug 15 10:32:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30a/0x6d0 Aug 15 10:32:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:32:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:32:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:32:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:32:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:32:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:32:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:32:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:32:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:32:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:32:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:32:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:32:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:32:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:32:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:32:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:32:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:32:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:32:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:32:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:32:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:32:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:32:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:32:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:32:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:32:56 oleg434-client kernel: Call Trace: Aug 15 10:32:56 oleg434-client kernel: Aug 15 10:32:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:32:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:32:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:32:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:32:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:32:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:32:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:32:56 oleg434-client kernel: Aug 15 10:32:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:32:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:32:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:32:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:32:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:32:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:32:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:32:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:32:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:32:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:32:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:32:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:33:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:33:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:33:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:33:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:33:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:33:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:33:16 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:33:16 oleg434-client kernel: RAX: 0000000000007b81 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:33:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:33:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:33:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:33:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:33:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:33:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:33:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:33:16 oleg434-client kernel: Call Trace: Aug 15 10:33:16 oleg434-client kernel: Aug 15 10:33:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:33:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:33:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:33:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:33:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:33:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:33:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:33:16 oleg434-client kernel: Aug 15 10:33:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:33:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:33:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:33:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:33:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:33:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:33:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:33:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:33:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:33:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:33:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:33:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:33:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:33:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:33:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:33:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:33:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:33:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:33:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:33:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:33:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:33:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:33:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:33:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:33:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:33:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:33:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:33:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:33:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:33:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:33:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:33:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:33:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:33:20 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:33:20 oleg434-client kernel: RAX: 0000000000006da1 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:33:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:33:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:33:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:33:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:33:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:33:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:33:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:33:20 oleg434-client kernel: Call Trace: Aug 15 10:33:20 oleg434-client kernel: Aug 15 10:33:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:33:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:33:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:33:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:33:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:33:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:33:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:33:20 oleg434-client kernel: Aug 15 10:33:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:33:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:33:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:33:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:33:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:33:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:33:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:33:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:33:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:33:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:33:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:33:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:33:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:33:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:33:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:33:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:33:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:33:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:33:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:33:24 oleg434-client kernel: RDX: 00000000000002e4 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:33:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:33:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:33:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:33:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:33:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:33:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:33:24 oleg434-client kernel: Call Trace: Aug 15 10:33:24 oleg434-client kernel: Aug 15 10:33:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:33:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:33:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:33:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:33:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:33:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:33:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:33:24 oleg434-client kernel: Aug 15 10:33:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:33:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:33:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:33:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:33:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:33:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:33:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:33:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:33:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:33:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:33:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:33:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:33:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:33:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:33:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:33:44 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:33:44 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:33:44 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:33:44 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:33:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:33:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:33:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:33:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:33:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:33:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:33:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:33:44 oleg434-client kernel: Call Trace: Aug 15 10:33:44 oleg434-client kernel: Aug 15 10:33:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:33:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:33:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:33:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:33:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:33:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:33:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:33:44 oleg434-client kernel: Aug 15 10:33:44 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:33:44 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:33:44 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:33:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:33:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:33:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:33:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:33:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:33:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:33:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:33:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:33:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:33:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:33:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:33:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:33:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:33:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:33:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:33:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:33:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:33:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:33:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:33:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:33:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:33:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:33:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:33:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:33:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:33:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:33:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:33:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:33:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:33:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:33:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:33:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:33:48 oleg434-client kernel: RAX: 0000000000005f07 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:33:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:33:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:33:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:33:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:33:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:33:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:33:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:33:48 oleg434-client kernel: Call Trace: Aug 15 10:33:48 oleg434-client kernel: Aug 15 10:33:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:33:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:33:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:33:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:33:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:33:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:33:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:33:48 oleg434-client kernel: Aug 15 10:33:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:33:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:33:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:33:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:33:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:33:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:33:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:33:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:33:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:33:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:33:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:33:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:33:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:33:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:33:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:33:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:33:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:33:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:33:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:33:52 oleg434-client kernel: RDX: 0000000000005d79 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:33:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:33:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:33:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:33:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:33:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:33:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:33:52 oleg434-client kernel: Call Trace: Aug 15 10:33:52 oleg434-client kernel: Aug 15 10:33:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:33:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:33:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:33:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:33:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:33:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:33:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:33:52 oleg434-client kernel: Aug 15 10:33:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:33:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:33:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:33:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:33:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:33:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:33:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:33:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:33:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:33:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:33:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:33:52 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:34:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:34:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:34:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:34:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:34:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:34:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:34:12 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:34:12 oleg434-client kernel: RAX: 0000000000006c04 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:34:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:34:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:34:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:34:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:34:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:34:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:34:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:34:12 oleg434-client kernel: Call Trace: Aug 15 10:34:12 oleg434-client kernel: Aug 15 10:34:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:34:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:34:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:34:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:34:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:34:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:34:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:34:12 oleg434-client kernel: Aug 15 10:34:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:34:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:34:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:34:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:34:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:34:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:34:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:34:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:34:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:34:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:34:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:34:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:34:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:34:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:34:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:34:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:34:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:34:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:34:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:34:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:34:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:34:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:34:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:34:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:34:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:34:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:34:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:34:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:34:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:34:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:34:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:34:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:34:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:34:16 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:34:16 oleg434-client kernel: RAX: 0000000000007983 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:34:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:34:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:34:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:34:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:34:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:34:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:34:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:34:16 oleg434-client kernel: Call Trace: Aug 15 10:34:16 oleg434-client kernel: Aug 15 10:34:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:34:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:34:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:34:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:34:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:34:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:34:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:34:16 oleg434-client kernel: Aug 15 10:34:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:34:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:34:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:34:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:34:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:34:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:34:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:34:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:34:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:34:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:34:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:34:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:34:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:34:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:34:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:34:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:34:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:34:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:34:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:34:20 oleg434-client kernel: RDX: 0000000000000321 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:34:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:34:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:34:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:34:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:34:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:34:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:34:20 oleg434-client kernel: Call Trace: Aug 15 10:34:20 oleg434-client kernel: Aug 15 10:34:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:34:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:34:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:34:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:34:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:34:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:34:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:34:20 oleg434-client kernel: Aug 15 10:34:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:34:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:34:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:34:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:34:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:34:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:34:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:34:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:34:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:34:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:34:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:34:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:34:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:34:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:34:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:34:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:34:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:34:40 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:34:40 oleg434-client kernel: RAX: 0000000000004e23 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:34:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:34:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:34:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:34:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:34:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:34:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:34:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:34:40 oleg434-client kernel: Call Trace: Aug 15 10:34:40 oleg434-client kernel: Aug 15 10:34:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:34:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:34:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:34:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:34:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:34:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:34:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:34:40 oleg434-client kernel: Aug 15 10:34:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:34:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:34:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:34:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:34:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:34:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:34:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:34:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:34:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:34:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:34:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:34:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:34:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:34:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:34:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:34:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:34:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:34:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:34:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:34:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:34:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:34:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:34:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:34:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:34:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:34:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:34:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:34:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:34:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:34:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:34:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:34:44 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:34:44 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:34:44 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:34:44 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:34:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:34:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:34:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:34:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:34:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:34:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:34:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:34:44 oleg434-client kernel: Call Trace: Aug 15 10:34:44 oleg434-client kernel: Aug 15 10:34:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:34:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:34:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:34:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:34:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:34:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:34:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:34:44 oleg434-client kernel: Aug 15 10:34:44 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:34:44 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:34:44 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:34:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:34:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:34:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:34:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:34:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:34:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:34:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:34:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:34:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:34:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:34:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:34:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:34:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:34:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:34:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:34:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:34:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:34:48 oleg434-client kernel: RDX: 0000000000000d50 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:34:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:34:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:34:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:34:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:34:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:34:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:34:48 oleg434-client kernel: Call Trace: Aug 15 10:34:48 oleg434-client kernel: Aug 15 10:34:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:34:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:34:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:34:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:34:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:34:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:34:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:34:48 oleg434-client kernel: Aug 15 10:34:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:34:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:34:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:34:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:34:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:34:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:34:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:34:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:34:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:34:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:34:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:35:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:35:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:35:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:35:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:35:08 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:35:08 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:35:08 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:35:08 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:35:08 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:35:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:35:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:35:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:35:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:35:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:35:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:35:08 oleg434-client kernel: Call Trace: Aug 15 10:35:08 oleg434-client kernel: Aug 15 10:35:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:35:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:35:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:35:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:35:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:35:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:35:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:35:08 oleg434-client kernel: Aug 15 10:35:08 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:35:08 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:35:08 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:35:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:35:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:35:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:35:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:35:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:35:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:35:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:35:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:35:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:35:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:35:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:35:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:35:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:35:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:35:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:35:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:35:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:35:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:35:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:35:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:35:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:35:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:35:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:35:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:35:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:35:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:35:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:35:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:35:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:35:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:35:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:35:12 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:35:12 oleg434-client kernel: RAX: 000000000000320c RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:35:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:35:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:35:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:35:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:35:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:35:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:35:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:35:12 oleg434-client kernel: Call Trace: Aug 15 10:35:12 oleg434-client kernel: Aug 15 10:35:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:35:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:35:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:35:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:35:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:35:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:35:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:35:12 oleg434-client kernel: Aug 15 10:35:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:35:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:35:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:35:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:35:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:35:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:35:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:35:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:35:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:35:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:35:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:35:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:35:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:35:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:35:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:35:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:35:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:35:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:35:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:35:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:35:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:35:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:35:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:35:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:35:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:35:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:35:16 oleg434-client kernel: Call Trace: Aug 15 10:35:16 oleg434-client kernel: Aug 15 10:35:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:35:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:35:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:35:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:35:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:35:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:35:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:35:16 oleg434-client kernel: Aug 15 10:35:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:35:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:35:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:35:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:35:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:35:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:35:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:35:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:35:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:35:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:35:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:35:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:35:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:35:30 oleg434-client kernel: rcu: #0110-....: (1491245 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=451856 Aug 15 10:35:30 oleg434-client kernel: #011(t=2400059 jiffies g=297885 q=12761) Aug 15 10:35:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:35:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:35:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:35:30 oleg434-client kernel: Call Trace: Aug 15 10:35:30 oleg434-client kernel: Aug 15 10:35:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:35:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:35:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:35:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:35:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:35:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:35:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:35:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:35:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:35:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:35:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:35:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:35:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:35:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:35:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:35:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:35:30 oleg434-client kernel: Aug 15 10:35:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:35:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:35:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:35:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:35:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:35:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:35:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:35:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:35:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:35:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:35:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:35:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:35:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:35:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:35:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:35:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:35:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:35:36 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:35:36 oleg434-client kernel: RAX: 0000000000006c90 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:35:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:35:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:35:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:35:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:35:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:35:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:35:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:35:36 oleg434-client kernel: Call Trace: Aug 15 10:35:36 oleg434-client kernel: Aug 15 10:35:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:35:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:35:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:35:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:35:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:35:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:35:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:35:36 oleg434-client kernel: Aug 15 10:35:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:35:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:35:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:35:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:35:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:35:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:35:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:35:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:35:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:35:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:35:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:35:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:35:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:35:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:35:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:35:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:35:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:35:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:35:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:35:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:35:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:35:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:35:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:35:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:35:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:35:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:35:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:35:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:35:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:35:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:35:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:35:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:35:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:35:40 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:35:40 oleg434-client kernel: RAX: 0000000000007e9c RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:35:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:35:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:35:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:35:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:35:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:35:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:35:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:35:40 oleg434-client kernel: Call Trace: Aug 15 10:35:40 oleg434-client kernel: Aug 15 10:35:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:35:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:35:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:35:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:35:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:35:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:35:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:35:40 oleg434-client kernel: Aug 15 10:35:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:35:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:35:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:35:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:35:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:35:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:35:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:35:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:35:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:35:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:35:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:35:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:35:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:35:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:35:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:35:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:35:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:35:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:35:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:35:56 oleg434-client kernel: RDX: 00000000000022c0 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:35:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:35:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:35:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:35:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:35:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:35:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:35:56 oleg434-client kernel: Call Trace: Aug 15 10:35:56 oleg434-client kernel: Aug 15 10:35:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:35:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:35:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:35:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:35:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:35:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:35:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:35:56 oleg434-client kernel: Aug 15 10:35:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:35:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:35:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:35:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:35:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:35:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:35:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:35:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:35:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:35:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:35:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:36:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:36:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:36:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:36:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:36:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:36:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:36:04 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:36:04 oleg434-client kernel: RAX: 0000000000006b20 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:36:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:36:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:36:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:36:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:36:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:36:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:36:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:36:04 oleg434-client kernel: Call Trace: Aug 15 10:36:04 oleg434-client kernel: Aug 15 10:36:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:36:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:36:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:36:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:36:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:36:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:36:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:36:04 oleg434-client kernel: Aug 15 10:36:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:36:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:36:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:36:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:36:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:36:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:36:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:36:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:36:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:36:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:36:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:36:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:36:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:36:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:36:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:36:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:36:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:36:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:36:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:36:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:36:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:36:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:36:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:36:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:36:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:36:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:36:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:36:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:36:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:36:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:36:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:36:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:36:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:36:08 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:36:08 oleg434-client kernel: RAX: 0000000000007f82 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:36:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:36:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:36:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:36:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:36:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:36:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:36:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:36:08 oleg434-client kernel: Call Trace: Aug 15 10:36:08 oleg434-client kernel: Aug 15 10:36:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:36:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:36:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:36:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:36:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:36:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:36:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:36:08 oleg434-client kernel: Aug 15 10:36:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:36:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:36:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:36:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:36:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:36:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:36:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:36:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:36:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:36:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:36:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:36:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:36:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:36:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:36:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:36:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:36:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:36:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:36:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:36:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:36:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:36:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:36:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:36:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:36:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:36:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:36:24 oleg434-client kernel: Call Trace: Aug 15 10:36:24 oleg434-client kernel: Aug 15 10:36:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:36:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:36:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:36:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:36:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:36:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:36:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:36:24 oleg434-client kernel: Aug 15 10:36:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:36:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:36:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:36:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:36:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:36:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:36:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:36:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:36:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:36:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:36:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:36:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:36:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:36:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:36:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:36:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:36:32 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:36:32 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:36:32 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:36:32 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:36:32 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:36:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:36:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:36:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:36:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:36:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:36:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:36:32 oleg434-client kernel: Call Trace: Aug 15 10:36:32 oleg434-client kernel: Aug 15 10:36:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:36:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:36:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:36:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:36:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:36:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:36:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:36:32 oleg434-client kernel: Aug 15 10:36:32 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:36:32 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:36:32 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:36:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:36:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:36:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:36:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:36:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:36:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:36:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:36:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:36:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:36:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:36:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:36:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:36:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:36:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:36:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:36:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:36:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:36:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:36:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:36:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:36:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:36:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:36:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:36:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:36:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:36:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:36:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:36:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:36:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:36:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:36:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:36:36 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:36:36 oleg434-client kernel: RAX: 0000000000002921 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:36:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:36:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:36:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:36:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:36:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:36:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:36:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:36:36 oleg434-client kernel: Call Trace: Aug 15 10:36:36 oleg434-client kernel: Aug 15 10:36:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:36:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:36:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:36:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:36:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:36:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:36:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:36:36 oleg434-client kernel: Aug 15 10:36:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:36:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:36:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:36:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:36:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:36:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:36:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:36:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:36:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:36:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:36:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:36:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:36:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:36:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:36:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:36:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:36:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:36:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:36:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:36:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:36:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:36:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:36:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:36:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:36:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:36:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:36:52 oleg434-client kernel: Call Trace: Aug 15 10:36:52 oleg434-client kernel: Aug 15 10:36:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:36:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:36:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:36:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:36:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:36:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:36:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:36:52 oleg434-client kernel: Aug 15 10:36:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:36:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:36:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:36:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:36:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:36:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:36:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:36:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:36:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:36:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:36:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:36:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:37:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:37:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:37:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:37:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:37:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:37:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:37:00 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:37:00 oleg434-client kernel: RAX: 0000000000005784 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:37:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:37:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:37:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:37:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:37:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:37:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:37:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:37:00 oleg434-client kernel: Call Trace: Aug 15 10:37:00 oleg434-client kernel: Aug 15 10:37:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:37:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:37:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:37:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:37:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:37:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:37:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:37:00 oleg434-client kernel: Aug 15 10:37:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:37:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:37:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:37:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:37:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:37:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:37:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:37:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:37:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:37:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:37:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:37:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:37:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:37:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:37:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:37:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:37:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:37:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:37:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:37:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:37:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:37:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:37:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:37:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:37:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:37:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:37:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:37:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:37:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:37:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:37:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:37:04 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:37:04 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:37:04 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:37:04 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:37:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:37:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:37:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:37:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:37:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:37:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:37:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:37:04 oleg434-client kernel: Call Trace: Aug 15 10:37:04 oleg434-client kernel: Aug 15 10:37:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:37:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:37:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:37:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:37:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:37:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:37:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:37:04 oleg434-client kernel: Aug 15 10:37:04 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:37:04 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:37:04 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:37:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:37:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:37:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:37:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:37:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:37:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:37:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:37:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:37:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:37:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:37:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:37:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:37:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:37:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:37:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:37:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:37:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:37:20 oleg434-client kernel: RDX: 0000000000002cae RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:37:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:37:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:37:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:37:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:37:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:37:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:37:20 oleg434-client kernel: Call Trace: Aug 15 10:37:20 oleg434-client kernel: Aug 15 10:37:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:37:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:37:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:37:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:37:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:37:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:37:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:37:20 oleg434-client kernel: Aug 15 10:37:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:37:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:37:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:37:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:37:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:37:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:37:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:37:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:37:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:37:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:37:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:37:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:37:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:37:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:37:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:37:28 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:37:28 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:37:28 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:37:28 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:37:28 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:37:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:37:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:37:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:37:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:37:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:37:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:37:28 oleg434-client kernel: Call Trace: Aug 15 10:37:28 oleg434-client kernel: Aug 15 10:37:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:37:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:37:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:37:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:37:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:37:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:37:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:37:28 oleg434-client kernel: Aug 15 10:37:28 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:37:28 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:37:28 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:37:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:37:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:37:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:37:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:37:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:37:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:37:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:37:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:37:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:37:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:37:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:37:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:37:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:37:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:37:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:37:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:37:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:37:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:37:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:37:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:37:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:37:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:37:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:37:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:37:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:37:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:37:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:37:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:37:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:37:32 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:37:32 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:37:32 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:37:32 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:37:32 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:37:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:37:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:37:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:37:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:37:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:37:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:37:32 oleg434-client kernel: Call Trace: Aug 15 10:37:32 oleg434-client kernel: Aug 15 10:37:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:37:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:37:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:37:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:37:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:37:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:37:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:37:32 oleg434-client kernel: Aug 15 10:37:32 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:37:32 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:37:32 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:37:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:37:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:37:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:37:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:37:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:37:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:37:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:37:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:37:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:37:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:37:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:37:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:37:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:37:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:37:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:37:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:37:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:37:48 oleg434-client kernel: RDX: 0000000000004886 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:37:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:37:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:37:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:37:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:37:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:37:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:37:48 oleg434-client kernel: Call Trace: Aug 15 10:37:48 oleg434-client kernel: Aug 15 10:37:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:37:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:37:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:37:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:37:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:37:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:37:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:37:48 oleg434-client kernel: Aug 15 10:37:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:37:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:37:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:37:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:37:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:37:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:37:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:37:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:37:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:37:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:37:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:37:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:37:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:37:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:37:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:37:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:37:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:37:56 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:37:56 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:37:56 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:37:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:37:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:37:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:37:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:37:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:37:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:37:56 oleg434-client kernel: Call Trace: Aug 15 10:37:56 oleg434-client kernel: Aug 15 10:37:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:37:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:37:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:37:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:37:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:37:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:37:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:37:56 oleg434-client kernel: Aug 15 10:37:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:37:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:37:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:37:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:37:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:37:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:37:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:37:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:37:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:37:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:37:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:37:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:37:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:37:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:37:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:37:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:37:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:37:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:37:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:37:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:37:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:37:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:37:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:37:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:37:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:37:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:37:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:38:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:38:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:38:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:38:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:38:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:38:00 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:38:00 oleg434-client kernel: RAX: 00000000000060a5 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:38:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:38:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:38:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:38:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:38:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:38:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:38:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:38:00 oleg434-client kernel: Call Trace: Aug 15 10:38:00 oleg434-client kernel: Aug 15 10:38:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:38:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:38:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:38:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:00 oleg434-client kernel: Aug 15 10:38:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:38:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:38:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:38:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:38:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:38:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:38:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:38:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:38:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:38:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:38:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:38:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:38:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:38:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:38:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:38:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:38:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:38:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:38:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:38:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:38:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:38:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:38:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:38:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:38:16 oleg434-client kernel: Call Trace: Aug 15 10:38:16 oleg434-client kernel: Aug 15 10:38:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:38:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:38:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:38:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:16 oleg434-client kernel: Aug 15 10:38:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:38:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:38:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:38:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:38:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:38:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:38:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:38:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:38:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:38:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:38:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:38:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:38:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:38:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:38:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:38:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:38:24 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:38:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:38:24 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:38:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:38:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:38:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:38:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:38:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:38:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:38:24 oleg434-client kernel: Call Trace: Aug 15 10:38:24 oleg434-client kernel: Aug 15 10:38:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:38:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:38:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:38:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:24 oleg434-client kernel: Aug 15 10:38:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:38:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:38:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:38:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:38:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:38:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:38:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:38:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:38:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:38:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:38:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:38:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:38:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:38:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:38:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:38:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:38:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:38:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:38:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:38:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:38:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:38:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:38:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:38:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:38:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:38:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:38:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:38:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:38:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:38:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:38:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:38:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:38:28 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:38:28 oleg434-client kernel: RAX: 0000000000007e34 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:38:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:38:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:38:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:38:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:38:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:38:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:38:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:38:28 oleg434-client kernel: Call Trace: Aug 15 10:38:28 oleg434-client kernel: Aug 15 10:38:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:38:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:38:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:38:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:28 oleg434-client kernel: Aug 15 10:38:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:38:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:38:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:38:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:38:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:38:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:38:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:38:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:38:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:38:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:38:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:38:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:38:30 oleg434-client kernel: rcu: #0110-....: (1600986 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=485339 Aug 15 10:38:30 oleg434-client kernel: #011(t=2580063 jiffies g=297885 q=13459) Aug 15 10:38:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:38:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:30 oleg434-client kernel: Call Trace: Aug 15 10:38:30 oleg434-client kernel: Aug 15 10:38:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:38:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:38:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:38:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:38:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:38:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:38:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:38:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:38:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:38:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:38:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:38:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:38:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:30 oleg434-client kernel: Aug 15 10:38:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:38:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:38:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:38:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:38:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:38:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:38:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:38:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:38:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:38:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:38:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:38:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:38:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:38:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:38:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:38:52 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:38:52 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:38:52 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:38:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:38:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:38:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:38:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:38:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:38:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:38:52 oleg434-client kernel: Call Trace: Aug 15 10:38:52 oleg434-client kernel: Aug 15 10:38:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:38:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:38:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:38:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:52 oleg434-client kernel: Aug 15 10:38:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:38:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:38:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:38:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:38:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:38:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:38:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:38:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:38:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:38:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:38:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:38:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:38:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:38:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:38:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:38:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:38:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:38:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:38:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:38:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:38:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:38:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:38:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:38:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:38:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:38:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:38:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:38:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:38:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:38:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) Aug 15 10:38:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:38:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:38:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:38:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13 Aug 15 10:38:56 oleg434-client kernel: RAX: 000000000000782a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:38:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:38:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:38:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:38:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:38:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:38:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:38:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:38:56 oleg434-client kernel: Call Trace: Aug 15 10:38:56 oleg434-client kernel: Aug 15 10:38:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:38:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:38:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:38:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:56 oleg434-client kernel: Aug 15 10:38:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:38:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:38:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:38:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:38:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:38:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:38:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:38:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:38:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:38:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:38:56 oleg434-client kernel: ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:38:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:38:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:38:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:38:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:38:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:38:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:38:56 oleg434-client kernel: RDX: 000000000000305e RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:38:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:38:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:38:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:38:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:38:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:38:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:38:56 oleg434-client kernel: Call Trace: Aug 15 10:38:56 oleg434-client kernel: Aug 15 10:38:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:38:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:38:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:38:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:38:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:38:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:38:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:38:56 oleg434-client kernel: Aug 15 10:38:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:38:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:38:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:38:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:38:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:38:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:38:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:38:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:38:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:38:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:38:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:39:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:39:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:39:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:39:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:39:20 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:39:20 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:39:20 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:39:20 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:39:20 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:39:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:39:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:39:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:39:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:39:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:39:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:39:20 oleg434-client kernel: Call Trace: Aug 15 10:39:20 oleg434-client kernel: Aug 15 10:39:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:39:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:39:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:39:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:39:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:39:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:39:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:39:20 oleg434-client kernel: Aug 15 10:39:20 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:39:20 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:39:20 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:39:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:39:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:39:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:39:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:39:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:39:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:39:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:39:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:39:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:39:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:39:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:39:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:39:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:39:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:39:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:39:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:39:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:39:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:39:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:39:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:39:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:39:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:39:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:39:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:39:20 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:39:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:39:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:39:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:39:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:39:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:39:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:39:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:39:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:39:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:39:24 oleg434-client kernel: RDX: 000000000000783e RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:39:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:39:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:39:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:39:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:39:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:39:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:39:24 oleg434-client kernel: Call Trace: Aug 15 10:39:24 oleg434-client kernel: Aug 15 10:39:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:39:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:39:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:39:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:39:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:39:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:39:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:39:24 oleg434-client kernel: Aug 15 10:39:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:39:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:39:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:39:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:39:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: Modules linked in: lustre(O) Aug 15 10:39:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:39:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:39:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:39:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:39:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:39:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:39:24 oleg434-client kernel: osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:39:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:39:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:39:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:39:24 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:39:24 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:39:24 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:39:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:39:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:39:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:39:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:39:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:39:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:39:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:39:24 oleg434-client kernel: Call Trace: Aug 15 10:39:24 oleg434-client kernel: Aug 15 10:39:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:39:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:39:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:39:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:39:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:39:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:39:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:39:24 oleg434-client kernel: Aug 15 10:39:24 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:39:24 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:39:24 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:39:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:39:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:39:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:39:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:39:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:39:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:39:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:39:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:39:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:39:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:39:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:39:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:39:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:39:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:39:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:39:48 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:39:48 oleg434-client kernel: RAX: 0000000000007f56 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:39:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:39:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:39:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:39:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:39:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:39:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:39:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:39:48 oleg434-client kernel: Call Trace: Aug 15 10:39:48 oleg434-client kernel: Aug 15 10:39:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:39:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:39:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:39:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:39:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:39:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:39:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:39:48 oleg434-client kernel: Aug 15 10:39:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:39:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:39:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:39:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:39:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:39:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:39:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:39:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:39:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:39:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:39:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:39:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:39:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:39:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:39:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:39:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:39:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:39:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:39:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:39:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:39:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:39:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:39:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:39:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:39:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:39:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:39:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:39:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:39:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:39:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:39:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:39:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:39:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:39:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:39:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:39:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:39:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:39:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:39:52 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:39:52 oleg434-client kernel: RAX: 0000000000007e08 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:39:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:39:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:39:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:39:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:39:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:39:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:39:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:39:52 oleg434-client kernel: Call Trace: Aug 15 10:39:52 oleg434-client kernel: Aug 15 10:39:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:39:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:39:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:39:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:39:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:39:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:39:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:39:52 oleg434-client kernel: Aug 15 10:39:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:39:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:39:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:39:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:39:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:39:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:39:52 oleg434-client kernel: RDX: 0000000000000b29 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:39:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:39:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:39:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:39:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:39:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:39:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:39:52 oleg434-client kernel: Call Trace: Aug 15 10:39:52 oleg434-client kernel: Aug 15 10:39:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:39:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:39:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:39:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:39:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:39:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:39:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:39:52 oleg434-client kernel: Aug 15 10:39:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:39:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:39:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:39:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:39:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:39:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:39:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:39:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:39:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:39:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:39:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:39:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:39:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:39:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:39:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:39:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:39:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:40:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:40:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:40:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:40:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:40:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:40:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:40:16 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:40:16 oleg434-client kernel: RAX: 0000000000005608 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:40:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:40:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:40:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:40:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:40:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:40:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:40:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:40:16 oleg434-client kernel: Call Trace: Aug 15 10:40:16 oleg434-client kernel: Aug 15 10:40:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:40:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:40:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:40:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:40:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:40:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:40:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:40:16 oleg434-client kernel: Aug 15 10:40:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:40:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:40:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:40:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:40:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:40:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:40:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:40:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:40:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:40:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:40:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:40:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:40:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:40:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:40:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:40:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:40:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:40:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:40:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:40:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:40:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:40:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:40:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:40:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:40:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:40:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:40:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:40:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:40:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) Aug 15 10:40:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:40:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:40:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:40:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:40:20 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:40:20 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:40:20 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:40:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:40:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:40:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:40:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:40:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:40:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:40:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:40:20 oleg434-client kernel: Call Trace: Aug 15 10:40:20 oleg434-client kernel: Aug 15 10:40:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:40:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:40:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:40:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:40:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:40:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:40:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:40:20 oleg434-client kernel: Aug 15 10:40:20 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:40:20 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:40:20 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:40:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:40:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:40:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:40:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:40:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:40:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:40:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:40:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:40:20 oleg434-client kernel: ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:40:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:40:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:40:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:40:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:40:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:40:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:40:20 oleg434-client kernel: RDX: 0000000000005542 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:40:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:40:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:40:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:40:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:40:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:40:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:40:20 oleg434-client kernel: Call Trace: Aug 15 10:40:20 oleg434-client kernel: Aug 15 10:40:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:40:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:40:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:40:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:40:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:40:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:40:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:40:20 oleg434-client kernel: Aug 15 10:40:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:40:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:40:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:40:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:40:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:40:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:40:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:40:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:40:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:40:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:40:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:40:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:40:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:40:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:40:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:40:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:40:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:40:44 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:40:44 oleg434-client kernel: RAX: 0000000000007b8e RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:40:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:40:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:40:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:40:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:40:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:40:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:40:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:40:44 oleg434-client kernel: Call Trace: Aug 15 10:40:44 oleg434-client kernel: Aug 15 10:40:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:40:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:40:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:40:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:40:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:40:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:40:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:40:44 oleg434-client kernel: Aug 15 10:40:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:40:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:40:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:40:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:40:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:40:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:40:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:40:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:40:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:40:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:40:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:40:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:40:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:40:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:40:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:40:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:40:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:40:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:40:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:40:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:40:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:40:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:40:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:40:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:40:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:40:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:40:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:40:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:40:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:40:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:40:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:40:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:40:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:40:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:40:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:40:48 oleg434-client kernel: RDX: 0000000000007e7d RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:40:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:40:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:40:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:40:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:40:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:40:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:40:48 oleg434-client kernel: Call Trace: Aug 15 10:40:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:40:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:40:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:40:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:40:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:40:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:40:48 oleg434-client kernel: RAX: 0000000000003c7d RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:40:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:40:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:40:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:40:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:40:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:40:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:40:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:40:48 oleg434-client kernel: Call Trace: Aug 15 10:40:48 oleg434-client kernel: Aug 15 10:40:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:40:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:40:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:40:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:40:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:40:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:40:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:40:48 oleg434-client kernel: Aug 15 10:40:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:40:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:40:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:40:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:40:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: Aug 15 10:40:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:40:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:40:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:40:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:40:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:40:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:40:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:40:48 oleg434-client kernel: Aug 15 10:40:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:40:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:40:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:40:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:40:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:40:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:40:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:40:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:40:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:40:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:40:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:40:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:40:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:40:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:40:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:40:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:40:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:41:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:41:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:41:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:41:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:41:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:41:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:41:12 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:41:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:41:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:41:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:41:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:41:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:41:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:41:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:41:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:41:12 oleg434-client kernel: Call Trace: Aug 15 10:41:12 oleg434-client kernel: Aug 15 10:41:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:41:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:41:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:41:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:41:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:41:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:41:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:41:12 oleg434-client kernel: Aug 15 10:41:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:41:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:41:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:41:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:41:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:41:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:41:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:41:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:41:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:41:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:41:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:41:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:41:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:41:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:41:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:41:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:41:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:41:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:41:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:41:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:41:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:41:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:41:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:41:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:41:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:41:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:41:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:41:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:41:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:41:16 oleg434-client kernel: Modules linked in: Aug 15 10:41:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:41:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:41:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:41:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:41:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:41:16 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:41:16 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:41:16 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:41:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:41:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:41:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:41:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:41:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:41:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:41:16 oleg434-client kernel: Call Trace: Aug 15 10:41:16 oleg434-client kernel: Aug 15 10:41:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:41:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:41:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:41:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:41:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:41:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:41:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:41:16 oleg434-client kernel: Aug 15 10:41:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:41:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:41:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:41:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:41:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:41:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:41:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:41:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:41:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:41:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:41:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:41:16 oleg434-client kernel: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:41:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:41:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:41:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:41:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:41:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:41:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:41:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:41:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:41:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:41:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:41:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:41:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:41:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:41:16 oleg434-client kernel: Call Trace: Aug 15 10:41:16 oleg434-client kernel: Aug 15 10:41:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:41:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:41:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:41:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:41:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:41:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:41:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:41:16 oleg434-client kernel: Aug 15 10:41:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:41:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:41:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:41:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:41:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:41:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:41:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:41:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:41:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:41:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:41:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:41:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:41:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:41:30 oleg434-client kernel: rcu: #0110-....: (1719950 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=520275 Aug 15 10:41:30 oleg434-client kernel: #011(t=2760066 jiffies g=297885 q=14183) Aug 15 10:41:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:41:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:41:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:41:30 oleg434-client kernel: Call Trace: Aug 15 10:41:30 oleg434-client kernel: Aug 15 10:41:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:41:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:41:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:41:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:41:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:41:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:41:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:41:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:41:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:41:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:41:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:41:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:41:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:41:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:41:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:41:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:41:30 oleg434-client kernel: Aug 15 10:41:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:41:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:41:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:41:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:41:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:41:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:41:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:41:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:41:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:41:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:41:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:41:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:41:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:41:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:41:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:41:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:41:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:41:40 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:41:40 oleg434-client kernel: RAX: 0000000000007a08 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:41:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:41:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:41:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:41:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:41:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:41:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:41:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:41:40 oleg434-client kernel: Call Trace: Aug 15 10:41:40 oleg434-client kernel: Aug 15 10:41:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:41:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:41:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:41:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:41:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:41:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:41:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:41:40 oleg434-client kernel: Aug 15 10:41:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:41:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:41:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:41:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:41:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:41:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:41:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:41:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:41:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:41:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:41:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:41:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:41:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:41:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:41:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:41:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:41:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:41:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:41:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:41:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:41:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:41:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:41:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:41:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:41:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:41:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:41:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:41:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:41:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:41:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:41:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:41:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:41:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:41:44 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13 Aug 15 10:41:44 oleg434-client kernel: RAX: 0000000000007f85 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:41:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:41:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:41:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:41:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:41:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:41:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:41:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:41:44 oleg434-client kernel: Call Trace: Aug 15 10:41:44 oleg434-client kernel: Aug 15 10:41:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:41:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:41:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:41:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:41:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:41:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:41:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:41:44 oleg434-client kernel: Aug 15 10:41:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:41:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:41:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:41:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:41:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:41:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:41:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:41:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:41:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:41:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:41:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:41:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:41:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:41:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:41:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:41:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:41:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:41:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:41:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:41:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:41:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:41:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:41:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:41:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:41:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:41:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:41:56 oleg434-client kernel: Call Trace: Aug 15 10:41:56 oleg434-client kernel: Aug 15 10:41:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:41:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:41:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:41:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:41:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:41:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:41:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:41:56 oleg434-client kernel: Aug 15 10:41:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:41:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:41:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:41:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:41:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:41:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:41:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:41:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:41:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:41:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:41:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:41:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:42:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:42:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:42:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:42:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:42:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:42:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:42:08 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:42:08 oleg434-client kernel: RAX: 0000000000003463 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:42:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:42:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:42:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:42:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:42:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:42:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:42:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:42:08 oleg434-client kernel: Call Trace: Aug 15 10:42:08 oleg434-client kernel: Aug 15 10:42:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:42:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:42:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:42:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:42:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:42:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:42:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:42:08 oleg434-client kernel: Aug 15 10:42:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:42:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:42:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:42:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:42:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:42:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:42:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:42:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:42:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:42:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:42:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:42:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:42:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:42:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:42:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:42:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:42:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:42:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:42:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:42:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:42:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:42:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:42:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:42:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:42:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:42:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:42:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:42:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:42:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:42:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:42:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:42:12 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:42:12 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:42:12 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:42:12 oleg434-client kernel: RAX: 0000000000005aa0 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:42:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:42:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:42:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:42:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:42:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:42:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:42:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:42:12 oleg434-client kernel: Call Trace: Aug 15 10:42:12 oleg434-client kernel: Aug 15 10:42:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:42:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:42:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:42:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:42:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:42:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:42:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:42:12 oleg434-client kernel: Aug 15 10:42:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:42:12 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:42:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:42:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:42:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:42:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:42:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:42:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:42:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:42:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:42:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:42:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:42:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:42:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:42:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:42:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:42:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:42:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:42:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:42:24 oleg434-client kernel: RDX: 0000000000007bc1 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:42:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:42:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:42:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:42:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:42:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:42:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:42:24 oleg434-client kernel: Call Trace: Aug 15 10:42:24 oleg434-client kernel: Aug 15 10:42:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:42:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:42:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:42:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:42:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:42:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:42:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:42:24 oleg434-client kernel: Aug 15 10:42:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:42:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:42:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:42:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:42:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:42:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:42:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:42:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:42:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:42:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:42:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:42:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:42:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:42:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:42:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:42:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:42:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:42:36 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:42:36 oleg434-client kernel: RAX: 0000000000005b6a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:42:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:42:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:42:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:42:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:42:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:42:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:42:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:42:36 oleg434-client kernel: Call Trace: Aug 15 10:42:36 oleg434-client kernel: Aug 15 10:42:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:42:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:42:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:42:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:42:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:42:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:42:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:42:36 oleg434-client kernel: Aug 15 10:42:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:42:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:42:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:42:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:42:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:42:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:42:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:42:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:42:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:42:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:42:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:42:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:42:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:42:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:42:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:42:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:42:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:42:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:42:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:42:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:42:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:42:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:42:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:42:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:42:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:42:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:42:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:42:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:42:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:42:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:42:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:42:40 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:42:40 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:42:40 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:42:40 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:42:40 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:42:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:42:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:42:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:42:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:42:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:42:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:42:40 oleg434-client kernel: Call Trace: Aug 15 10:42:40 oleg434-client kernel: Aug 15 10:42:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:42:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:42:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:42:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:42:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:42:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:42:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:42:40 oleg434-client kernel: Aug 15 10:42:40 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:42:40 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:42:40 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:42:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:42:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:42:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:42:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:42:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:42:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:42:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:42:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:42:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:42:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:42:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:42:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:42:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:42:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:42:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:42:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:42:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:42:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:42:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:42:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:42:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:42:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:42:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:42:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:42:52 oleg434-client kernel: Call Trace: Aug 15 10:42:52 oleg434-client kernel: Aug 15 10:42:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:42:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:42:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:42:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:42:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:42:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:42:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:42:52 oleg434-client kernel: Aug 15 10:42:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:42:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:42:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:42:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:42:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:42:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:42:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:42:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:42:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:42:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:42:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:42:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:43:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:43:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:43:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:43:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:43:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:43:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:43:04 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:43:04 oleg434-client kernel: RAX: 0000000000005287 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:43:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:43:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:43:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:43:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:43:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:43:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:43:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:43:04 oleg434-client kernel: Call Trace: Aug 15 10:43:04 oleg434-client kernel: Aug 15 10:43:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:43:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:43:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:43:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:43:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:43:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:43:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:43:04 oleg434-client kernel: Aug 15 10:43:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:43:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:43:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:43:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:43:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:43:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:43:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:43:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:43:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:43:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:43:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:43:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:43:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:43:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:43:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:43:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:43:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:43:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:43:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:43:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:43:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:43:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:43:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:43:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:43:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:43:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:43:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:43:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:43:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:43:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:43:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:43:08 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:43:08 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:43:08 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:43:08 oleg434-client kernel: RAX: 0000000000006246 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:43:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:43:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:43:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:43:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:43:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:43:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:43:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:43:08 oleg434-client kernel: Call Trace: Aug 15 10:43:08 oleg434-client kernel: Aug 15 10:43:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:43:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:43:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:43:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:43:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:43:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:43:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:43:08 oleg434-client kernel: Aug 15 10:43:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:43:08 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:43:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:43:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:43:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:43:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:43:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:43:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:43:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:43:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:43:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:43:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:43:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:43:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:43:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:43:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:43:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:43:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:43:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:43:20 oleg434-client kernel: RDX: 0000000000004d67 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:43:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:43:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:43:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:43:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:43:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:43:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:43:20 oleg434-client kernel: Call Trace: Aug 15 10:43:20 oleg434-client kernel: Aug 15 10:43:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:43:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:43:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:43:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:43:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:43:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:43:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:43:20 oleg434-client kernel: Aug 15 10:43:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:43:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:43:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:43:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:43:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:43:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:43:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:43:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:43:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:43:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:43:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:43:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:43:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:43:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:43:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:43:32 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:43:32 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:43:32 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:43:32 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:43:32 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:43:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:43:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:43:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:43:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:43:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:43:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:43:32 oleg434-client kernel: Call Trace: Aug 15 10:43:32 oleg434-client kernel: Aug 15 10:43:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:43:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:43:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:43:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:43:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:43:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:43:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:43:32 oleg434-client kernel: Aug 15 10:43:32 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:43:32 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:43:32 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:43:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:43:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:43:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:43:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:43:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:43:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:43:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:43:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:43:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:43:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:43:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:43:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:43:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:43:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:43:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:43:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:43:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:43:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:43:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:43:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:43:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:43:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:43:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:43:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:43:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:43:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:43:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:43:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:43:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:43:36 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:43:36 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:43:36 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:43:36 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:43:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:43:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:43:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:43:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:43:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:43:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:43:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:43:36 oleg434-client kernel: Call Trace: Aug 15 10:43:36 oleg434-client kernel: Aug 15 10:43:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:43:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:43:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:43:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:43:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:43:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:43:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:43:36 oleg434-client kernel: Aug 15 10:43:36 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:43:36 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:43:36 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:43:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:43:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:43:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:43:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:43:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:43:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:43:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:43:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:43:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:43:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:43:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:43:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:43:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:43:48 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:43:48 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:43:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:43:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:43:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:43:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:43:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:43:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:43:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:43:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:43:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:43:48 oleg434-client kernel: Call Trace: Aug 15 10:43:48 oleg434-client kernel: Aug 15 10:43:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:43:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:43:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:43:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:43:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:43:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:43:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:43:48 oleg434-client kernel: Aug 15 10:43:48 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:43:48 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:43:48 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:43:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:43:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:43:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:43:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:43:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:43:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:43:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:43:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:43:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:44:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:44:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:44:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:44:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:44:00 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:44:00 oleg434-client kernel: RAX: 0000000000007a24 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:44:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:44:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:44:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:44:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:44:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:44:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:44:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:44:00 oleg434-client kernel: Call Trace: Aug 15 10:44:00 oleg434-client kernel: Aug 15 10:44:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:44:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:44:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:44:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:00 oleg434-client kernel: Aug 15 10:44:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:44:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:44:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:44:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:44:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:44:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:44:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:44:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:44:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:44:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:44:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:44:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:44:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:44:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:44:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:44:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:44:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:44:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:44:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:44:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:44:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:44:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:44:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:44:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:44:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:44:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:44:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:44:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:44:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:44:04 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:44:04 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:44:04 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:44:04 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:44:04 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:44:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:44:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:44:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:44:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:44:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:44:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:44:04 oleg434-client kernel: Call Trace: Aug 15 10:44:04 oleg434-client kernel: Aug 15 10:44:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:44:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:44:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:44:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:04 oleg434-client kernel: Aug 15 10:44:04 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:44:04 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:44:04 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:44:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:44:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:44:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:44:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:44:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:44:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:44:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:44:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:44:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:44:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:44:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:44:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:44:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:44:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:44:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:44:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:44:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:44:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:44:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:44:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:44:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:44:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:44:16 oleg434-client kernel: Call Trace: Aug 15 10:44:16 oleg434-client kernel: Aug 15 10:44:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:44:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:44:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:44:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:16 oleg434-client kernel: Aug 15 10:44:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:44:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:44:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:44:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:44:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:44:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:44:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:44:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:44:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:44:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:44:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:44:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:44:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:44:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:44:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:44:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:44:28 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:44:28 oleg434-client kernel: RAX: 000000000000138f RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:44:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:44:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:44:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:44:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:44:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:44:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:44:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:44:28 oleg434-client kernel: Call Trace: Aug 15 10:44:28 oleg434-client kernel: Aug 15 10:44:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:44:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:44:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:44:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:28 oleg434-client kernel: Aug 15 10:44:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:44:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:44:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:44:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:44:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:44:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:44:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:44:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:44:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:44:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:44:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:44:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:44:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:44:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:44:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:44:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:44:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:44:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:44:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:44:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:44:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:44:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:44:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:44:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:44:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:44:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:44:28 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:44:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:44:30 oleg434-client kernel: rcu: #0110-....: (1827490 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=554398 Aug 15 10:44:30 oleg434-client kernel: #011(t=2940070 jiffies g=297885 q=14937) Aug 15 10:44:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:44:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:30 oleg434-client kernel: Call Trace: Aug 15 10:44:30 oleg434-client kernel: Aug 15 10:44:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:44:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:44:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:44:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:44:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:44:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:44:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:44:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:44:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:44:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:44:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:44:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:44:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:30 oleg434-client kernel: Aug 15 10:44:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:44:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:44:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:44:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:44:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:44:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:44:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:44:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:44:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:44:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:44:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:44:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:44:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:44:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:44:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:44:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:44:32 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:44:32 oleg434-client kernel: RAX: 0000000000000588 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:44:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:44:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:44:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:44:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:44:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:44:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:44:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:44:32 oleg434-client kernel: Call Trace: Aug 15 10:44:32 oleg434-client kernel: Aug 15 10:44:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:44:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:44:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:44:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:32 oleg434-client kernel: Aug 15 10:44:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:44:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:44:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:44:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:44:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:44:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:44:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:44:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:44:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:44:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:44:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:44:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:44:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:44:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:44:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:44:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:44:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:44:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:44:56 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:44:56 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:44:56 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:44:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:44:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:44:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:44:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:44:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:44:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:44:56 oleg434-client kernel: Call Trace: Aug 15 10:44:56 oleg434-client kernel: Aug 15 10:44:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:44:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:44:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:44:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:56 oleg434-client kernel: Aug 15 10:44:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:44:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:44:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:44:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:44:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:44:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:44:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:44:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:44:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:44:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:44:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:44:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:44:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:44:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:44:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:44:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:44:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:44:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:44:56 oleg434-client kernel: Call Trace: Aug 15 10:44:56 oleg434-client kernel: Aug 15 10:44:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:44:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:44:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:44:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:44:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:44:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:44:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:44:56 oleg434-client kernel: Aug 15 10:44:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:44:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:44:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:44:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:44:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:44:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:44:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:44:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:44:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:44:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:44:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:44:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:44:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:44:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:44:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:44:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:44:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:44:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:44:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:44:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:44:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:44:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:44:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:44:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:44:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:44:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:44:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:44:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:44:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:44:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:45:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:45:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:45:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:45:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:45:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:45:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:45:00 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:45:00 oleg434-client kernel: RAX: 0000000000005e86 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:45:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:45:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:45:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:45:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:45:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:45:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:45:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:45:00 oleg434-client kernel: Call Trace: Aug 15 10:45:00 oleg434-client kernel: Aug 15 10:45:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:45:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:45:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:45:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:45:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:45:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:45:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:45:00 oleg434-client kernel: Aug 15 10:45:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:45:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:45:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:45:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:45:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:45:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:45:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:45:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:45:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:45:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:45:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:45:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:45:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:45:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:45:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:45:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:45:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:45:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:45:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:45:24 oleg434-client kernel: RDX: 00000000000046a6 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:45:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:45:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:45:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:45:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:45:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:45:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:45:24 oleg434-client kernel: Call Trace: Aug 15 10:45:24 oleg434-client kernel: Aug 15 10:45:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:45:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:45:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:45:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:45:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:45:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:45:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:45:24 oleg434-client kernel: Aug 15 10:45:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:45:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:45:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:45:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:45:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:45:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:45:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:45:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:45:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:45:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:45:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:45:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:45:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:45:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:45:24 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:45:24 oleg434-client kernel: RAX: 0000000000007a89 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:45:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:45:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:45:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:45:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:45:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:45:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:45:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:45:24 oleg434-client kernel: Call Trace: Aug 15 10:45:24 oleg434-client kernel: Aug 15 10:45:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:45:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:45:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:45:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:45:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:45:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:45:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:45:24 oleg434-client kernel: Aug 15 10:45:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:45:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:45:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:45:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:45:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:45:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:45:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:45:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:45:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:45:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:45:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:45:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:45:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:45:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:45:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:45:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:45:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:45:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:45:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:45:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:45:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:45:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:45:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:45:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:45:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:45:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:45:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:45:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:45:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:45:28 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:45:28 oleg434-client kernel: RAX: 0000000000007526 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:45:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:45:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:45:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:45:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:45:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:45:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:45:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:45:28 oleg434-client kernel: Call Trace: Aug 15 10:45:28 oleg434-client kernel: Aug 15 10:45:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:45:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:45:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:45:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:45:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:45:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:45:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:45:28 oleg434-client kernel: Aug 15 10:45:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:45:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:45:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:45:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:45:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:45:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:45:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:45:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:45:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:45:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:45:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:45:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:45:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:45:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:45:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:45:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:45:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:45:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:45:52 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:45:52 oleg434-client kernel: RAX: 000000000000552e RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:45:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:45:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:45:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:45:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:45:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:45:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:45:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:45:52 oleg434-client kernel: Call Trace: Aug 15 10:45:52 oleg434-client kernel: Aug 15 10:45:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:45:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:45:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:45:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:45:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:45:52 oleg434-client kernel: RDX: 0000000000007b78 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:45:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:45:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:45:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:45:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:45:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:45:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:45:52 oleg434-client kernel: Call Trace: Aug 15 10:45:52 oleg434-client kernel: Aug 15 10:45:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:45:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:45:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:45:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:45:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:45:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:45:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:45:52 oleg434-client kernel: Aug 15 10:45:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:45:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:45:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:45:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:45:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:45:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:45:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:45:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:45:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:45:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:45:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:45:52 oleg434-client kernel: Aug 15 10:45:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:45:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:45:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:45:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:45:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:45:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:45:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:45:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:45:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:45:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:45:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:45:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:45:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:45:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:45:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:45:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:45:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:45:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:45:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:45:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:45:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:45:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:45:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:45:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:45:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:45:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:45:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:45:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:45:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:45:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:45:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:45:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:45:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:45:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:45:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:45:56 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:45:56 oleg434-client kernel: RAX: 0000000000002206 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:45:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:45:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:45:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:45:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:45:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:45:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:45:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:45:56 oleg434-client kernel: Call Trace: Aug 15 10:45:56 oleg434-client kernel: Aug 15 10:45:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:45:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:45:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:45:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:45:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:45:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:45:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:45:56 oleg434-client kernel: Aug 15 10:45:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:45:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:45:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:45:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:45:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:45:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:45:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:45:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:45:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:45:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:45:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:46:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:46:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:46:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:46:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:46:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:46:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:46:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:46:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:46:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:46:20 oleg434-client kernel: RDX: 0000000000002d13 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:46:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:46:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:46:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:46:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:46:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:46:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:46:20 oleg434-client kernel: Call Trace: Aug 15 10:46:20 oleg434-client kernel: Aug 15 10:46:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:46:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:46:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:46:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:46:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:46:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:46:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:46:20 oleg434-client kernel: Aug 15 10:46:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:46:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:46:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:46:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:46:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:46:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:46:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:46:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:46:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:46:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:46:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:46:20 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:46:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:46:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:46:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:46:20 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:46:20 oleg434-client kernel: RAX: 0000000000005f26 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:46:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:46:20 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:46:20 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:46:20 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:46:20 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:46:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:46:20 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:46:20 oleg434-client kernel: Call Trace: Aug 15 10:46:20 oleg434-client kernel: Aug 15 10:46:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:46:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:46:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:46:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:46:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:46:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:46:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:46:20 oleg434-client kernel: Aug 15 10:46:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:46:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:46:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:46:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:46:20 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:46:20 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:46:20 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:46:20 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:46:20 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:46:20 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:46:20 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:46:20 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:46:20 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:46:20 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:46:20 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:46:20 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:46:20 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:46:20 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:46:20 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:46:20 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:46:20 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:46:20 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:46:20 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:46:20 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:46:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:46:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:46:24 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:46:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:46:24 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:46:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:46:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:46:24 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:46:24 oleg434-client kernel: RAX: 00000000000013c0 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:46:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:46:24 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:46:24 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:46:24 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:46:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:46:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:46:24 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:46:24 oleg434-client kernel: Call Trace: Aug 15 10:46:24 oleg434-client kernel: Aug 15 10:46:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:46:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:46:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:46:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:46:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:46:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:46:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:46:24 oleg434-client kernel: Aug 15 10:46:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:46:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:46:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:46:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:46:24 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:46:24 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:46:24 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:46:24 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:46:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:46:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:46:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:46:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:46:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:46:48 oleg434-client kernel: Modules linked in: lustre(O) Aug 15 10:46:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:46:48 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:46:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:46:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:46:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:46:48 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:46:48 oleg434-client kernel: RAX: 0000000000005f19 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:46:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:46:48 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:46:48 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:46:48 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:46:48 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:46:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:46:48 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:46:48 oleg434-client kernel: Call Trace: Aug 15 10:46:48 oleg434-client kernel: Aug 15 10:46:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:46:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:46:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:46:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:46:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:46:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:46:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:46:48 oleg434-client kernel: Aug 15 10:46:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:46:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:46:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:46:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:46:48 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:46:48 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:46:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:46:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:46:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:46:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:46:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:46:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:46:48 oleg434-client kernel: RDX: 000000000000679e RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:46:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:46:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:46:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:46:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:46:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:46:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:46:48 oleg434-client kernel: Call Trace: Aug 15 10:46:48 oleg434-client kernel: Aug 15 10:46:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:46:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:46:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:46:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:46:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:46:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:46:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:46:48 oleg434-client kernel: Aug 15 10:46:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:46:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:46:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:46:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:46:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:46:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:46:48 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:46:48 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:46:48 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:46:48 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:46:48 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:46:48 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:46:48 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:46:48 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:46:48 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:46:48 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:46:48 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:46:48 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:46:48 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:46:48 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:46:48 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:46:48 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:46:48 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:46:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:46:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:46:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:46:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:46:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:46:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:46:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:46:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:46:52 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:46:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:46:52 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:46:52 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:46:52 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:46:52 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:46:52 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:46:52 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:46:52 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:46:52 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:46:52 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:46:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:46:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:46:52 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:46:52 oleg434-client kernel: Call Trace: Aug 15 10:46:52 oleg434-client kernel: Aug 15 10:46:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:46:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:46:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:46:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:46:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:46:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:46:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:46:52 oleg434-client kernel: Aug 15 10:46:52 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:46:52 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:46:52 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:46:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:46:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:46:52 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:46:52 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:46:52 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:46:52 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:46:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:46:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:46:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:47:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:47:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:47:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:47:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:47:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:47:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:47:16 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:47:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:47:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:47:16 oleg434-client kernel: RDX: 000000000000260d RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:47:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:47:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:47:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:47:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:47:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:47:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:47:16 oleg434-client kernel: Call Trace: Aug 15 10:47:16 oleg434-client kernel: Aug 15 10:47:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:47:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:47:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:47:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:47:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:47:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:47:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:47:16 oleg434-client kernel: Aug 15 10:47:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:47:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:47:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:47:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:47:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:47:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:47:16 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:47:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:47:16 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:16 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:47:16 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:47:16 oleg434-client kernel: RAX: 0000000000003aab RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:47:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:47:16 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:47:16 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:47:16 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:47:16 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:47:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:47:16 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:47:16 oleg434-client kernel: Call Trace: Aug 15 10:47:16 oleg434-client kernel: Aug 15 10:47:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:47:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:47:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:47:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:47:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:47:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:47:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:47:16 oleg434-client kernel: Aug 15 10:47:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:16 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:47:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:47:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:47:16 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:47:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:47:16 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:47:16 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:47:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:47:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:47:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:47:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:47:16 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:47:16 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:47:16 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:47:16 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:47:16 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:47:16 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:47:16 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:47:16 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:47:16 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:47:16 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:47:16 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:47:16 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:47:16 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:47:16 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:47:16 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:47:16 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:47:16 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:47:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:47:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:47:20 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:47:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:47:20 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:47:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:20 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:47:20 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:47:20 oleg434-client kernel: RAX: 0000000000002d0e RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:47:20 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:47:20 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:47:20 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:47:20 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:47:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:47:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:47:20 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:47:20 oleg434-client kernel: Call Trace: Aug 15 10:47:20 oleg434-client kernel: Aug 15 10:47:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:47:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:47:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:47:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:47:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:47:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:47:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:47:20 oleg434-client kernel: Aug 15 10:47:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:47:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:47:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:47:20 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:47:20 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:47:20 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:47:20 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:47:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:47:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:47:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:47:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:47:30 oleg434-client kernel: rcu: #0110-....: (1928573 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=587154 Aug 15 10:47:30 oleg434-client kernel: #011(t=3120073 jiffies g=297885 q=15581) Aug 15 10:47:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:47:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:47:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:47:30 oleg434-client kernel: Call Trace: Aug 15 10:47:30 oleg434-client kernel: Aug 15 10:47:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:47:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:47:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:47:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:47:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:47:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:47:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:47:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:47:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:47:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:47:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:47:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:47:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:47:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:47:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:47:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:47:30 oleg434-client kernel: Aug 15 10:47:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:47:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:47:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:47:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:47:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:47:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:47:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:47:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:47:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:47:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:47:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:47:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:47:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:47:44 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:47:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:47:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:47:44 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:47:44 oleg434-client kernel: RAX: 0000000000007ab5 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:47:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:47:44 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:47:44 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:47:44 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:47:44 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:47:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:47:44 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:47:44 oleg434-client kernel: Call Trace: Aug 15 10:47:44 oleg434-client kernel: Aug 15 10:47:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:47:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:47:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:47:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:47:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:47:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:47:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:47:44 oleg434-client kernel: Aug 15 10:47:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:47:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:47:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:47:44 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:47:44 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:47:44 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:47:44 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:47:44 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:47:44 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:47:44 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:47:44 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:47:44 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:47:44 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:47:44 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:47:44 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:47:44 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:47:44 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:47:44 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:47:44 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:47:44 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:47:44 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:47:44 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:47:44 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:47:44 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:47:44 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:47:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:47:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:47:48 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:47:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:47:48 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:47:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:48 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:47:48 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:47:48 oleg434-client kernel: RAX: 0000000000001a22 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:47:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:47:48 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:47:48 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:47:48 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:47:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:47:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:47:48 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:47:48 oleg434-client kernel: Call Trace: Aug 15 10:47:48 oleg434-client kernel: Aug 15 10:47:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:47:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:47:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:47:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:47:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:47:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:47:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:47:48 oleg434-client kernel: Aug 15 10:47:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:47:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:47:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:47:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:47:48 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:47:48 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:47:48 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:47:48 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:47:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:47:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:47:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:47:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:47:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:47:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:47:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:47:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:47:56 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:47:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:47:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:47:56 oleg434-client kernel: RDX: 0000000000004c20 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:47:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:47:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:47:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:47:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:47:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:47:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:47:56 oleg434-client kernel: Call Trace: Aug 15 10:47:56 oleg434-client kernel: Aug 15 10:47:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:47:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:47:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:47:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:47:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:47:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:47:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:47:56 oleg434-client kernel: Aug 15 10:47:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:47:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:47:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:47:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:47:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:47:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:47:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:47:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:47:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:47:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:47:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:48:01 oleg434-client anacron[38105]: Job `cron.weekly' started Aug 15 10:48:01 oleg434-client anacron[38105]: Job `cron.weekly' terminated Aug 15 10:48:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:48:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:48:12 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:48:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:48:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:48:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:48:12 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:48:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:48:12 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:48:12 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:48:12 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:48:12 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:48:12 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:48:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:48:12 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:48:12 oleg434-client kernel: Call Trace: Aug 15 10:48:12 oleg434-client kernel: Aug 15 10:48:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:48:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:48:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:48:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:48:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:48:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:48:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:48:12 oleg434-client kernel: Aug 15 10:48:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:48:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:48:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:48:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:48:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:48:12 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:48:12 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:48:12 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:48:12 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:48:12 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:48:12 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:48:12 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:48:12 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:48:12 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:48:12 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:48:12 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:48:12 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:48:12 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:48:12 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:48:12 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:48:12 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:48:12 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:48:12 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:48:12 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:48:12 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:48:12 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:48:12 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:48:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:48:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:48:16 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:48:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:48:16 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:48:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:48:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:48:16 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:48:16 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:48:16 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:48:16 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:48:16 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:48:16 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:48:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:48:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:48:16 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:48:16 oleg434-client kernel: Call Trace: Aug 15 10:48:16 oleg434-client kernel: Aug 15 10:48:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:48:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:48:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:48:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:48:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:48:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:48:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:48:16 oleg434-client kernel: Aug 15 10:48:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:48:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:48:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:48:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:48:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:48:16 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:48:16 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:48:16 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:48:16 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:48:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:48:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:48:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:48:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:48:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:48:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:48:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:48:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:48:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:48:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:48:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:48:24 oleg434-client kernel: RDX: 00000000000000e6 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:48:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:48:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:48:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:48:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:48:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:48:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:48:24 oleg434-client kernel: Call Trace: Aug 15 10:48:24 oleg434-client kernel: Aug 15 10:48:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:48:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:48:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:48:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:48:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:48:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:48:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:48:24 oleg434-client kernel: Aug 15 10:48:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:48:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:48:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:48:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:48:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:48:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:48:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:48:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:48:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:48:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:48:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:48:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:48:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:48:40 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:48:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:48:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:48:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:48:40 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:48:40 oleg434-client kernel: RAX: 0000000000007b08 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:48:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:48:40 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:48:40 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:48:40 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:48:40 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:48:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:48:40 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:48:40 oleg434-client kernel: Call Trace: Aug 15 10:48:40 oleg434-client kernel: Aug 15 10:48:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:48:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:48:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:48:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:48:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:48:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:48:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:48:40 oleg434-client kernel: Aug 15 10:48:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:48:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:48:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:48:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:48:40 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:48:40 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:48:40 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:48:40 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:48:40 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:48:40 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:48:40 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:48:40 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:48:40 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:48:40 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:48:40 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:48:40 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:48:40 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:48:40 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:48:40 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:48:40 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:48:40 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:48:40 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:48:40 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:48:40 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:48:40 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:48:40 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:48:44 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:48:44 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:48:44 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:48:44 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:48:44 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:48:44 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:48:44 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:48:44 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:48:44 oleg434-client kernel: RAX: 0000000000005487 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:48:44 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:48:44 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:48:44 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:48:44 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:48:44 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:48:44 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:48:44 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:48:44 oleg434-client kernel: Call Trace: Aug 15 10:48:44 oleg434-client kernel: Aug 15 10:48:44 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:48:44 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:48:44 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:48:44 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:48:44 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:48:44 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:48:44 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:48:44 oleg434-client kernel: Aug 15 10:48:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:48:44 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:48:44 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:48:44 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:48:44 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:48:44 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:48:44 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:48:44 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:48:44 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:48:44 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:48:44 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:48:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:48:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:48:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:48:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:48:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:48:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:48:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:48:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:48:52 oleg434-client kernel: RDX: 00000000000076cc RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:48:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:48:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:48:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:48:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:48:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:48:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:48:52 oleg434-client kernel: Call Trace: Aug 15 10:48:52 oleg434-client kernel: Aug 15 10:48:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:48:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:48:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:48:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:48:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:48:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:48:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:48:52 oleg434-client kernel: Aug 15 10:48:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:48:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:48:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:48:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:48:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:48:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:48:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:48:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:48:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:48:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:48:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:49:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:49:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:49:08 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:49:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:49:08 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:49:08 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:49:08 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:49:08 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:49:08 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:49:08 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:49:08 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:49:08 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:49:08 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:49:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:49:08 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:49:08 oleg434-client kernel: Call Trace: Aug 15 10:49:08 oleg434-client kernel: Aug 15 10:49:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:49:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:49:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:49:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:49:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:49:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:49:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:49:08 oleg434-client kernel: Aug 15 10:49:08 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:49:08 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:49:08 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:49:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:49:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:49:08 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:49:08 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:49:08 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:49:08 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:49:08 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:49:08 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:49:08 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:49:08 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:49:08 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:49:08 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:49:08 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:49:08 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:49:08 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:49:08 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:49:08 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:49:08 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:49:08 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:49:08 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:49:08 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:49:08 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:49:08 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:49:08 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:49:12 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:49:12 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:49:12 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:49:12 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:49:12 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:49:12 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:49:12 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:49:12 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:49:12 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:49:12 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:49:12 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:49:12 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:49:12 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:49:12 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:49:12 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:49:12 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:49:12 oleg434-client kernel: Call Trace: Aug 15 10:49:12 oleg434-client kernel: Aug 15 10:49:12 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:49:12 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:49:12 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:49:12 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:49:12 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:49:12 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:49:12 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:49:12 oleg434-client kernel: Aug 15 10:49:12 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:49:12 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:49:12 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:49:12 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:49:12 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:49:12 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:49:12 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:49:12 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:49:12 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:49:12 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:49:12 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:49:12 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:49:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:49:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:49:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:49:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:49:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:49:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:49:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:49:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:49:20 oleg434-client kernel: RDX: 0000000000004af4 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:49:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:49:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:49:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:49:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:49:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:49:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:49:20 oleg434-client kernel: Call Trace: Aug 15 10:49:20 oleg434-client kernel: Aug 15 10:49:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:49:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:49:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:49:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:49:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:49:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:49:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:49:20 oleg434-client kernel: Aug 15 10:49:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:49:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:49:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:49:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:49:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:49:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:49:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:49:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:49:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:49:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:49:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:49:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:49:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:49:36 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:49:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:49:36 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:49:36 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:49:36 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:49:36 oleg434-client kernel: RAX: 0000000000000a8a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:49:36 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:49:36 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:49:36 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:49:36 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:49:36 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:49:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:49:36 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:49:36 oleg434-client kernel: Call Trace: Aug 15 10:49:36 oleg434-client kernel: Aug 15 10:49:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:49:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:49:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:49:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:49:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:49:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:49:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:49:36 oleg434-client kernel: Aug 15 10:49:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:49:36 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:49:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:49:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:49:36 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:49:36 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:49:36 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:49:36 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:49:36 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:49:36 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:49:36 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:49:36 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:49:36 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:49:36 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:49:36 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:49:36 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:49:36 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:49:36 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:49:36 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:49:36 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:49:36 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:49:36 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:49:36 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:49:36 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:49:36 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:49:36 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:49:36 oleg434-client rsyslogd[1070]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Aug 15 10:49:40 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:49:40 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:49:40 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:49:40 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:49:40 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:49:40 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:49:40 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:49:40 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000216 ORIG_RAX: ffffffffffffff13 Aug 15 10:49:40 oleg434-client kernel: RAX: 0000000000007b86 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:49:40 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:49:40 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:49:40 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:49:40 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:49:40 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:49:40 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:49:40 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:49:40 oleg434-client kernel: Call Trace: Aug 15 10:49:40 oleg434-client kernel: Aug 15 10:49:40 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:49:40 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:49:40 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:49:40 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:49:40 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:49:40 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:49:40 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:49:40 oleg434-client kernel: Aug 15 10:49:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:49:40 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:49:40 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:49:40 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:49:40 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:49:40 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:49:40 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:49:40 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:49:40 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:49:40 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:49:40 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:49:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:49:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:49:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:49:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:49:48 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:49:48 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:49:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:49:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:49:48 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:49:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:49:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:49:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:49:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:49:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:49:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:49:48 oleg434-client kernel: Call Trace: Aug 15 10:49:48 oleg434-client kernel: Aug 15 10:49:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:49:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:49:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:49:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:49:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:49:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:49:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:49:48 oleg434-client kernel: Aug 15 10:49:48 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:49:48 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:49:48 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:49:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:49:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:49:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:49:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:49:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:49:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:49:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:49:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:49:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:50:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:50:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:50:04 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:50:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:50:04 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:50:04 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:50:04 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:50:04 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:50:04 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:50:04 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:50:04 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:50:04 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:50:04 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:50:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:50:04 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:50:04 oleg434-client kernel: Call Trace: Aug 15 10:50:04 oleg434-client kernel: Aug 15 10:50:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:50:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:50:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:50:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:50:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:50:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:50:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:50:04 oleg434-client kernel: Aug 15 10:50:04 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:50:04 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:50:04 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:50:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:50:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:50:04 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:50:04 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:50:04 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:50:04 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:50:04 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:50:04 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:50:04 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:50:04 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:50:04 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:50:04 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:50:04 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:50:04 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:50:04 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:50:04 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:50:04 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:50:04 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:50:04 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:50:04 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:50:04 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:50:04 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:50:04 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:50:04 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:50:08 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:50:08 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:50:08 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:50:08 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:50:08 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:50:08 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:50:08 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:50:08 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:50:08 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:50:08 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:50:08 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:50:08 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:50:08 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:50:08 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:50:08 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:50:08 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:50:08 oleg434-client kernel: Call Trace: Aug 15 10:50:08 oleg434-client kernel: Aug 15 10:50:08 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:50:08 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:50:08 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:50:08 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:50:08 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:50:08 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:50:08 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:50:08 oleg434-client kernel: Aug 15 10:50:08 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:50:08 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:50:08 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:50:08 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:50:08 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:50:08 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:50:08 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:50:08 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:50:08 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:50:08 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:50:08 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:50:08 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:50:16 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [ptlrpcd_rcv:2387] Aug 15 10:50:16 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:50:16 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:50:16 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:50:16 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:50:16 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:50:16 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:50:16 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:50:16 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:50:16 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:50:16 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:50:16 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:50:16 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:50:16 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:50:16 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:50:16 oleg434-client kernel: Call Trace: Aug 15 10:50:16 oleg434-client kernel: Aug 15 10:50:16 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:50:16 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:50:16 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:50:16 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:50:16 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:50:16 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:50:16 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:50:16 oleg434-client kernel: Aug 15 10:50:16 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:50:16 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:50:16 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:50:16 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:50:16 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:50:16 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:50:16 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:50:16 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:50:16 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:50:16 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:50:16 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:50:16 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:50:30 oleg434-client kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 15 10:50:30 oleg434-client kernel: rcu: #0110-....: (2028699 ticks this GP) idle=6d2/1/0x4000000000000002 softirq=141607/141607 fqs=619430 Aug 15 10:50:30 oleg434-client kernel: #011(t=3300076 jiffies g=297885 q=16420) Aug 15 10:50:30 oleg434-client kernel: NMI backtrace for cpu 0 Aug 15 10:50:30 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:50:30 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:50:30 oleg434-client kernel: Call Trace: Aug 15 10:50:30 oleg434-client kernel: Aug 15 10:50:30 oleg434-client kernel: ? dump_stack+0xbb/0x10e Aug 15 10:50:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x16/0x55 Aug 15 10:50:30 oleg434-client kernel: ? nmi_cpu_backtrace.cold.8+0x24/0xa2 Aug 15 10:50:30 oleg434-client kernel: ? lapic_can_unplug_cpu.cold.28+0x55/0x55 Aug 15 10:50:30 oleg434-client kernel: ? nmi_trigger_cpumask_backtrace+0x1d7/0x1f1 Aug 15 10:50:30 oleg434-client kernel: ? arch_trigger_cpumask_backtrace+0x1d/0x30 Aug 15 10:50:30 oleg434-client kernel: ? rcu_dump_cpu_stacks+0x11b/0x171 Aug 15 10:50:30 oleg434-client kernel: ? rcu_sched_clock_irq.cold.51+0xdb/0x307 Aug 15 10:50:30 oleg434-client kernel: ? update_process_times+0x6d/0xc0 Aug 15 10:50:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x27/0x90 Aug 15 10:50:30 oleg434-client kernel: ? tick_sched_timer+0x53/0xb0 Aug 15 10:50:30 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:50:30 oleg434-client kernel: ? tick_sched_handle.isra.18+0x90/0x90 Aug 15 10:50:30 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:50:30 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:50:30 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:50:30 oleg434-client kernel: Aug 15 10:50:30 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:50:30 oleg434-client kernel: ? kvm_wait+0xcd/0xe0 Aug 15 10:50:30 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:50:30 oleg434-client kernel: ? do_raw_spin_lock+0x177/0x190 Aug 15 10:50:30 oleg434-client kernel: ? _raw_spin_lock+0x21/0x30 Aug 15 10:50:30 oleg434-client kernel: ? __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:50:30 oleg434-client kernel: ? ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:50:30 oleg434-client kernel: ? ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:50:30 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:50:30 oleg434-client kernel: ? kthread+0x1d1/0x200 Aug 15 10:50:30 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:50:30 oleg434-client kernel: ? ret_from_fork+0x1f/0x30 Aug 15 10:50:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:50:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:50:32 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:50:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:50:32 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:50:32 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:50:32 oleg434-client kernel: RSP: 0018:ffff985380d7fb98 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:50:32 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:50:32 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:50:32 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:50:32 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:50:32 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:50:32 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:50:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:50:32 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:50:32 oleg434-client kernel: Call Trace: Aug 15 10:50:32 oleg434-client kernel: Aug 15 10:50:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:50:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:50:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:50:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:50:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:50:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:50:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:50:32 oleg434-client kernel: Aug 15 10:50:32 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:50:32 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:50:32 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:50:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:50:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:50:32 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:50:32 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:50:32 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:50:32 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:50:32 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:50:32 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:50:32 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:50:32 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:50:32 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:50:32 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:50:32 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:50:32 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:50:32 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:50:32 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:50:32 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:50:32 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:50:32 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:50:32 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:50:32 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:50:32 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:50:32 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:50:32 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:50:36 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:50:36 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:50:36 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:50:36 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:50:36 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:50:36 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:50:36 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:50:36 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:50:36 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:50:36 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:50:36 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:50:36 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:50:36 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:50:36 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:50:36 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:50:36 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:50:36 oleg434-client kernel: Call Trace: Aug 15 10:50:36 oleg434-client kernel: Aug 15 10:50:36 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:50:36 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:50:36 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:50:36 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:50:36 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:50:36 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:50:36 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:50:36 oleg434-client kernel: Aug 15 10:50:36 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:50:36 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:50:36 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:50:36 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:50:36 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:50:36 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:50:36 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:50:36 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:50:36 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:50:36 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:50:36 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:50:36 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:50:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:50:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:50:56 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:50:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:50:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:50:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:50:56 oleg434-client kernel: RSP: 0018:ffff9853816cfbb8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:50:56 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:50:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:50:56 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:50:56 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:50:56 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:50:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:50:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:50:56 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:50:56 oleg434-client kernel: Call Trace: Aug 15 10:50:56 oleg434-client kernel: Aug 15 10:50:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:50:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:50:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:50:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:50:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:50:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:50:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:50:56 oleg434-client kernel: Aug 15 10:50:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:50:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:50:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:50:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:50:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:50:56 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:50:56 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:50:56 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:50:56 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:50:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:50:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:50:56 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:51:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [writemany:37219] Aug 15 10:51:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:51:00 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:51:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:51:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:51:00 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:51:00 oleg434-client kernel: RAX: 000000000000612a RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:51:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:51:00 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:51:00 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:51:00 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:51:00 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:51:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:51:00 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:51:00 oleg434-client kernel: Call Trace: Aug 15 10:51:00 oleg434-client kernel: Aug 15 10:51:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:51:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:51:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:51:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:51:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:51:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:51:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:51:00 oleg434-client kernel: Aug 15 10:51:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:51:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:51:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:51:00 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:51:00 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:51:00 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:51:00 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:51:00 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:51:00 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:51:00 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:51:00 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:51:00 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:51:00 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:51:00 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:51:00 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:51:00 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:51:00 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:51:00 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:51:00 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:51:00 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:51:00 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:51:00 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:51:00 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:51:00 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:51:00 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:51:04 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u8:2:37] Aug 15 10:51:04 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:51:04 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:51:04 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:51:04 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:51:04 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:04 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:51:04 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:51:04 oleg434-client kernel: RAX: 000000000000140f RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:51:04 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:51:04 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:51:04 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:51:04 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:51:04 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:51:04 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:51:04 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:51:04 oleg434-client kernel: Call Trace: Aug 15 10:51:04 oleg434-client kernel: Aug 15 10:51:04 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:51:04 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:51:04 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:51:04 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:51:04 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:51:04 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:51:04 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:51:04 oleg434-client kernel: Aug 15 10:51:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:04 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:51:04 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:51:04 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:51:04 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:51:04 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:51:04 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:51:04 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:51:04 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:51:04 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:51:04 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:51:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:51:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:51:24 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:51:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:51:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:51:24 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:51:24 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:51:24 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:51:24 oleg434-client kernel: RDX: 0000000000002e68 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:51:24 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:51:24 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:51:24 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:51:24 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:51:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:51:24 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:51:24 oleg434-client kernel: Call Trace: Aug 15 10:51:24 oleg434-client kernel: Aug 15 10:51:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:51:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:51:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:51:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:51:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:51:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:51:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:51:24 oleg434-client kernel: Aug 15 10:51:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:51:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:51:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:51:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:51:24 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:51:24 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:51:24 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:51:24 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:51:24 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:51:24 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:51:24 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:51:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:51:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:51:28 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:51:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:51:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:51:28 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:51:28 oleg434-client kernel: RAX: 0000000000005b84 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:51:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:51:28 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:51:28 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:51:28 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:51:28 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:51:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:51:28 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:51:28 oleg434-client kernel: Call Trace: Aug 15 10:51:28 oleg434-client kernel: Aug 15 10:51:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:51:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:51:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:51:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:51:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:51:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:51:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:51:28 oleg434-client kernel: Aug 15 10:51:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:51:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:51:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:51:28 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:51:28 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:51:28 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:51:28 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:51:28 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:51:28 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:51:28 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:51:28 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:51:28 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:51:28 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:51:28 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:51:28 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:51:28 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:51:28 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:51:28 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:51:28 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:51:28 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:51:28 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:51:28 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:51:28 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:51:28 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:51:28 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:51:32 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:51:32 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:51:32 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:51:32 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:51:32 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:51:32 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:32 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:51:32 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:51:32 oleg434-client kernel: RAX: 0000000000003a88 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:51:32 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:51:32 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:51:32 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:51:32 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:51:32 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:51:32 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:51:32 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:51:32 oleg434-client kernel: Call Trace: Aug 15 10:51:32 oleg434-client kernel: Aug 15 10:51:32 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:51:32 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:51:32 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:51:32 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:51:32 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:51:32 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:51:32 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:51:32 oleg434-client kernel: Aug 15 10:51:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:32 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:51:32 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:51:32 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:51:32 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:51:32 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:51:32 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:51:32 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:51:32 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:51:32 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:51:32 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:51:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:51:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:51:52 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:51:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:51:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:51:52 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:51:52 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:51:52 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:51:52 oleg434-client kernel: RDX: 0000000000006974 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:51:52 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:51:52 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:51:52 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:51:52 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:51:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:51:52 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:51:52 oleg434-client kernel: Call Trace: Aug 15 10:51:52 oleg434-client kernel: Aug 15 10:51:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:51:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:51:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:51:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:51:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:51:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:51:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:51:52 oleg434-client kernel: Aug 15 10:51:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:51:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:51:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:51:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:51:52 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:51:52 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:51:52 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:51:52 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:51:52 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:51:52 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:51:52 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:51:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:51:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:51:56 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:51:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:51:56 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:56 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:51:56 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:51:56 oleg434-client kernel: RAX: 000000000000018e RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:51:56 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:51:56 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:51:56 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:51:56 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:51:56 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:51:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:51:56 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:51:56 oleg434-client kernel: Call Trace: Aug 15 10:51:56 oleg434-client kernel: Aug 15 10:51:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:51:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:51:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:51:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:51:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:51:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:51:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:51:56 oleg434-client kernel: Aug 15 10:51:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:51:56 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:51:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:51:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:51:56 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:51:56 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:51:56 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:51:56 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:51:56 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:51:56 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:51:56 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:51:56 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:51:56 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:51:56 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:51:56 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:51:56 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:51:56 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:51:56 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:51:56 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:51:56 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:51:56 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:51:56 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:51:56 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:51:56 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:51:56 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:51:56 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:52:00 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:52:00 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:52:00 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:52:00 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:52:00 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:52:00 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:00 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:52:00 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:52:00 oleg434-client kernel: RAX: 0000000000005907 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:52:00 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:52:00 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:52:00 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:52:00 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:52:00 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:52:00 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:52:00 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:52:00 oleg434-client kernel: Call Trace: Aug 15 10:52:00 oleg434-client kernel: Aug 15 10:52:00 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:52:00 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:52:00 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:52:00 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:52:00 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:52:00 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:52:00 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:52:00 oleg434-client kernel: Aug 15 10:52:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:00 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:52:00 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:52:00 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:52:00 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:52:00 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:52:00 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:52:00 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:52:00 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:52:00 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:52:00 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:52:20 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:52:20 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:52:20 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:52:20 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:52:20 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:52:20 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:52:20 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:52:20 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:52:20 oleg434-client kernel: RDX: 0000000000006639 RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:52:20 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:52:20 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:52:20 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:52:20 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:52:20 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:52:20 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:52:20 oleg434-client kernel: Call Trace: Aug 15 10:52:20 oleg434-client kernel: Aug 15 10:52:20 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:52:20 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:52:20 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:52:20 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:52:20 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:52:20 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:52:20 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:52:20 oleg434-client kernel: Aug 15 10:52:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:52:20 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:52:20 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:52:20 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:52:20 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:52:20 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:52:20 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:52:20 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:52:20 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:52:20 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:52:20 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:52:24 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:52:24 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:52:24 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:52:24 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:52:24 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:24 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:52:24 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:52:24 oleg434-client kernel: RAX: 0000000000001878 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:52:24 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:52:24 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:52:24 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:52:24 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:52:24 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:52:24 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:52:24 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:52:24 oleg434-client kernel: Call Trace: Aug 15 10:52:24 oleg434-client kernel: Aug 15 10:52:24 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:52:24 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:52:24 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:52:24 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:52:24 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:52:24 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:52:24 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:52:24 oleg434-client kernel: Aug 15 10:52:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:24 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:52:24 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:52:24 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:52:24 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:52:24 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:52:24 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:52:24 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:52:24 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:52:24 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:52:24 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:52:24 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:52:24 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:52:24 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:52:24 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:52:24 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:52:24 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:52:24 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:52:24 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:52:24 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:52:24 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:52:24 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:52:24 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:52:24 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:52:24 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:52:24 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:52:28 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:52:28 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:52:28 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:52:28 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:52:28 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:52:28 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:28 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:52:28 oleg434-client kernel: RSP: 0018:ffff985380da3dd8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:52:28 oleg434-client kernel: RAX: 0000000000007e96 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:52:28 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:52:28 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:52:28 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:52:28 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:52:28 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:52:28 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:52:28 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:52:28 oleg434-client kernel: Call Trace: Aug 15 10:52:28 oleg434-client kernel: Aug 15 10:52:28 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:52:28 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:52:28 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:52:28 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:52:28 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:52:28 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:52:28 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:52:28 oleg434-client kernel: Aug 15 10:52:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:28 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:52:28 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:52:28 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:52:28 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:52:28 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:52:28 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:52:28 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:52:28 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:52:28 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:52:28 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:52:48 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ptlrpcd_rcv:2387] Aug 15 10:52:48 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:52:48 oleg434-client kernel: CPU: 0 PID: 2387 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:52:48 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:52:48 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:52:48 oleg434-client kernel: Code: 0c 00 00 00 00 41 be 01 00 00 00 41 bf 00 01 00 00 65 48 ff 05 ed 8a c7 72 c6 45 14 00 ba 00 80 00 00 c6 43 01 01 eb 13 f3 90 <48> 83 05 5c d6 dc 02 01 83 ea 01 0f 84 ef 03 00 00 0f b6 03 84 c0 Aug 15 10:52:48 oleg434-client kernel: RSP: 0018:ffff9853816cfbc8 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Aug 15 10:52:48 oleg434-client kernel: RAX: 0000000000000003 RBX: ffff898e84d1d2e0 RCX: ffff898ec201e480 Aug 15 10:52:48 oleg434-client kernel: RDX: 000000000000390c RSI: 0000000000000003 RDI: ffff898e84d1d2e0 Aug 15 10:52:48 oleg434-client kernel: RBP: ffff898ec2034140 R08: 0000000000000008 R09: 0000000000000008 Aug 15 10:52:48 oleg434-client kernel: R10: ffffffff8ee08b80 R11: ffff9853816cf8f0 R12: 0000000000040000 Aug 15 10:52:48 oleg434-client kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000100 Aug 15 10:52:48 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2000000(0000) knlGS:0000000000000000 Aug 15 10:52:48 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:52:48 oleg434-client kernel: CR2: 00007f98f2861270 CR3: 000000010aa16001 CR4: 0000000000170ef0 Aug 15 10:52:48 oleg434-client kernel: Call Trace: Aug 15 10:52:48 oleg434-client kernel: Aug 15 10:52:48 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:52:48 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:52:48 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:52:48 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:52:48 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:52:48 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:52:48 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:52:48 oleg434-client kernel: Aug 15 10:52:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x174/0x6d0 Aug 15 10:52:48 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x5e7/0x6d0 Aug 15 10:52:48 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:52:48 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:52:48 oleg434-client kernel: __ptlrpc_req_put+0x6af/0xa50 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: obd_mod_free+0x46/0x140 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: mdc_commit_open+0x91/0xb0 [mdc] Aug 15 10:52:48 oleg434-client kernel: ptlrpc_free_request+0x4b/0xc0 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: ptlrpc_free_committed+0x15c/0xd70 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: after_reply+0xe2c/0x1780 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: ptlrpc_check_set+0x2575/0x30b0 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: ? __next_timer_interrupt+0x160/0x160 Aug 15 10:52:48 oleg434-client kernel: ptlrpcd+0xa82/0xe40 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:52:48 oleg434-client kernel: ? ptlrpcd_add_req+0x540/0x540 [ptlrpc] Aug 15 10:52:48 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:52:48 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:52:48 oleg434-client kernel: ret_from_fork+0x1f/0x30 Aug 15 10:52:52 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [writemany:37219] Aug 15 10:52:52 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:52:52 oleg434-client kernel: CPU: 3 PID: 37219 Comm: writemany Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:52:52 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:52:52 oleg434-client kernel: RIP: 0010:__pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:52 oleg434-client kernel: Code: 4c 03 2c c5 80 58 c8 8e 49 89 6d 00 b8 00 80 00 00 eb 20 41 0f b6 55 14 48 83 05 46 d4 dc 02 01 84 d2 0f 85 db 00 00 00 f3 90 <83> e8 01 0f 84 3b 02 00 00 8b 55 08 85 d2 75 0e 84 c0 74 d5 48 83 Aug 15 10:52:52 oleg434-client kernel: RSP: 0018:ffff985380d7fba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Aug 15 10:52:52 oleg434-client kernel: RAX: 0000000000007b48 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:52:52 oleg434-client kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff898ec21b4154 Aug 15 10:52:52 oleg434-client kernel: RBP: ffff898ec21b4140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:52:52 oleg434-client kernel: R10: 000000002e49b6d3 R11: ffff898e84e5e000 R12: 0000000000100000 Aug 15 10:52:52 oleg434-client kernel: R13: ffff898ec2034140 R14: 000000000001e480 R15: ffff898ec219e480 Aug 15 10:52:52 oleg434-client kernel: FS: 00007f3395fc2740(0000) GS:ffff898ec2180000(0000) knlGS:0000000000000000 Aug 15 10:52:52 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:52:52 oleg434-client kernel: CR2: 00007f34d7aab160 CR3: 00000001063d6003 CR4: 0000000000170ee0 Aug 15 10:52:52 oleg434-client kernel: Call Trace: Aug 15 10:52:52 oleg434-client kernel: Aug 15 10:52:52 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:52:52 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:52:52 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:52:52 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:52:52 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:52:52 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:52:52 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:52:52 oleg434-client kernel: Aug 15 10:52:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x30c/0x6d0 Aug 15 10:52:52 oleg434-client kernel: ? __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:52:52 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:52:52 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:52:52 oleg434-client kernel: ptlrpc_check_set+0x11c5/0x30b0 [ptlrpc] Aug 15 10:52:52 oleg434-client kernel: ? do_raw_spin_unlock+0x75/0x190 Aug 15 10:52:52 oleg434-client kernel: ptlrpc_set_wait+0x38e/0xa50 [ptlrpc] Aug 15 10:52:52 oleg434-client kernel: ? do_wait_intr+0xf0/0xf0 Aug 15 10:52:52 oleg434-client kernel: ptlrpc_queue_wait+0xb1/0x2d0 [ptlrpc] Aug 15 10:52:52 oleg434-client kernel: mdc_reint+0x2d/0x110 [mdc] Aug 15 10:52:52 oleg434-client kernel: mdc_unlink+0x658/0x870 [mdc] Aug 15 10:52:52 oleg434-client kernel: lmv_unlink+0x34d/0xbd0 [lmv] Aug 15 10:52:52 oleg434-client kernel: ll_unlink+0x24d/0x7f0 [lustre] Aug 15 10:52:52 oleg434-client kernel: vfs_unlink+0x202/0x330 Aug 15 10:52:52 oleg434-client kernel: do_unlinkat+0x2fa/0x460 Aug 15 10:52:52 oleg434-client kernel: __x64_sys_unlink+0x37/0x50 Aug 15 10:52:52 oleg434-client kernel: do_syscall_64+0xc1/0x440 Aug 15 10:52:52 oleg434-client kernel: entry_SYSCALL_64_after_hwframe+0x49/0xae Aug 15 10:52:52 oleg434-client kernel: RIP: 0033:0x7f33957fc10b Aug 15 10:52:52 oleg434-client kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 7a 7d 39 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4d 7d 39 00 f7 d8 64 89 01 48 Aug 15 10:52:52 oleg434-client kernel: RSP: 002b:00007ffe42a47a78 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 Aug 15 10:52:52 oleg434-client kernel: RAX: ffffffffffffffda RBX: 000000000001df10 RCX: 00007f33957fc10b Aug 15 10:52:52 oleg434-client kernel: RDX: 0000000000000038 RSI: 00007ffe42a47ee0 RDI: 00007ffe42a47ae0 Aug 15 10:52:52 oleg434-client kernel: RBP: 00007ffe42a47ee0 R08: 00007f3395b9421c R09: 00007f3395b94260 Aug 15 10:52:52 oleg434-client kernel: R10: 00007ffe42a47822 R11: 0000000000000246 R12: 0000000000000003 Aug 15 10:52:52 oleg434-client kernel: R13: 00000000ffffffff R14: 0000000000000038 R15: 0000000000000000 Aug 15 10:52:56 oleg434-client kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u8:2:37] Aug 15 10:52:56 oleg434-client kernel: Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) ec(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic Aug 15 10:52:56 oleg434-client kernel: CPU: 2 PID: 37 Comm: kworker/u8:2 Kdump: loaded Tainted: G O L -------- - - 4.18.0rh8.10-debug #2 Aug 15 10:52:56 oleg434-client kernel: Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Aug 15 10:52:56 oleg434-client kernel: Workqueue: ptlrpc_pinger ptlrpc_pinger_main [ptlrpc] Aug 15 10:52:56 oleg434-client kernel: RIP: 0010:native_safe_halt+0x2e/0x50 Aug 15 10:52:56 oleg434-client kernel: Code: ed f1 01 01 e9 2a 00 00 00 48 83 05 3b ed f1 01 01 48 83 05 3b ed f1 01 01 0f 00 2d 44 44 43 00 48 83 05 34 ed f1 01 01 fb f4 <48> 83 05 32 ed f1 01 01 c3 48 83 05 09 ed f1 01 01 eb eb 66 66 2e Aug 15 10:52:56 oleg434-client kernel: RSP: 0018:ffff985380da3dc8 EFLAGS: 00000212 ORIG_RAX: ffffffffffffff13 Aug 15 10:52:56 oleg434-client kernel: RAX: 0000000000000001 RBX: ffff898e84d1d2e0 RCX: 0000000000000001 Aug 15 10:52:56 oleg434-client kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff898ec2134154 Aug 15 10:52:56 oleg434-client kernel: RBP: ffff898ec2134140 R08: 0000000000000000 R09: 0000000000000000 Aug 15 10:52:56 oleg434-client kernel: R10: 000000002e49bce4 R11: ffff898e84f5d000 R12: 00000000000c0000 Aug 15 10:52:56 oleg434-client kernel: R13: ffff898ec21b4140 R14: 000000000001e480 R15: ffff898ec211e480 Aug 15 10:52:56 oleg434-client kernel: FS: 0000000000000000(0000) GS:ffff898ec2100000(0000) knlGS:0000000000000000 Aug 15 10:52:56 oleg434-client kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 15 10:52:56 oleg434-client kernel: CR2: 0000563e44f60948 CR3: 000000010aa16005 CR4: 0000000000170ee0 Aug 15 10:52:56 oleg434-client kernel: Call Trace: Aug 15 10:52:56 oleg434-client kernel: Aug 15 10:52:56 oleg434-client kernel: ? show_regs.cold.9+0x22/0x2f Aug 15 10:52:56 oleg434-client kernel: ? watchdog_timer_fn.cold.6+0x62/0x10a Aug 15 10:52:56 oleg434-client kernel: ? __hrtimer_run_queues+0x1c2/0x4d0 Aug 15 10:52:56 oleg434-client kernel: ? watchdog+0x40/0x40 Aug 15 10:52:56 oleg434-client kernel: ? hrtimer_interrupt+0x128/0x2c0 Aug 15 10:52:56 oleg434-client kernel: ? smp_apic_timer_interrupt+0xa6/0x270 Aug 15 10:52:56 oleg434-client kernel: ? apic_timer_interrupt+0xf/0x20 Aug 15 10:52:56 oleg434-client kernel: Aug 15 10:52:56 oleg434-client kernel: ? native_safe_halt+0x2e/0x50 Aug 15 10:52:56 oleg434-client kernel: kvm_wait+0xcd/0xe0 Aug 15 10:52:56 oleg434-client kernel: __pv_queued_spin_lock_slowpath+0x451/0x6d0 Aug 15 10:52:56 oleg434-client kernel: do_raw_spin_lock+0x177/0x190 Aug 15 10:52:56 oleg434-client kernel: _raw_spin_lock+0x21/0x30 Aug 15 10:52:56 oleg434-client kernel: ptlrpc_pinger_main+0x1cd/0xf30 [ptlrpc] Aug 15 10:52:56 oleg434-client kernel: process_one_work+0x2c8/0x700 Aug 15 10:52:56 oleg434-client kernel: worker_thread+0x296/0x6e0 Aug 15 10:52:56 oleg434-client kernel: ? rescuer_thread+0x570/0x570 Aug 15 10:52:56 oleg434-client kernel: kthread+0x1d1/0x200 Aug 15 10:52:56 oleg434-client kernel: ? set_kthread_struct+0x70/0x70 Aug 15 10:52:56 oleg434-client kernel: ret_from_fork+0x1f/0x30