************************ crashinfo ************************* /exports/testreports/65345/testresults/sanityn-ldiskfs-DNE-rocky8.10_x86_64-rocky8.10_x86_64/oleg140-client-timeout-core (4.18.0rh8.10-debug) +==========================+ | *** Crashinfo v1.3.7 *** | +==========================+ +++WARNING+++ PARTIAL DUMP with size(vmcore) < 25% size(RAM) KERNEL: /tmp/crash-anaysis.krfJ0/vmlinux [TAINTED] DUMPFILE: /exports/testreports/65345/testresults/sanityn-ldiskfs-DNE-rocky8.10_x86_64-rocky8.10_x86_64/oleg140-client-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Thu Jun 18 21:38:38 EDT 2026 UPTIME: 04:23:42 LOAD AVERAGE: 0.52, 0.82, 1.25 TASKS: 190 NODENAME: oleg140-client.virtnet RELEASE: 4.18.0rh8.10-debug VERSION: #2 SMP Mon Jul 14 01:24:22 EDT 2025 MACHINE: x86_64 (2399 Mhz) MEMORY: 4.1 GB PANIC: "" +--------------------------+ >------------------------| Per-cpu Stacks ('bt -a') |------------------------< +--------------------------+ -- CPU#0 -- PID=0 CPU=0 CMD=swapper/0 #-1 native_safe_halt+0x2e, 449 bytes of data #0 default_idle+0x1a #1 arch_cpu_idle+0x13 #2 default_idle_call+0xb8 #3 do_idle+0x3c9 #4 cpu_startup_entry+0x9f #5 rest_init+0x128 #6 start_kernel+0x981 #7 x86_64_start_reservations+0x3c #8 x86_64_start_kernel+0xfd #9 secondary_startup_64_no_verify+0xd1 -- CPU#1 -- PID=0 CPU=1 CMD=swapper/1 #-1 __pv_queued_spin_lock_slowpath+0x174, 449 bytes of data #0 do_raw_spin_lock+0x177 #1 _raw_spin_lock+0x21 #2 __schedule+0xe0 #3 schedule_idle+0x24 #4 do_idle+0x2a8 #5 cpu_startup_entry+0x9f #6 start_secondary+0x2b8 #7 secondary_startup_64_no_verify+0xd1 -- CPU#2 -- PID=0 CPU=2 CMD=swapper/2 #-1 native_safe_halt+0x2e, 449 bytes of data #0 default_idle+0x1a #1 arch_cpu_idle+0x13 #2 default_idle_call+0xb8 #3 do_idle+0x3c9 #4 cpu_startup_entry+0x9f #5 start_secondary+0x2b8 #6 secondary_startup_64_no_verify+0xd1 -- CPU#3 -- PID=282917 CPU=3 CMD=pdsh #-1 __pv_queued_spin_lock_slowpath+0x30c, 449 bytes of data #0 __update_load_avg_cfs_rq+0x33f #1 do_raw_spin_lock+0x177 #2 _raw_spin_lock+0x21 #3 try_to_wake_up+0x236 #4 wake_up_process+0x19 #5 swake_up_locked+0x28 #6 swake_up_one+0x2a #7 rcu_gp_kthread_wake+0x5b #8 rcu_report_qs_rnp+0x2c9 #9 rcu_report_qs_rdp+0xe0 #10 rcu_core+0xc9 #11 rcu_core_si+0x12 #12 __softirqentry_text_start+0x134 #13 irq_exit_rcu+0x1c6 #14 irq_exit+0x12 #15 smp_apic_timer_interrupt+0xe0 #16 apic_timer_interrupt+0xf, 19 bytes of data #17 apic_timer_interrupt+0xf #-1 free_unref_page_list+0xd4, 477 bytes of data #18 release_pages+0x271 #19 __pagevec_lru_add+0x682 #20 lru_add_drain_cpu+0x98 #21 lru_add_drain+0x43 #22 unmap_region+0x52 #23 __do_munmap+0x257 #24 __vm_munmap+0x7f #25 __x64_sys_munmap+0x37 #26 do_syscall_64+0xc1 #27 entry_SYSCALL_64_after_hwframe+0x49, 477 bytes of data +--------------------------------+ >---------------------| How This Dump Has Been Created |---------------------< +--------------------------------+ Cannot identify the specific condition that triggered vmcore +---------------+ >------------------------------| Tasks Summary |------------------------------< +---------------+ +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task Number of Threads That Ran Recently ----------------------------------- last second 45 last 5s 65 last 60s 83 ----- Total Numbers of Threads per State ------ ?? 187 +++WARNING+++ There are 6 threads running in their own namespaces Use 'taskinfo --ns' to get more details +-----------------------+ >--------------------------| 5 Most Recent Threads |--------------------------< +-----------------------+ PID CMD Age ARGS ----- -------------- ------ ---------------------------- 282915 pdsh 0 ms pdsh -S -Rssh -w oleg140-client.virtnet oleg140-server (PATH=$PATH:/home/green/git/lustre-release/lustre/utils:/home/green/git/lustre-release/lustre/tests:/sbin:/usr/sbin; cd /root; LUSTRE="/home/green/git/lustre-release/lustre" mds1_FSTYPE=ldiskfs ost1_FSTYPE=ldiskfs VERBOSE=false FSTYPE=ldiskfs NETTYPE=tcp FORCE_LARGE_NID=false bash -c "dmesg") 13 rcu_sched 0 ms (no user stack) 282917 pdsh 0 ms pdsh -S -Rssh -w oleg140-client.virtnet oleg140-server (PATH=$PATH:/home/green/git/lustre-release/lustre/utils:/home/green/git/lustre-release/lustre/tests:/sbin:/usr/sbin; cd /root; LUSTRE="/home/green/git/lustre-release/lustre" mds1_FSTYPE=ldiskfs ost1_FSTYPE=ldiskfs VERBOSE=false FSTYPE=ldiskfs NETTYPE=tcp FORCE_LARGE_NID=false bash -c "dmesg") 282916 pdsh 0 ms pdsh -S -Rssh -w oleg140-client.virtnet oleg140-server (PATH=$PATH:/home/green/git/lustre-release/lustre/utils:/home/green/git/lustre-release/lustre/tests:/sbin:/usr/sbin; cd /root; LUSTRE="/home/green/git/lustre-release/lustre" mds1_FSTYPE=ldiskfs ost1_FSTYPE=ldiskfs VERBOSE=false FSTYPE=ldiskfs NETTYPE=tcp FORCE_LARGE_NID=false bash -c "dmesg") 282697 kworker/2:3 7 ms (no user stack) +------------------------+ >-------------------------| Memory Usage (kmem -i) |-------------------------< +------------------------+ PAGES TOTAL PERCENTAGE TOTAL MEM 945454 3.6 GB ---- FREE 798918 3 GB 84% of TOTAL MEM USED 146536 572.4 MB 15% of TOTAL MEM SHARED 17976 70.2 MB 1% of TOTAL MEM BUFFERS 3467 13.5 MB 0% of TOTAL MEM CACHED 42634 166.5 MB 4% of TOTAL MEM SLAB 13323 52 MB 1% of TOTAL MEM TOTAL HUGE 0 0 ---- HUGE FREE 0 0 0% of TOTAL HUGE TOTAL SWAP 262143 1024 MB ---- SWAP USED 195 780 KB 0% of TOTAL SWAP SWAP FREE 261948 1023.2 MB 99% of TOTAL SWAP COMMIT LIMIT 734870 2.8 GB ---- COMMITTED 101152 395.1 MB 13% of TOTAL LIMIT print_blkreq is not supported on this kernel Traceback (most recent call last): File "/usr/local/crash/mpykdump.so/progs/crashinfo.py", line 1673, in File "/home/green/git/pykdump/LinuxDump/Dev.py", line 500, in print_gendisk # Get the list of (dev, gendisk) sorted by dev File "/home/green/git/pykdump/LinuxDump/Dev.py", line 473, in get_gendisks ttype = target.type File "/home/green/git/pykdump/pykdump/lowlevel.py", line 391, in __getattr__ raise KeyError(msg) KeyError: ' does not have a field ' ****************************************************************************** ************************ A Summary Of Problems Found ************************* ****************************************************************************** -------------------- A list of all +++WARNING+++ messages -------------------- PARTIAL DUMP with size(vmcore) < 25% size(RAM) There are 6 threads running in their own namespaces Use 'taskinfo --ns' to get more details --------------------- A list of all +++ERROR+++ messages --------------------- corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task ------------------------------------------------------------------------------ ** Execution took 22.31s (real) 8.07s (CPU), Child processes: 14.16s