************************ crashinfo ************************* /exports/testreports/62305/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64/oleg228-server-timeout-core (4.18.0rh8.10-debug) +==========================+ | *** Crashinfo v1.3.7 *** | +==========================+ +++WARNING+++ PARTIAL DUMP with size(vmcore) < 25% size(RAM) KERNEL: /tmp/crash-anaysis.9pMZk/vmlinux [TAINTED] DUMPFILE: /exports/testreports/62305/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64/oleg228-server-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Thu Apr 9 16:01:35 EDT 2026 UPTIME: 00:39:22 LOAD AVERAGE: 0.99, 1.08, 1.17 TASKS: 351 NODENAME: oleg228-server.virtnet RELEASE: 4.18.0rh8.10-debug VERSION: #2 SMP Mon Jul 14 01:24:22 EDT 2025 MACHINE: x86_64 (2399 Mhz) MEMORY: 4.1 GB PANIC: "" +--------------------------+ >------------------------| Per-cpu Stacks ('bt -a') |------------------------< +--------------------------+ -- CPU#0 -- PID=3330 CPU=0 CMD=ptlrpcd_00_02 #-1 __pv_queued_spin_lock_slowpath+0x30c, 449 bytes of data #0 _raw_spin_unlock+0x12 #1 cfs_percpt_unlock+0x42 #2 do_raw_spin_lock+0x177 #3 _raw_spin_lock+0x21 #4 cfs_percpt_lock+0x73 #5 lnet_finalize+0x219 #6 lolnd_recv+0x54 #7 lnet_ni_recv+0x122 #8 lnet_recv_put+0x92 #9 lnet_parse_local+0x813 #10 lnet_parse+0x16a4 #11 lolnd_send+0x32 #12 lnet_ni_send+0x59 #13 lnet_send+0xc5 #14 LNetPut+0x4c3 #15 ptl_send_buf+0x1b5 #16 ptl_send_rpc+0xc82 #17 ptlrpc_send_new_req+0xa51 #18 ptlrpc_check_set+0xacd #19 ptlrpcd+0xa82 #20 kthread+0x1d1 #21 ret_from_fork+0x1f -- CPU#1 -- PID=3331 CPU=1 CMD=ptlrpcd_00_03 #-1 __pv_queued_spin_lock_slowpath+0x30c, 449 bytes of data #0 do_raw_spin_lock+0x177 #1 _raw_spin_lock+0x21 #2 cfs_percpt_lock+0x73 #3 LNetMEAttach+0x149 #4 ptl_send_rpc+0x439 #5 ptlrpc_send_new_req+0xa51 #6 ptlrpc_check_set+0xacd #7 ptlrpcd+0xa82 #8 kthread+0x1d1 #9 ret_from_fork+0x1f -- CPU#2 -- PID=3329 CPU=2 CMD=ptlrpcd_00_01 #-1 __pv_queued_spin_lock_slowpath+0x30c, 449 bytes of data #0 do_raw_spin_lock+0x177 #1 _raw_spin_lock+0x21 #2 cfs_percpt_lock+0x73 #3 LNetMEAttach+0x149 #4 ptl_send_rpc+0x439 #5 ptlrpc_send_new_req+0xa51 #6 ptlrpc_check_set+0xacd #7 ptlrpcd+0xa82 #8 kthread+0x1d1 #9 ret_from_fork+0x1f -- CPU#3 -- PID=49905 CPU=3 CMD=z_wr_int #-1 blkcg_ioprio_track+0x41, 449 bytes of data #0 __rq_qos_track+0x2f #1 blk_mq_make_request+0x218 #2 generic_make_request_no_check+0x107 #3 generic_make_request+0x2a #4 submit_bio+0x48 #5 vdev_disk_io_rw+0x1f8 #6 vdev_disk_io_start+0x9f #7 zio_vdev_io_start+0xba #8 zio_execute+0xbb #9 vdev_queue_io_done+0x1b4 #10 zio_vdev_io_done+0x24d #11 zio_execute+0xbb #12 taskq_thread+0x45c #13 kthread+0x1d1 #14 ret_from_fork+0x1f +--------------------------------+ >---------------------| How This Dump Has Been Created |---------------------< +--------------------------------+ Cannot identify the specific condition that triggered vmcore +---------------+ >------------------------------| Tasks Summary |------------------------------< +---------------+ +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task +++ERROR+++ corrupted task Number of Threads That Ran Recently ----------------------------------- last second 67 last 5s 104 last 60s 162 ----- Total Numbers of Threads per State ------ ?? 348 +++WARNING+++ There are 6 threads running in their own namespaces Use 'taskinfo --ns' to get more details +-----------------------+ >--------------------------| 5 Most Recent Threads |--------------------------< +-----------------------+ PID CMD Age ARGS ----- -------------- ------ ---------------------------- 49905 z_wr_int 0 ms (no user stack) 3329 ptlrpcd_00_01 0 ms (no user stack) 41523 kworker/u8:2 0 ms (no user stack) 42320 ll_evictor 1 ms (no user stack) 48270 z_wr_iss 1 ms (no user stack) +------------------------+ >-------------------------| Memory Usage (kmem -i) |-------------------------< +------------------------+ PAGES TOTAL PERCENTAGE TOTAL MEM 945443 3.6 GB ---- FREE 593072 2.3 GB 62% of TOTAL MEM USED 352371 1.3 GB 37% of TOTAL MEM SHARED 19768 77.2 MB 2% of TOTAL MEM BUFFERS 8133 31.8 MB 0% of TOTAL MEM CACHED 111120 434.1 MB 11% of TOTAL MEM SLAB 11455 44.7 MB 1% of TOTAL MEM TOTAL HUGE 0 0 ---- HUGE FREE 0 0 0% of TOTAL HUGE TOTAL SWAP 262143 1024 MB ---- SWAP USED 0 0 0% of TOTAL SWAP SWAP FREE 262143 1024 MB 100% of TOTAL SWAP COMMIT LIMIT 734864 2.8 GB ---- COMMITTED 89670 350.3 MB 12% of TOTAL LIMIT print_blkreq is not supported on this kernel Traceback (most recent call last): File "/usr/local/crash/mpykdump.so/progs/crashinfo.py", line 1673, in File "/home/green/git/pykdump/LinuxDump/Dev.py", line 500, in print_gendisk # Get the list of (dev, gendisk) sorted by dev File "/home/green/git/pykdump/LinuxDump/Dev.py", line 473, in get_gendisks ttype = target.type File "/home/green/git/pykdump/pykdump/lowlevel.py", line 391, in __getattr__ raise KeyError(msg) KeyError: ' does not have a field ' ****************************************************************************** ************************ A Summary Of Problems Found ************************* ****************************************************************************** -------------------- A list of all +++WARNING+++ messages -------------------- PARTIAL DUMP with size(vmcore) < 25% size(RAM) There are 6 threads running in their own namespaces Use 'taskinfo --ns' to get more details --------------------- A list of all +++ERROR+++ messages --------------------- corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task corrupted task ------------------------------------------------------------------------------ ** Execution took 22.96s (real) 9.01s (CPU), Child processes: 13.79s