crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.pWwKH/vmlinux [TAINTED] DUMPFILE: /exports/testreports/50430/testresults/sanityn-zfs-centos7_x86_64-centos7_x86_64/oleg104-client-vmcore [PARTIAL DUMP] CPUS: 4 DATE: Tue Apr 1 13:19:32 EDT 2025 UPTIME: 00:06:07 LOAD AVERAGE: 0.88, 0.73, 0.35 TASKS: 160 NODENAME: oleg104-client.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2400 Mhz) MEMORY: 4 GB PANIC: "BUG: unable to handle kernel NULL pointer dereference at 000000000000012e" PID: 27159 COMMAND: "fsx" TASK: ffff880137609110 [THREAD_INFO: ffff8800a7e7c000] CPU: 2 STATE: TASK_RUNNING (PANIC) Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for lrw module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for sb_edac module MODULE NAME BASE SIZE OBJECT FILE ffffffffa01b0380 ost ffffffffa01ad000 19298 /tmp/crash-anaysis.pWwKH/modules/ost.ko mod: cannot find or load object file for rpcsec_gss_krb5 module ffffffffa01d11a0 fid ffffffffa01c3000 84843 /tmp/crash-anaysis.pWwKH/modules/fid.ko mod: cannot find or load object file for edac_core module mod: cannot find or load object file for aesni_intel module ffffffffa0244360 libcfs ffffffffa022f000 132619 /tmp/crash-anaysis.pWwKH/modules/libcfs.ko ffffffffa025f7e0 fld ffffffffa0251000 88713 /tmp/crash-anaysis.pWwKH/modules/fld.ko ffffffffa027a920 mgc ffffffffa0268000 109376 /tmp/crash-anaysis.pWwKH/modules/mgc.ko mod: cannot find or load object file for squashfs module mod: cannot find or load object file for kvm module ffffffffa03c8020 lnet ffffffffa0332000 958750 /tmp/crash-anaysis.pWwKH/modules/lnet.ko ffffffffa043c8a0 ksocklnd ffffffffa041e000 182768 /tmp/crash-anaysis.pWwKH/modules/ksocklnd.ko ffffffffa0484de0 ptlrpc_gss ffffffffa044c000 342063 /tmp/crash-anaysis.pWwKH/modules/ptlrpc_gss.ko ffffffffa04cc860 lmv ffffffffa04a1000 234767 /tmp/crash-anaysis.pWwKH/modules/lmv.ko ffffffffa0527d40 osc ffffffffa04dc000 427843 /tmp/crash-anaysis.pWwKH/modules/osc.ko mod: cannot find or load object file for kvm_intel module ffffffffa0669580 obdclass ffffffffa059c000 2652163 /tmp/crash-anaysis.pWwKH/modules/obdclass.ko ffffffffa09d5aa0 ptlrpc ffffffffa0825000 2543606 /tmp/crash-anaysis.pWwKH/modules/ptlrpc.ko ffffffffa0acd660 lov ffffffffa0a93000 332217 /tmp/crash-anaysis.pWwKH/modules/lov.ko ffffffffa0b188a0 mdc ffffffffa0ae6000 276564 /tmp/crash-anaysis.pWwKH/modules/mdc.ko ffffffffa0b44120 obdecho ffffffffa0b2b000 151561 /tmp/crash-anaysis.pWwKH/modules/obdecho.ko ffffffffa0be9240 lfsck ffffffffa0b52000 782830 /tmp/crash-anaysis.pWwKH/modules/lfsck.ko ffffffffa0c69280 lquota ffffffffa0c13000 472402 /tmp/crash-anaysis.pWwKH/modules/lquota.ko ffffffffa0ce6120 mgs ffffffffa0ca2000 373732 /tmp/crash-anaysis.pWwKH/modules/mgs.ko ffffffffa0d5c000 mdd ffffffffa0cff000 497881 /tmp/crash-anaysis.pWwKH/modules/mdd.ko ffffffffa0e4dce0 mdt ffffffffa0d94000 1023484 /tmp/crash-anaysis.pWwKH/modules/mdt.ko ffffffffa0f08a60 lod ffffffffa0e8f000 660609 /tmp/crash-anaysis.pWwKH/modules/lod.ko ffffffffa0f746c0 ofd ffffffffa0f32000 361788 /tmp/crash-anaysis.pWwKH/modules/ofd.ko ffffffffa0fca2a0 osp ffffffffa0f8c000 350313 /tmp/crash-anaysis.pWwKH/modules/osp.ko ffffffffa10ae9c0 lustre ffffffffa0fe3000 1105717 /tmp/crash-anaysis.pWwKH/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b35c02c8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff8800a84dc7a8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800a971caa8) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800b7b37f88) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff88012e25e128) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88012d4d9dc8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800b5b9e388) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 4099 total debug pages from 4 CPUs to /tmp/crash-anaysis.pWwKH/lustre.bin