crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.0wU2E/vmlinux [TAINTED] DUMPFILE: /exports/testreports/42551/testresults/sanity-benchmark-ldiskfs-DNE-centos7_x86_64-centos7_x86_64/oleg440-client-vmcore [PARTIAL DUMP] CPUS: 4 DATE: Wed May 8 18:08:14 EDT 2024 UPTIME: 00:07:23 LOAD AVERAGE: 0.77, 1.34, 0.69 TASKS: 159 NODENAME: oleg440-client.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "BUG: unable to handle kernel NULL pointer dereference at (null)" PID: 12004 COMMAND: "fsx" TASK: ffff8800b639c440 [THREAD_INFO: ffff88009ba14000] CPU: 0 STATE: TASK_RUNNING (PANIC) Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for libata module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for lrw module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for sb_edac module mod: cannot find or load object file for rpcsec_gss_krb5 module MODULE NAME BASE SIZE OBJECT FILE ffffffffa01de380 ost ffffffffa01db000 19298 /tmp/crash-anaysis.0wU2E/modules/ost.ko mod: cannot find or load object file for edac_core module ffffffffa020a1a0 fid ffffffffa01fd000 80015 /tmp/crash-anaysis.0wU2E/modules/fid.ko ffffffffa022e620 libcfs ffffffffa0218000 143496 /tmp/crash-anaysis.0wU2E/modules/libcfs.ko ffffffffa024b7e0 fld ffffffffa023d000 88713 /tmp/crash-anaysis.0wU2E/modules/fld.ko mod: cannot find or load object file for squashfs module ffffffffa0287120 obdecho ffffffffa026e000 151561 /tmp/crash-anaysis.0wU2E/modules/obdecho.ko ffffffffa02bb880 ksocklnd ffffffffa029d000 182458 /tmp/crash-anaysis.0wU2E/modules/ksocklnd.ko ffffffffa02f6860 lmv ffffffffa02cb000 234745 /tmp/crash-anaysis.0wU2E/modules/lmv.ko mod: cannot find or load object file for kvm module ffffffffa0436b00 lnet ffffffffa03aa000 907535 /tmp/crash-anaysis.0wU2E/modules/lnet.ko ffffffffa04c1e60 ptlrpc_gss ffffffffa0489000 342028 /tmp/crash-anaysis.0wU2E/modules/ptlrpc_gss.ko ffffffffa04f0920 mgc ffffffffa04de000 109376 /tmp/crash-anaysis.0wU2E/modules/mgc.ko mod: cannot find or load object file for kvm_intel module ffffffffa0615940 obdclass ffffffffa0546000 2668406 /tmp/crash-anaysis.0wU2E/modules/obdclass.ko ffffffffa0982ee0 ptlrpc ffffffffa07d3000 2543957 /tmp/crash-anaysis.0wU2E/modules/ptlrpc.ko ffffffffa0a8dcc0 osc ffffffffa0a42000 427723 /tmp/crash-anaysis.0wU2E/modules/osc.ko ffffffffa0ae65a0 lov ffffffffa0aac000 332319 /tmp/crash-anaysis.0wU2E/modules/lov.ko ffffffffa0b318a0 mdc ffffffffa0aff000 276573 /tmp/crash-anaysis.0wU2E/modules/mdc.ko ffffffffa0bdc240 lfsck ffffffffa0b44000 786939 /tmp/crash-anaysis.0wU2E/modules/lfsck.ko ffffffffa0c7e400 lquota ffffffffa0c28000 472644 /tmp/crash-anaysis.0wU2E/modules/lquota.ko ffffffffa0ce0120 mgs ffffffffa0c9d000 369598 /tmp/crash-anaysis.0wU2E/modules/mgs.ko ffffffffa0d55f40 mdd ffffffffa0cf9000 497497 /tmp/crash-anaysis.0wU2E/modules/mdd.ko ffffffffa0e2dca0 mdt ffffffffa0d74000 1023391 /tmp/crash-anaysis.0wU2E/modules/mdt.ko ffffffffa0ee8ac0 lod ffffffffa0e6f000 660567 /tmp/crash-anaysis.0wU2E/modules/lod.ko ffffffffa0f77680 ofd ffffffffa0f34000 365899 /tmp/crash-anaysis.0wU2E/modules/ofd.ko ffffffffa0fcd2a0 osp ffffffffa0f8f000 346300 /tmp/crash-anaysis.0wU2E/modules/osp.ko ffffffffa10af500 lustre ffffffffa0fe5000 1099676 /tmp/crash-anaysis.0wU2E/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b3fdee28) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 643 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff8800b5910108) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 984 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800b0032628) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff88012b774808) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff88012a43c3e8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800b59fa108) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 3677 total debug pages from 4 CPUs to /tmp/crash-anaysis.0wU2E/lustre.bin