crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.Iz65P/vmlinux [TAINTED] DUMPFILE: /exports/testreports/45132/testresults/replay-single-zfs-centos7_x86_64-centos7_x86_64/oleg407-server-vmcore [PARTIAL DUMP] CPUS: 4 DATE: Thu Aug 22 02:16:23 EDT 2024 UPTIME: 00:49:45 LOAD AVERAGE: 1.11, 0.95, 0.85 TASKS: 325 NODENAME: oleg407-server.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "BUG: unable to handle kernel paging request at ffffffffffffffa1" PID: 26338 COMMAND: "mount.lustre" TASK: ffff8800a53e3330 [THREAD_INFO: ffff88009f744000] CPU: 0 STATE: TASK_RUNNING (PANIC) Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for lrw module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for kvm module mod: cannot find or load object file for sb_edac module mod: cannot find or load object file for rpcsec_gss_krb5 module MODULE NAME BASE SIZE OBJECT FILE ffffffffa028e160 fid ffffffffa0280000 84802 /tmp/crash-anaysis.Iz65P/modules/fid.ko mod: cannot find or load object file for edac_core module ffffffffa02be360 libcfs ffffffffa02a9000 132619 /tmp/crash-anaysis.Iz65P/modules/libcfs.ko ffffffffa02d86e0 fld ffffffffa02cb000 84453 /tmp/crash-anaysis.Iz65P/modules/fld.ko mod: cannot find or load object file for zavl module ffffffffa037d020 lnet ffffffffa02e7000 958904 /tmp/crash-anaysis.Iz65P/modules/lnet.ko ffffffffa03d6380 ost ffffffffa03d3000 19298 /tmp/crash-anaysis.Iz65P/modules/ost.ko ffffffffa03f7140 obdecho ffffffffa03dc000 159917 /tmp/crash-anaysis.Iz65P/modules/obdecho.ko ffffffffa04238a0 ksocklnd ffffffffa0405000 182768 /tmp/crash-anaysis.Iz65P/modules/ksocklnd.ko ffffffffa046bda0 ptlrpc_gss ffffffffa0433000 342061 /tmp/crash-anaysis.Iz65P/modules/ptlrpc_gss.ko ffffffffa04b2760 lmv ffffffffa0488000 230401 /tmp/crash-anaysis.Iz65P/modules/lmv.ko ffffffffa04f48a0 mdc ffffffffa04c2000 276564 /tmp/crash-anaysis.Iz65P/modules/mdc.ko mod: cannot find or load object file for kvm_intel module ffffffffa0604300 obdclass ffffffffa0537000 2652917 /tmp/crash-anaysis.Iz65P/modules/obdclass.ko ffffffffa09706a0 ptlrpc ffffffffa07c0000 2543392 /tmp/crash-anaysis.Iz65P/modules/ptlrpc.ko ffffffffa0a79d80 osc ffffffffa0a2e000 427807 /tmp/crash-anaysis.Iz65P/modules/osc.ko ffffffffa0ad26e0 lov ffffffffa0a98000 332465 /tmp/crash-anaysis.Iz65P/modules/lov.ko ffffffffa0afda20 mgc ffffffffa0aeb000 109604 /tmp/crash-anaysis.Iz65P/modules/mgc.ko ffffffffa0ba88c0 lfsck ffffffffa0b12000 776311 /tmp/crash-anaysis.Iz65P/modules/lfsck.ko mod: cannot find or load object file for spl module ffffffffa0c49220 lquota ffffffffa0bf3000 472637 /tmp/crash-anaysis.Iz65P/modules/lquota.ko mod: cannot find or load object file for znvpair module mod: cannot find or load object file for icp module mod: cannot find or load object file for zcommon module mod: cannot find or load object file for zlua module mod: cannot find or load object file for zzstd module mod: cannot find or load object file for zunicode module mod: cannot find or load object file for zfs module ffffffffa12010e0 mgs ffffffffa11bd000 374066 /tmp/crash-anaysis.Iz65P/modules/mgs.ko ffffffffa12892c0 osd_zfs ffffffffa123f000 409237 /tmp/crash-anaysis.Iz65P/modules/osd_zfs.ko ffffffffa12fe980 mdd ffffffffa12a4000 489255 /tmp/crash-anaysis.Iz65P/modules/mdd.ko ffffffffa13f1ee0 mdt ffffffffa1337000 1028220 /tmp/crash-anaysis.Iz65P/modules/mdt.ko ffffffffa14ad5e0 lod ffffffffa1434000 660832 /tmp/crash-anaysis.Iz65P/modules/lod.ko ffffffffa15192c0 ofd ffffffffa14d7000 361151 /tmp/crash-anaysis.Iz65P/modules/ofd.ko ffffffffa1572480 osp ffffffffa1531000 363310 /tmp/crash-anaysis.Iz65P/modules/osp.ko ffffffffa165e900 lustre ffffffffa158b000 1144163 /tmp/crash-anaysis.Iz65P/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800a55bfce8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff880094e13308) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff880093bbfb28) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800a55bf428) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b3d784e8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff880136bef688) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800a50ca2c8) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800a50ca288) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff880129f9ab08) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 4101 total debug pages from 4 CPUs to /tmp/crash-anaysis.Iz65P/lustre.bin