crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.5VNB5/vmlinux [TAINTED] DUMPFILE: /exports/testreports/45618/testresults/sanity2-zfs-centos7_x86_64-centos7_x86_64/oleg217-server-vmcore [PARTIAL DUMP] CPUS: 4 DATE: Thu Sep 12 01:31:11 EDT 2024 UPTIME: 00:52:42 LOAD AVERAGE: 5.24, 2.68, 1.29 TASKS: 445 NODENAME: oleg217-server.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "Kernel panic - not syncing: LBUG" PID: 25515 COMMAND: "mdt_out00_003" TASK: ffff8800948a3330 [THREAD_INFO: ffff880120ef4000] CPU: 2 STATE: TASK_RUNNING (PANIC) Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for lrw module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for kvm module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for zavl module mod: cannot find or load object file for squashfs module MODULE NAME BASE SIZE OBJECT FILE ffffffffa028d160 fid ffffffffa027f000 84802 /tmp/crash-anaysis.5VNB5/modules/fid.ko mod: cannot find or load object file for edac_core module mod: cannot find or load object file for sb_edac module ffffffffa02c8360 libcfs ffffffffa02b3000 132473 /tmp/crash-anaysis.5VNB5/modules/libcfs.ko ffffffffa0367020 lnet ffffffffa02d5000 928646 /tmp/crash-anaysis.5VNB5/modules/lnet.ko ffffffffa03c66e0 fld ffffffffa03b9000 84453 /tmp/crash-anaysis.5VNB5/modules/fld.ko mod: cannot find or load object file for znvpair module ffffffffa04078a0 ksocklnd ffffffffa03ea000 173554 /tmp/crash-anaysis.5VNB5/modules/ksocklnd.ko ffffffffa044eda0 ptlrpc_gss ffffffffa0416000 342054 /tmp/crash-anaysis.5VNB5/modules/ptlrpc_gss.ko ffffffffa0495760 lmv ffffffffa046b000 230393 /tmp/crash-anaysis.5VNB5/modules/lmv.ko ffffffffa04a8380 ost ffffffffa04a5000 19298 /tmp/crash-anaysis.5VNB5/modules/ost.ko ffffffffa04ff020 osc ffffffffa04b2000 437181 /tmp/crash-anaysis.5VNB5/modules/osc.ko ffffffffa0537120 obdecho ffffffffa051e000 151561 /tmp/crash-anaysis.5VNB5/modules/obdecho.ko mod: cannot find or load object file for kvm_intel module ffffffffa0646020 obdclass ffffffffa0579000 2652011 /tmp/crash-anaysis.5VNB5/modules/obdclass.ko ffffffffa09b2700 ptlrpc ffffffffa0802000 2543139 /tmp/crash-anaysis.5VNB5/modules/ptlrpc.ko ffffffffa0aaa6a0 lov ffffffffa0a70000 332258 /tmp/crash-anaysis.5VNB5/modules/lov.ko ffffffffa0af5a20 mdc ffffffffa0ac3000 276995 /tmp/crash-anaysis.5VNB5/modules/mdc.ko ffffffffa0b1aa20 mgc ffffffffa0b08000 109604 /tmp/crash-anaysis.5VNB5/modules/mgc.ko ffffffffa0bba8c0 lfsck ffffffffa0b24000 776530 /tmp/crash-anaysis.5VNB5/modules/lfsck.ko mod: cannot find or load object file for spl module ffffffffa0c5b100 lquota ffffffffa0c05000 472157 /tmp/crash-anaysis.5VNB5/modules/lquota.ko mod: cannot find or load object file for icp module mod: cannot find or load object file for zcommon module mod: cannot find or load object file for zlua module mod: cannot find or load object file for zzstd module mod: cannot find or load object file for zunicode module mod: cannot find or load object file for zfs module ffffffffa1206120 mgs ffffffffa11c3000 370167 /tmp/crash-anaysis.5VNB5/modules/mgs.ko ffffffffa128f200 osd_zfs ffffffffa1245000 408902 /tmp/crash-anaysis.5VNB5/modules/osd_zfs.ko ffffffffa13049c0 mdd ffffffffa12aa000 489198 /tmp/crash-anaysis.5VNB5/modules/mdd.ko ffffffffa13f80e0 mdt ffffffffa133d000 1028900 /tmp/crash-anaysis.5VNB5/modules/mdt.ko ffffffffa14b4620 lod ffffffffa143a000 664969 /tmp/crash-anaysis.5VNB5/modules/lod.ko ffffffffa151f2c0 ofd ffffffffa14de000 357020 /tmp/crash-anaysis.5VNB5/modules/ofd.ko ffffffffa15773c0 osp ffffffffa1537000 358933 /tmp/crash-anaysis.5VNB5/modules/osp.ko ffffffffa1665b40 lustre ffffffffa1590000 1157906 /tmp/crash-anaysis.5VNB5/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b1e71428) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88012b5cfca8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff88012fe87588) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800925a8408) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8801212f0ea8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff8800b40fd868) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8801212f0108) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800b1806e68) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 4608 total debug pages from 4 CPUs to /tmp/crash-anaysis.5VNB5/lustre.bin