crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.c8FqN/vmlinux [TAINTED] DUMPFILE: /exports/testreports/38859/testresults/racer-special4-ldiskfs-centos7_x86_64-centos7_x86_64/oleg206-server-vmcore [PARTIAL DUMP] CPUS: 4 DATE: Fri Jan 19 11:59:59 EST 2024 UPTIME: 00:06:12 LOAD AVERAGE: 2.05, 1.66, 0.74 TASKS: 257 NODENAME: oleg206-server.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "Kernel panic - not syncing: LBUG" PID: 12171 COMMAND: "mdt00_013" TASK: ffff8800a9bf8000 [THREAD_INFO: ffff880077770000] CPU: 3 STATE: TASK_RUNNING (PANIC) Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for dm_flakey module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for dm_mod module MODULE NAME BASE SIZE OBJECT FILE ffffffffa01abd20 libcfs ffffffffa018d000 197564 /tmp/crash-anaysis.c8FqN/modules/libcfs.ko mod: cannot find or load object file for crc32_generic module ffffffffa01c62c0 ost ffffffffa01c4000 14929 /tmp/crash-anaysis.c8FqN/modules/ost.ko ffffffffa024bf00 lnet ffffffffa01ca000 837600 /tmp/crash-anaysis.c8FqN/modules/lnet.ko ffffffffa02a51a0 fid ffffffffa0298000 80093 /tmp/crash-anaysis.c8FqN/modules/fid.ko mod: cannot find or load object file for zavl module ffffffffa02e0880 ksocklnd ffffffffa02c3000 178176 /tmp/crash-anaysis.c8FqN/modules/ksocklnd.ko ffffffffa03c3b60 obdclass ffffffffa02fd000 2617259 /tmp/crash-anaysis.c8FqN/modules/obdclass.ko ffffffffa05b5e60 ptlrpc_gss ffffffffa057d000 342450 /tmp/crash-anaysis.c8FqN/modules/ptlrpc_gss.ko ffffffffa0784c00 ptlrpc ffffffffa05d4000 2556109 /tmp/crash-anaysis.c8FqN/modules/ptlrpc.ko ffffffffa08547e0 fld ffffffffa0846000 88791 /tmp/crash-anaysis.c8FqN/modules/fld.ko ffffffffa0885640 lmv ffffffffa085d000 220900 /tmp/crash-anaysis.c8FqN/modules/lmv.ko ffffffffa08ebc00 osc ffffffffa08a1000 422912 /tmp/crash-anaysis.c8FqN/modules/osc.ko mod: cannot find or load object file for znvpair module ffffffffa095f3e0 lov ffffffffa0925000 327619 /tmp/crash-anaysis.c8FqN/modules/lov.ko ffffffffa09a74e0 mdc ffffffffa0976000 271621 /tmp/crash-anaysis.c8FqN/modules/mdc.ko ffffffffa09cc920 mgc ffffffffa09ba000 109452 /tmp/crash-anaysis.c8FqN/modules/mgc.ko ffffffffa09ef120 obdecho ffffffffa09d6000 151561 /tmp/crash-anaysis.c8FqN/modules/obdecho.ko ffffffffa0a94200 lfsck ffffffffa09fd000 782273 /tmp/crash-anaysis.c8FqN/modules/lfsck.ko mod: cannot find or load object file for spl module ffffffffa0b351c0 lquota ffffffffa0adf000 471771 /tmp/crash-anaysis.c8FqN/modules/lquota.ko ffffffffa0bd5980 ldiskfs ffffffffa0b54000 650700 /tmp/crash-anaysis.c8FqN/modules/ldiskfs.ko mod: cannot find or load object file for zcommon module ffffffffa0c85c60 osd_ldiskfs ffffffffa0c1c000 572171 /tmp/crash-anaysis.c8FqN/modules/osd_ldiskfs.ko ffffffffa0ced1a0 mgs ffffffffa0ca9000 373688 /tmp/crash-anaysis.c8FqN/modules/mgs.ko ffffffffa0d620c0 mdd ffffffffa0d06000 494108 /tmp/crash-anaysis.c8FqN/modules/mdd.ko ffffffffa0e378a0 mdt ffffffffa0d80000 1013645 /tmp/crash-anaysis.c8FqN/modules/mdt.ko ffffffffa0ef28c0 lod ffffffffa0e79000 660276 /tmp/crash-anaysis.c8FqN/modules/lod.ko ffffffffa0f5a2e0 osp ffffffffa0f1c000 346512 /tmp/crash-anaysis.c8FqN/modules/osp.ko ffffffffa0fb45c0 ofd ffffffffa0f72000 361622 /tmp/crash-anaysis.c8FqN/modules/ofd.ko ffffffffa108b040 lustre ffffffffa0fcc000 1039496 /tmp/crash-anaysis.c8FqN/modules/lustre.ko mod: cannot find or load object file for icp module mod: cannot find or load object file for zlua module mod: cannot find or load object file for zunicode module mod: cannot find or load object file for zfs module lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b24b9828) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88012da8f848) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800a8a794c8) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff880130f491e8) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff88006e016d28) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800a89eae08) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff88012db4dac8) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 1639 total debug pages from 4 CPUs to /tmp/crash-anaysis.c8FqN/lustre.bin