crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. please wait... (sorting flat format data) please wait... (sorting flat format data: 1%) please wait... (sorting flat format data: 2%) please wait... (sorting flat format data: 3%) please wait... (sorting flat format data: 4%) please wait... (sorting flat format data: 5%) please wait... (sorting flat format data: 6%) please wait... (sorting flat format data: 7%) please wait... (sorting flat format data: 8%) please wait... (sorting flat format data: 9%) please wait... (sorting flat format data: 10%) please wait... (sorting flat format data: 11%) please wait... (sorting flat format data: 12%) please wait... (sorting flat format data: 13%) please wait... (sorting flat format data: 14%) please wait... (sorting flat format data: 15%) please wait... (sorting flat format data: 16%) please wait... (sorting flat format data: 17%) please wait... (sorting flat format data: 18%) please wait... (sorting flat format data: 19%) please wait... (sorting flat format data: 20%) please wait... (sorting flat format data: 21%) please wait... (sorting flat format data: 22%) please wait... (sorting flat format data: 23%) please wait... (sorting flat format data: 24%) please wait... (sorting flat format data: 25%) please wait... (sorting flat format data: 26%) please wait... (sorting flat format data: 27%) please wait... (sorting flat format data: 28%) please wait... (sorting flat format data: 29%) please wait... (sorting flat format data: 30%) please wait... (sorting flat format data: 31%) please wait... (sorting flat format data: 32%) please wait... (sorting flat format data: 33%) please wait... (sorting flat format data: 34%) please wait... (sorting flat format data: 35%) please wait... (sorting flat format data: 36%) please wait... (sorting flat format data: 37%) please wait... (sorting flat format data: 38%) please wait... (sorting flat format data: 39%) please wait... (sorting flat format data: 40%) please wait... (sorting flat format data: 41%) please wait... (sorting flat format data: 42%) please wait... (sorting flat format data: 43%) please wait... (sorting flat format data: 44%) please wait... (sorting flat format data: 45%) please wait... (sorting flat format data: 46%) please wait... (sorting flat format data: 47%) please wait... (sorting flat format data: 48%) please wait... (sorting flat format data: 49%) please wait... (sorting flat format data: 50%) please wait... (sorting flat format data: 51%) please wait... (sorting flat format data: 52%) please wait... (sorting flat format data: 53%) please wait... (sorting flat format data: 54%) please wait... (sorting flat format data: 55%) please wait... (sorting flat format data: 56%) please wait... (sorting flat format data: 57%) please wait... (sorting flat format data: 58%) please wait... (sorting flat format data: 59%) please wait... (sorting flat format data: 60%) please wait... (sorting flat format data: 61%) please wait... (sorting flat format data: 62%) please wait... (sorting flat format data: 63%) please wait... (sorting flat format data: 64%) please wait... (sorting flat format data: 65%) please wait... (sorting flat format data: 66%) please wait... (sorting flat format data: 67%) please wait... (sorting flat format data: 68%) please wait... (sorting flat format data: 69%) please wait... (sorting flat format data: 70%) please wait... (sorting flat format data: 71%) please wait... (sorting flat format data: 72%) please wait... (sorting flat format data: 73%) please wait... (sorting flat format data: 74%) please wait... (sorting flat format data: 75%) please wait... (sorting flat format data: 76%) please wait... (sorting flat format data: 77%) please wait... (sorting flat format data: 78%) please wait... (sorting flat format data: 79%) please wait... (sorting flat format data: 80%) please wait... (sorting flat format data: 81%) please wait... (sorting flat format data: 82%) please wait... (sorting flat format data: 83%) please wait... (sorting flat format data: 84%) please wait... (sorting flat format data: 85%) please wait... (sorting flat format data: 86%) please wait... (sorting flat format data: 87%) please wait... (sorting flat format data: 88%) please wait... (sorting flat format data: 89%) please wait... (sorting flat format data: 90%) please wait... (sorting flat format data: 91%) please wait... (sorting flat format data: 92%) please wait... (sorting flat format data: 93%) please wait... (sorting flat format data: 94%) please wait... (sorting flat format data: 95%) please wait... (sorting flat format data: 96%) please wait... (sorting flat format data: 97%) please wait... (sorting flat format data: 98%) please wait... (sorting flat format data: 99%) NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.TULGM/vmlinux [TAINTED] DUMPFILE: /exports/testreports/42551/testresults/sanity-pcc-zfs-centos7_x86_64-centos7_x86_64/oleg150-server-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Wed May 8 18:34:16 EDT 2024 UPTIME: 00:33:26 LOAD AVERAGE: 0.00, 0.01, 0.05 TASKS: 388 NODENAME: oleg150-server.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "" PID: 0 COMMAND: "swapper/0" TASK: ffffffff81c18480 (1 of 4) [THREAD_INFO: ffffffff81c00000] CPU: 0 STATE: TASK_RUNNING (ACTIVE) WARNING: panic task not found Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for lrw module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for crc_t10dif module MODULE NAME BASE SIZE OBJECT FILE ffffffffa01b51a0 fid ffffffffa01a8000 80015 /tmp/crash-anaysis.TULGM/modules/fid.ko mod: cannot find or load object file for zavl module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for kvm module mod: cannot find or load object file for edac_core module mod: cannot find or load object file for sb_edac module ffffffffa02c0620 libcfs ffffffffa02aa000 143496 /tmp/crash-anaysis.TULGM/modules/libcfs.ko ffffffffa02d2380 ost ffffffffa02cf000 19298 /tmp/crash-anaysis.TULGM/modules/ost.ko ffffffffa036cb00 lnet ffffffffa02e0000 907535 /tmp/crash-anaysis.TULGM/modules/lnet.ko ffffffffa03cd7e0 fld ffffffffa03bf000 88713 /tmp/crash-anaysis.TULGM/modules/fld.ko ffffffffa040c880 ksocklnd ffffffffa03ee000 182458 /tmp/crash-anaysis.TULGM/modules/ksocklnd.ko ffffffffa0454e60 ptlrpc_gss ffffffffa041c000 342028 /tmp/crash-anaysis.TULGM/modules/ptlrpc_gss.ko ffffffffa049c860 lmv ffffffffa0471000 234745 /tmp/crash-anaysis.TULGM/modules/lmv.ko ffffffffa04f7cc0 osc ffffffffa04ac000 427723 /tmp/crash-anaysis.TULGM/modules/osc.ko mod: cannot find or load object file for kvm_intel module ffffffffa062a940 obdclass ffffffffa055b000 2668406 /tmp/crash-anaysis.TULGM/modules/obdclass.ko ffffffffa0997ee0 ptlrpc ffffffffa07e8000 2543957 /tmp/crash-anaysis.TULGM/modules/ptlrpc.ko mod: cannot find or load object file for znvpair module ffffffffa0aac5a0 lov ffffffffa0a72000 332319 /tmp/crash-anaysis.TULGM/modules/lov.ko ffffffffa0af78a0 mdc ffffffffa0ac5000 276573 /tmp/crash-anaysis.TULGM/modules/mdc.ko ffffffffa0b1c920 mgc ffffffffa0b0a000 109376 /tmp/crash-anaysis.TULGM/modules/mgc.ko ffffffffa0b3f120 obdecho ffffffffa0b26000 151561 /tmp/crash-anaysis.TULGM/modules/obdecho.ko ffffffffa0be5240 lfsck ffffffffa0b4d000 786939 /tmp/crash-anaysis.TULGM/modules/lfsck.ko mod: cannot find or load object file for spl module ffffffffa0c87400 lquota ffffffffa0c31000 472644 /tmp/crash-anaysis.TULGM/modules/lquota.ko mod: cannot find or load object file for icp module mod: cannot find or load object file for zcommon module mod: cannot find or load object file for zlua module mod: cannot find or load object file for zunicode module mod: cannot find or load object file for zfs module ffffffffa1276120 mgs ffffffffa1233000 369598 /tmp/crash-anaysis.TULGM/modules/mgs.ko ffffffffa12ee8c0 osd_zfs ffffffffa12a7000 394824 /tmp/crash-anaysis.TULGM/modules/osd_zfs.ko ffffffffa1365f40 mdd ffffffffa1309000 497497 /tmp/crash-anaysis.TULGM/modules/mdd.ko ffffffffa1457ca0 mdt ffffffffa139e000 1023391 /tmp/crash-anaysis.TULGM/modules/mdt.ko ffffffffa1512ac0 lod ffffffffa1499000 660567 /tmp/crash-anaysis.TULGM/modules/lod.ko ffffffffa15a1680 ofd ffffffffa155e000 365899 /tmp/crash-anaysis.TULGM/modules/ofd.ko ffffffffa15f72a0 osp ffffffffa15b9000 346300 /tmp/crash-anaysis.TULGM/modules/osp.ko ffffffffa16d9500 lustre ffffffffa160f000 1099676 /tmp/crash-anaysis.TULGM/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff88012e884d88) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 673 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff8800b24078a8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 527 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800b1e14d48) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 701 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800b1e4d9c8) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 508 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b4b25468) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff8800a9637408) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800a65b8968) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff88012a3b77e8) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 2413 total debug pages from 4 CPUs to /tmp/crash-anaysis.TULGM/lustre.bin