crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. please wait... (sorting flat format data) please wait... (sorting flat format data: 1%) please wait... (sorting flat format data: 2%) please wait... (sorting flat format data: 3%) please wait... (sorting flat format data: 4%) please wait... (sorting flat format data: 5%) please wait... (sorting flat format data: 6%) please wait... (sorting flat format data: 7%) please wait... (sorting flat format data: 8%) please wait... (sorting flat format data: 9%) please wait... (sorting flat format data: 10%) please wait... (sorting flat format data: 11%) please wait... (sorting flat format data: 12%) please wait... (sorting flat format data: 13%) please wait... (sorting flat format data: 14%) please wait... (sorting flat format data: 15%) please wait... (sorting flat format data: 16%) please wait... (sorting flat format data: 17%) please wait... (sorting flat format data: 18%) please wait... (sorting flat format data: 19%) please wait... (sorting flat format data: 20%) please wait... (sorting flat format data: 21%) please wait... (sorting flat format data: 22%) please wait... (sorting flat format data: 23%) please wait... (sorting flat format data: 24%) please wait... (sorting flat format data: 25%) please wait... (sorting flat format data: 26%) please wait... (sorting flat format data: 27%) please wait... (sorting flat format data: 28%) please wait... (sorting flat format data: 29%) please wait... (sorting flat format data: 30%) please wait... (sorting flat format data: 31%) please wait... (sorting flat format data: 32%) please wait... (sorting flat format data: 33%) please wait... (sorting flat format data: 34%) please wait... (sorting flat format data: 35%) please wait... (sorting flat format data: 36%) please wait... (sorting flat format data: 37%) please wait... (sorting flat format data: 38%) please wait... (sorting flat format data: 39%) please wait... (sorting flat format data: 40%) please wait... (sorting flat format data: 41%) please wait... (sorting flat format data: 42%) please wait... (sorting flat format data: 43%) please wait... (sorting flat format data: 44%) please wait... (sorting flat format data: 45%) please wait... (sorting flat format data: 46%) please wait... (sorting flat format data: 47%) please wait... (sorting flat format data: 48%) please wait... (sorting flat format data: 49%) please wait... (sorting flat format data: 50%) please wait... (sorting flat format data: 51%) please wait... (sorting flat format data: 52%) please wait... (sorting flat format data: 53%) please wait... (sorting flat format data: 54%) please wait... (sorting flat format data: 55%) please wait... (sorting flat format data: 56%) please wait... (sorting flat format data: 57%) please wait... (sorting flat format data: 58%) please wait... (sorting flat format data: 59%) please wait... (sorting flat format data: 60%) please wait... (sorting flat format data: 61%) please wait... (sorting flat format data: 62%) please wait... (sorting flat format data: 63%) please wait... (sorting flat format data: 64%) please wait... (sorting flat format data: 65%) please wait... (sorting flat format data: 66%) please wait... (sorting flat format data: 67%) please wait... (sorting flat format data: 68%) please wait... (sorting flat format data: 69%) please wait... (sorting flat format data: 70%) please wait... (sorting flat format data: 71%) please wait... (sorting flat format data: 72%) please wait... (sorting flat format data: 73%) please wait... (sorting flat format data: 74%) please wait... (sorting flat format data: 75%) please wait... (sorting flat format data: 76%) please wait... (sorting flat format data: 77%) please wait... (sorting flat format data: 78%) please wait... (sorting flat format data: 79%) please wait... (sorting flat format data: 80%) please wait... (sorting flat format data: 81%) please wait... (sorting flat format data: 82%) please wait... (sorting flat format data: 83%) please wait... (sorting flat format data: 84%) please wait... (sorting flat format data: 85%) please wait... (sorting flat format data: 86%) please wait... (sorting flat format data: 87%) please wait... (sorting flat format data: 88%) please wait... (sorting flat format data: 89%) please wait... (sorting flat format data: 90%) please wait... (sorting flat format data: 91%) please wait... (sorting flat format data: 92%) please wait... (sorting flat format data: 93%) please wait... (sorting flat format data: 94%) please wait... (sorting flat format data: 95%) please wait... (sorting flat format data: 96%) please wait... (sorting flat format data: 97%) please wait... (sorting flat format data: 98%) please wait... (sorting flat format data: 99%) NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.IkiUB/vmlinux [TAINTED] DUMPFILE: /exports/testreports/51305/testresults/sanity2-zfs-centos7_x86_64-centos7_x86_64/oleg311-client-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Fri May 2 03:35:46 EDT 2025 UPTIME: 04:13:43 LOAD AVERAGE: 0.00, 0.01, 0.05 TASKS: 151 NODENAME: oleg311-client.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "" PID: 0 COMMAND: "swapper/0" TASK: ffffffff81c18480 (1 of 4) [THREAD_INFO: ffffffff81c00000] CPU: 0 STATE: TASK_RUNNING (ACTIVE) WARNING: panic task not found Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for lrw module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for sb_edac module mod: cannot find or load object file for iosf_mbi module MODULE NAME BASE SIZE OBJECT FILE ffffffffa01e6c20 mgc ffffffffa01d3000 114311 /tmp/crash-anaysis.IkiUB/modules/mgc.ko mod: cannot find or load object file for inet_diag module mod: cannot find or load object file for edac_core module ffffffffa02223a0 libcfs ffffffffa0215000 86805 /tmp/crash-anaysis.IkiUB/modules/libcfs.ko ffffffffa02396e0 fld ffffffffa022c000 84453 /tmp/crash-anaysis.IkiUB/modules/fld.ko mod: cannot find or load object file for tcp_diag module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for kvm module ffffffffa03a1fe0 lnet ffffffffa030f000 938755 /tmp/crash-anaysis.IkiUB/modules/lnet.ko ffffffffa0404160 fid ffffffffa03f6000 84802 /tmp/crash-anaysis.IkiUB/modules/fid.ko ffffffffa04448a0 ksocklnd ffffffffa0427000 173659 /tmp/crash-anaysis.IkiUB/modules/ksocklnd.ko ffffffffa048ba20 ptlrpc_gss ffffffffa0453000 336904 /tmp/crash-anaysis.IkiUB/modules/ptlrpc_gss.ko ffffffffa04d2700 lmv ffffffffa04a7000 234641 /tmp/crash-anaysis.IkiUB/modules/lmv.ko ffffffffa04fa060 obdecho ffffffffa04e2000 143140 /tmp/crash-anaysis.IkiUB/modules/obdecho.ko mod: cannot find or load object file for kvm_intel module ffffffffa06244e0 obdclass ffffffffa0549000 2742226 /tmp/crash-anaysis.IkiUB/modules/obdclass.ko ffffffffa09aa8c0 ptlrpc ffffffffa07e8000 2637991 /tmp/crash-anaysis.IkiUB/modules/ptlrpc.ko ffffffffa0abe420 osc ffffffffa0a6e000 447869 /tmp/crash-anaysis.IkiUB/modules/osc.ko ffffffffa0b199a0 lov ffffffffa0add000 341620 /tmp/crash-anaysis.IkiUB/modules/lov.ko ffffffffa0b64c00 mdc ffffffffa0b32000 276988 /tmp/crash-anaysis.IkiUB/modules/mdc.ko ffffffffa0c0cbc0 lfsck ffffffffa0b77000 772474 /tmp/crash-anaysis.IkiUB/modules/lfsck.ko ffffffffa0cab2a0 lquota ffffffffa0c57000 464257 /tmp/crash-anaysis.IkiUB/modules/lquota.ko ffffffffa0d0e120 mgs ffffffffa0cca000 374304 /tmp/crash-anaysis.IkiUB/modules/mgs.ko ffffffffa0d84f00 mdd ffffffffa0d27000 502753 /tmp/crash-anaysis.IkiUB/modules/mdd.ko ffffffffa0e7b620 mdt ffffffffa0dbe000 1043385 /tmp/crash-anaysis.IkiUB/modules/mdt.ko ffffffffa0f6e620 lod ffffffffa0ef5000 665397 /tmp/crash-anaysis.IkiUB/modules/lod.ko ffffffffa1001dc0 ofd ffffffffa0fbb000 386197 /tmp/crash-anaysis.IkiUB/modules/ofd.ko ffffffffa105b300 osp ffffffffa101b000 358704 /tmp/crash-anaysis.IkiUB/modules/osp.ko ffffffffa11452c0 lustre ffffffffa1074000 1141296 /tmp/crash-anaysis.IkiUB/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800898ac468) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff880087c32fa8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800a993f388) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800a83c2e08) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800a9ad9a88) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88008de40568) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff880135941768) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800a78d82e8) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 4608 total debug pages from 4 CPUs to /tmp/crash-anaysis.IkiUB/lustre.bin