crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. please wait... (sorting flat format data) please wait... (sorting flat format data: 1%) please wait... (sorting flat format data: 2%) please wait... (sorting flat format data: 3%) please wait... (sorting flat format data: 4%) please wait... (sorting flat format data: 5%) please wait... (sorting flat format data: 6%) please wait... (sorting flat format data: 7%) please wait... (sorting flat format data: 8%) please wait... (sorting flat format data: 9%) please wait... (sorting flat format data: 10%) please wait... (sorting flat format data: 11%) please wait... (sorting flat format data: 12%) please wait... (sorting flat format data: 13%) please wait... (sorting flat format data: 14%) please wait... (sorting flat format data: 15%) please wait... (sorting flat format data: 16%) please wait... (sorting flat format data: 17%) please wait... (sorting flat format data: 18%) please wait... (sorting flat format data: 19%) please wait... (sorting flat format data: 20%) please wait... (sorting flat format data: 21%) please wait... (sorting flat format data: 22%) please wait... (sorting flat format data: 23%) please wait... (sorting flat format data: 24%) please wait... (sorting flat format data: 25%) please wait... (sorting flat format data: 26%) please wait... (sorting flat format data: 27%) please wait... (sorting flat format data: 28%) please wait... (sorting flat format data: 29%) please wait... (sorting flat format data: 30%) please wait... (sorting flat format data: 31%) please wait... (sorting flat format data: 32%) please wait... (sorting flat format data: 33%) please wait... (sorting flat format data: 34%) please wait... (sorting flat format data: 35%) please wait... (sorting flat format data: 36%) please wait... (sorting flat format data: 37%) please wait... (sorting flat format data: 38%) please wait... (sorting flat format data: 39%) please wait... (sorting flat format data: 40%) please wait... (sorting flat format data: 41%) please wait... (sorting flat format data: 42%) please wait... (sorting flat format data: 43%) please wait... (sorting flat format data: 44%) please wait... (sorting flat format data: 45%) please wait... (sorting flat format data: 46%) please wait... (sorting flat format data: 47%) please wait... (sorting flat format data: 48%) please wait... (sorting flat format data: 49%) please wait... (sorting flat format data: 50%) please wait... (sorting flat format data: 51%) please wait... (sorting flat format data: 52%) please wait... (sorting flat format data: 53%) please wait... (sorting flat format data: 54%) please wait... (sorting flat format data: 55%) please wait... (sorting flat format data: 56%) please wait... (sorting flat format data: 57%) please wait... (sorting flat format data: 58%) please wait... (sorting flat format data: 59%) please wait... (sorting flat format data: 60%) please wait... (sorting flat format data: 61%) please wait... (sorting flat format data: 62%) please wait... (sorting flat format data: 63%) please wait... (sorting flat format data: 64%) please wait... (sorting flat format data: 65%) please wait... (sorting flat format data: 66%) please wait... (sorting flat format data: 67%) please wait... (sorting flat format data: 68%) please wait... (sorting flat format data: 69%) please wait... (sorting flat format data: 70%) please wait... (sorting flat format data: 71%) please wait... (sorting flat format data: 72%) please wait... (sorting flat format data: 73%) please wait... (sorting flat format data: 74%) please wait... (sorting flat format data: 75%) please wait... (sorting flat format data: 76%) please wait... (sorting flat format data: 77%) please wait... (sorting flat format data: 78%) please wait... (sorting flat format data: 79%) please wait... (sorting flat format data: 80%) please wait... (sorting flat format data: 81%) please wait... (sorting flat format data: 82%) please wait... (sorting flat format data: 83%) please wait... (sorting flat format data: 84%) please wait... (sorting flat format data: 85%) please wait... (sorting flat format data: 86%) please wait... (sorting flat format data: 87%) please wait... (sorting flat format data: 88%) please wait... (sorting flat format data: 89%) please wait... (sorting flat format data: 90%) please wait... (sorting flat format data: 91%) please wait... (sorting flat format data: 92%) please wait... (sorting flat format data: 93%) please wait... (sorting flat format data: 94%) please wait... (sorting flat format data: 95%) please wait... (sorting flat format data: 96%) please wait... (sorting flat format data: 97%) please wait... (sorting flat format data: 98%) please wait... (sorting flat format data: 99%) NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.vsNuj/vmlinux [TAINTED] DUMPFILE: /exports/testreports/47916/testresults/conf-sanity3-zfs-centos7_x86_64-centos7_x86_64/oleg453-server-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Sun Dec 15 05:49:45 EST 2024 UPTIME: 01:20:30 LOAD AVERAGE: 0.00, 0.01, 0.05 TASKS: 284 NODENAME: oleg453-server.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2400 Mhz) MEMORY: 4 GB PANIC: "" PID: 0 COMMAND: "swapper/0" TASK: ffffffff81c18480 (1 of 4) [THREAD_INFO: ffffffff81c00000] CPU: 0 STATE: TASK_RUNNING (ACTIVE) WARNING: panic task not found Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for lrw module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for zavl module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for edac_core module mod: cannot find or load object file for kvm module mod: cannot find or load object file for sb_edac module mod: cannot find or load object file for rpcsec_gss_krb5 module MODULE NAME BASE SIZE OBJECT FILE ffffffffa029c160 fid ffffffffa028e000 84802 /tmp/crash-anaysis.vsNuj/modules/fid.ko ffffffffa02bc360 libcfs ffffffffa02a7000 132473 /tmp/crash-anaysis.vsNuj/modules/libcfs.ko ffffffffa02cc380 ost ffffffffa02c9000 19298 /tmp/crash-anaysis.vsNuj/modules/ost.ko ffffffffa036e0c0 lnet ffffffffa02db000 937331 /tmp/crash-anaysis.vsNuj/modules/lnet.ko ffffffffa03ce6e0 fld ffffffffa03c1000 84453 /tmp/crash-anaysis.vsNuj/modules/fld.ko ffffffffa040f8a0 ksocklnd ffffffffa03f2000 173554 /tmp/crash-anaysis.vsNuj/modules/ksocklnd.ko ffffffffa0456a40 ptlrpc_gss ffffffffa041e000 337040 /tmp/crash-anaysis.vsNuj/modules/ptlrpc_gss.ko ffffffffa049d860 lmv ffffffffa0472000 234913 /tmp/crash-anaysis.vsNuj/modules/lmv.ko ffffffffa04e0d20 mdc ffffffffa04ad000 286133 /tmp/crash-anaysis.vsNuj/modules/mdc.ko mod: cannot find or load object file for kvm_intel module ffffffffa06146e0 obdclass ffffffffa0545000 2669029 /tmp/crash-anaysis.vsNuj/modules/obdclass.ko ffffffffa0987560 ptlrpc ffffffffa07d2000 2567590 /tmp/crash-anaysis.vsNuj/modules/ptlrpc.ko mod: cannot find or load object file for znvpair module ffffffffa0aac020 osc ffffffffa0a5f000 437181 /tmp/crash-anaysis.vsNuj/modules/osc.ko ffffffffa0b05760 lov ffffffffa0acb000 332376 /tmp/crash-anaysis.vsNuj/modules/lov.ko ffffffffa0b30c20 mgc ffffffffa0b1e000 110215 /tmp/crash-anaysis.vsNuj/modules/mgc.ko ffffffffa0b53120 obdecho ffffffffa0b3a000 151561 /tmp/crash-anaysis.vsNuj/modules/obdecho.ko ffffffffa0bab200 osd_zfs ffffffffa0b61000 408902 /tmp/crash-anaysis.vsNuj/modules/osd_zfs.ko mod: cannot find or load object file for spl module ffffffffa0c50200 lquota ffffffffa0bfa000 472384 /tmp/crash-anaysis.vsNuj/modules/lquota.ko mod: cannot find or load object file for icp module mod: cannot find or load object file for zcommon module mod: cannot find or load object file for zlua module mod: cannot find or load object file for zzstd module mod: cannot find or load object file for zunicode module mod: cannot find or load object file for zfs module ffffffffa12578c0 lfsck ffffffffa11c1000 776530 /tmp/crash-anaysis.vsNuj/modules/lfsck.ko ffffffffa12c3120 mgs ffffffffa1280000 370169 /tmp/crash-anaysis.vsNuj/modules/mgs.ko ffffffffa1336980 mdd ffffffffa12dc000 488914 /tmp/crash-anaysis.vsNuj/modules/mdd.ko ffffffffa1411560 mdt ffffffffa1355000 1038385 /tmp/crash-anaysis.vsNuj/modules/mdt.ko ffffffffa14cd620 lod ffffffffa1454000 660881 /tmp/crash-anaysis.vsNuj/modules/lod.ko ffffffffa155b320 ofd ffffffffa1519000 361380 /tmp/crash-anaysis.vsNuj/modules/ofd.ko ffffffffa15b33c0 osp ffffffffa1573000 358935 /tmp/crash-anaysis.vsNuj/modules/osp.ko ffffffffa16a3c80 lustre ffffffffa15cc000 1168545 /tmp/crash-anaysis.vsNuj/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8801364b81a8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff8800abfb0fa8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff880094ee2b08) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff880094ce9828) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff880091acf928) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff880130d37e48) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800a5a8f8a8) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff880090f26568) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 128 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 4608 total debug pages from 4 CPUs to /tmp/crash-anaysis.vsNuj/lustre.bin