crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. please wait... (sorting flat format data) please wait... (sorting flat format data: 1%) please wait... (sorting flat format data: 2%) please wait... (sorting flat format data: 3%) please wait... (sorting flat format data: 4%) please wait... (sorting flat format data: 5%) please wait... (sorting flat format data: 6%) please wait... (sorting flat format data: 7%) please wait... (sorting flat format data: 8%) please wait... (sorting flat format data: 9%) please wait... (sorting flat format data: 10%) please wait... (sorting flat format data: 11%) please wait... (sorting flat format data: 12%) please wait... (sorting flat format data: 13%) please wait... (sorting flat format data: 14%) please wait... (sorting flat format data: 15%) please wait... (sorting flat format data: 16%) please wait... (sorting flat format data: 17%) please wait... (sorting flat format data: 18%) please wait... (sorting flat format data: 19%) please wait... (sorting flat format data: 20%) please wait... (sorting flat format data: 21%) please wait... (sorting flat format data: 22%) please wait... (sorting flat format data: 23%) please wait... (sorting flat format data: 24%) please wait... (sorting flat format data: 25%) please wait... (sorting flat format data: 26%) please wait... (sorting flat format data: 27%) please wait... (sorting flat format data: 28%) please wait... (sorting flat format data: 29%) please wait... (sorting flat format data: 30%) please wait... (sorting flat format data: 31%) please wait... (sorting flat format data: 32%) please wait... (sorting flat format data: 33%) please wait... (sorting flat format data: 34%) please wait... (sorting flat format data: 35%) please wait... (sorting flat format data: 36%) please wait... (sorting flat format data: 37%) please wait... (sorting flat format data: 38%) please wait... (sorting flat format data: 39%) please wait... (sorting flat format data: 40%) please wait... (sorting flat format data: 41%) please wait... (sorting flat format data: 42%) please wait... (sorting flat format data: 43%) please wait... (sorting flat format data: 44%) please wait... (sorting flat format data: 45%) please wait... (sorting flat format data: 46%) please wait... (sorting flat format data: 47%) please wait... (sorting flat format data: 48%) please wait... (sorting flat format data: 49%) please wait... (sorting flat format data: 50%) please wait... (sorting flat format data: 51%) please wait... (sorting flat format data: 52%) please wait... (sorting flat format data: 53%) please wait... (sorting flat format data: 54%) please wait... (sorting flat format data: 55%) please wait... (sorting flat format data: 56%) please wait... (sorting flat format data: 57%) please wait... (sorting flat format data: 58%) please wait... (sorting flat format data: 59%) please wait... (sorting flat format data: 60%) please wait... (sorting flat format data: 61%) please wait... (sorting flat format data: 62%) please wait... (sorting flat format data: 63%) please wait... (sorting flat format data: 64%) please wait... (sorting flat format data: 65%) please wait... (sorting flat format data: 66%) please wait... (sorting flat format data: 67%) please wait... (sorting flat format data: 68%) please wait... (sorting flat format data: 69%) please wait... (sorting flat format data: 70%) please wait... (sorting flat format data: 71%) please wait... (sorting flat format data: 72%) please wait... (sorting flat format data: 73%) please wait... (sorting flat format data: 74%) please wait... (sorting flat format data: 75%) please wait... (sorting flat format data: 76%) please wait... (sorting flat format data: 77%) please wait... (sorting flat format data: 78%) please wait... (sorting flat format data: 79%) please wait... (sorting flat format data: 80%) please wait... (sorting flat format data: 81%) please wait... (sorting flat format data: 82%) please wait... (sorting flat format data: 83%) please wait... (sorting flat format data: 84%) please wait... (sorting flat format data: 85%) please wait... (sorting flat format data: 86%) please wait... (sorting flat format data: 87%) please wait... (sorting flat format data: 88%) please wait... (sorting flat format data: 89%) please wait... (sorting flat format data: 90%) please wait... (sorting flat format data: 91%) please wait... (sorting flat format data: 92%) please wait... (sorting flat format data: 93%) please wait... (sorting flat format data: 94%) please wait... (sorting flat format data: 95%) please wait... (sorting flat format data: 96%) please wait... (sorting flat format data: 97%) please wait... (sorting flat format data: 98%) please wait... (sorting flat format data: 99%) NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.ycKzE/vmlinux [TAINTED] DUMPFILE: /exports/testreports/47845/testresults/sanity-benchmark-special9-ldiskfs-centos7_x86_64-centos7_x86_64-retry1/oleg123-server-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Thu Dec 12 10:09:11 EST 2024 UPTIME: 00:06:55 LOAD AVERAGE: 0.88, 1.60, 0.83 TASKS: 272 NODENAME: oleg123-server.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "" PID: 0 COMMAND: "swapper/0" TASK: ffffffff81c18480 (1 of 4) [THREAD_INFO: ffffffff81c00000] CPU: 0 STATE: TASK_RUNNING (ACTIVE) WARNING: panic task not found Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for lrw module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for dm_flakey module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for edac_core module mod: cannot find or load object file for sb_edac module mod: cannot find or load object file for dm_mod module MODULE NAME BASE SIZE OBJECT FILE ffffffffa0205380 ost ffffffffa0202000 19298 /tmp/crash-anaysis.ycKzE/modules/ost.ko mod: cannot find or load object file for zavl module ffffffffa0227360 libcfs ffffffffa0212000 132473 /tmp/crash-anaysis.ycKzE/modules/libcfs.ko ffffffffa0242160 fid ffffffffa0234000 84802 /tmp/crash-anaysis.ycKzE/modules/fid.ko mod: cannot find or load object file for squashfs module mod: cannot find or load object file for kvm module ffffffffa0395020 lnet ffffffffa0303000 928651 /tmp/crash-anaysis.ycKzE/modules/lnet.ko ffffffffa03f46e0 fld ffffffffa03e7000 84453 /tmp/crash-anaysis.ycKzE/modules/fld.ko mod: cannot find or load object file for spl module ffffffffa04358a0 ksocklnd ffffffffa0418000 173554 /tmp/crash-anaysis.ycKzE/modules/ksocklnd.ko ffffffffa047cda0 ptlrpc_gss ffffffffa0444000 342054 /tmp/crash-anaysis.ycKzE/modules/ptlrpc_gss.ko ffffffffa04c3760 lmv ffffffffa0499000 230393 /tmp/crash-anaysis.ycKzE/modules/lmv.ko ffffffffa050d6a0 lov ffffffffa04d3000 332258 /tmp/crash-anaysis.ycKzE/modules/lov.ko mod: cannot find or load object file for kvm_intel module ffffffffa063a020 obdclass ffffffffa056d000 2651961 /tmp/crash-anaysis.ycKzE/modules/obdclass.ko ffffffffa09a7800 ptlrpc ffffffffa07f6000 2547608 /tmp/crash-anaysis.ycKzE/modules/ptlrpc.ko ffffffffa0ab2020 osc ffffffffa0a65000 437181 /tmp/crash-anaysis.ycKzE/modules/osc.ko ffffffffa0b03a20 mdc ffffffffa0ad1000 276995 /tmp/crash-anaysis.ycKzE/modules/mdc.ko ffffffffa0b28a20 mgc ffffffffa0b16000 109604 /tmp/crash-anaysis.ycKzE/modules/mgc.ko ffffffffa0b4b120 obdecho ffffffffa0b32000 151561 /tmp/crash-anaysis.ycKzE/modules/obdecho.ko ffffffffa0bef8c0 lfsck ffffffffa0b59000 776530 /tmp/crash-anaysis.ycKzE/modules/lfsck.ko mod: cannot find or load object file for znvpair module ffffffffa0c90100 lquota ffffffffa0c3a000 472109 /tmp/crash-anaysis.ycKzE/modules/lquota.ko ffffffffa0d319c0 ldiskfs ffffffffa0caf000 654947 /tmp/crash-anaysis.ycKzE/modules/ldiskfs.ko mod: cannot find or load object file for zcommon module ffffffffa0de3520 osd_ldiskfs ffffffffa0d78000 581793 /tmp/crash-anaysis.ycKzE/modules/osd_ldiskfs.ko ffffffffa0e4b120 mgs ffffffffa0e08000 370169 /tmp/crash-anaysis.ycKzE/modules/mgs.ko ffffffffa0ebe980 mdd ffffffffa0e64000 488914 /tmp/crash-anaysis.ycKzE/modules/mdd.ko ffffffffa0f97fa0 mdt ffffffffa0edd000 1028715 /tmp/crash-anaysis.ycKzE/modules/mdt.ko ffffffffa1054620 lod ffffffffa0fda000 665019 /tmp/crash-anaysis.ycKzE/modules/lod.ko ffffffffa10c02c0 ofd ffffffffa107e000 360982 /tmp/crash-anaysis.ycKzE/modules/ofd.ko ffffffffa11183c0 osp ffffffffa10d8000 358935 /tmp/crash-anaysis.ycKzE/modules/osp.ko ffffffffa1205b00 lustre ffffffffa1131000 1153389 /tmp/crash-anaysis.ycKzE/modules/lustre.ko mod: cannot find or load object file for icp module mod: cannot find or load object file for zlua module mod: cannot find or load object file for zzstd module mod: cannot find or load object file for zunicode module mod: cannot find or load object file for zfs module lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff88007a07f748) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88007cd8b868) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff88007ef3ed28) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800a75d8ce8) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8801368295a8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88006e2396c8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800b1866308) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 4099 total debug pages from 4 CPUs to /tmp/crash-anaysis.ycKzE/lustre.bin