crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. please wait... (sorting flat format data) please wait... (sorting flat format data: 1%) please wait... (sorting flat format data: 2%) please wait... (sorting flat format data: 3%) please wait... (sorting flat format data: 4%) please wait... (sorting flat format data: 5%) please wait... (sorting flat format data: 6%) please wait... (sorting flat format data: 7%) please wait... (sorting flat format data: 8%) please wait... (sorting flat format data: 9%) please wait... (sorting flat format data: 10%) please wait... (sorting flat format data: 11%) please wait... (sorting flat format data: 12%) please wait... (sorting flat format data: 13%) please wait... (sorting flat format data: 14%) please wait... (sorting flat format data: 15%) please wait... (sorting flat format data: 16%) please wait... (sorting flat format data: 17%) please wait... (sorting flat format data: 18%) please wait... (sorting flat format data: 19%) please wait... (sorting flat format data: 20%) please wait... (sorting flat format data: 21%) please wait... (sorting flat format data: 22%) please wait... (sorting flat format data: 23%) please wait... (sorting flat format data: 24%) please wait... (sorting flat format data: 25%) please wait... (sorting flat format data: 26%) please wait... (sorting flat format data: 27%) please wait... (sorting flat format data: 28%) please wait... (sorting flat format data: 29%) please wait... (sorting flat format data: 30%) please wait... (sorting flat format data: 31%) please wait... (sorting flat format data: 32%) please wait... (sorting flat format data: 33%) please wait... (sorting flat format data: 34%) please wait... (sorting flat format data: 35%) please wait... (sorting flat format data: 36%) please wait... (sorting flat format data: 37%) please wait... (sorting flat format data: 38%) please wait... (sorting flat format data: 39%) please wait... (sorting flat format data: 40%) please wait... (sorting flat format data: 41%) please wait... (sorting flat format data: 42%) please wait... (sorting flat format data: 43%) please wait... (sorting flat format data: 44%) please wait... (sorting flat format data: 45%) please wait... (sorting flat format data: 46%) please wait... (sorting flat format data: 47%) please wait... (sorting flat format data: 48%) please wait... (sorting flat format data: 49%) please wait... (sorting flat format data: 50%) please wait... (sorting flat format data: 51%) please wait... (sorting flat format data: 52%) please wait... (sorting flat format data: 53%) please wait... (sorting flat format data: 54%) please wait... (sorting flat format data: 55%) please wait... (sorting flat format data: 56%) please wait... (sorting flat format data: 57%) please wait... (sorting flat format data: 58%) please wait... (sorting flat format data: 59%) please wait... (sorting flat format data: 60%) please wait... (sorting flat format data: 61%) please wait... (sorting flat format data: 62%) please wait... (sorting flat format data: 63%) please wait... (sorting flat format data: 64%) please wait... (sorting flat format data: 65%) please wait... (sorting flat format data: 66%) please wait... (sorting flat format data: 67%) please wait... (sorting flat format data: 68%) please wait... (sorting flat format data: 69%) please wait... (sorting flat format data: 70%) please wait... (sorting flat format data: 71%) please wait... (sorting flat format data: 72%) please wait... (sorting flat format data: 73%) please wait... (sorting flat format data: 74%) please wait... (sorting flat format data: 75%) please wait... (sorting flat format data: 76%) please wait... (sorting flat format data: 77%) please wait... (sorting flat format data: 78%) please wait... (sorting flat format data: 79%) please wait... (sorting flat format data: 80%) please wait... (sorting flat format data: 81%) please wait... (sorting flat format data: 82%) please wait... (sorting flat format data: 83%) please wait... (sorting flat format data: 84%) please wait... (sorting flat format data: 85%) please wait... (sorting flat format data: 86%) please wait... (sorting flat format data: 87%) please wait... (sorting flat format data: 88%) please wait... (sorting flat format data: 89%) please wait... (sorting flat format data: 90%) please wait... (sorting flat format data: 91%) please wait... (sorting flat format data: 92%) please wait... (sorting flat format data: 93%) please wait... (sorting flat format data: 94%) please wait... (sorting flat format data: 95%) please wait... (sorting flat format data: 96%) please wait... (sorting flat format data: 97%) please wait... (sorting flat format data: 98%) please wait... (sorting flat format data: 99%) NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.MNejx/vmlinux [TAINTED] DUMPFILE: /exports/testreports/43549/testresults/racer-ldiskfs-DNE-centos7_x86_64-centos7_x86_64/oleg132-server-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Wed Jun 19 23:04:14 EDT 2024 UPTIME: 00:16:59 LOAD AVERAGE: 0.00, 0.32, 0.64 TASKS: 332 NODENAME: oleg132-server.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "" PID: 0 COMMAND: "swapper/3" TASK: ffff880139bd1110 (1 of 4) [THREAD_INFO: ffff880139bd8000] CPU: 3 STATE: TASK_RUNNING (PANIC) Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for lrw module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for kvm module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for crc_t10dif module MODULE NAME BASE SIZE OBJECT FILE ffffffffa027d380 ost ffffffffa027a000 19298 /tmp/crash-anaysis.MNejx/modules/ost.ko mod: cannot find or load object file for zavl module mod: cannot find or load object file for dm_flakey module mod: cannot find or load object file for edac_core module mod: cannot find or load object file for sb_edac module mod: cannot find or load object file for dm_mod module ffffffffa02db360 libcfs ffffffffa02c6000 132619 /tmp/crash-anaysis.MNejx/modules/libcfs.ko ffffffffa02f61a0 fid ffffffffa02e8000 84843 /tmp/crash-anaysis.MNejx/modules/fid.ko ffffffffa0394640 lnet ffffffffa0303000 934237 /tmp/crash-anaysis.MNejx/modules/lnet.ko ffffffffa03f77e0 fld ffffffffa03e9000 88713 /tmp/crash-anaysis.MNejx/modules/fld.ko mod: cannot find or load object file for znvpair module ffffffffa04388a0 ksocklnd ffffffffa041a000 182768 /tmp/crash-anaysis.MNejx/modules/ksocklnd.ko ffffffffa0480e60 ptlrpc_gss ffffffffa0448000 342181 /tmp/crash-anaysis.MNejx/modules/ptlrpc_gss.ko ffffffffa04c8860 lmv ffffffffa049d000 234767 /tmp/crash-anaysis.MNejx/modules/lmv.ko ffffffffa04f1120 obdecho ffffffffa04d8000 151561 /tmp/crash-anaysis.MNejx/modules/obdecho.ko mod: cannot find or load object file for kvm_intel module ffffffffa0603480 obdclass ffffffffa0536000 2651606 /tmp/crash-anaysis.MNejx/modules/obdclass.ko ffffffffa0970aa0 ptlrpc ffffffffa07bf000 2547562 /tmp/crash-anaysis.MNejx/modules/ptlrpc.ko ffffffffa0a79cc0 osc ffffffffa0a2e000 427723 /tmp/crash-anaysis.MNejx/modules/osc.ko ffffffffa0ad2660 lov ffffffffa0a98000 332256 /tmp/crash-anaysis.MNejx/modules/lov.ko ffffffffa0b1d8a0 mdc ffffffffa0aeb000 276573 /tmp/crash-anaysis.MNejx/modules/mdc.ko ffffffffa0b42920 mgc ffffffffa0b30000 109415 /tmp/crash-anaysis.MNejx/modules/mgc.ko ffffffffa0be3240 lfsck ffffffffa0b4c000 782830 /tmp/crash-anaysis.MNejx/modules/lfsck.ko mod: cannot find or load object file for spl module ffffffffa0c85280 lquota ffffffffa0c2f000 472402 /tmp/crash-anaysis.MNejx/modules/lquota.ko ffffffffa0d40980 ldiskfs ffffffffa0cbe000 654850 /tmp/crash-anaysis.MNejx/modules/ldiskfs.ko mod: cannot find or load object file for zcommon module ffffffffa0df2460 osd_ldiskfs ffffffffa0d87000 581692 /tmp/crash-anaysis.MNejx/modules/osd_ldiskfs.ko ffffffffa0e5b120 mgs ffffffffa0e17000 373684 /tmp/crash-anaysis.MNejx/modules/mgs.ko ffffffffa0ed0f40 mdd ffffffffa0e74000 497533 /tmp/crash-anaysis.MNejx/modules/mdd.ko ffffffffa0fa8ce0 mdt ffffffffa0eef000 1023523 /tmp/crash-anaysis.MNejx/modules/mdt.ko ffffffffa1063a60 lod ffffffffa0fea000 660609 /tmp/crash-anaysis.MNejx/modules/lod.ko ffffffffa10cf6c0 ofd ffffffffa108d000 361693 /tmp/crash-anaysis.MNejx/modules/ofd.ko ffffffffa11252a0 osp ffffffffa10e7000 350313 /tmp/crash-anaysis.MNejx/modules/osp.ko ffffffffa1209a00 lustre ffffffffa113e000 1105643 /tmp/crash-anaysis.MNejx/modules/lustre.ko mod: cannot find or load object file for icp module mod: cannot find or load object file for zlua module mod: cannot find or load object file for zunicode module mod: cannot find or load object file for zfs module lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff880095f00d48) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff880130dfee28) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff88012ea9ecc8) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff88011ea99728) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1024 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800a5c123a8) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88012dfd4f28) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800b4c1e9e8) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800b26df5e8) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 4100 total debug pages from 4 CPUs to /tmp/crash-anaysis.MNejx/lustre.bin