crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. please wait... (sorting flat format data) please wait... (sorting flat format data: 1%) please wait... (sorting flat format data: 2%) please wait... (sorting flat format data: 3%) please wait... (sorting flat format data: 4%) please wait... (sorting flat format data: 5%) please wait... (sorting flat format data: 6%) please wait... (sorting flat format data: 7%) please wait... (sorting flat format data: 8%) please wait... (sorting flat format data: 9%) please wait... (sorting flat format data: 10%) please wait... (sorting flat format data: 11%) please wait... (sorting flat format data: 12%) please wait... (sorting flat format data: 13%) please wait... (sorting flat format data: 14%) please wait... (sorting flat format data: 15%) please wait... (sorting flat format data: 16%) please wait... (sorting flat format data: 17%) please wait... (sorting flat format data: 18%) please wait... (sorting flat format data: 19%) please wait... (sorting flat format data: 20%) please wait... (sorting flat format data: 21%) please wait... (sorting flat format data: 22%) please wait... (sorting flat format data: 23%) please wait... (sorting flat format data: 24%) please wait... (sorting flat format data: 25%) please wait... (sorting flat format data: 26%) please wait... (sorting flat format data: 27%) please wait... (sorting flat format data: 28%) please wait... (sorting flat format data: 29%) please wait... (sorting flat format data: 30%) please wait... (sorting flat format data: 31%) please wait... (sorting flat format data: 32%) please wait... (sorting flat format data: 33%) please wait... (sorting flat format data: 34%) please wait... (sorting flat format data: 35%) please wait... (sorting flat format data: 36%) please wait... (sorting flat format data: 37%) please wait... (sorting flat format data: 38%) please wait... (sorting flat format data: 39%) please wait... (sorting flat format data: 40%) please wait... (sorting flat format data: 41%) please wait... (sorting flat format data: 42%) please wait... (sorting flat format data: 43%) please wait... (sorting flat format data: 44%) please wait... (sorting flat format data: 45%) please wait... (sorting flat format data: 46%) please wait... (sorting flat format data: 47%) please wait... (sorting flat format data: 48%) please wait... (sorting flat format data: 49%) please wait... (sorting flat format data: 50%) please wait... (sorting flat format data: 51%) please wait... (sorting flat format data: 52%) please wait... (sorting flat format data: 53%) please wait... (sorting flat format data: 54%) please wait... (sorting flat format data: 55%) please wait... (sorting flat format data: 56%) please wait... (sorting flat format data: 57%) please wait... (sorting flat format data: 58%) please wait... (sorting flat format data: 59%) please wait... (sorting flat format data: 60%) please wait... (sorting flat format data: 61%) please wait... (sorting flat format data: 62%) please wait... (sorting flat format data: 63%) please wait... (sorting flat format data: 64%) please wait... (sorting flat format data: 65%) please wait... (sorting flat format data: 66%) please wait... (sorting flat format data: 67%) please wait... (sorting flat format data: 68%) please wait... (sorting flat format data: 69%) please wait... (sorting flat format data: 70%) please wait... (sorting flat format data: 71%) please wait... (sorting flat format data: 72%) please wait... (sorting flat format data: 73%) please wait... (sorting flat format data: 74%) please wait... (sorting flat format data: 75%) please wait... (sorting flat format data: 76%) please wait... (sorting flat format data: 77%) please wait... (sorting flat format data: 78%) please wait... (sorting flat format data: 79%) please wait... (sorting flat format data: 80%) please wait... (sorting flat format data: 81%) please wait... (sorting flat format data: 82%) please wait... (sorting flat format data: 83%) please wait... (sorting flat format data: 84%) please wait... (sorting flat format data: 85%) please wait... (sorting flat format data: 86%) please wait... (sorting flat format data: 87%) please wait... (sorting flat format data: 88%) please wait... (sorting flat format data: 89%) please wait... (sorting flat format data: 90%) please wait... (sorting flat format data: 91%) please wait... (sorting flat format data: 92%) please wait... (sorting flat format data: 93%) please wait... (sorting flat format data: 94%) please wait... (sorting flat format data: 95%) please wait... (sorting flat format data: 96%) please wait... (sorting flat format data: 97%) please wait... (sorting flat format data: 98%) please wait... (sorting flat format data: 99%) NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.oYGoo/vmlinux [TAINTED] DUMPFILE: /exports/testreports/51918/testresults/lustre-rsync-test-special5-ldiskfs-centos7_x86_64-centos7_x86_64/oleg203-client-timeout-core [PARTIAL DUMP] CPUS: 4 DATE: Fri May 23 18:44:37 EDT 2025 UPTIME: 01:03:04 LOAD AVERAGE: 0.00, 0.01, 0.05 TASKS: 156 NODENAME: oleg203-client.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "" PID: 0 COMMAND: "swapper/0" TASK: ffffffff81c18480 (1 of 4) [THREAD_INFO: ffffffff81c00000] CPU: 0 STATE: TASK_RUNNING (ACTIVE) WARNING: panic task not found Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for crc32c_intel module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for crct10dif_pclmul module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for glue_helper module mod: cannot find or load object file for cryptd module mod: cannot find or load object file for gf128mul module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for ghash_clmulni_intel module mod: cannot find or load object file for lrw module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for iosf_mbi module mod: cannot find or load object file for crc32_pclmul module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for ablk_helper module mod: cannot find or load object file for aesni_intel module mod: cannot find or load object file for irqbypass module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for kvm module MODULE NAME BASE SIZE OBJECT FILE ffffffffa0274280 ost ffffffffa0272000 14932 /tmp/crash-anaysis.oYGoo/modules/ost.ko mod: cannot find or load object file for sb_edac module mod: cannot find or load object file for edac_core module ffffffffa02af320 fid ffffffffa02a1000 84965 /tmp/crash-anaysis.oYGoo/modules/fid.ko ffffffffa02dab20 libcfs ffffffffa02c2000 154326 /tmp/crash-anaysis.oYGoo/modules/libcfs.ko ffffffffa0369400 lnet ffffffffa02f9000 752271 /tmp/crash-anaysis.oYGoo/modules/lnet.ko ffffffffa03c0a20 fld ffffffffa03b2000 88993 /tmp/crash-anaysis.oYGoo/modules/fld.ko ffffffffa03f6940 ksocklnd ffffffffa03d9000 178330 /tmp/crash-anaysis.oYGoo/modules/ksocklnd.ko ffffffffa043c4c0 ptlrpc_gss ffffffffa0406000 336560 /tmp/crash-anaysis.oYGoo/modules/ptlrpc_gss.ko ffffffffa047ff00 lmv ffffffffa045a000 205631 /tmp/crash-anaysis.oYGoo/modules/lmv.ko ffffffffa04d8f40 osc ffffffffa048e000 423026 /tmp/crash-anaysis.oYGoo/modules/osc.ko mod: cannot find or load object file for kvm_intel module ffffffffa060c280 obdclass ffffffffa053c000 2742617 /tmp/crash-anaysis.oYGoo/modules/obdclass.ko ffffffffa096e180 ptlrpc ffffffffa07db000 2381315 /tmp/crash-anaysis.oYGoo/modules/ptlrpc.ko ffffffffa0a76940 lov ffffffffa0a3d000 327959 /tmp/crash-anaysis.oYGoo/modules/lov.ko ffffffffa0abe2e0 mdc ffffffffa0a8f000 261939 /tmp/crash-anaysis.oYGoo/modules/mdc.ko ffffffffa0ae15c0 mgc ffffffffa0ad0000 99216 /tmp/crash-anaysis.oYGoo/modules/mgc.ko ffffffffa0b032e0 obdecho ffffffffa0aea000 151759 /tmp/crash-anaysis.oYGoo/modules/obdecho.ko ffffffffa0ba87c0 lfsck ffffffffa0b11000 784296 /tmp/crash-anaysis.oYGoo/modules/lfsck.ko ffffffffa0c472e0 lquota ffffffffa0bf4000 458271 /tmp/crash-anaysis.oYGoo/modules/lquota.ko ffffffffa0ca8200 mgs ffffffffa0c65000 373050 /tmp/crash-anaysis.oYGoo/modules/mgs.ko ffffffffa0d1c9a0 mdd ffffffffa0cc2000 487413 /tmp/crash-anaysis.oYGoo/modules/mdd.ko ffffffffa0dece00 mdt ffffffffa0d3a000 987436 /tmp/crash-anaysis.oYGoo/modules/mdt.ko ffffffffa0e9d580 lod ffffffffa0e2d000 611645 /tmp/crash-anaysis.oYGoo/modules/lod.ko ffffffffa0f05480 ofd ffffffffa0ec4000 357053 /tmp/crash-anaysis.oYGoo/modules/ofd.ko ffffffffa0f5b680 osp ffffffffa0f1d000 350863 /tmp/crash-anaysis.oYGoo/modules/osp.ko ffffffffa102ac00 lustre ffffffffa0f74000 997182 /tmp/crash-anaysis.oYGoo/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8801373d0488) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 202 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88012aa79e68) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 233 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800aa912d28) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 110 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff88012dc5a968) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 216 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 761 total debug pages from 4 CPUs to /tmp/crash-anaysis.oYGoo/lustre.bin