crash 8.0.0++ Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. NOTE: stdin: not a tty GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... please wait... (gathering kmem slab cache data) please wait... (gathering module symbol data) please wait... (gathering task table data) please wait... (determining panic task) KERNEL: /tmp/crash-anaysis.Dkr1p/vmlinux [TAINTED] DUMPFILE: /exports/testreports/35992/testresults/sanity-quota-zfs-centos7_x86_64-centos7_x86_64/oleg105-client-vmcore [PARTIAL DUMP] CPUS: 4 DATE: Mon Sep 25 15:22:49 EDT 2023 UPTIME: 01:30:07 LOAD AVERAGE: 0.25, 0.16, 0.21 TASKS: 157 NODENAME: oleg105-client.virtnet RELEASE: 3.10.0-7.9-debug VERSION: #1 SMP Sat Mar 26 23:28:42 EDT 2022 MACHINE: x86_64 (2399 Mhz) MEMORY: 4 GB PANIC: "BUG: unable to handle kernel NULL pointer dereference at (null)" PID: 9909 COMMAND: "umount" TASK: ffff8800b6498000 [THREAD_INFO: ffff8800a804c000] CPU: 0 STATE: TASK_RUNNING (PANIC) Setting scroll off while initializing PyKdump /usr/local/crash/mpykdump.so: shared object loaded ./lustre.so: shared object loaded mod: cannot find or load object file for libata module mod: cannot find or load object file for pata_acpi module mod: cannot find or load object file for ata_generic module mod: cannot find or load object file for mbcache module mod: cannot find or load object file for pcspkr module mod: cannot find or load object file for serio_raw module mod: cannot find or load object file for ata_piix module mod: cannot find or load object file for jbd2 module mod: cannot find or load object file for ext4 module mod: cannot find or load object file for binfmt_misc module mod: cannot find or load object file for crc_t10dif module mod: cannot find or load object file for squashfs module mod: cannot find or load object file for crct10dif_common module mod: cannot find or load object file for crct10dif_generic module mod: cannot find or load object file for ip_tables module mod: cannot find or load object file for rpcsec_gss_krb5 module mod: cannot find or load object file for i2c_core module mod: cannot find or load object file for i2c_piix4 module mod: cannot find or load object file for crc32_generic module MODULE NAME BASE SIZE OBJECT FILE ffffffffa016a280 ost ffffffffa0168000 14891 /tmp/crash-anaysis.Dkr1p/modules/ost.ko ffffffffa018cd60 libcfs ffffffffa016d000 202734 /tmp/crash-anaysis.Dkr1p/modules/libcfs.ko ffffffffa0227ac0 lnet ffffffffa01b3000 769518 /tmp/crash-anaysis.Dkr1p/modules/lnet.ko ffffffffa027d1a0 fid ffffffffa0270000 80213 /tmp/crash-anaysis.Dkr1p/modules/fid.ko ffffffffa02b4880 ksocklnd ffffffffa0297000 178007 /tmp/crash-anaysis.Dkr1p/modules/ksocklnd.ko ffffffffa0388960 obdclass ffffffffa02c4000 2671905 /tmp/crash-anaysis.Dkr1p/modules/obdclass.ko ffffffffa0587ec0 ptlrpc_gss ffffffffa0552000 331348 /tmp/crash-anaysis.Dkr1p/modules/ptlrpc_gss.ko ffffffffa0754b80 ptlrpc ffffffffa05a8000 2532682 /tmp/crash-anaysis.Dkr1p/modules/ptlrpc.ko ffffffffa08227e0 fld ffffffffa0814000 88791 /tmp/crash-anaysis.Dkr1p/modules/fld.ko ffffffffa08535c0 lmv ffffffffa082b000 220867 /tmp/crash-anaysis.Dkr1p/modules/lmv.ko ffffffffa08acae0 osc ffffffffa0862000 422017 /tmp/crash-anaysis.Dkr1p/modules/osc.ko ffffffffa08dca00 mgc ffffffffa08cb000 104865 /tmp/crash-anaysis.Dkr1p/modules/mgc.ko ffffffffa091f4a0 lov ffffffffa08e6000 322902 /tmp/crash-anaysis.Dkr1p/modules/lov.ko ffffffffa0979380 mdc ffffffffa0949000 266669 /tmp/crash-anaysis.Dkr1p/modules/mdc.ko ffffffffa09a5120 obdecho ffffffffa098c000 151561 /tmp/crash-anaysis.Dkr1p/modules/obdecho.ko ffffffffa0a4a280 lfsck ffffffffa09b3000 781792 /tmp/crash-anaysis.Dkr1p/modules/lfsck.ko ffffffffa0ae9fc0 lquota ffffffffa0a95000 466584 /tmp/crash-anaysis.Dkr1p/modules/lquota.ko ffffffffa0b64180 mgs ffffffffa0b21000 369273 /tmp/crash-anaysis.Dkr1p/modules/mgs.ko ffffffffa0bd7b80 mdd ffffffffa0b7d000 488938 /tmp/crash-anaysis.Dkr1p/modules/mdd.ko ffffffffa0cc66c0 mdt ffffffffa0c10000 1004255 /tmp/crash-anaysis.Dkr1p/modules/mdt.ko ffffffffa0d7bf00 lod ffffffffa0d07000 636544 /tmp/crash-anaysis.Dkr1p/modules/lod.ko ffffffffa0de2200 osp ffffffffa0da4000 346184 /tmp/crash-anaysis.Dkr1p/modules/osp.ko ffffffffa0e3b2e0 ofd ffffffffa0dfa000 356487 /tmp/crash-anaysis.Dkr1p/modules/ofd.ko ffffffffa0f0fa80 lustre ffffffffa0e53000 1029012 /tmp/crash-anaysis.Dkr1p/modules/lustre.ko lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b7b36c88) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[0])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[0].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[1].tcd.tcd_pages.next lustre_walk_trace_pages(1, 5, 0xffff88012e3f8dc8) lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[0])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[1].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800b435fc08) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[0])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[2].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[0])[3].tcd.tcd_pages.next lustre_walk_trace_pages(3, 5, 0xffff8800b6d7a388) lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[0])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[0])[3].tcd.tcd_daemon_pages.next lustre: Dumped 409 debug pages from type 0 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[0].tcd.tcd_pages.next lustre_walk_trace_pages(0, 5, 0xffff8800b6447868) lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[1])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[0].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[1])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[2].tcd.tcd_pages.next lustre_walk_trace_pages(2, 5, 0xffff8800b6f62ca8) lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[1])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[2].tcd.tcd_daemon_pages.next lustre: Dumped 1 debug pages from type 1 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[1])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[1])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[1])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 1 - CPU 3 lustre_walk_cpus(0, 5, 1) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[0].tcd.tcd_pages.next lustre_walk_cpus(0, 5, 2) cmd p (*cfs_trace_data[2])[0].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[0].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 0 lustre_walk_cpus(1, 5, 1) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[1].tcd.tcd_pages.next lustre_walk_cpus(1, 5, 2) cmd p (*cfs_trace_data[2])[1].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[1].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 1 lustre_walk_cpus(2, 5, 1) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[2].tcd.tcd_pages.next lustre_walk_cpus(2, 5, 2) cmd p (*cfs_trace_data[2])[2].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[2].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 2 lustre_walk_cpus(3, 5, 1) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_pages // p (*cfs_trace_data[2])[3].tcd.tcd_pages.next lustre_walk_cpus(3, 5, 2) cmd p (*cfs_trace_data[2])[3].tcd.tcd_cur_daemon_pages // p (*cfs_trace_data[2])[3].tcd.tcd_daemon_pages.next lustre: Dumped 0 debug pages from type 2 - CPU 3 lustre: Dumped 1638 total debug pages from 4 CPUs to /tmp/crash-anaysis.Dkr1p/lustre.bin kmem: xarray_cache: slab: ffffea0004dbbd00 duplicate freelist object: ffff880136ef5918