[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] mapped at [ffffffffff200b50] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2f2000-0xbffcffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5970 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1bb7 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1a53 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1ac7 00090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1b57 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1b8f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 290459121 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffd9fff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043832 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782298 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027499 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 3820316k/5224448k available (8172k kernel code, 1049120k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.450484] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.453332] pid_max: default: 32768 minimum: 301 [ 0.456122] Security Framework initialized [ 0.458278] SELinux: Initializing. [ 0.459952] SELinux: Starting in permissive mode [ 0.461512] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.466048] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.468946] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.471495] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.475095] Initializing cgroup subsys memory [ 0.477077] Initializing cgroup subsys devices [ 0.479004] Initializing cgroup subsys freezer [ 0.481040] Initializing cgroup subsys net_cls [ 0.483134] Initializing cgroup subsys blkio [ 0.484896] Initializing cgroup subsys perf_event [ 0.486561] Initializing cgroup subsys hugetlb [ 0.487847] Initializing cgroup subsys pids [ 0.489082] Initializing cgroup subsys net_prio [ 0.491278] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.494469] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.496967] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.498586] tlb_flushall_shift: 6 [ 0.499956] FEATURE SPEC_CTRL Present [ 0.501300] FEATURE IBPB_SUPPORT Present [ 0.503125] Spectre V2 : Enabling Indirect Branch Prediction Barrier [ 0.505789] Spectre V2 : Vulnerable [ 0.507171] Speculative Store Bypass: Vulnerable [ 0.509672] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.515882] ACPI: Core revision 20130517 [ 0.519436] ACPI: All ACPI Tables successfully acquired [ 0.521283] ftrace: allocating 30294 entries in 119 pages [ 0.574818] Enabling x2apic [ 0.575869] Enabled x2apic [ 0.577227] Switched APIC routing to physical x2apic. [ 0.580906] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.583152] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (fam: 06, model: 3e, stepping: 04) [ 0.587049] TSC deadline timer enabled [ 0.587310] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.590320] ... version: 2 [ 0.591459] ... bit width: 48 [ 0.592859] ... generic registers: 4 [ 0.594248] ... value mask: 0000ffffffffffff [ 0.596260] ... max period: 00007fffffffffff [ 0.597851] ... fixed-purpose events: 3 [ 0.599301] ... event mask: 000000070000000f [ 0.601114] KVM setup paravirtual spinlock [ 0.607560] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.611547] KVM setup async PF for cpu 1 [ 0.613135] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.616493] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.620717] KVM setup async PF for cpu 2 [ 0.605407] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.622251] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.624400] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.628032] Brought up 4 CPUs [ 0.628042] KVM setup async PF for cpu 3 [ 0.628053] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.632086] smpboot: Max logical packages: 1 [ 0.633445] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.637970] devtmpfs: initialized [ 0.639433] x86/mm: Memory block size: 128MB [ 0.643695] EVM: security.selinux [ 0.644918] EVM: security.ima [ 0.645838] EVM: security.capability [ 0.649482] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.651901] NET: Registered protocol family 16 [ 0.653868] cpuidle: using governor haltpoll [ 0.655795] ACPI: bus type PCI registered [ 0.657054] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.659599] PCI: Using configuration type 1 for base access [ 0.661785] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.670841] ACPI: Added _OSI(Module Device) [ 0.672295] ACPI: Added _OSI(Processor Device) [ 0.673767] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.675463] ACPI: Added _OSI(Processor Aggregator Device) [ 0.677416] ACPI: Added _OSI(Linux-Dell-Video) [ 0.679769] ACPI: EC: Look up EC in DSDT [ 0.681978] ACPI: Interpreter enabled [ 0.683396] ACPI: (supports S0 S3 S4 S5) [ 0.684658] ACPI: Using IOAPIC for interrupt routing [ 0.686283] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.689495] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.696814] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.699143] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.701506] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.703714] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.708801] acpiphp: Slot [2] registered [ 0.710211] acpiphp: Slot [3] registered [ 0.711696] acpiphp: Slot [4] registered [ 0.713202] acpiphp: Slot [5] registered [ 0.714728] acpiphp: Slot [6] registered [ 0.716180] acpiphp: Slot [7] registered [ 0.717699] acpiphp: Slot [8] registered [ 0.719035] acpiphp: Slot [9] registered [ 0.720391] acpiphp: Slot [10] registered [ 0.721840] acpiphp: Slot [11] registered [ 0.723303] acpiphp: Slot [12] registered [ 0.724751] acpiphp: Slot [13] registered [ 0.726338] acpiphp: Slot [14] registered [ 0.727856] acpiphp: Slot [15] registered [ 0.729049] acpiphp: Slot [16] registered [ 0.730656] acpiphp: Slot [17] registered [ 0.732314] acpiphp: Slot [18] registered [ 0.733784] acpiphp: Slot [19] registered [ 0.735261] acpiphp: Slot [20] registered [ 0.736809] acpiphp: Slot [21] registered [ 0.738320] acpiphp: Slot [22] registered [ 0.739829] acpiphp: Slot [23] registered [ 0.741281] acpiphp: Slot [24] registered [ 0.742840] acpiphp: Slot [25] registered [ 0.744248] acpiphp: Slot [26] registered [ 0.745786] acpiphp: Slot [27] registered [ 0.747203] acpiphp: Slot [28] registered [ 0.748776] acpiphp: Slot [29] registered [ 0.750287] acpiphp: Slot [30] registered [ 0.751792] acpiphp: Slot [31] registered [ 0.753148] PCI host bridge to bus 0000:00 [ 0.754571] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.756371] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.758955] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.761750] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.764432] pci_bus 0000:00: root bus resource [mem 0x140000000-0x1bfffffff window] [ 0.767040] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.769108] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.769882] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.770825] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.774370] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.776087] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.778768] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.781075] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.784414] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.787189] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.787843] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.790449] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.793508] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.800681] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.808093] pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.809365] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.810094] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.812818] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.815777] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.826558] pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.833781] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.837952] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.843001] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.849030] pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.854709] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 0.857270] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 0.859769] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 0.862225] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 0.864487] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 0.868436] vgaarb: loaded [ 0.869766] SCSI subsystem initialized [ 0.871028] ACPI: bus type USB registered [ 0.872503] usbcore: registered new interface driver usbfs [ 0.874573] usbcore: registered new interface driver hub [ 0.876682] usbcore: registered new device driver usb [ 0.879071] PCI: Using ACPI for IRQ routing [ 0.880452] PCI: pci_cache_line_size set to 64 bytes [ 0.880598] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 0.880603] e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] [ 0.880605] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 0.881398] NetLabel: Initializing [ 0.882280] NetLabel: domain hash size = 128 [ 0.883886] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.885473] NetLabel: unlabeled traffic allowed by default [ 0.887879] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.889476] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.893300] amd_nb: Cannot enumerate AMD northbridges [ 0.895320] Switched to clocksource kvm-clock [ 0.914009] pnp: PnP ACPI init [ 0.915432] ACPI: bus type PNP registered [ 0.917161] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 0.917253] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 0.917309] pnp 00:02: [dma 2] [ 0.917364] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 0.917444] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.917517] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.917589] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.917985] pnp: PnP ACPI: found 6 devices [ 0.919547] ACPI: bus type PNP unregistered [ 0.934705] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.934713] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.934716] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.934719] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.934721] pci_bus 0000:00: resource 8 [mem 0x140000000-0x1bfffffff window] [ 0.934796] NET: Registered protocol family 2 [ 0.936958] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 0.940541] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 0.944185] TCP: Hash tables configured (established 32768 bind 32768) [ 0.946220] TCP: reno registered [ 0.947634] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 0.950039] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 0.952771] NET: Registered protocol family 1 [ 0.955533] RPC: Registered named UNIX socket transport module. [ 0.959152] RPC: Registered udp transport module. [ 0.960973] RPC: Registered tcp transport module. [ 0.963017] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.965456] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.967399] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.969538] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.971838] PCI: CLS 0 bytes, default 64 [ 0.972749] Unpacking initramfs... [ 2.355545] debug: unmapping init [mem 0xffff8800bc2f2000-0xffff8800bffcffff] [ 2.359193] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.361244] software IO TLB [mem 0xb82f2000-0xbc2f2000] (64MB) mapped at [ffff8800b82f2000-ffff8800bc2f1fff] [ 2.363945] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 10737418240 ms ovfl timer [ 2.366091] RAPL PMU: hw unit of domain pp0-core 2^-0 Joules [ 2.367856] RAPL PMU: hw unit of domain package 2^-0 Joules [ 2.368828] RAPL PMU: hw unit of domain dram 2^-0 Joules [ 2.372916] cryptomgr_test (51) used greatest stack depth: 14480 bytes left [ 2.375257] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 2.375336] Initialise system trusted keyring [ 2.416625] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 2.419023] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 2.424935] zpool: loaded [ 2.425907] zbud: loaded [ 2.427275] VFS: Disk quotas dquot_6.6.0 [ 2.428668] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.432238] NFS: Registering the id_resolver key type [ 2.434131] Key type id_resolver registered [ 2.435619] Key type id_legacy registered [ 2.436902] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 2.439833] Key type big_key registered [ 2.441112] SELinux: Registering netfilter hooks [ 2.444337] cryptomgr_test (57) used greatest stack depth: 13968 bytes left [ 2.447481] cryptomgr_test (59) used greatest stack depth: 13664 bytes left [ 2.450458] NET: Registered protocol family 38 [ 2.451571] Key type asymmetric registered [ 2.452747] Asymmetric key parser 'x509' registered [ 2.454092] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 2.456787] io scheduler noop registered [ 2.458100] io scheduler deadline registered (default) [ 2.459625] io scheduler cfq registered [ 2.460574] io scheduler mq-deadline registered [ 2.461762] io scheduler kyber registered [ 2.463969] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 2.464962] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 2.467440] intel_idle: does not run on family 6 model 62 [ 2.467571] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.470148] ACPI: Power Button [PWRF] [ 2.471552] GHES: HEST is not enabled! [ 2.527446] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 2.588104] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 2.650367] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.681313] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 2.719754] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 2.723267] Non-volatile memory driver v1.3 [ 2.724920] Linux agpgart interface v0.103 [ 2.726769] crash memory driver: version 1.1 [ 2.728739] nbd: registered device at major 43 [ 2.734077] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 2.734124] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 2.734173] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 2.734214] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 2.734253] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 2.740149] virtio_blk virtio1: [vda] 116072 512-byte logical blocks (59.4 MB/56.6 MiB) [ 2.749176] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 2.749219] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 2.749250] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 2.749280] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 2.749326] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 2.755885] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.760861] rdac: device handler registered [ 2.762348] hp_sw: device handler registered [ 2.763709] emc: device handler registered [ 2.765208] libphy: Fixed MDIO Bus: probed [ 2.774326] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.776572] ehci-pci: EHCI PCI platform driver [ 2.778164] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.780224] ohci-pci: OHCI PCI platform driver [ 2.781829] uhci_hcd: USB Universal Host Controller Interface driver [ 2.784372] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.788249] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.790049] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.792161] mousedev: PS/2 mouse device common for all mice [ 2.794650] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.794790] rtc_cmos 00:05: RTC can wake from S4 [ 2.795947] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 2.796327] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.803056] hidraw: raw HID events driver (C) Jiri Kosina [ 2.803355] usbcore: registered new interface driver usbhid [ 2.803356] usbhid: USB HID core driver [ 2.803433] drop_monitor: Initializing network drop monitor service [ 2.803511] Netfilter messages via NETLINK v0.30. [ 2.803588] TCP: cubic registered [ 2.803606] Initializing XFRM netlink socket [ 2.803909] NET: Registered protocol family 10 [ 2.805054] NET: Registered protocol family 17 [ 2.805109] Key type dns_resolver registered [ 2.805786] mce: Using 10 MCE banks [ 2.807259] Loading compiled-in X.509 certificates [ 2.809037] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 2.809102] registered taskstats version 1 [ 2.812927] modprobe (71) used greatest stack depth: 13456 bytes left [ 2.816375] Key type trusted registered [ 2.821388] Key type encrypted registered [ 2.821448] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 2.823332] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 2.825564] rtc_cmos 00:05: setting system clock to 2025-06-22 11:04:35 UTC (1750590275) [ 2.839064] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 2.841826] Write protecting the kernel read-only data: 12288k [ 2.844232] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 2.846856] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 2.858133] random: systemd: uninitialized urandom read (16 bytes read) [ 2.861269] random: systemd: uninitialized urandom read (16 bytes read) [ 2.863559] random: systemd: uninitialized urandom read (16 bytes read) [ 2.867689] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 2.873809] systemd[1]: Detected virtualization kvm. [ 2.875750] systemd[1]: Detected architecture x86-64. [ 2.877548] systemd[1]: Running in initial RAM disk. [ 2.883280] systemd[1]: No hostname configured. [ 2.885370] systemd[1]: Set hostname to . [ 2.887552] random: systemd: uninitialized urandom read (16 bytes read) [ 2.890393] systemd[1]: Initializing machine ID from random generator. [ 2.937604] dracut-rootfs-g (86) used greatest stack depth: 13264 bytes left [ 2.940953] random: systemd: uninitialized urandom read (16 bytes read) [ 2.943138] random: systemd: uninitialized urandom read (16 bytes read) [ 2.945171] random: systemd: uninitialized urandom read (16 bytes read) [ 2.946613] random: systemd: uninitialized urandom read (16 bytes read) [ 2.950338] random: systemd: uninitialized urandom read (16 bytes read) [ 2.952838] random: systemd: uninitialized urandom read (16 bytes read) [ 2.964111] systemd[1]: Reached target Swap. [ 2.968564] systemd[1]: Created slice Root Slice. [ 2.972770] systemd[1]: Listening on Journal Socket. [ 2.977474] systemd[1]: Reached target Local File Systems. [ 2.982297] systemd[1]: Listening on udev Control Socket. [ 2.986740] systemd[1]: Created slice System Slice. [ 2.992391] systemd[1]: Starting Journal Service... [ 2.997237] systemd[1]: Starting Setup Virtual Console... [ 3.002789] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 3.009007] systemd[1]: Listening on udev Kernel Socket. [ 3.013239] systemd[1]: Reached target Sockets. [ 3.019152] systemd[1]: Starting dracut cmdline hook... [ 3.024468] systemd[1]: Reached target Timers. [ 3.029033] systemd[1]: Reached target Slices. [ 3.035397] systemd[1]: Starting Load Kernel Modules... [ 3.040051] systemd[1]: Started Journal Service. [ 3.262509] random: fast init done [ 3.372498] tsc: Refined TSC clocksource calibration: 2399.980 MHz [ 3.584849] libata version 3.00 loaded. [ 3.596871] ata_piix 0000:00:01.1: version 2.13 [ 3.614143] scsi host0: ata_piix [ 3.625484] scsi host1: ata_piix [ 3.627450] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 3.629969] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 3.667159] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 3.694039] ip (322) used greatest stack depth: 13080 bytes left [ 3.755795] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 3.759004] ip (345) used greatest stack depth: 12464 bytes left [ 3.776403] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 6.810890] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 7.231291] systemd-journald[100]: Received SIGTERM from PID 1 (systemd). [ 7.461143] SELinux: Disabled at runtime. [ 7.462433] SELinux: Unregistering netfilter hooks [ 7.527020] ip_tables: (C) 2000-2006 Netfilter Core Team [ 7.530951] systemd[1]: Inserted module 'ip_tables' [ 7.790398] modprobe (565) used greatest stack depth: 11792 bytes left [ 7.961351] systemd-journald[566]: Received request to flush runtime journal from PID 1 [ 8.069218] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 8.078269] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 8.113600] cryptd: max_cpu_qlen set to 1000 [ 8.140731] AVX version of gcm_enc/dec engaged. [ 8.143478] AES CTR mode by8 optimization enabled [ 8.146230] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 8.200268] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 8.209065] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 8.211194] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 8.306152] EDAC MC: Ver: 3.0.0 [ 8.311593] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 8.311603] EDAC sbridge: Ver: 1.1.2 [ 10.034887] mount.nfs (765) used greatest stack depth: 10704 bytes left [ 27.331699] libcfs: loading out-of-tree module taints kernel. [ 27.334099] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 27.486550] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 27.492014] alg: No test for adler32 (adler32-zlib) [ 28.399616] Lustre: Lustre: Build Version: 2.16.56_63_g33ce4dc [ 28.596892] LNet: Added LNI 192.168.204.39@tcp [8/256/0/180] [ 28.598897] LNet: Accept secure, port 988 [ 30.153542] Key type lgssc registered [ 30.483119] Lustre: Echo OBD driver; http://www.lustre.org/ [ 117.867645] Lustre: Mounted lustre-client [ 120.362829] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 132.819041] Lustre: DEBUG MARKER: oleg439-client.virtnet: executing check_logdir /tmp/testlogs/ [ 134.496859] Lustre: DEBUG MARKER: oleg439-client.virtnet: executing yml_node [ 136.644859] Lustre: DEBUG MARKER: Client: 2.16.56.63 [ 137.825711] Lustre: DEBUG MARKER: MDS: 2.16.56.63 [ 139.104742] Lustre: DEBUG MARKER: OSS: 2.16.56.63 [ 139.732292] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity ============----- Sun Jun 22 07:06:51 EDT 2025 [ 142.910060] Lustre: lustre-OST0000-osc-ffff8800b5c5f000: disconnect after 23s idle [ 151.073747] Lustre: DEBUG MARKER: - need mds1 <= 2.14.55-100-g8a84c7f9c7 for LU-14927, skip 0f [ 151.936598] Lustre: DEBUG MARKER: - need mds1 < v2_14_55-100-g8a84c7f9c7 for LU-14927, skip 0f [ 152.876725] Lustre: DEBUG MARKER: excepting tests: 225 255 256 400a 42a 42c 42b 118c 118d 407 119i 411b [ 153.916287] Lustre: DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 [ 154.869227] Lustre: DEBUG MARKER: === sanity: start setup 07:07:06 (1750590426) === [ 157.289763] Lustre: DEBUG MARKER: oleg439-client.virtnet: executing check_config_client /mnt/lustre [ 170.163188] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 177.350639] Lustre: DEBUG MARKER: === sanity: finish setup 07:07:29 (1750590449) === [ 177.824115] random: crng init done [ 184.535077] Lustre: DEBUG MARKER: == sanity test 200: OST pools ============================ 07:07:36 (1750590456) [ 190.945427] mkdir (11934) used greatest stack depth: 10512 bytes left [ 192.136278] lfs (11983) used greatest stack depth: 10464 bytes left [ 207.637232] Lustre: DEBUG MARKER: == sanity test 204a: Print default stripe attributes ===== 07:07:59 (1750590479) [ 211.493964] Lustre: DEBUG MARKER: == sanity test 204b: Print default stripe size and offset ========================================================== 07:08:03 (1750590483) [ 214.495189] Lustre: DEBUG MARKER: == sanity test 204c: Print default stripe count and offset ========================================================== 07:08:06 (1750590486) [ 217.354384] Lustre: DEBUG MARKER: == sanity test 204d: Print default stripe count and size ========================================================== 07:08:09 (1750590489) [ 220.383361] Lustre: DEBUG MARKER: == sanity test 204e: Print raw stripe attributes ========= 07:08:12 (1750590492) [ 223.660416] Lustre: DEBUG MARKER: == sanity test 204f: Print raw stripe size and offset ==== 07:08:15 (1750590495) [ 226.434770] Lustre: DEBUG MARKER: == sanity test 204g: Print raw stripe count and offset === 07:08:18 (1750590498) [ 229.995302] Lustre: DEBUG MARKER: == sanity test 204h: Print raw stripe count and size ===== 07:08:22 (1750590502) [ 233.328825] Lustre: DEBUG MARKER: == sanity test 205a: Verify job stats ==================== 07:08:25 (1750590505) [ 239.966613] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 1 /mnt/lustre/d205a.sanity [ 240.632827] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.21029 [ 241.694419] Lustre: DEBUG MARKER: Test: rmdir /mnt/lustre/d205a.sanity [ 242.334590] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.rmdir.1027 [ 243.519729] Lustre: DEBUG MARKER: Test: lfs mkdir -i 1 /mnt/lustre/d205a.sanity.remote [ 244.321153] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.30723 [ 245.356145] Lustre: DEBUG MARKER: Test: mknod /mnt/lustre/f205a.sanity c 1 3 [ 245.951898] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.mknod.4176 [ 246.995906] Lustre: DEBUG MARKER: Test: rm -f /mnt/lustre/f205a.sanity [ 247.686664] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.rm.11696 [ 248.792994] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/f205a.sanity [ 249.522023] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.32312 [ 250.892299] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 251.658941] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.touch.15904 [ 253.212902] Lustre: DEBUG MARKER: Test: dd if=/dev/zero of=/mnt/lustre/f205a.sanity bs=1M count=1 oflag=sync [ 253.796126] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.dd.16753 [ 255.096989] Lustre: DEBUG MARKER: Test: dd if=/mnt/lustre/f205a.sanity of=/dev/null bs=1M count=1 iflag=direct [ 255.718453] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.dd.25695 [ 255.832804] ------------[ cut here ]------------ [ 255.836022] WARNING: CPU: 2 PID: 21067 at mm/util.c:474 kvmalloc_node+0xbf/0xd0 [ 255.839362] Modules linked in: lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata [ 255.858722] CPU: 2 PID: 21067 Comm: dd Kdump: loaded Tainted: G OE ------------ 3.10.0-7.9-debug #1 [ 255.862977] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 255.866077] Call Trace: [ 255.866861] [] dump_stack+0x19/0x1b [ 255.871966] [] __warn+0xd8/0x100 [ 255.874662] [] warn_slowpath_null+0x1d/0x20 [ 255.881473] [] kvmalloc_node+0xbf/0xd0 [ 255.883332] [] ll_get_iov_memory+0x80/0x400 [obdclass] [ 255.886595] [] cl_dio_pages_init+0x7d/0x620 [obdclass] [ 255.889252] [] ll_direct_IO_impl+0x2a2/0xdd0 [lustre] [ 255.891492] [] ll_direct_IO+0x7c/0xa0 [lustre] [ 255.893437] [] generic_file_aio_read+0x24e/0x290 [ 255.895255] [] vvp_io_read_start+0x7a9/0xb20 [lustre] [ 255.897643] [] cl_io_start+0x6d/0x150 [obdclass] [ 255.901096] [] cl_io_loop+0x9f/0x230 [obdclass] [ 255.903557] [] ll_file_io_generic+0x370/0x1370 [lustre] [ 255.905730] [] do_file_read_iter+0xd16/0x1370 [lustre] [ 255.909559] [] ll_file_read_iter+0x2d/0x40 [lustre] [ 255.912202] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 255.915479] [] ll_file_read+0x111/0x1e0 [lustre] [ 255.918767] [] vfs_read+0xb9/0x1c0 [ 255.920647] [] SyS_read+0x7f/0xf0 [ 255.922932] [] system_call_fastpath+0x1f/0x24 [ 255.925795] ---[ end trace 6b9fbda28e7a36e6 ]--- [ 256.995807] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/tests/truncate /mnt/lustre/f205a.sanity 0 [ 257.710177] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.truncate.19187 [ 259.436440] Lustre: DEBUG MARKER: Test: mv -f /mnt/lustre/f205a.sanity /mnt/lustre/d205a.sanity.rename [ 260.231834] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.mv.18029 [ 261.639133] Lustre: DEBUG MARKER: Test: /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 1 /mnt/lustre/d205a.sanity.expire [ 262.330891] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205a.lfs.18305 [ 267.407407] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 268.090090] Lustre: DEBUG MARKER: Using JobID environment USER=S.root.touch.0.oleg439-client.v [ 269.499730] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 270.322517] Lustre: DEBUG MARKER: Using JobID environment USER=S.root.touch.0.oleg439-client.E [ 271.476463] Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205a.sanity [ 272.176658] Lustre: DEBUG MARKER: Using JobID environment session=S.root.touch.0.oleg439-client.v [ 278.160676] Lustre: lustre-OST0001-osc-ffff8800b5c5f000: disconnect after 23s idle [ 278.164896] Lustre: Skipped 1 previous similar message [ 281.581921] Lustre: DEBUG MARKER: == sanity test 205b: Verify job stats jobid and output format ========================================================== 07:09:13 (1750590553) [ 288.997027] Lustre: DEBUG MARKER: == sanity test 205c: Verify client stats format ========== 07:09:20 (1750590560) [ 292.474134] Lustre: DEBUG MARKER: == sanity test 205d: verify the format of some stats files ========================================================== 07:09:24 (1750590564) [ 293.297610] lfs (25283) used greatest stack depth: 10416 bytes left [ 301.918881] Lustre: DEBUG MARKER: == sanity test 205e: verify the output of lljobstat ====== 07:09:33 (1750590573) [ 302.750820] hrtimer: interrupt took 3812562 ns [ 312.654397] Lustre: DEBUG MARKER: == sanity test 205f: verify qos_ost_weights YAML format == 07:09:44 (1750590584) [ 317.148333] Lustre: DEBUG MARKER: == sanity test 205g: stress test for job_stats procfile == 07:09:49 (1750590589) [ 412.582453] Lustre: DEBUG MARKER: == sanity test 205h: check jobid xattr is stored correctly ========================================================== 07:11:24 (1750590684) [ 419.568908] Lustre: DEBUG MARKER: == sanity test 205i: check job_xattr parameter accepts and rejects values correctly ========================================================== 07:11:31 (1750590691) [ 427.446191] Lustre: DEBUG MARKER: == sanity test 205k: Verify '?' operator on job stats ==== 07:11:39 (1750590699) [ 433.255466] Lustre: DEBUG MARKER: == sanity test 205l: Verify job stats can scale ========== 07:11:45 (1750590705) [ 495.850588] Lustre: DEBUG MARKER: == sanity test 205m: Test width parsing of job_stats ===== 07:12:47 (1750590767) [ 504.847373] Lustre: DEBUG MARKER: == sanity test 206: fail lov_init_raid0() doesn't lbug === 07:12:56 (1750590776) [ 505.011044] Lustre: *** cfs_fail_loc=1403, val=1*** [ 505.012873] LustreError: 12641:0:(lcommon_cl.c:188:cl_file_inode_init()) lustre: failed to initialize cl_object [0x200000402:0x5b2:0x0]: rc = -5 [ 505.030180] LustreError: 12641:0:(llite_lib.c:3774:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [ 508.000396] Lustre: DEBUG MARKER: == sanity test 207a: can refresh layout at glimpse ======= 07:13:00 (1750590780) [ 511.178010] Lustre: DEBUG MARKER: == sanity test 207b: can refresh layout at open ========== 07:13:03 (1750590783) [ 513.968715] Lustre: DEBUG MARKER: == sanity test 208: Exclusive open ======================= 07:13:06 (1750590786) [ 523.656453] Lustre: lustre-MDT0000-mdc-ffff8800b5c5f000: Connection to lustre-MDT0000 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 533.666811] Lustre: lustre-OST0000-osc-ffff8800b5c5f000: disconnect after 22s idle [ 539.696041] Lustre: 2006:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1750590796/real 1750590796] req@ffff88012dacf100 x1835626977800576/t0(0) o400->MGC192.168.204.139@tcp@192.168.204.139@tcp:26/25 lens 224/224 e 0 to 1 dl 1750590812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 539.708404] LustreError: MGC192.168.204.139@tcp: Connection to MGS (at 192.168.204.139@tcp) was lost; in progress operations using this service will fail [ 539.731998] Lustre: Evicted from MGS (at 192.168.204.139@tcp) after server handle changed from 0xd4e4d3cb0414820a to 0xd4e4d3cb04175882 [ 539.744536] Lustre: MGC192.168.204.139@tcp: Connection restored to (at 192.168.204.139@tcp) [ 539.760649] LustreError: 2002:0:(mdc_request.c:660:mdc_replay_open()) @@@ cannot properly replay without open data req@ffff8800aa6ab480 x1835626977787008/t4294972777(4294972777) o101->lustre-MDT0000-mdc-ffff8800b5c5f000@192.168.204.139@tcp:12/10 lens 608/608 e 0 to 0 dl 1750590828 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'touch.0' uid:0 gid:0 projid:0 [ 539.779514] LustreError: 2002:0:(client.c:3395:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800aa6ab480 x1835626977787008/t4294972777(4294972777) o101->lustre-MDT0000-mdc-ffff8800b5c5f000@192.168.204.139@tcp:12/10 lens 608/608 e 0 to 0 dl 1750590828 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'touch.0' uid:0 gid:0 projid:0 [ 543.876808] Lustre: lustre-MDT0000-mdc-ffff8800b5c5f000: Connection restored to (at 192.168.204.139@tcp) [ 545.349692] Lustre: DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 546.244412] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 554.760383] Lustre: lustre-MDT0000-mdc-ffff8800b5c5f000: Connection to lustre-MDT0000 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 569.778615] Lustre: lustre-OST0000-osc-ffff8800b5c5f000: disconnect after 22s idle [ 569.779866] LustreError: MGC192.168.204.139@tcp: Connection to MGS (at 192.168.204.139@tcp) was lost; in progress operations using this service will fail [ 569.784104] Lustre: Skipped 1 previous similar message [ 569.784593] Lustre: Evicted from MGS (at 192.168.204.139@tcp) after server handle changed from 0xd4e4d3cb04175882 to 0xd4e4d3cb04175e01 [ 569.785408] Lustre: MGC192.168.204.139@tcp: Connection restored to (at 192.168.204.139@tcp) [ 569.792649] LustreError: 2002:0:(mdc_request.c:660:mdc_replay_open()) @@@ cannot properly replay without open data req@ffff8800aa6ab480 x1835626977787008/t4294972777(4294972777) o101->lustre-MDT0000-mdc-ffff8800b5c5f000@192.168.204.139@tcp:12/10 lens 608/608 e 0 to 0 dl 1750590858 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'touch.0' uid:0 gid:0 projid:0 [ 569.804016] LustreError: 2002:0:(client.c:3395:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a8104700 x1835626977807872/t8589934595(8589934595) o101->lustre-MDT0000-mdc-ffff8800b5c5f000@192.168.204.139@tcp:12/10 lens 584/608 e 0 to 0 dl 1750590858 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'multiop.0' uid:0 gid:0 projid:0 [ 569.818194] LustreError: 2002:0:(client.c:3395:ptlrpc_replay_interpret()) Skipped 2 previous similar messages [ 572.185516] Lustre: lustre-MDT0000-mdc-ffff8800b5c5f000: Connection restored to (at 192.168.204.139@tcp) [ 573.764568] Lustre: DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 574.423941] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 579.789506] Lustre: DEBUG MARKER: == sanity test 209: read-only open/close requests should be freed promptly ========================================================== 07:14:11 (1750590851) [ 585.076577] bash (16759): drop_caches: 3 [ 588.801832] bash (16759): drop_caches: 3 [ 591.701286] Lustre: DEBUG MARKER: == sanity test 210: lfs getstripe does not break leases == 07:14:23 (1750590863) [ 596.614530] Lustre: DEBUG MARKER: == sanity test 212: Sendfile test ====================================================================================================== 07:14:28 (1750590868) [ 601.151487] Lustre: DEBUG MARKER: == sanity test 213: OSC lock completion and cancel race don't crash - bug 18829 ========================================================== 07:14:33 (1750590873) [ 601.332282] LustreError: 2003:0:(osc_request.c:3127:osc_enqueue_interpret()) cfs_fail_timeout id 40f sleeping for 10000ms [ 611.359418] LustreError: 2003:0:(osc_request.c:3127:osc_enqueue_interpret()) cfs_fail_timeout id 40f awake [ 611.377825] cat (19355) used greatest stack depth: 10240 bytes left [ 614.242110] Lustre: DEBUG MARKER: == sanity test 214: hash-indexed directory test - bug 20133 ========================================================== 07:14:46 (1750590886) [ 636.425562] Lustre: DEBUG MARKER: == sanity test 215: lnet exists and has proper content - bugs 18102, 21079, 21517 ========================================================== 07:15:08 (1750590908) [ 640.177975] Lustre: DEBUG MARKER: == sanity test 216: check lockless direct write updates file size and kms correctly ========================================================== 07:15:12 (1750590912) [ 650.628646] Lustre: DEBUG MARKER: == sanity test 217: check lctl ping for hostnames with embedded hyphen ('-') ========================================================== 07:15:22 (1750590922) [ 654.667281] Lustre: DEBUG MARKER: == sanity test 218: parallel read and truncate should not deadlock ========================================================== 07:15:26 (1750590926) [ 655.456785] Lustre: DEBUG MARKER: creating a 10 Mb file [ 674.960926] Lustre: lustre-OST0000-osc-ffff8800b5c5f000: disconnect after 22s idle [ 674.965360] Lustre: Skipped 1 previous similar message [ 684.611144] Lustre: DEBUG MARKER: starting reads [ 685.064635] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 685.067034] in_atomic(): 1, irqs_disabled(): 0, pid: 23641, name: dd [ 685.069137] CPU: 0 PID: 23641 Comm: dd Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 685.073732] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 685.077897] Call Trace: [ 685.079097] [] dump_stack+0x19/0x1b [ 685.082927] [] __might_sleep+0xd9/0x100 [ 685.092747] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 685.095120] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 685.103658] [] do_read_folio+0xd83/0x1290 [lustre] [ 685.117827] [] ll_readpage+0xe/0x10 [lustre] [ 685.120458] [] do_generic_file_read.constprop.52+0x225/0x540 [ 685.127244] [] generic_file_aio_read+0x1c9/0x290 [ 685.130122] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 685.133684] [] ll_file_read_iter+0x2d/0x40 [lustre] [ 685.137719] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 685.140793] [] ll_file_read+0x111/0x1e0 [lustre] [ 685.145200] [] vfs_read+0xb9/0x1c0 [ 685.147991] [] SyS_read+0x7f/0xf0 [ 685.150885] [] system_call_fastpath+0x1f/0x24 [ 685.153204] BUG: scheduling while atomic: dd/23641/0x10000002 [ 685.155410] Modules linked in: lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata [ 685.228178] CPU: 0 PID: 23641 Comm: dd Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 685.235895] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 685.241662] Call Trace: [ 685.242928] [] dump_stack+0x19/0x1b [ 685.248113] [] __schedule_bug+0x64/0x72 [ 685.250575] [] __schedule+0x791/0x7d0 [ 685.256222] [] __cond_resched+0x26/0x30 [ 685.265165] [] _cond_resched+0x3a/0x50 [ 685.267864] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 685.272667] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 685.280659] [] do_read_folio+0xd83/0x1290 [lustre] [ 685.284387] [] ll_readpage+0xe/0x10 [lustre] [ 685.292102] [] do_generic_file_read.constprop.52+0x225/0x540 [ 685.295112] [] generic_file_aio_read+0x1c9/0x290 [ 685.296326] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 685.299135] [] ll_file_read_iter+0x2d/0x40 [lustre] [ 685.302604] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 685.306660] [] ll_file_read+0x111/0x1e0 [lustre] [ 685.309685] [] vfs_read+0xb9/0x1c0 [ 685.311963] [] SyS_read+0x7f/0xf0 [ 685.313825] [] system_call_fastpath+0x1f/0x24 [ 685.377032] Lustre: DEBUG MARKER: truncating the file [ 686.555675] Lustre: DEBUG MARKER: killing dd [ 687.148190] Lustre: DEBUG MARKER: removing the temporary file [ 690.457646] Lustre: DEBUG MARKER: == sanity test 219: LU-394: Write partial won't cause uncontiguous pages vec at LND ========================================================== 07:16:02 (1750590962) [ 690.643009] Lustre: *** cfs_fail_loc=411, val=0*** [ 694.187541] Lustre: DEBUG MARKER: == sanity test 220: preallocated MDS objects still used if ENOSPC from OST ========================================================== 07:16:06 (1750590966) [ 711.909127] Lustre: DEBUG MARKER: == sanity test 221: make sure fault and truncate race to not cause OOM ========================================================== 07:16:23 (1750590983) [ 717.363304] Lustre: DEBUG MARKER: == sanity test 222a: AGL for ls should not trigger CLIO lock failure ========================================================== 07:16:29 (1750590989) [ 721.405733] Lustre: DEBUG MARKER: == sanity test 222b: AGL for rmdir should not trigger CLIO lock failure ========================================================== 07:16:33 (1750590993) [ 725.340841] Lustre: DEBUG MARKER: == sanity test 223: osc reenqueue if without AGL lock granted ================================================================================= 07:16:37 (1750590997) [ 729.743658] Lustre: DEBUG MARKER: == sanity test 224a: Don't panic on bulk IO failure ====== 07:16:41 (1750591001) [ 729.962655] Lustre: *** cfs_fail_loc=508, val=2147483648*** [ 729.965591] LustreError: 1998:0:(events.c:193:client_bulk_callback()) event type 1, status -5, desc ffff8800a889e400 [ 729.971124] Lustre: 2004:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1750591002/real 1750591002] req@ffff8800b6773100 x1835626978488576/t0(0) o4->lustre-OST0001-osc-ffff8800b5c5f000@192.168.204.139@tcp:6/4 lens 488/448 e 0 to 1 dl 1750591018 ref 2 fl Rpc:eXQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 [ 729.983254] Lustre: lustre-OST0001-osc-ffff8800b5c5f000: Connection to lustre-OST0001 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 730.010984] Lustre: lustre-OST0001-osc-ffff8800b5c5f000: Connection restored to (at 192.168.204.139@tcp) [ 734.435823] Lustre: DEBUG MARKER: == sanity test 224b: Don't panic on bulk IO failure ====== 07:16:46 (1750591006) [ 744.990241] Lustre: DEBUG MARKER: == sanity test 224c: Don't hang if one of md lost during large bulk RPC ========================================================== 07:16:56 (1750591016) [ 755.044094] Lustre: lustre-OST0001-osc-ffff8800b5c5f000: disconnect after 20s idle [ 758.775714] Lustre: 30784:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1750591026/real 1750591026] req@ffff8800b6770700 x1835626978503808/t0(0) o35->lustre-MDT0000-mdc-ffff8800b5c5f000@192.168.204.139@tcp:23/10 lens 392/624 e 0 to 1 dl 1750591031 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 [ 758.799268] Lustre: lustre-MDT0000-mdc-ffff8800b5c5f000: Connection to lustre-MDT0000 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 758.828051] Lustre: lustre-MDT0000-mdc-ffff8800b5c5f000: Connection restored to (at 192.168.204.139@tcp) [ 770.028792] Lustre: DEBUG MARKER: == sanity test 224d: Don't corrupt data on bulk IO timeout ========================================================== 07:17:21 (1750591041) [ 792.875444] Lustre: 2003:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1750591045/real 1750591045] req@ffff8800b6770000 x1835626978517120/t0(0) o3->lustre-OST0000-osc-ffff8800b5c5f000@192.168.204.139@tcp:6/4 lens 488/440 e 0 to 1 dl 1750591065 ref 2 fl Bulk:RXMQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 [ 792.892123] Lustre: lustre-OST0000-osc-ffff8800b5c5f000: Connection to lustre-OST0000 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 792.903451] LustreError: 2003:0:(client.c:2322:ptlrpc_check_set()) @@@ bulk transfer failed 0/1048576/0 req@ffff8800b6770000 x1835626978517120/t0(0) o3->lustre-OST0000-osc-ffff8800b5c5f000@192.168.204.139@tcp:6/4 lens 488/440 e 0 to 1 dl 1750591065 ref 2 fl Bulk:ReXMQU/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 [ 792.919402] LustreError: 2003:0:(osc_request.c:2463:osc_brw_redo_request()) @@@ redo for recoverable error -5 req@ffff8800b6770000 x1835626978517120/t0(0) o3->lustre-OST0000-osc-ffff8800b5c5f000@192.168.204.139@tcp:6/4 lens 488/440 e 0 to 1 dl 1750591065 ref 2 fl Interpret:ReXMQU/600/0 rc -5/0 job:'dd.0' uid:0 gid:0 projid:0 [ 792.939098] Lustre: lustre-OST0000-osc-ffff8800b5c5f000: Connection restored to (at 192.168.204.139@tcp) [ 799.018885] Lustre: DEBUG MARKER: SKIP: sanity test_225a skipping excluded test 225a (base 225) [ 800.115743] Lustre: DEBUG MARKER: SKIP: sanity test_225b skipping excluded test 225b (base 225) [ 801.028737] Lustre: DEBUG MARKER: == sanity test 226a: call path2fid and fid2path on files of all type ========================================================== 07:17:53 (1750591073) [ 805.474629] Lustre: DEBUG MARKER: == sanity test 226b: call path2fid and fid2path on files of all type under remote dir ========================================================== 07:17:57 (1750591077) [ 809.815787] Lustre: DEBUG MARKER: == sanity test 226c: call path2fid and fid2path under remote dir with subdir mount ========================================================== 07:18:01 (1750591081) [ 810.415166] Lustre: Mounted lustre-client [ 810.533450] LustreError: 1882:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800a9a1f000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 810.548594] LustreError: 1882:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 810.618456] Lustre: Unmounted lustre-client [ 813.746654] LustreError: 2397:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012bf5d800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 813.751880] LustreError: 2397:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 813.759439] LustreError: 2397:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 813.762855] LustreError: 2397:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 813.799452] Lustre: Unmounted lustre-client [ 814.594664] Lustre: DEBUG MARKER: == sanity test 226d: verify fid2path with -n and -fn option ========================================================== 07:18:06 (1750591086) [ 818.710020] Lustre: DEBUG MARKER: == sanity test 226e: Verify path2fid -0 option with newline and space ========================================================== 07:18:10 (1750591090) [ 822.945229] Lustre: DEBUG MARKER: == sanity test 227: running truncated executable does not cause OOM ========================================================== 07:18:14 (1750591094) [ 826.743965] Lustre: DEBUG MARKER: == sanity test 228a: try to reuse idle OI blocks ========= 07:18:18 (1750591098) [ 828.048989] Lustre: *** cfs_fail_loc=1002, val=0*** [ 850.896458] Lustre: lustre-OST0001-osc-ffff8800b5c5f000: disconnect after 23s idle [ 957.984944] Lustre: DEBUG MARKER: == sanity test 228b: idle OI blocks can be reused after MDT restart ========================================================== 07:20:29 (1750591229) [ 959.758242] Lustre: *** cfs_fail_loc=1002, val=0*** [ 1071.260976] Lustre: lustre-MDT0000-mdc-ffff8800b5c5f000: Connection to lustre-MDT0000 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1081.272101] LustreError: MGC192.168.204.139@tcp: Connection to MGS (at 192.168.204.139@tcp) was lost; in progress operations using this service will fail [ 1081.298204] Lustre: Evicted from MGS (at 192.168.204.139@tcp) after server handle changed from 0xd4e4d3cb04175e01 to 0xd4e4d3cb042e964a [ 1081.310149] LustreError: 2002:0:(mdc_request.c:660:mdc_replay_open()) @@@ cannot properly replay without open data req@ffff8800aa6ab480 x1835626977787008/t4294972777(4294972777) o101->lustre-MDT0000-mdc-ffff8800b5c5f000@192.168.204.139@tcp:12/10 lens 608/608 e 0 to 0 dl 1750591369 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'touch.0' uid:0 gid:0 projid:0 [ 1081.312131] Lustre: MGC192.168.204.139@tcp: Connection restored to (at 192.168.204.139@tcp) [ 1106.306194] Lustre: lustre-OST0001-osc-ffff8800b5c5f000: disconnect after 21s idle [ 1110.814423] Lustre: DEBUG MARKER: == sanity test 228c: NOT shrink the last entry in OI index node to recycle idle leaf ========================================================== 07:23:02 (1750591382) [ 1112.357992] Lustre: *** cfs_fail_loc=1002, val=0*** [ 1353.196139] Lustre: DEBUG MARKER: == sanity test 229: getstripe/stat/rm/attr changes work on released files ========================================================== 07:27:05 (1750591625) [ 1356.812950] Lustre: DEBUG MARKER: == sanity test 230a: Create remote directory and files under the remote directory ========================================================== 07:27:08 (1750591628) [ 1361.038253] Lustre: DEBUG MARKER: == sanity test 230b: migrate directory =================== 07:27:13 (1750591633) [ 1397.475397] Lustre: DEBUG MARKER: == sanity test 230c: check directory accessiblity if migration failed ========================================================== 07:27:49 (1750591669) [ 1407.538058] Lustre: DEBUG MARKER: SKIP: sanity test_230d skipping SLOW test 230d [ 1408.318771] Lustre: DEBUG MARKER: == sanity test 230e: migrate mulitple local link files === 07:28:00 (1750591680) [ 1412.951402] Lustre: DEBUG MARKER: == sanity test 230f: migrate mulitple remote link files == 07:28:04 (1750591684) [ 1418.580478] Lustre: DEBUG MARKER: == sanity test 230g: migrate dir to non-exist MDT ======== 07:28:10 (1750591690) [ 1422.282831] Lustre: DEBUG MARKER: == sanity test 230h: migrate .. and root ================= 07:28:14 (1750591694) [ 1425.650367] Lustre: DEBUG MARKER: == sanity test 230i: lfs migrate -m tolerates trailing slashes ========================================================== 07:28:17 (1750591697) [ 1429.291520] Lustre: DEBUG MARKER: == sanity test 230j: DoM file data not changed after dir migration ========================================================== 07:28:21 (1750591701) [ 1433.664388] Lustre: DEBUG MARKER: == sanity test 230k: file data not changed after dir migration ========================================================== 07:28:25 (1750591705) [ 1434.637685] Lustre: DEBUG MARKER: SKIP: sanity test_230k needs >= 4 MDTs [ 1435.720123] Lustre: DEBUG MARKER: == sanity test 230l: readdir between MDTs won't crash ==== 07:28:27 (1750591707) [ 1522.419530] Lustre: DEBUG MARKER: == sanity test 230m: xattrs not changed after dir migration ========================================================== 07:29:54 (1750591794) [ 1525.666860] bash (17399): drop_caches: 3 [ 1526.769454] bash (17399): drop_caches: 3 [ 1530.793968] Lustre: DEBUG MARKER: == sanity test 230n: Dir migration with mirrored file ==== 07:30:02 (1750591802) [ 1534.901493] Lustre: DEBUG MARKER: == sanity test 230o: dir split =========================== 07:30:06 (1750591806) [ 1551.473792] Lustre: DEBUG MARKER: == sanity test 230p: dir merge =========================== 07:30:23 (1750591823) [ 1565.271630] LustreError: 20067:0:(llite_lib.c:1875:ll_update_lsm_md()) lustre: [0x2000013a1:0x3497:0x0] dir layout mismatch: [ 1565.276543] LustreError: 20067:0:(lustre_lmv.h:160:lmv_stripe_object_dump()) dump LMV: magic=0xcd20cd0 refs=1 count=1 index=0 hash=crush:0x2000003 max_inherit=0 max_inherit_rr=0 version=2 migrate_offset=0 migrate_hash=invalid:0 pool= [ 1565.287138] LustreError: 20067:0:(lustre_lmv.h:167:lmv_stripe_object_dump()) stripe[0] [0x200001b70:0x7d:0x0] [ 1565.293454] LustreError: 20067:0:(lustre_lmv.h:160:lmv_stripe_object_dump()) dump LMV: magic=0xcd20cd0 refs=1 count=2 index=0 hash=crush:0x88000003 max_inherit=0 max_inherit_rr=0 version=2 migrate_offset=1 migrate_hash=crush:86000003 pool= [ 1565.313886] LustreError: 20067:0:(llite_lib.c:3774:ll_prep_inode()) lustre: new_inode - fatal error: rc = -22 [ 1577.306043] Lustre: DEBUG MARKER: == sanity test 230q: dir auto split ====================== 07:30:49 (1750591849) [ 1608.855655] Lustre: DEBUG MARKER: == sanity test 230r: migrate with too many local locks === 07:31:20 (1750591880) [ 1614.702007] Lustre: DEBUG MARKER: == sanity test 230s: lfs mkdir should return -EEXIST if target exists ========================================================== 07:31:26 (1750591886) [ 1621.963772] Lustre: DEBUG MARKER: == sanity test 230t: migrate directory with project ID set ========================================================== 07:31:33 (1750591893) [ 1627.627436] Lustre: DEBUG MARKER: == sanity test 230u: migrate directory by QOS ============ 07:31:39 (1750591899) [ 1628.656903] Lustre: DEBUG MARKER: SKIP: sanity test_230u needs >= 4 MDTs [ 1629.867353] Lustre: DEBUG MARKER: == sanity test 230v: subdir migrated to the MDT where its parent is located ========================================================== 07:31:41 (1750591901) [ 1630.798481] Lustre: DEBUG MARKER: SKIP: sanity test_230v needs >= 4 MDTs [ 1632.133733] Lustre: DEBUG MARKER: == sanity test 230w: non-recursive mode dir migration ==== 07:31:43 (1750591903) [ 1639.385598] Lustre: DEBUG MARKER: == sanity test 230x: dir migration check space =========== 07:31:51 (1750591911) [ 1677.903044] Lustre: DEBUG MARKER: == sanity test 230y: unlink dir with bad hash type ======= 07:32:29 (1750591949) [ 1689.832611] Lustre: DEBUG MARKER: == sanity test 230z: resume dir migration with bad hash type ========================================================== 07:32:41 (1750591961) [ 1723.483070] Lustre: DEBUG MARKER: == sanity test 231a: checking that reading/writing of BRW RPC size results in one RPC ========================================================== 07:33:15 (1750591995) [ 1728.690221] Lustre: DEBUG MARKER: == sanity test 231b: must not assert on fully utilized OST request buffer ========================================================== 07:33:20 (1750592000) [ 1747.376585] Lustre: lustre-OST0001-osc-ffff8800b5c5f000: disconnect after 22s idle [ 1762.973130] Lustre: DEBUG MARKER: == sanity test 232a: failed lock should not block umount ========================================================== 07:33:54 (1750592034) [ 1763.655352] LustreError: lustre-OST0000-osc-ffff8800b5c5f000: operation ldlm_enqueue to node 192.168.204.139@tcp failed: rc = -12 [ 1765.045091] LustreError: 30045:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b5c5f000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1765.055849] LustreError: 30045:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 1765.060440] LustreError: 30045:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 1765.064087] LustreError: 30045:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1765.128139] Lustre: Unmounted lustre-client [ 1765.496752] Lustre: Mounted lustre-client [ 1765.497784] Lustre: Skipped 1 previous similar message [ 1770.503464] Lustre: lustre-OST0000-osc-ffff88012bf5a000: Connection to lustre-OST0000 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1777.704025] Lustre: lustre-OST0000-osc-ffff88012bf5a000: Connection restored to 192.168.204.139@tcp (at 192.168.204.139@tcp) [ 1777.709560] Lustre: Skipped 1 previous similar message [ 1781.646025] Lustre: DEBUG MARKER: == sanity test 232b: failed data version lock should not block umount ========================================================== 07:34:13 (1750592053) [ 1783.472009] LustreError: 31014:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012bf5a000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1783.482375] LustreError: 31014:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 1783.496243] LustreError: 31014:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 1783.498914] LustreError: 31014:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 1783.569896] Lustre: Unmounted lustre-client [ 1783.869041] Lustre: Mounted lustre-client [ 1788.874786] Lustre: lustre-OST0000-osc-ffff8800ad4d9800: Connection to lustre-OST0000 (at 192.168.204.139@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1796.777396] Lustre: lustre-OST0000-osc-ffff8800ad4d9800: Connection restored to 192.168.204.139@tcp (at 192.168.204.139@tcp) [ 1802.839119] Lustre: DEBUG MARKER: == sanity test 233a: checking that OBF of the FS root succeeds ========================================================== 07:34:34 (1750592074) [ 1806.690971] Lustre: DEBUG MARKER: == sanity test 233b: checking that OBF of the FS .lustre succeeds ========================================================== 07:34:38 (1750592078) [ 1810.534076] Lustre: DEBUG MARKER: == sanity test 234: xattr cache should not crash on ENOMEM ========================================================== 07:34:42 (1750592082) [ 1810.836960] Lustre: *** cfs_fail_loc=1405, val=0*** [ 1814.979024] Lustre: DEBUG MARKER: == sanity test 235: LU-1715: flock deadlock detection does not work properly ========================================================== 07:34:46 (1750592086) [ 1820.926988] Lustre: DEBUG MARKER: == sanity test 236: Layout swap on open unlinked file ==== 07:34:52 (1750592092) [ 1825.761433] Lustre: DEBUG MARKER: == sanity test 238: Verify linkea consistency ============ 07:34:57 (1750592097) [ 1830.171097] Lustre: DEBUG MARKER: == sanity test 239A: osp_sync test ======================= 07:35:02 (1750592102) [ 1891.369347] Lustre: DEBUG MARKER: == sanity test 239a: process invalid osp sync record correctly ========================================================== 07:36:03 (1750592163) [ 1900.415162] Lustre: DEBUG MARKER: == sanity test 239b: process osp sync record with ENOMEM error correctly ========================================================== 07:36:12 (1750592172) [ 1908.777931] Lustre: DEBUG MARKER: == sanity test 240: race between ldlm enqueue and the connection RPC (no ASSERT) ========================================================== 07:36:20 (1750592180) [ 1909.786801] LustreError: 6449:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800ad4d9800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1909.792156] LustreError: 6449:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 1909.799372] LustreError: 6449:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 1909.801935] LustreError: 6449:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 1909.862277] Lustre: Unmounted lustre-client [ 1910.697529] Lustre: Mounted lustre-client [ 1918.070292] Lustre: DEBUG MARKER: == sanity test 241a: bio vs dio ========================== 07:36:29 (1750592189) [ 1986.288543] Lustre: DEBUG MARKER: == sanity test 241b: dio vs dio ========================== 07:37:38 (1750592258) [ 2025.092123] Lustre: DEBUG MARKER: == sanity test 242: mdt_readpage failure should not cause directory unreadable ========================================================== 07:38:16 (1750592296) [ 2026.121882] LustreError: lustre-MDT0000-mdc-ffff8800b060d800: operation mds_readpage to node 192.168.204.139@tcp failed: rc = -12 [ 2031.952312] Lustre: DEBUG MARKER: == sanity test 243: various group lock tests ============= 07:38:23 (1750592303) [ 2040.320776] Lustre: 18209:0:(file.c:3149:ll_get_grouplock()) lustre: group lock already exists with gid 97486 on [0x200001b73:0x5:0x0]: rc = -22 [ 2040.332730] Lustre: 18209:0:(file.c:3224:ll_put_grouplock()) lustre: no group lock held on [0x200001b73:0x5:0x0]: rc = -22 [ 2040.349377] Lustre: 18209:0:(file.c:3131:ll_get_grouplock()) lustre: group id for group lock on [0x200001b73:0x5:0x0] is 0: rc = -22 [ 2040.362947] Lustre: 18209:0:(file.c:3234:ll_put_grouplock()) lustre: group lock 4294967286 doesn't match current id 3543 on [0x200001b73:0x5:0x0]: rc = -22 [ 2252.040696] Lustre: 18209:0:(file.c:3224:ll_put_grouplock()) lustre: no group lock held on [0x200001b73:0xc:0x0]: rc = -22 [ 2252.073507] Lustre: 18209:0:(file.c:3131:ll_get_grouplock()) lustre: group id for group lock on [0x200001b73:0xc:0x0] is 0: rc = -22 [ 2257.133212] Lustre: DEBUG MARKER: == sanity test 244a: sendfile with group lock tests ====== 07:42:08 (1750592528) [ 2295.270171] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2295.277736] in_atomic(): 1, irqs_disabled(): 0, pid: 19076, name: sendfile_groupl [ 2295.281301] CPU: 0 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2295.288232] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2295.292134] Call Trace: [ 2295.293102] [] dump_stack+0x19/0x1b [ 2295.295010] [] __might_sleep+0xd9/0x100 [ 2295.300992] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 2295.305837] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 2295.312513] [] do_read_folio+0xd83/0x1290 [lustre] [ 2295.318687] [] ll_readpage+0xe/0x10 [lustre] [ 2295.325198] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2295.337259] [] generic_file_aio_read+0x1c9/0x290 [ 2295.339616] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2295.342009] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2295.344045] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2295.346709] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2295.348820] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2295.350703] [] do_sync_readv_writev+0x79/0xd0 [ 2295.352323] [] do_readv_writev+0xce/0x260 [ 2295.373793] [] ? alloc_pages_current+0x98/0x110 [ 2295.392602] [] vfs_readv+0x32/0x60 [ 2295.394416] [] default_file_splice_read+0x2a5/0x3c0 [ 2295.396490] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2295.398526] [] ? string.isra.7+0x3b/0xf0 [ 2295.400243] [] ? vsnprintf+0x201/0x6a0 [ 2295.411252] [] ? string.isra.7+0x3b/0xf0 [ 2295.413474] [] ? snprintf+0x49/0x70 [ 2295.419675] [] ? do_raw_spin_unlock+0x49/0x90 [ 2295.425735] [] ? _raw_spin_unlock+0xe/0x20 [ 2295.427655] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2295.430543] [] do_splice_to+0x72/0x90 [ 2295.433471] [] splice_direct_to_actor+0xb7/0x200 [ 2295.437943] [] ? do_splice_from+0xf0/0xf0 [ 2295.441756] [] do_splice_direct+0x62/0x90 [ 2295.444201] [] do_sendfile+0x1d8/0x3c0 [ 2295.446038] [] SyS_sendfile64+0xda/0xf0 [ 2295.450608] [] system_call_fastpath+0x1f/0x24 [ 2295.452917] BUG: scheduling while atomic: sendfile_groupl/19076/0x10000002 [ 2295.459569] Modules linked in: lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata [ 2295.485065] CPU: 0 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2295.491487] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2295.498563] Call Trace: [ 2295.500581] [] dump_stack+0x19/0x1b [ 2295.504074] [] __schedule_bug+0x64/0x72 [ 2295.506018] [] __schedule+0x791/0x7d0 [ 2295.507812] [] __cond_resched+0x26/0x30 [ 2295.511649] [] _cond_resched+0x3a/0x50 [ 2295.514420] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 2295.518829] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 2295.521665] [] do_read_folio+0xd83/0x1290 [lustre] [ 2295.526034] [] ll_readpage+0xe/0x10 [lustre] [ 2295.528534] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2295.532422] [] generic_file_aio_read+0x1c9/0x290 [ 2295.534587] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2295.539244] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2295.541966] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2295.545902] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2295.548744] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2295.552748] [] do_sync_readv_writev+0x79/0xd0 [ 2295.556039] [] do_readv_writev+0xce/0x260 [ 2295.561067] [] ? alloc_pages_current+0x98/0x110 [ 2295.565111] [] vfs_readv+0x32/0x60 [ 2295.566997] [] default_file_splice_read+0x2a5/0x3c0 [ 2295.571404] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2295.576468] [] ? string.isra.7+0x3b/0xf0 [ 2295.579683] [] ? vsnprintf+0x201/0x6a0 [ 2295.583413] [] ? string.isra.7+0x3b/0xf0 [ 2295.587418] [] ? snprintf+0x49/0x70 [ 2295.589511] [] ? do_raw_spin_unlock+0x49/0x90 [ 2295.591689] [] ? _raw_spin_unlock+0xe/0x20 [ 2295.595987] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2295.600032] [] do_splice_to+0x72/0x90 [ 2295.603398] [] splice_direct_to_actor+0xb7/0x200 [ 2295.606006] [] ? do_splice_from+0xf0/0xf0 [ 2295.607966] [] do_splice_direct+0x62/0x90 [ 2295.609915] [] do_sendfile+0x1d8/0x3c0 [ 2295.611780] [] SyS_sendfile64+0xda/0xf0 [ 2295.613679] [] system_call_fastpath+0x1f/0x24 [ 2302.245287] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2302.247732] in_atomic(): 1, irqs_disabled(): 0, pid: 19076, name: sendfile_groupl [ 2302.249860] CPU: 2 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2302.258241] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2302.262918] Call Trace: [ 2302.263943] [] dump_stack+0x19/0x1b [ 2302.265773] [] __might_sleep+0xd9/0x100 [ 2302.270110] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 2302.271978] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 2302.279638] [] do_read_folio+0xd83/0x1290 [lustre] [ 2302.283622] [] ll_readpage+0xe/0x10 [lustre] [ 2302.287235] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2302.289112] [] generic_file_aio_read+0x1c9/0x290 [ 2302.295144] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2302.310433] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 2302.317456] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2302.321054] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2302.329375] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2302.334342] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2302.347826] [] do_sync_readv_writev+0x79/0xd0 [ 2302.351512] [] do_readv_writev+0xce/0x260 [ 2302.355521] [] ? alloc_pages_current+0x98/0x110 [ 2302.364513] [] vfs_readv+0x32/0x60 [ 2302.366147] [] default_file_splice_read+0x2a5/0x3c0 [ 2302.368301] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2302.382785] [] ? string.isra.7+0x3b/0xf0 [ 2302.386854] [] ? vsnprintf+0x201/0x6a0 [ 2302.393490] [] ? snprintf+0x49/0x70 [ 2302.398685] [] ? do_raw_spin_unlock+0x49/0x90 [ 2302.400174] [] ? _raw_spin_unlock+0xe/0x20 [ 2302.401483] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2302.403070] [] do_splice_to+0x72/0x90 [ 2302.404244] [] splice_direct_to_actor+0xb7/0x200 [ 2302.405585] [] ? do_splice_from+0xf0/0xf0 [ 2302.406842] [] do_splice_direct+0x62/0x90 [ 2302.408091] [] do_sendfile+0x1d8/0x3c0 [ 2302.409253] [] SyS_sendfile64+0xda/0xf0 [ 2302.410429] [] system_call_fastpath+0x1f/0x24 [ 2302.411718] BUG: scheduling while atomic: sendfile_groupl/19076/0x10000002 [ 2302.413278] Modules linked in: lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata [ 2302.440700] CPU: 2 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2302.446496] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2302.451583] Call Trace: [ 2302.454180] [] dump_stack+0x19/0x1b [ 2302.457726] [] __schedule_bug+0x64/0x72 [ 2302.461451] [] __schedule+0x791/0x7d0 [ 2302.466007] [] __cond_resched+0x26/0x30 [ 2302.471244] [] _cond_resched+0x3a/0x50 [ 2302.474645] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 2302.477149] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 2302.479845] [] do_read_folio+0xd83/0x1290 [lustre] [ 2302.482532] [] ll_readpage+0xe/0x10 [lustre] [ 2302.484895] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2302.488575] [] generic_file_aio_read+0x1c9/0x290 [ 2302.493022] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2302.496300] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 2302.499537] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2302.503212] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2302.508084] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2302.510092] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2302.522074] [] do_sync_readv_writev+0x79/0xd0 [ 2302.533771] [] do_readv_writev+0xce/0x260 [ 2302.541751] [] ? alloc_pages_current+0x98/0x110 [ 2302.543461] [] vfs_readv+0x32/0x60 [ 2302.545281] [] default_file_splice_read+0x2a5/0x3c0 [ 2302.547471] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2302.549802] [] ? string.isra.7+0x3b/0xf0 [ 2302.551811] [] ? vsnprintf+0x201/0x6a0 [ 2302.553428] [] ? snprintf+0x49/0x70 [ 2302.577834] [] ? do_raw_spin_unlock+0x49/0x90 [ 2302.589146] [] ? _raw_spin_unlock+0xe/0x20 [ 2302.591525] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2302.605916] [] do_splice_to+0x72/0x90 [ 2302.607911] [] splice_direct_to_actor+0xb7/0x200 [ 2302.611144] [] ? do_splice_from+0xf0/0xf0 [ 2302.613897] [] do_splice_direct+0x62/0x90 [ 2302.619078] [] do_sendfile+0x1d8/0x3c0 [ 2302.622428] [] SyS_sendfile64+0xda/0xf0 [ 2302.627474] [] system_call_fastpath+0x1f/0x24 [ 2308.944820] BUG: sleeping function called from invalid context at mm/slub.c:989 [ 2308.947040] in_atomic(): 1, irqs_disabled(): 0, pid: 19076, name: sendfile_groupl [ 2308.953609] CPU: 1 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2308.960282] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2308.968801] Call Trace: [ 2308.971146] [] dump_stack+0x19/0x1b [ 2308.974945] [] __might_sleep+0xd9/0x100 [ 2308.977582] [] kmem_cache_alloc_trace+0x57/0x2e0 [ 2308.981197] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 2308.984192] [] do_read_folio+0xd83/0x1290 [lustre] [ 2308.988481] [] ll_readpage+0xe/0x10 [lustre] [ 2308.993143] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2309.000289] [] generic_file_aio_read+0x1c9/0x290 [ 2309.009194] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2309.014883] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 2309.017126] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2309.019179] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2309.021463] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2309.027267] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2309.033062] [] do_sync_readv_writev+0x79/0xd0 [ 2309.035907] [] do_readv_writev+0xce/0x260 [ 2309.037553] [] ? alloc_pages_current+0x98/0x110 [ 2309.039674] [] vfs_readv+0x32/0x60 [ 2309.041203] [] default_file_splice_read+0x2a5/0x3c0 [ 2309.043337] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2309.045401] [] ? string.isra.7+0x3b/0xf0 [ 2309.066110] [] ? vsnprintf+0x201/0x6a0 [ 2309.073489] [] ? snprintf+0x49/0x70 [ 2309.080317] [] ? do_raw_spin_unlock+0x49/0x90 [ 2309.088120] [] ? _raw_spin_unlock+0xe/0x20 [ 2309.090040] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2309.091928] [] do_splice_to+0x72/0x90 [ 2309.093371] [] splice_direct_to_actor+0xb7/0x200 [ 2309.095043] [] ? do_splice_from+0xf0/0xf0 [ 2309.096380] [] do_splice_direct+0x62/0x90 [ 2309.097720] [] do_sendfile+0x1d8/0x3c0 [ 2309.099344] [] SyS_sendfile64+0xda/0xf0 [ 2309.101298] [] system_call_fastpath+0x1f/0x24 [ 2309.103164] BUG: scheduling while atomic: sendfile_groupl/19076/0x10000002 [ 2309.105504] Modules linked in: lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata [ 2309.175940] CPU: 1 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2309.184579] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2309.193168] Call Trace: [ 2309.193991] [] dump_stack+0x19/0x1b [ 2309.201694] [] __schedule_bug+0x64/0x72 [ 2309.202999] [] __schedule+0x791/0x7d0 [ 2309.205677] [] __cond_resched+0x26/0x30 [ 2309.209983] [] _cond_resched+0x3a/0x50 [ 2309.211595] [] kmem_cache_alloc_trace+0x5c/0x2e0 [ 2309.215809] [] ? do_read_folio+0xd83/0x1290 [lustre] [ 2309.218896] [] do_read_folio+0xd83/0x1290 [lustre] [ 2309.223161] [] ll_readpage+0xe/0x10 [lustre] [ 2309.225868] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2309.230745] [] generic_file_aio_read+0x1c9/0x290 [ 2309.233485] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2309.236073] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 2309.238173] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2309.239641] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2309.250021] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2309.254452] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2309.257608] [] do_sync_readv_writev+0x79/0xd0 [ 2309.261561] [] do_readv_writev+0xce/0x260 [ 2309.263744] [] ? alloc_pages_current+0x98/0x110 [ 2309.265152] [] vfs_readv+0x32/0x60 [ 2309.268831] [] default_file_splice_read+0x2a5/0x3c0 [ 2309.270906] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2309.276416] [] ? string.isra.7+0x3b/0xf0 [ 2309.278214] [] ? vsnprintf+0x201/0x6a0 [ 2309.279928] [] ? snprintf+0x49/0x70 [ 2309.285719] [] ? do_raw_spin_unlock+0x49/0x90 [ 2309.289162] [] ? _raw_spin_unlock+0xe/0x20 [ 2309.292243] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2309.296774] [] do_splice_to+0x72/0x90 [ 2309.299199] [] splice_direct_to_actor+0xb7/0x200 [ 2309.303824] [] ? do_splice_from+0xf0/0xf0 [ 2309.307893] [] do_splice_direct+0x62/0x90 [ 2309.312993] [] do_sendfile+0x1d8/0x3c0 [ 2309.314402] [] SyS_sendfile64+0xda/0xf0 [ 2309.316379] [] system_call_fastpath+0x1f/0x24 [ 2309.319085] LustreError: 19076:0:(cl_object.c:989:cl_env_percpu_put()) ASSERTION( cle == &cl_env_percpu[cpu] ) failed: [ 2309.322107] LustreError: 19076:0:(cl_object.c:989:cl_env_percpu_put()) LBUG [ 2309.328926] CPU: 0 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2309.333773] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2309.342044] Call Trace: [ 2309.343616] [] dump_stack+0x19/0x1b [ 2309.345688] [] lbug_with_loc+0x4d/0xa0 [libcfs] [ 2309.347346] [] cl_env_percpu_put+0x7e/0xb0 [obdclass] [ 2309.350305] [] do_read_folio+0x6fc/0x1290 [lustre] [ 2309.354282] [] ll_readpage+0xe/0x10 [lustre] [ 2309.356152] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2309.357909] [] generic_file_aio_read+0x1c9/0x290 [ 2309.363614] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2309.366382] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 2309.369524] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2309.373100] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2309.375491] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2309.378503] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2309.381037] [] do_sync_readv_writev+0x79/0xd0 [ 2309.385063] [] do_readv_writev+0xce/0x260 [ 2309.388087] [] ? alloc_pages_current+0x98/0x110 [ 2309.390302] [] vfs_readv+0x32/0x60 [ 2309.393986] [] default_file_splice_read+0x2a5/0x3c0 [ 2309.398852] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2309.402648] [] ? string.isra.7+0x3b/0xf0 [ 2309.405425] [] ? vsnprintf+0x201/0x6a0 [ 2309.408198] [] ? snprintf+0x49/0x70 [ 2309.410016] [] ? do_raw_spin_unlock+0x49/0x90 [ 2309.413153] [] ? _raw_spin_unlock+0xe/0x20 [ 2309.419008] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2309.421455] [] do_splice_to+0x72/0x90 [ 2309.423844] [] splice_direct_to_actor+0xb7/0x200 [ 2309.426618] [] ? do_splice_from+0xf0/0xf0 [ 2309.432099] [] do_splice_direct+0x62/0x90 [ 2309.435337] [] do_sendfile+0x1d8/0x3c0 [ 2309.438649] [] SyS_sendfile64+0xda/0xf0 [ 2309.443330] [] system_call_fastpath+0x1f/0x24 [ 2309.445599] Kernel panic - not syncing: LBUG [ 2309.446949] CPU: 0 PID: 19076 Comm: sendfile_groupl Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 2309.450867] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 2309.453379] Call Trace: [ 2309.453993] [] dump_stack+0x19/0x1b [ 2309.455514] [] panic+0xe8/0x20d [ 2309.457267] [] lbug_with_loc+0x95/0xa0 [libcfs] [ 2309.459661] [] cl_env_percpu_put+0x7e/0xb0 [obdclass] [ 2309.461803] [] do_read_folio+0x6fc/0x1290 [lustre] [ 2309.463690] [] ll_readpage+0xe/0x10 [lustre] [ 2309.465700] [] do_generic_file_read.constprop.52+0x225/0x540 [ 2309.469013] [] generic_file_aio_read+0x1c9/0x290 [ 2309.471383] [] do_file_read_iter+0x96a/0x1370 [lustre] [ 2309.473917] [] ? libcfs_debug_msg+0x4c9/0xc60 [libcfs] [ 2309.476066] [] ? ll_file_write+0x1e0/0x1e0 [lustre] [ 2309.477894] [] do_loop_readv_writev.isra.65+0x84/0xc0 [lustre] [ 2309.480502] [] ll_file_read_iter+0x22/0x40 [lustre] [ 2309.482996] [] ll_file_aio_read+0x1d6/0x210 [lustre] [ 2309.485643] [] do_sync_readv_writev+0x79/0xd0 [ 2309.487234] [] do_readv_writev+0xce/0x260 [ 2309.488935] [] ? alloc_pages_current+0x98/0x110 [ 2309.491109] [] vfs_readv+0x32/0x60 [ 2309.492550] [] default_file_splice_read+0x2a5/0x3c0 [ 2309.494955] [] ? page_cache_pipe_buf_release+0x20/0x20 [ 2309.497368] [] ? string.isra.7+0x3b/0xf0 [ 2309.499700] [] ? vsnprintf+0x201/0x6a0 [ 2309.501805] [] ? snprintf+0x49/0x70 [ 2309.503330] [] ? do_raw_spin_unlock+0x49/0x90 [ 2309.507241] [] ? _raw_spin_unlock+0xe/0x20 [ 2309.509689] [] pcc_file_splice_read+0x195/0x270 [lustre] [ 2309.511672] [] do_splice_to+0x72/0x90 [ 2309.515454] [] splice_direct_to_actor+0xb7/0x200 [ 2309.520324] [] ? do_splice_from+0xf0/0xf0 [ 2309.522138] [] do_splice_direct+0x62/0x90 [ 2309.524649] [] do_sendfile+0x1d8/0x3c0 [ 2309.526802] [] SyS_sendfile64+0xda/0xf0 [ 2309.528366] [] system_call_fastpath+0x1f/0x24