[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] AGP: No AGP bridge found [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 00C0000000 mask FFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] mapped at [ffffffffff200b50] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2f2000-0xbffcffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5970 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1bb7 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1a53 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1ac7 00090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1b57 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1b8f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 452901057 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffd9fff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043832 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782298 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027499 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] AGP: Checking aperture... [ 0.000000] AGP: No AGP bridge found [ 0.000000] Memory: 3820316k/5224448k available (8172k kernel code, 1049120k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.490681] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.492650] pid_max: default: 32768 minimum: 301 [ 0.493787] Security Framework initialized [ 0.494804] SELinux: Initializing. [ 0.495673] SELinux: Starting in permissive mode [ 0.497378] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.501655] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.504547] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.506167] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.508038] Initializing cgroup subsys memory [ 0.509120] Initializing cgroup subsys devices [ 0.510217] Initializing cgroup subsys freezer [ 0.511143] Initializing cgroup subsys net_cls [ 0.512084] Initializing cgroup subsys blkio [ 0.512952] Initializing cgroup subsys perf_event [ 0.513919] Initializing cgroup subsys hugetlb [ 0.515009] Initializing cgroup subsys pids [ 0.516333] Initializing cgroup subsys net_prio [ 0.518293] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.520318] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.522285] tlb_flushall_shift: 6 [ 0.523433] FEATURE SPEC_CTRL Not Present [ 0.525625] FEATURE IBPB_SUPPORT Not Present [ 0.526882] Spectre V2 : Vulnerable [ 0.527816] Speculative Store Bypass: Vulnerable [ 0.530237] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.537704] ACPI: Core revision 20130517 [ 0.540858] ACPI: All ACPI Tables successfully acquired [ 0.542317] ftrace: allocating 30294 entries in 119 pages [ 0.588331] Enabling x2apic [ 0.588928] Enabled x2apic [ 0.589708] Switched APIC routing to physical x2apic. [ 0.591759] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.592881] smpboot: CPU0: Intel QEMU Virtual CPU version 2.5+ (fam: 0f, model: 6b, stepping: 01) [ 0.696614] Performance Events: unsupported Netburst CPU model 107 no PMU driver, software events only. [ 0.712358] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.715812] KVM setup async PF for cpu 1 [ 0.716543] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.729454] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.734594] KVM setup async PF for cpu 2 [ 0.700331] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.736272] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.745961] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.750359] KVM setup async PF for cpu 3 [ 0.750362] Brought up 4 CPUs [ 0.750368] smpboot: Max logical packages: 1 [ 0.750371] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.756524] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.760534] devtmpfs: initialized [ 0.761977] x86/mm: Memory block size: 128MB [ 0.766137] EVM: security.selinux [ 0.766938] EVM: security.ima [ 0.767634] EVM: security.capability [ 0.770615] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.772644] NET: Registered protocol family 16 [ 0.773925] cpuidle: using governor haltpoll [ 0.775311] ACPI: bus type PCI registered [ 0.776210] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.777803] PCI: Using configuration type 1 for base access [ 0.784872] ACPI: Added _OSI(Module Device) [ 0.786005] ACPI: Added _OSI(Processor Device) [ 0.787220] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.788705] ACPI: Added _OSI(Processor Aggregator Device) [ 0.789847] ACPI: Added _OSI(Linux-Dell-Video) [ 0.791653] ACPI: EC: Look up EC in DSDT [ 0.794454] ACPI: Interpreter enabled [ 0.795441] ACPI: (supports S0 S3 S4 S5) [ 0.796170] ACPI: Using IOAPIC for interrupt routing [ 0.797436] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.799201] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.803944] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.805232] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.806875] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.808387] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.811511] acpiphp: Slot [2] registered [ 0.812356] acpiphp: Slot [3] registered [ 0.813191] acpiphp: Slot [4] registered [ 0.814278] acpiphp: Slot [5] registered [ 0.815124] acpiphp: Slot [6] registered [ 0.816009] acpiphp: Slot [7] registered [ 0.816889] acpiphp: Slot [8] registered [ 0.818120] acpiphp: Slot [9] registered [ 0.818921] acpiphp: Slot [10] registered [ 0.819866] acpiphp: Slot [11] registered [ 0.820720] acpiphp: Slot [12] registered [ 0.821538] acpiphp: Slot [13] registered [ 0.822377] acpiphp: Slot [14] registered [ 0.823144] acpiphp: Slot [15] registered [ 0.824137] acpiphp: Slot [16] registered [ 0.824976] acpiphp: Slot [17] registered [ 0.825903] acpiphp: Slot [18] registered [ 0.826739] acpiphp: Slot [19] registered [ 0.827592] acpiphp: Slot [20] registered [ 0.828591] acpiphp: Slot [21] registered [ 0.829495] acpiphp: Slot [22] registered [ 0.831262] acpiphp: Slot [23] registered [ 0.832551] acpiphp: Slot [24] registered [ 0.833368] acpiphp: Slot [25] registered [ 0.834724] acpiphp: Slot [26] registered [ 0.835488] acpiphp: Slot [27] registered [ 0.836390] acpiphp: Slot [28] registered [ 0.838119] acpiphp: Slot [29] registered [ 0.839656] acpiphp: Slot [30] registered [ 0.841118] acpiphp: Slot [31] registered [ 0.842536] PCI host bridge to bus 0000:00 [ 0.844260] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.845842] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.848062] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.850156] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.852279] pci_bus 0000:00: root bus resource [mem 0x140000000-0x1bfffffff window] [ 0.854974] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.857331] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.858084] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.858899] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.863606] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.866062] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.868871] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.870658] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.872811] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.875132] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.875729] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.877799] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.880637] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.882318] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.889176] pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.890435] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.891542] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.895288] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.898589] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.906107] pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.909458] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.912765] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.914579] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.926559] pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.929812] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 0.931174] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 0.933326] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 0.934939] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 0.936217] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 0.938607] vgaarb: loaded [ 0.939835] SCSI subsystem initialized [ 0.940714] ACPI: bus type USB registered [ 0.941984] usbcore: registered new interface driver usbfs [ 0.943126] usbcore: registered new interface driver hub [ 0.944238] usbcore: registered new device driver usb [ 0.945813] PCI: Using ACPI for IRQ routing [ 0.946792] PCI: pci_cache_line_size set to 64 bytes [ 0.946957] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 0.946962] e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] [ 0.946963] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 0.947872] NetLabel: Initializing [ 0.948835] NetLabel: domain hash size = 128 [ 0.950240] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.951780] NetLabel: unlabeled traffic allowed by default [ 0.954001] HPET: 3 timers in total, 0 timers will be used for per-cpu timer [ 0.956324] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.957804] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.962930] amd_nb: Cannot enumerate AMD northbridges [ 0.964357] Switched to clocksource kvm-clock [ 0.977203] pnp: PnP ACPI init [ 0.978361] ACPI: bus type PNP registered [ 0.979442] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 0.979496] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 0.979526] pnp 00:02: [dma 2] [ 0.979553] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 0.979607] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.979666] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.979716] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.979978] pnp: PnP ACPI: found 6 devices [ 0.980810] ACPI: bus type PNP unregistered [ 0.990731] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.990737] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.990741] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.990744] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.990747] pci_bus 0000:00: resource 8 [mem 0x140000000-0x1bfffffff window] [ 0.990825] NET: Registered protocol family 2 [ 0.992688] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 0.995048] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 0.997403] TCP: Hash tables configured (established 32768 bind 32768) [ 0.998871] TCP: reno registered [ 0.999652] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 1.000929] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 1.003095] NET: Registered protocol family 1 [ 1.004943] RPC: Registered named UNIX socket transport module. [ 1.006843] RPC: Registered udp transport module. [ 1.008358] RPC: Registered tcp transport module. [ 1.009721] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.011101] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.012364] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.013971] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.015267] PCI: CLS 0 bytes, default 64 [ 1.015404] Unpacking initramfs... [ 2.324576] debug: unmapping init [mem 0xffff8800bc2f2000-0xffff8800bffcffff] [ 2.327248] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.328656] software IO TLB [mem 0xb82f2000-0xbc2f2000] (64MB) mapped at [ffff8800b82f2000-ffff8800bc2f1fff] [ 2.332759] cryptomgr_test (52) used greatest stack depth: 14128 bytes left [ 2.333150] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 2.333205] Initialise system trusted keyring [ 2.363846] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 2.368247] zpool: loaded [ 2.368881] zbud: loaded [ 2.369949] VFS: Disk quotas dquot_6.6.0 [ 2.371716] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.374858] NFS: Registering the id_resolver key type [ 2.375940] Key type id_resolver registered [ 2.376874] Key type id_legacy registered [ 2.377691] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 2.379699] Key type big_key registered [ 2.380656] SELinux: Registering netfilter hooks [ 2.381952] cryptomgr_test (58) used greatest stack depth: 13968 bytes left [ 2.383393] cryptomgr_test (61) used greatest stack depth: 13664 bytes left [ 2.383917] NET: Registered protocol family 38 [ 2.383928] Key type asymmetric registered [ 2.383931] Asymmetric key parser 'x509' registered [ 2.384009] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 2.384298] io scheduler noop registered [ 2.384303] io scheduler deadline registered (default) [ 2.384401] io scheduler cfq registered [ 2.384407] io scheduler mq-deadline registered [ 2.384412] io scheduler kyber registered [ 2.386967] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 2.386979] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 2.387395] cryptomgr_test (63) used greatest stack depth: 13536 bytes left [ 2.398815] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.400640] ACPI: Power Button [PWRF] [ 2.401600] GHES: HEST is not enabled! [ 2.446244] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 2.495752] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 2.547100] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.573964] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 2.601091] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 2.603922] Non-volatile memory driver v1.3 [ 2.605168] Linux agpgart interface v0.103 [ 2.606863] crash memory driver: version 1.1 [ 2.608775] nbd: registered device at major 43 [ 2.613271] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 2.613328] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 2.613382] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 2.613415] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 2.613455] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 2.620189] virtio_blk virtio1: [vda] 65496 512-byte logical blocks (33.5 MB/31.9 MiB) [ 2.625196] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 2.625243] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 2.625270] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 2.625300] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 2.625377] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 2.631383] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.636456] rdac: device handler registered [ 2.638089] hp_sw: device handler registered [ 2.639519] emc: device handler registered [ 2.641124] libphy: Fixed MDIO Bus: probed [ 2.644005] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.646615] ehci-pci: EHCI PCI platform driver [ 2.648024] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.650010] ohci-pci: OHCI PCI platform driver [ 2.651483] uhci_hcd: USB Universal Host Controller Interface driver [ 2.653231] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.657172] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.658625] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.660491] mousedev: PS/2 mouse device common for all mice [ 2.662835] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.663005] rtc_cmos 00:05: RTC can wake from S4 [ 2.663746] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 2.664168] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.664281] kvm: host does not support poll control [ 2.664281] kvm: host upgrade recommended [ 2.667099] hidraw: raw HID events driver (C) Jiri Kosina [ 2.667392] usbcore: registered new interface driver usbhid [ 2.667392] usbhid: USB HID core driver [ 2.667487] drop_monitor: Initializing network drop monitor service [ 2.667541] Netfilter messages via NETLINK v0.30. [ 2.667612] TCP: cubic registered [ 2.667619] Initializing XFRM netlink socket [ 2.667806] NET: Registered protocol family 10 [ 2.668739] NET: Registered protocol family 17 [ 2.668777] Key type dns_resolver registered [ 2.669137] mce: Using 10 MCE banks [ 2.669450] Loading compiled-in X.509 certificates [ 2.670481] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 2.670531] registered taskstats version 1 [ 2.673238] modprobe (72) used greatest stack depth: 12992 bytes left [ 2.675707] Key type trusted registered [ 2.679102] Key type encrypted registered [ 2.679147] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 2.680407] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 2.681703] rtc_cmos 00:05: setting system clock to 2023-10-24 09:42:50 UTC (1698140570) [ 2.703445] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 2.705704] Write protecting the kernel read-only data: 12288k [ 2.707269] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 2.709260] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 2.718253] random: systemd: uninitialized urandom read (16 bytes read) [ 2.721767] random: systemd: uninitialized urandom read (16 bytes read) [ 2.724137] random: systemd: uninitialized urandom read (16 bytes read) [ 2.728329] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 2.734673] systemd[1]: Detected virtualization kvm. [ 2.736240] systemd[1]: Detected architecture x86-64. [ 2.737806] systemd[1]: Running in initial RAM disk. [ 2.742146] systemd[1]: No hostname configured. [ 2.743164] systemd[1]: Set hostname to . [ 2.744509] random: systemd: uninitialized urandom read (16 bytes read) [ 2.746035] systemd[1]: Initializing machine ID from random generator. [ 2.786424] random: systemd: uninitialized urandom read (16 bytes read) [ 2.788296] random: systemd: uninitialized urandom read (16 bytes read) [ 2.789899] random: systemd: uninitialized urandom read (16 bytes read) [ 2.791515] random: systemd: uninitialized urandom read (16 bytes read) [ 2.794168] random: systemd: uninitialized urandom read (16 bytes read) [ 2.795812] random: systemd: uninitialized urandom read (16 bytes read) [ 2.804247] systemd[1]: Created slice Root Slice. [ 2.807012] systemd[1]: Listening on udev Kernel Socket. [ 2.809876] systemd[1]: Created slice System Slice. [ 2.812532] systemd[1]: Reached target Slices. [ 2.814863] systemd[1]: Reached target Timers. [ 2.817263] systemd[1]: Reached target Swap. [ 2.819672] systemd[1]: Listening on Journal Socket. [ 2.823119] systemd[1]: Starting Setup Virtual Console... [ 2.828496] systemd[1]: Starting Journal Service... [ 2.832581] systemd[1]: Starting Load Kernel Modules... [ 2.836131] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 2.842494] systemd[1]: Starting dracut cmdline hook... [ 2.845440] systemd[1]: Listening on udev Control Socket. [ 2.848457] systemd[1]: Reached target Sockets. [ 2.852197] systemd[1]: Reached target Local File Systems. [ 2.856904] systemd[1]: Started Journal Service. [ 2.882363] random: fast init done [ 3.267431] libata version 3.00 loaded. [ 3.270161] ata_piix 0000:00:01.1: version 2.13 [ 3.285804] scsi host0: ata_piix [ 3.289017] scsi host1: ata_piix [ 3.291869] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 3.293164] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 3.332485] tsc: Refined TSC clocksource calibration: 2399.962 MHz [ 3.372557] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 3.374006] ip (342) used greatest stack depth: 12464 bytes left [ 3.519420] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 3.644467] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 5.510145] ip (380) used greatest stack depth: 12432 bytes left [ 9.327660] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 9.691127] systemd-journald[102]: Received SIGTERM from PID 1 (systemd). [ 9.872308] SELinux: Disabled at runtime. [ 9.873392] SELinux: Unregistering netfilter hooks [ 9.923154] ip_tables: (C) 2000-2006 Netfilter Core Team [ 9.925028] systemd[1]: Inserted module 'ip_tables' [ 10.222168] systemd-journald[567]: Received request to flush runtime journal from PID 1 [ 10.310614] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 10.334931] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 10.422102] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 10.429559] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 11.752540] mount.nfs (731) used greatest stack depth: 10728 bytes left [ 23.018058] libcfs: loading out-of-tree module taints kernel. [ 23.020151] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 23.026458] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 23.046610] alg: No test for adler32 (adler32-zlib) [ 23.301694] PCLMULQDQ-NI instructions are not detected. [ 24.017372] Lustre: Lustre: Build Version: 2.15.58_96_gc826a2a [ 24.198208] LNet: Added LNI 192.168.204.1@tcp [8/256/0/180] [ 24.201643] LNet: Accept secure, port 988 [ 25.751518] Key type lgssc registered [ 26.044447] Lustre: Echo OBD driver; http://www.lustre.org/ [ 57.524655] Lustre: Mounted lustre-client [ 59.455748] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 68.218733] Lustre: DEBUG MARKER: oleg401-client.virtnet: executing check_logdir /tmp/testlogs/ [ 69.044224] Lustre: DEBUG MARKER: oleg401-client.virtnet: executing yml_node [ 70.037270] Lustre: DEBUG MARKER: Client: 2.15.58.96 [ 70.644554] Lustre: DEBUG MARKER: MDS: 2.15.58.96 [ 71.311808] Lustre: DEBUG MARKER: OSS: 2.15.58.96 [ 71.720942] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-quota ============----- Tue Oct 24 05:43:59 EDT 2023 [ 73.074319] Lustre: DEBUG MARKER: excepting tests: 2 4a 63 65 [ 73.418471] Lustre: DEBUG MARKER: skipping tests SLOW=no: 61 12a 9 [ 74.083578] Lustre: DEBUG MARKER: oleg401-client.virtnet: executing check_config_client /mnt/lustre [ 77.996223] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 89.822740] Lustre: DEBUG MARKER: == sanity-quota test 0: Test basic quota performance ===== 05:44:17 (1698140657) [ 117.620513] Lustre: lustre-OST0001-osc-ffff8800b6cd4000: disconnect after 20s idle [ 120.280799] Lustre: DEBUG MARKER: == sanity-quota test 1a: Block hard limit (normal use and out of quota) ========================================================== 05:44:47 (1698140687) [ 122.628559] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 22s idle [ 127.551613] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB) [ 128.552222] Lustre: DEBUG MARKER: Write... [ 129.006723] Lustre: DEBUG MARKER: Write out of block quota ... [ 143.117150] random: crng init done [ 152.676609] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 24s idle [ 157.491831] Lustre: DEBUG MARKER: -------------------------------------- [ 157.847153] Lustre: DEBUG MARKER: Group quota (block hardlimit:10 MB) [ 158.975254] Lustre: DEBUG MARKER: Write... [ 159.443370] Lustre: DEBUG MARKER: Write out of block quota ... [ 182.724638] Lustre: lustre-OST0001-osc-ffff8800b6cd4000: disconnect after 24s idle [ 186.205161] Lustre: DEBUG MARKER: -------------------------------------- [ 186.527909] Lustre: DEBUG MARKER: Project quota (block hardlimit:10 mb) [ 186.932754] Lustre: DEBUG MARKER: Write... [ 187.397723] Lustre: DEBUG MARKER: Write out of block quota ... [ 207.764569] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 22s idle [ 221.974724] Lustre: DEBUG MARKER: == sanity-quota test 1b: Quota pools: Block hard limit (normal use and out of quota) ========================================================== 05:46:29 (1698140789) [ 229.257449] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB) [ 232.804524] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 21s idle [ 235.091588] Lustre: DEBUG MARKER: Write... [ 235.585395] Lustre: DEBUG MARKER: Write out of block quota ... [ 257.844585] Lustre: lustre-OST0001-osc-ffff8800b6cd4000: disconnect after 23s idle [ 257.847439] Lustre: Skipped 1 previous similar message [ 260.233047] Lustre: DEBUG MARKER: -------------------------------------- [ 260.590942] Lustre: DEBUG MARKER: Group quota (block hardlimit:20 MB) [ 261.632275] Lustre: DEBUG MARKER: Write... [ 262.128452] Lustre: DEBUG MARKER: Write out of block quota ... [ 288.478814] Lustre: DEBUG MARKER: -------------------------------------- [ 288.775306] Lustre: DEBUG MARKER: Project quota (block hardlimit:20 mb) [ 289.131021] Lustre: DEBUG MARKER: Write... [ 289.554674] Lustre: DEBUG MARKER: Write out of block quota ... [ 312.932566] Lustre: lustre-OST0001-osc-ffff8800b6cd4000: disconnect after 24s idle [ 312.934770] Lustre: Skipped 1 previous similar message [ 331.621015] Lustre: DEBUG MARKER: == sanity-quota test 1c: Quota pools: check 3 pools with hardlimit only for global ========================================================== 05:48:19 (1698140899) [ 339.241568] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB) [ 350.758520] Lustre: DEBUG MARKER: Write... [ 351.360677] Lustre: DEBUG MARKER: Write out of block quota ... [ 398.068554] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 22s idle [ 398.071216] Lustre: Skipped 2 previous similar messages [ 400.624875] Lustre: DEBUG MARKER: == sanity-quota test 1d: Quota pools: check block hardlimit on different pools ========================================================== 05:49:28 (1698140968) [ 407.930683] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB) [ 417.441087] Lustre: DEBUG MARKER: Write... [ 417.901364] Lustre: DEBUG MARKER: Write out of block quota ... [ 464.531606] Lustre: DEBUG MARKER: == sanity-quota test 1e: Quota pools: global pool high block limit vs quota pool with small ========================================================== 05:50:32 (1698141032) [ 471.843080] Lustre: DEBUG MARKER: User quota (block hardlimit:53000000 MB) [ 477.796066] Lustre: DEBUG MARKER: Write... [ 478.285416] Lustre: DEBUG MARKER: Write out of block quota ... [ 484.549817] Lustre: DEBUG MARKER: Write... [ 519.501006] Lustre: DEBUG MARKER: == sanity-quota test 1f: Quota pools: correct qunit after removing/adding OST ========================================================== 05:51:27 (1698141087) [ 526.703285] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB) [ 528.276622] Lustre: lustre-OST0001-osc-ffff8800b6cd4000: disconnect after 24s idle [ 528.279496] Lustre: Skipped 4 previous similar messages [ 531.650641] Lustre: DEBUG MARKER: Write... [ 532.093999] Lustre: DEBUG MARKER: Write out of block quota ... [ 558.505892] Lustre: DEBUG MARKER: Write... [ 558.981111] Lustre: DEBUG MARKER: Write out of block quota ... [ 591.596715] Lustre: DEBUG MARKER: == sanity-quota test 1g: Quota pools: Block hard limit with wide striping ========================================================== 05:52:39 (1698141159) [ 598.978370] Lustre: DEBUG MARKER: User quota (block hardlimit:40 MB) [ 604.125747] Lustre: DEBUG MARKER: Write... [ 605.887945] Lustre: DEBUG MARKER: Write out of block quota ... [ 648.213653] Lustre: DEBUG MARKER: == sanity-quota test 1h: Block hard limit test using fallocate ========================================================== 05:53:35 (1698141215) [ 648.530439] Lustre: DEBUG MARKER: SKIP: sanity-quota test_1h need >= 2.13.57 and ldiskfs for fallocate [ 649.615675] Lustre: DEBUG MARKER: == sanity-quota test 1i: Quota pools: different limit and usage relations ========================================================== 05:53:37 (1698141217) [ 656.970259] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB) [ 661.953796] Lustre: DEBUG MARKER: Write... [ 662.461187] Lustre: DEBUG MARKER: Write out of block quota ... [ 687.034109] Lustre: DEBUG MARKER: Write... [ 687.628924] Lustre: DEBUG MARKER: Write out of block quota ... [ 719.161113] Lustre: DEBUG MARKER: == sanity-quota test 1j: Enable project quota enforcement for root ========================================================== 05:54:46 (1698141286) [ 726.700658] Lustre: DEBUG MARKER: -------------------------------------- [ 727.058134] Lustre: DEBUG MARKER: Project quota (block hardlimit:20 mb) [ 756.724590] Lustre: DEBUG MARKER: SKIP: sanity-quota test_2 skipping excluded test 2 [ 757.584279] Lustre: DEBUG MARKER: == sanity-quota test 3a: Block soft limit (start timer, timer goes off, stop timer) ========================================================== 05:55:25 (1698141325) [ 788.692568] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 22s idle [ 788.695086] Lustre: Skipped 6 previous similar messages [ 830.979646] Lustre: DEBUG MARKER: Write after timer goes off [ 831.351311] Lustre: DEBUG MARKER: Write after cancel lru locks [ 939.707718] Lustre: DEBUG MARKER: Write after timer goes off [ 940.067507] Lustre: DEBUG MARKER: Write after cancel lru locks [ 1048.375548] Lustre: DEBUG MARKER: Write after timer goes off [ 1048.731716] Lustre: DEBUG MARKER: Write after cancel lru locks [ 1112.226520] Lustre: DEBUG MARKER: == sanity-quota test 3b: Quota pools: Block soft limit (start timer, expires, stop timer) ========================================================== 06:01:19 (1698141679) [ 1191.238576] Lustre: DEBUG MARKER: Write after timer goes off [ 1191.602861] Lustre: DEBUG MARKER: Write after cancel lru locks [ 1299.824652] Lustre: DEBUG MARKER: Write after timer goes off [ 1300.272379] Lustre: DEBUG MARKER: Write after cancel lru locks [ 1369.620722] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 24s idle [ 1369.623898] Lustre: Skipped 11 previous similar messages [ 1411.516126] Lustre: DEBUG MARKER: Write after timer goes off [ 1412.024982] Lustre: DEBUG MARKER: Write after cancel lru locks [ 1482.640958] Lustre: DEBUG MARKER: == sanity-quota test 3c: Quota pools: check block soft limit on different pools ========================================================== 06:07:30 (1698142050) [ 1566.871527] Lustre: DEBUG MARKER: Write after timer goes off [ 1567.226448] Lustre: DEBUG MARKER: Write after cancel lru locks [ 1625.959137] Lustre: DEBUG MARKER: SKIP: sanity-quota test_4a skipping excluded test 4a [ 1627.163214] Lustre: DEBUG MARKER: == sanity-quota test 4b: Grace time strings handling ===== 06:09:54 (1698142194) [ 1635.418971] Lustre: DEBUG MARKER: == sanity-quota test 5: Chown [ 1669.908302] Lustre: DEBUG MARKER: == sanity-quota test 6: Test dropping acquire request on master ========================================================== 06:10:37 (1698142237) [ 1778.756500] Lustre: DEBUG MARKER: == sanity-quota test 7a: Quota reintegration (global index) ========================================================== 06:12:26 (1698142346) [ 1795.301675] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection to lustre-OST0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1798.345762] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection restored to 192.168.204.101@tcp (at 192.168.204.101@tcp) [ 1856.916557] Lustre: DEBUG MARKER: == sanity-quota test 7b: Quota reintegration (slave index) ========================================================== 06:13:44 (1698142424) [ 1875.429601] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection to lustre-OST0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1876.501593] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection restored to 192.168.204.101@tcp (at 192.168.204.101@tcp) [ 1911.531470] Lustre: DEBUG MARKER: == sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 06:14:39 (1698142479) [ 1930.518604] Lustre: lustre-MDT0000-mdc-ffff8800b6cd4000: Connection to lustre-MDT0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1930.518624] LustreError: 166-1: MGC192.168.204.101@tcp: Connection to MGS (at 192.168.204.101@tcp) was lost; in progress operations using this service will fail [ 1930.520703] Lustre: Evicted from MGS (at 192.168.204.101@tcp) after server handle changed from 0x75f018385c99e5cb to 0x75f018385c9a73d8 [ 1930.521280] Lustre: MGC192.168.204.101@tcp: Connection restored to 192.168.204.101@tcp (at 192.168.204.101@tcp) [ 1941.532460] Lustre: 1811:0:(client.c:2310:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1698142493/real 1698142493] req@ffff88012bf02800 x1780629469997760/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6cd4000@192.168.204.101@tcp:12/10 lens 224/224 e 0 to 1 dl 1698142509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 [ 2072.660077] Lustre: DEBUG MARKER: == sanity-quota test 7d: Quota reintegration (Transfer index in multiple bulks) ========================================================== 06:17:20 (1698142640) [ 2075.748544] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 24s idle [ 2075.750215] Lustre: Skipped 16 previous similar messages [ 2107.406607] Lustre: DEBUG MARKER: == sanity-quota test 7e: Quota reintegration (inode limits) ========================================================== 06:17:54 (1698142674) [ 2107.797793] Lustre: DEBUG MARKER: SKIP: sanity-quota test_7e needs >= 2 MDTs [ 2109.471072] Lustre: DEBUG MARKER: == sanity-quota test 8: Run dbench with quota enabled ==== 06:17:56 (1698142676) [ 2282.843690] Lustre: DEBUG MARKER: SKIP: sanity-quota test_9 skipping SLOW test 9 [ 2284.006816] Lustre: DEBUG MARKER: == sanity-quota test 10: Test quota for root user ======== 06:20:51 (1698142851) [ 2319.001741] Lustre: DEBUG MARKER: == sanity-quota test 11: Chown/chgrp ignores quota ======= 06:21:26 (1698142886) [ 2352.759752] Lustre: DEBUG MARKER: SKIP: sanity-quota test_12a skipping SLOW test 12a [ 2354.065821] Lustre: DEBUG MARKER: == sanity-quota test 12b: Inode quota rebalancing ======== 06:22:01 (1698142921) [ 2354.411312] Lustre: DEBUG MARKER: SKIP: sanity-quota test_12b needs >= 2 MDTs [ 2355.664504] Lustre: DEBUG MARKER: == sanity-quota test 13: Cancel per-ID lock in the LRU list ========================================================== 06:22:03 (1698142923) [ 2392.395020] Lustre: DEBUG MARKER: == sanity-quota test 14: check panic in qmt_site_recalc_cb ========================================================== 06:22:39 (1698142959) [ 2411.286274] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection to lustre-OST0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2414.688656] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection restored to 192.168.204.101@tcp (at 192.168.204.101@tcp) [ 2414.691011] Lustre: Skipped 1 previous similar message [ 2439.298732] Lustre: DEBUG MARKER: == sanity-quota test 15: Set over 4T block quota ========= 06:23:26 (1698143006) [ 2452.581374] Lustre: DEBUG MARKER: == sanity-quota test 16a: lfs quota should skip the inactive MDT/OST ========================================================== 06:23:39 (1698143019) [ 2459.701096] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2460.965600] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection to lustre-OST0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2460.978563] LustreError: 167-0: lustre-OST0000-osc-ffff8800b6cd4000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.985060] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: Connection restored to 192.168.204.101@tcp (at 192.168.204.101@tcp) [ 2478.926471] Lustre: DEBUG MARKER: == sanity-quota test 16b: lfs quota should skip the nonexistent MDT/OST ========================================================== 06:24:06 (1698143046) [ 2479.431028] Lustre: DEBUG MARKER: SKIP: sanity-quota test_16b needs >= 3 MDTs [ 2480.656628] Lustre: DEBUG MARKER: == sanity-quota test 17: DQACQ return recoverable error == 06:24:08 (1698143048) [ 2654.145346] Lustre: DEBUG MARKER: == sanity-quota test 18: MDS failover while writing, no watchdog triggered (b14840) ========================================================== 06:27:01 (1698143221) [ 2664.026791] Lustre: DEBUG MARKER: User quota (limit: 200) [ 2665.433077] Lustre: DEBUG MARKER: Write 100M (buffered) ... [ 2666.429026] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 [ 2666.743968] Lustre: DEBUG MARKER: Fail mds for 40 seconds [ 2681.718128] Lustre: lustre-MDT0000-mdc-ffff8800b6cd4000: Connection to lustre-MDT0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2681.718202] LustreError: 166-1: MGC192.168.204.101@tcp: Connection to MGS (at 192.168.204.101@tcp) was lost; in progress operations using this service will fail [ 2681.723884] Lustre: Evicted from MGS (at 192.168.204.101@tcp) after server handle changed from 0x75f018385c9a73d8 to 0x75f018385cc12f35 [ 2681.724229] Lustre: MGC192.168.204.101@tcp: Connection restored to 192.168.204.101@tcp (at 192.168.204.101@tcp) [ 2681.743182] LustreError: 1809:0:(client.c:3260:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a99fbc00 x1780629491892864/t8590004864(8590004864) o101->lustre-MDT0000-mdc-ffff8800b6cd4000@192.168.204.101@tcp:12/10 lens 592/608 e 0 to 0 dl 1698143265 ref 2 fl Interpret:RPQU/204/0 rc 301/301 job:'dd.60000' uid:60000 gid:60000 [ 2682.439533] Lustre: DEBUG MARKER: oleg401-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2682.766135] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 2687.708490] Lustre: 1813:0:(client.c:2310:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1698143239/real 1698143239] req@ffff8800a99fa300 x1780629491906368/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6cd4000@192.168.204.101@tcp:12/10 lens 224/224 e 0 to 1 dl 1698143255 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 [ 2689.823214] Lustre: DEBUG MARKER: (dd_pid=4260, time=5, timeout=600) [ 2692.713512] Lustre: 1813:0:(client.c:2310:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1698143244/real 1698143244] req@ffff8800a8ce0f00 x1780629491906624/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6cd4000@192.168.204.101@tcp:12/10 lens 224/224 e 0 to 1 dl 1698143260 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 [ 2711.764647] Lustre: lustre-OST0000-osc-ffff8800b6cd4000: disconnect after 21s idle [ 2711.768106] Lustre: Skipped 21 previous similar messages [ 2719.206127] Lustre: DEBUG MARKER: User quota (limit: 200) [ 2720.451214] Lustre: DEBUG MARKER: Write 100M (directio) ... [ 2721.448828] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 [ 2721.772821] Lustre: DEBUG MARKER: Fail mds for 40 seconds [ 2736.806990] Lustre: lustre-MDT0000-mdc-ffff8800b6cd4000: Connection to lustre-MDT0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2736.807012] LustreError: 166-1: MGC192.168.204.101@tcp: Connection to MGS (at 192.168.204.101@tcp) was lost; in progress operations using this service will fail [ 2736.808902] Lustre: Evicted from MGS (at 192.168.204.101@tcp) after server handle changed from 0x75f018385cc12f35 to 0x75f018385cc138b2 [ 2736.809660] Lustre: MGC192.168.204.101@tcp: Connection restored to 192.168.204.101@tcp (at 192.168.204.101@tcp) [ 2736.809663] Lustre: Skipped 1 previous similar message [ 2736.840460] LustreError: 1809:0:(client.c:3260:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a8ce0f00 x1780629491916416/t12884901904(12884901904) o101->lustre-MDT0000-mdc-ffff8800b6cd4000@192.168.204.101@tcp:12/10 lens 592/608 e 0 to 0 dl 1698143320 ref 2 fl Interpret:RPQU/204/0 rc 301/301 job:'dd.60000' uid:60000 gid:60000 [ 2738.563025] Lustre: DEBUG MARKER: oleg401-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2739.115285] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 2743.391499] Lustre: DEBUG MARKER: (dd_pid=6742, time=2, timeout=600) [ 2743.572420] Lustre: 1813:0:(client.c:2310:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1698143294/real 1698143294] req@ffff8800a8ce5000 x1780629491927936/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6cd4000@192.168.204.101@tcp:12/10 lens 224/224 e 0 to 1 dl 1698143310 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 [ 2747.820606] Lustre: 1813:0:(client.c:2310:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1698143299/real 1698143299] req@ffff8800a8ce0000 x1780629491928192/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6cd4000@192.168.204.101@tcp:12/10 lens 224/224 e 0 to 1 dl 1698143315 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 [ 2779.815031] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 06:29:07 (1698143347) [ 2789.725290] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1: [ 2790.265111] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2). [ 2791.788444] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1: [ 2792.339209] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2). [ 2813.206072] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 06:29:40 (1698143380) [ 2822.138231] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing [ 2830.118512] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr [ 2830.528483] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr [ 2830.955116] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000 [ 2831.315035] Lustre: DEBUG MARKER: Set quota for 1 times [ 2832.709456] Lustre: DEBUG MARKER: Set quota for 2 times [ 2834.087205] Lustre: DEBUG MARKER: Set quota for 3 times [ 2835.483704] Lustre: DEBUG MARKER: Set quota for 4 times [ 2836.865517] Lustre: DEBUG MARKER: Set quota for 5 times [ 2838.266479] Lustre: DEBUG MARKER: Set quota for 6 times [ 2839.623846] Lustre: DEBUG MARKER: Set quota for 7 times [ 2841.026890] Lustre: DEBUG MARKER: Set quota for 8 times [ 2842.383658] Lustre: DEBUG MARKER: Set quota for 9 times [ 2843.776128] Lustre: DEBUG MARKER: Set quota for 10 times [ 2845.159659] Lustre: DEBUG MARKER: Set quota for 11 times [ 2846.556435] Lustre: DEBUG MARKER: Set quota for 12 times [ 2847.916001] Lustre: DEBUG MARKER: Set quota for 13 times [ 2849.334929] Lustre: DEBUG MARKER: Set quota for 14 times [ 2850.714165] Lustre: DEBUG MARKER: Set quota for 15 times [ 2852.100753] Lustre: DEBUG MARKER: Set quota for 16 times [ 2853.471145] Lustre: DEBUG MARKER: Set quota for 17 times [ 2854.852070] Lustre: DEBUG MARKER: Set quota for 18 times [ 2856.235217] Lustre: DEBUG MARKER: Set quota for 19 times [ 2857.624162] Lustre: DEBUG MARKER: Set quota for 20 times [ 2859.026865] Lustre: DEBUG MARKER: Set quota for 21 times [ 2860.432702] Lustre: DEBUG MARKER: Set quota for 22 times [ 2884.731293] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 06:30:52 (1698143452) [ 2888.931287] Lustre: Unmounted lustre-client [ 2931.784578] Lustre: Mounted lustre-client [ 2934.092557] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2946.402506] Lustre: Unmounted lustre-client [ 2987.274155] Lustre: Mounted lustre-client [ 2989.596948] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2999.889240] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 06:32:47 (1698143567) [ 3000.425188] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS [ 3002.158574] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 06:32:49 (1698143569) [ 3034.246455] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 06:33:21 (1698143601) [ 3054.693280] Lustre: DEBUG MARKER: Write... [ 3055.326793] Lustre: DEBUG MARKER: Write out of block quota ... [ 3090.607611] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 06:34:17 (1698143657) [ 3093.890208] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 06:34:21 (1698143661) [ 3098.823077] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 06:34:26 (1698143666) [ 3102.910533] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 06:34:30 (1698143670) [ 3107.229941] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 06:34:34 (1698143674) [ 3149.869435] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user [ 3220.310469] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user [ 3326.014788] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 06:38:13 (1698143893) [ 3327.812838] Lustre: lustre-OST0000-osc-ffff88012bf4e800: disconnect after 22s idle [ 3327.817410] Lustre: Skipped 13 previous similar messages [ 3359.840389] Lustre: DEBUG MARKER: Restart... [ 3360.050493] Lustre: Unmounted lustre-client [ 3388.331122] Lustre: Mounted lustre-client [ 3390.729933] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3426.214659] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 06:39:53 (1698143993) [ 3477.068422] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 06:40:44 (1698144044) [ 3897.909851] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 06:47:45 (1698144465) [ 3904.392432] Lustre: Unmounted lustre-client [ 3947.140886] Lustre: Mounted lustre-client [ 3949.358448] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3972.180512] Lustre: lustre-OST0000-osc-ffff8800b622c000: disconnect after 23s idle [ 3972.184212] Lustre: Skipped 9 previous similar messages [ 3975.599436] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 06:49:03 (1698144543) [ 4005.292539] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 06:49:32 (1698144572) [ 4035.462537] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 06:50:02 (1698144602) [ 4035.961036] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs [ 4037.605628] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 06:50:04 (1698144604) [ 4038.160070] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs [ 4039.826198] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 06:50:07 (1698144607) [ 4074.655417] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 06:50:42 (1698144642) [ 4134.197318] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 06:51:41 (1698144701) [ 4160.159105] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 06:52:07 (1698144727) [ 4190.518167] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 06:52:37 (1698144757) [ 4202.928306] Lustre: DEBUG MARKER: rename directory return 255 [ 4225.574468] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 06:53:12 (1698144792) [ 4242.825719] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 06:53:30 (1698144810) [ 4264.854645] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 06:53:52 (1698144832) [ 4285.563156] LustreError: 26475:0:(llite_lib.c:1981:ll_md_setattr()) md_setattr fails: rc = -122 [ 4310.324233] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 06:54:37 (1698144877) [ 4329.897692] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 06:54:57 (1698144897) [ 4359.784985] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 06:55:27 (1698144927) [ 4436.353851] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 06:56:43 (1698145003) [ 4436.889083] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test [ 4438.586106] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 06:56:45 (1698145005) [ 4470.840658] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61 [ 4472.123678] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 06:57:19 (1698145039) [ 4488.863701] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63 [ 4490.089387] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non dir/files should succeed ========================================================== 06:57:37 (1698145057) [ 4520.139888] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65 [ 4521.416344] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 06:58:08 (1698145088) [ 4551.803213] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 06:58:39 (1698145119) [ 4552.322616] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode [ 4554.076211] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 06:58:41 (1698145121) [ 4594.294535] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 06:59:21 (1698145161) [ 4610.486315] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB) [ 4611.004407] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB) [ 4660.715965] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 07:00:28 (1698145228) [ 4663.284682] Lustre: lustre-OST0000-osc-ffff8800b622c000: disconnect after 21s idle [ 4663.287949] Lustre: Skipped 23 previous similar messages [ 4690.164044] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 07:00:57 (1698145257) [ 4707.146118] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 07:01:14 (1698145274) [ 4707.440426] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode [ 4708.721479] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 07:01:16 (1698145276) [ 4709.208838] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode [ 4710.866277] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 07:01:18 (1698145278) [ 4719.342486] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB) [ 4726.255894] Lustre: DEBUG MARKER: Write... [ 4727.049071] Lustre: DEBUG MARKER: Write out of block quota ... [ 4761.550522] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 07:02:08 (1698145328) [ 4776.954292] Lustre: DEBUG MARKER: set to use default quota [ 4777.495700] Lustre: DEBUG MARKER: set default quota [ 4778.007528] Lustre: DEBUG MARKER: get default quota [ 4779.504822] Lustre: DEBUG MARKER: Test not out of quota [ 4780.912993] Lustre: DEBUG MARKER: Test out of quota [ 4784.337150] Lustre: DEBUG MARKER: Increase default quota [ 4794.059334] Lustre: DEBUG MARKER: Set quota to override default quota [ 4797.468329] Lustre: DEBUG MARKER: Set to use default quota again [ 4807.095399] Lustre: DEBUG MARKER: Cleanup [ 4849.312935] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 07:03:36 (1698145416) [ 4862.760747] Lustre: DEBUG MARKER: set default quota for qpool1 [ 4863.293542] Lustre: DEBUG MARKER: Write from user that hasn't lqe [ 4892.100123] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 07:04:19 (1698145459) [ 4936.446328] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 07:05:03 (1698145503) [ 5014.488267] Lustre: DEBUG MARKER: Write... [ 5015.433732] Lustre: DEBUG MARKER: Write out of block quota ... [ 5107.201229] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 07:07:54 (1698145674) [ 5137.728124] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 07:08:25 (1698145705) [ 5137.883056] Lustre: Mounted lustre-client read-only [ 5137.983451] Lustre: Unmounted lustre-client [ 5140.985598] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 07:08:28 (1698145708) [ 5141.508124] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate [ 5143.005221] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 07:08:30 (1698145710) [ 5143.538559] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate [ 5145.096792] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 07:08:32 (1698145712) [ 5155.051434] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 07:08:42 (1698145722) [ 5155.537928] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode [ 5156.995039] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 07:08:44 (1698145724) [ 5165.167334] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB) [ 5173.942043] Lustre: lustre-MDT0000-mdc-ffff8800b622c000: Connection to lustre-MDT0000 (at 192.168.204.101@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5203.989840] LustreError: 166-1: MGC192.168.204.101@tcp: Connection to MGS (at 192.168.204.101@tcp) was lost; in progress operations using this service will fail [ 5203.997480] Lustre: Evicted from MGS (at 192.168.204.101@tcp) after server handle changed from 0x75f018385cdb2791 to 0x75f018385cdc59df [ 5204.002965] LustreError: 167-0: lustre-MDT0000-mdc-ffff8800b622c000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 5204.003091] Lustre: MGC192.168.204.101@tcp: Connection restored to (at 192.168.204.101@tcp) [ 5204.003093] Lustre: Skipped 1 previous similar message [ 5222.387313] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 07:09:49 (1698145789) [ 5240.169469] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 07:10:07 (1698145807) [ 5257.760218] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 07:10:25 (1698145825) [ 5269.092560] Lustre: lustre-OST0000-osc-ffff8800b622c000: disconnect after 22s idle [ 5269.096104] Lustre: Skipped 21 previous similar messages [ 5332.012630] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 07:11:39 (1698145899) [ 5387.779423] Lustre: DEBUG MARKER: == sanity-quota test complete, duration 5316 sec ========= 07:12:35 (1698145955) [ 5388.084923] ------------[ cut here ]------------ [ 5388.086884] WARNING: CPU: 2 PID: 12374 at lib/debugobjects.c:286 debug_print_object+0x83/0xa0 [ 5388.090358] ODEBUG: activate active (active state 1) object type: rcu_head hint: (null) [ 5388.093865] Modules linked in: lustre(OE) ofd(OE) osp(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) crc32_generic libcfs(OE) crc_t10dif crct10dif_generic crct10dif_common rpcsec_gss_krb5 squashfs i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi ata_piix serio_raw libata [ 5388.111551] CPU: 2 PID: 12374 Comm: umount Kdump: loaded Tainted: G OE ------------ 3.10.0-7.9-debug #1 [ 5388.115720] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 5388.118855] Call Trace: [ 5388.119767] [] dump_stack+0x19/0x1b [ 5388.121579] [] __warn+0xd8/0x100 [ 5388.123230] [] warn_slowpath_fmt+0x5f/0x80 [ 5388.125149] [] debug_print_object+0x83/0xa0 [ 5388.126952] [] debug_object_activate+0x1af/0x210 [ 5388.128783] [] ? xas_alloc+0xd0/0xd0 [libcfs] [ 5388.130521] [] __call_rcu+0x3f/0x2d0 [ 5388.131982] [] call_rcu_sched+0x1d/0x20 [ 5388.133274] [] xas_free_nodes+0xa4/0xf0 [libcfs] [ 5388.134768] [] xa_destroy+0xdf/0xf0 [libcfs] [ 5388.136120] [] osc_quota_cleanup+0x15/0x20 [osc] [ 5388.137445] [] osc_cleanup_common+0xbf/0x1b0 [osc] [ 5388.138878] [] class_free_dev+0x219/0x730 [obdclass] [ 5388.140170] [] class_export_put+0x1e0/0x2e0 [obdclass] [ 5388.141542] [] class_unlink_export+0x125/0x160 [obdclass] [ 5388.142964] [] class_decref_free+0x4e/0x90 [obdclass] [ 5388.144213] [] class_decref+0x48/0xf0 [obdclass] [ 5388.145414] [] class_detach+0x1c1/0x310 [obdclass] [ 5388.146589] [] class_process_config+0x163b/0x27c0 [obdclass] [ 5388.147955] [] ? __kmalloc+0x1e0/0x340 [ 5388.148980] [] class_manual_cleanup+0x1e0/0x770 [obdclass] [ 5388.150288] [] lov_tgts_putref+0x385/0xad0 [lov] [ 5388.151400] [] lov_disconnect+0x237/0x280 [lov] [ 5388.152551] [] obd_disconnect+0x56/0x300 [lustre] [ 5388.153677] [] ll_put_super+0x767/0xce0 [lustre] [ 5388.154762] [] ? call_rcu_sched+0x1d/0x20 [ 5388.155780] [] ? ll_destroy_inode+0x1c/0x20 [lustre] [ 5388.156911] [] ? destroy_inode+0x38/0x60 [ 5388.157858] [] ? evict+0x10e/0x180 [ 5388.158762] [] ? _raw_spin_unlock+0xe/0x20 [ 5388.159774] [] ? fsnotify_unmount_inodes+0x1d6/0x1e0 [ 5388.160924] [] generic_shutdown_super+0x6a/0xf0 [ 5388.161988] [] kill_anon_super+0x12/0x20 [ 5388.162976] [] lustre_kill_super+0x2b/0x30 [lustre] [ 5388.164168] [] deactivate_locked_super+0x49/0x60 [ 5388.165258] [] deactivate_super+0x46/0x60 [ 5388.166228] [] cleanup_mnt+0x3f/0x80 [ 5388.167187] [] __cleanup_mnt+0x12/0x20 [ 5388.168114] [] task_work_run+0xb5/0xf0 [ 5388.169047] [] do_notify_resume+0x92/0xb0 [ 5388.170025] [] int_signal+0x12/0x17 [ 5388.170923] ---[ end trace a193f2979542d3de ]--- [ 5388.171735] ------------[ cut here ]------------ [ 5388.172525] WARNING: CPU: 2 PID: 12374 at kernel/rcupdate.c:311 rcuhead_fixup_activate+0x5a/0x70 [ 5388.174050] Modules linked in: lustre(OE) ofd(OE) osp(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) crc32_generic libcfs(OE) crc_t10dif crct10dif_generic crct10dif_common rpcsec_gss_krb5 squashfs i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi ata_piix serio_raw libata [ 5388.181848] CPU: 2 PID: 12374 Comm: umount Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 5388.183638] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 5388.185108] Call Trace: [ 5388.185542] [] dump_stack+0x19/0x1b [ 5388.186407] [] __warn+0xd8/0x100 [ 5388.187230] [] warn_slowpath_null+0x1d/0x20 [ 5388.188260] [] rcuhead_fixup_activate+0x5a/0x70 [ 5388.189297] [] debug_object_activate+0x1cf/0x210 [ 5388.190362] [] ? xas_alloc+0xd0/0xd0 [libcfs] [ 5388.191402] [] __call_rcu+0x3f/0x2d0 [ 5388.192268] [] call_rcu_sched+0x1d/0x20 [ 5388.193238] [] xas_free_nodes+0xa4/0xf0 [libcfs] [ 5388.194301] [] xa_destroy+0xdf/0xf0 [libcfs] [ 5388.195288] [] osc_quota_cleanup+0x15/0x20 [osc] [ 5388.196352] [] osc_cleanup_common+0xbf/0x1b0 [osc] [ 5388.197496] [] class_free_dev+0x219/0x730 [obdclass] [ 5388.198663] [] class_export_put+0x1e0/0x2e0 [obdclass] [ 5388.199844] [] class_unlink_export+0x125/0x160 [obdclass] [ 5388.201071] [] class_decref_free+0x4e/0x90 [obdclass] [ 5388.202189] [] class_decref+0x48/0xf0 [obdclass] [ 5388.203324] [] class_detach+0x1c1/0x310 [obdclass] [ 5388.204368] [] class_process_config+0x163b/0x27c0 [obdclass] [ 5388.205614] [] ? __kmalloc+0x1e0/0x340 [ 5388.206515] [] class_manual_cleanup+0x1e0/0x770 [obdclass] [ 5388.207748] [] lov_tgts_putref+0x385/0xad0 [lov] [ 5388.208826] [] lov_disconnect+0x237/0x280 [lov] [ 5388.209881] [] obd_disconnect+0x56/0x300 [lustre] [ 5388.210884] [] ll_put_super+0x767/0xce0 [lustre] [ 5388.211889] [] ? call_rcu_sched+0x1d/0x20 [ 5388.212837] [] ? ll_destroy_inode+0x1c/0x20 [lustre] [ 5388.213943] [] ? destroy_inode+0x38/0x60 [ 5388.214909] [] ? evict+0x10e/0x180 [ 5388.215749] [] ? _raw_spin_unlock+0xe/0x20 [ 5388.216671] [] ? fsnotify_unmount_inodes+0x1d6/0x1e0 [ 5388.217800] [] generic_shutdown_super+0x6a/0xf0 [ 5388.218863] [] kill_anon_super+0x12/0x20 [ 5388.219757] [] lustre_kill_super+0x2b/0x30 [lustre] [ 5388.220822] [] deactivate_locked_super+0x49/0x60 [ 5388.221886] [] deactivate_super+0x46/0x60 [ 5388.222850] [] cleanup_mnt+0x3f/0x80 [ 5388.223703] [] __cleanup_mnt+0x12/0x20 [ 5388.224627] [] task_work_run+0xb5/0xf0 [ 5388.225555] [] do_notify_resume+0x92/0xb0 [ 5388.226487] [] int_signal+0x12/0x17 [ 5388.227368] ---[ end trace a193f2979542d3df ]--- [ 5388.228160] ------------[ cut here ]------------ [ 5388.228944] WARNING: CPU: 2 PID: 12374 at lib/debugobjects.c:286 debug_print_object+0x83/0xa0 [ 5388.230369] ODEBUG: active_state active (active state 1) object type: rcu_head hint: (null) [ 5388.231891] Modules linked in: lustre(OE) ofd(OE) osp(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) crc32_generic libcfs(OE) crc_t10dif crct10dif_generic crct10dif_common rpcsec_gss_krb5 squashfs i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi ata_piix serio_raw libata [ 5388.239386] CPU: 2 PID: 12374 Comm: umount Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 5388.241072] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 5388.242503] Call Trace: [ 5388.242946] [] dump_stack+0x19/0x1b [ 5388.243756] [] __warn+0xd8/0x100 [ 5388.244588] [] warn_slowpath_fmt+0x5f/0x80 [ 5388.245540] [] ? __warn+0xaa/0x100 [ 5388.246304] [] debug_print_object+0x83/0xa0 [ 5388.247282] [] debug_object_active_state+0x17c/0x190 [ 5388.248344] [] ? xas_alloc+0xd0/0xd0 [libcfs] [ 5388.249287] [] __call_rcu+0x55/0x2d0 [ 5388.250161] [] call_rcu_sched+0x1d/0x20 [ 5388.251089] [] xas_free_nodes+0xa4/0xf0 [libcfs] [ 5388.252113] [] xa_destroy+0xdf/0xf0 [libcfs] [ 5388.253180] [] osc_quota_cleanup+0x15/0x20 [osc] [ 5388.254172] [] osc_cleanup_common+0xbf/0x1b0 [osc] [ 5388.255279] [] class_free_dev+0x219/0x730 [obdclass] [ 5388.256422] [] class_export_put+0x1e0/0x2e0 [obdclass] [ 5388.257553] [] class_unlink_export+0x125/0x160 [obdclass] [ 5388.258755] [] class_decref_free+0x4e/0x90 [obdclass] [ 5388.259906] [] class_decref+0x48/0xf0 [obdclass] [ 5388.261019] [] class_detach+0x1c1/0x310 [obdclass] [ 5388.262080] [] class_process_config+0x163b/0x27c0 [obdclass] [ 5388.263305] [] ? __kmalloc+0x1e0/0x340 [ 5388.264202] [] class_manual_cleanup+0x1e0/0x770 [obdclass] [ 5388.265366] [] lov_tgts_putref+0x385/0xad0 [lov] [ 5388.266461] [] lov_disconnect+0x237/0x280 [lov] [ 5388.267492] [] obd_disconnect+0x56/0x300 [lustre] [ 5388.268561] [] ll_put_super+0x767/0xce0 [lustre] [ 5388.269623] [] ? call_rcu_sched+0x1d/0x20 [ 5388.270581] [] ? ll_destroy_inode+0x1c/0x20 [lustre] [ 5388.271677] [] ? destroy_inode+0x38/0x60 [ 5388.272622] [] ? evict+0x10e/0x180 [ 5388.273480] [] ? _raw_spin_unlock+0xe/0x20 [ 5388.274440] [] ? fsnotify_unmount_inodes+0x1d6/0x1e0 [ 5388.275587] [] generic_shutdown_super+0x6a/0xf0 [ 5388.276628] [] kill_anon_super+0x12/0x20 [ 5388.277567] [] lustre_kill_super+0x2b/0x30 [lustre] [ 5388.278700] [] deactivate_locked_super+0x49/0x60 [ 5388.279722] [] deactivate_super+0x46/0x60 [ 5388.280660] [] cleanup_mnt+0x3f/0x80 [ 5388.281537] [] __cleanup_mnt+0x12/0x20 [ 5388.282451] [] task_work_run+0xb5/0xf0 [ 5388.283367] [] do_notify_resume+0x92/0xb0 [ 5388.284318] [] int_signal+0x12/0x17 [ 5388.285184] ---[ end trace a193f2979542d3e0 ]--- [ 5388.285981] ------------[ cut here ]------------ [ 5388.286764] WARNING: CPU: 2 PID: 12374 at lib/debugobjects.c:286 debug_print_object+0x83/0xa0 [ 5388.288185] ODEBUG: activate active (active state 1) object type: rcu_head hint: (null) [ 5388.289669] Modules linked in: lustre(OE) ofd(OE) osp(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) crc32_generic libcfs(OE) crc_t10dif crct10dif_generic crct10dif_common rpcsec_gss_krb5 squashfs i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi ata_piix serio_raw libata [ 5388.297109] CPU: 2 PID: 12374 Comm: umount Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 5388.298823] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 5388.300283] Call Trace: [ 5388.300708] [] dump_stack+0x19/0x1b [ 5388.301570] [] __warn+0xd8/0x100 [ 5388.302379] [] warn_slowpath_fmt+0x5f/0x80 [ 5388.303347] [] debug_print_object+0x83/0xa0 [ 5388.304295] [] debug_object_activate+0x1af/0x210 [ 5388.305342] [] ? xas_alloc+0xd0/0xd0 [libcfs] [ 5388.306317] [] __call_rcu+0x3f/0x2d0 [ 5388.307194] [] call_rcu_sched+0x1d/0x20 [ 5388.308130] [] xas_free_nodes+0xa4/0xf0 [libcfs] [ 5388.309211] [] xa_destroy+0xdf/0xf0 [libcfs] [ 5388.310196] [] osc_quota_cleanup+0x15/0x20 [osc] [ 5388.311277] [] osc_cleanup_common+0xbf/0x1b0 [osc] [ 5388.312353] [] class_free_dev+0x219/0x730 [obdclass] [ 5388.313469] [] class_export_put+0x1e0/0x2e0 [obdclass] [ 5388.314644] [] class_unlink_export+0x125/0x160 [obdclass] [ 5388.315815] [] class_decref_free+0x4e/0x90 [obdclass] [ 5388.316940] [] class_decref+0x48/0xf0 [obdclass] [ 5388.318017] [] class_detach+0x1c1/0x310 [obdclass] [ 5388.319090] [] class_process_config+0x163b/0x27c0 [obdclass] [ 5388.320269] [] ? __kmalloc+0x1e0/0x340 [ 5388.321182] [] class_manual_cleanup+0x1e0/0x770 [obdclass] [ 5388.322401] [] lov_tgts_putref+0x385/0xad0 [lov] [ 5388.323442] [] lov_disconnect+0x237/0x280 [lov] [ 5388.324497] [] obd_disconnect+0x56/0x300 [lustre] [ 5388.325552] [] ll_put_super+0x767/0xce0 [lustre] [ 5388.326580] [] ? call_rcu_sched+0x1d/0x20 [ 5388.327574] [] ? ll_destroy_inode+0x1c/0x20 [lustre] [ 5388.328705] [] ? destroy_inode+0x38/0x60 [ 5388.329616] [] ? evict+0x10e/0x180 [ 5388.330465] [] ? _raw_spin_unlock+0xe/0x20 [ 5388.331441] [] ? fsnotify_unmount_inodes+0x1d6/0x1e0 [ 5388.332533] [] generic_shutdown_super+0x6a/0xf0 [ 5388.333571] [] kill_anon_super+0x12/0x20 [ 5388.334483] [] lustre_kill_super+0x2b/0x30 [lustre] [ 5388.335617] [] deactivate_locked_super+0x49/0x60 [ 5388.336687] [] deactivate_super+0x46/0x60 [ 5388.337622] [] cleanup_mnt+0x3f/0x80 [ 5388.338486] [] __cleanup_mnt+0x12/0x20 [ 5388.339402] [] task_work_run+0xb5/0xf0 [ 5388.340325] [] do_notify_resume+0x92/0xb0 [ 5388.341246] [] int_signal+0x12/0x17 [ 5388.342116] ---[ end trace a193f2979542d3e1 ]--- [ 5388.342908] ------------[ cut here ]------------ [ 5388.343678] WARNING: CPU: 2 PID: 12374 at lib/debugobjects.c:286 debug_print_object+0x83/0xa0 [ 5388.345138] ODEBUG: active_state active (active state 1) object type: rcu_head hint: (null) [ 5388.346686] Modules linked in: lustre(OE) ofd(OE) osp(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) crc32_generic libcfs(OE) crc_t10dif crct10dif_generic crct10dif_common rpcsec_gss_krb5 squashfs i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi ata_piix serio_raw libata [ 5388.354189] CPU: 2 PID: 12374 Comm: umount Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 5388.355968] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 5388.357439] Call Trace: [ 5388.357869] [] dump_stack+0x19/0x1b [ 5388.358752] [] __warn+0xd8/0x100 [ 5388.359598] [] warn_slowpath_fmt+0x5f/0x80 [ 5388.360578] [] debug_print_object+0x83/0xa0 [ 5388.361579] [] debug_object_active_state+0x17c/0x190 [ 5388.362666] [] ? xas_alloc+0xd0/0xd0 [libcfs] [ 5388.363685] [] __call_rcu+0x55/0x2d0 [ 5388.364542] [] call_rcu_sched+0x1d/0x20 [ 5388.365478] [] xas_free_nodes+0xa4/0xf0 [libcfs] [ 5388.366560] [] xa_destroy+0xdf/0xf0 [libcfs] [ 5388.367570] [] osc_quota_cleanup+0x15/0x20 [osc] [ 5388.368638] [] osc_cleanup_common+0xbf/0x1b0 [osc] [ 5388.369744] [] class_free_dev+0x219/0x730 [obdclass] [ 5388.370877] [] class_export_put+0x1e0/0x2e0 [obdclass] [ 5388.372048] [] class_unlink_export+0x125/0x160 [obdclass] [ 5388.373238] [] class_decref_free+0x4e/0x90 [obdclass] [ 5388.374383] [] class_decref+0x48/0xf0 [obdclass] [ 5388.375423] [] class_detach+0x1c1/0x310 [obdclass] [ 5388.376542] [] class_process_config+0x163b/0x27c0 [obdclass] [ 5388.377785] [] ? __kmalloc+0x1e0/0x340 [ 5388.378734] [] class_manual_cleanup+0x1e0/0x770 [obdclass] [ 5388.379950] [] lov_tgts_putref+0x385/0xad0 [lov] [ 5388.381004] [] lov_disconnect+0x237/0x280 [lov] [ 5388.382082] [] obd_disconnect+0x56/0x300 [lustre] [ 5388.383161] [] ll_put_super+0x767/0xce0 [lustre] [ 5388.384225] [] ? call_rcu_sched+0x1d/0x20 [ 5388.385213] [] ? ll_destroy_inode+0x1c/0x20 [lustre] [ 5388.386314] [] ? destroy_inode+0x38/0x60 [ 5388.387248] [] ? evict+0x10e/0x180 [ 5388.388133] [] ? _raw_spin_unlock+0xe/0x20 [ 5388.389088] [] ? fsnotify_unmount_inodes+0x1d6/0x1e0 [ 5388.390147] [] generic_shutdown_super+0x6a/0xf0 [ 5388.391155] [] kill_anon_super+0x12/0x20 [ 5388.392109] [] lustre_kill_super+0x2b/0x30 [lustre] [ 5388.393222] [] deactivate_locked_super+0x49/0x60 [ 5388.394246] [] deactivate_super+0x46/0x60 [ 5388.395211] [] cleanup_mnt+0x3f/0x80 [ 5388.396107] [] __cleanup_mnt+0x12/0x20 [ 5388.397018] [] task_work_run+0xb5/0xf0 [ 5388.397928] [] do_notify_resume+0x92/0xb0 [ 5388.398837] [] int_signal+0x12/0x17 [ 5388.399727] ---[ end trace a193f2979542d3e2 ]--- [ 5388.400457] ------------[ cut here ]------------ [ 5388.401251] WARNING: CPU: 2 PID: 12374 at lib/debugobjects.c:286 debug_print_object+0x83/0xa0 [ 5388.402684] ODEBUG: activate active (active state 1) object type: rcu_head hint: (null) [ 5388.404149] Modules linked in: lustre(OE) ofd(OE) osp(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) crc32_generic libcfs(OE) crc_t10dif crct10dif_generic crct10dif_common rpcsec_gss_krb5 squashfs i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi ata_piix serio_raw libata [ 5388.411563] CPU: 2 PID: 12374 Comm: umount Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 5388.413343] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 5388.414823] Call Trace: [ 5388.415251] [] dump_stack+0x19/0x1b [ 5388.416116] [] __warn+0xd8/0x100 [ 5388.416925] [] warn_slowpath_fmt+0x5f/0x80 [ 5388.417850] [] debug_print_object+0x83/0xa0 [ 5388.418827] [] debug_object_activate+0x1af/0x210 [ 5388.419897] [] ? xas_alloc+0xd0/0xd0 [libcfs] [ 5388.420931] [] __call_rcu+0x3f/0x2d0 [ 5388.421801] [] call_rcu_sched+0x1d/0x20 [ 5388.422722] [] xas_free_nodes+0xa4/0xf0 [libcfs] [ 5388.423795] [] xa_destroy+0xdf/0xf0 [libcfs] [ 5388.424779] [] osc_quota_cleanup+0x15/0x20 [osc] [ 5388.425804] [] osc_cleanup_common+0xbf/0x1b0 [osc] [ 5388.426902] [] class_free_dev+0x219/0x730 [obdclass] [ 5388.428025] [] class_export_put+0x1e0/0x2e0 [obdclass] [ 5388.429205] [] class_unlink_export+0x125/0x160 [obdclass] [ 5388.430404] [] class_decref_free+0x4e/0x90 [obdclass] [ 5388.431549] [] class_decref+0x48/0xf0 [obdclass] [ 5388.432643] [] class_detach+0x1c1/0x310 [obdclass] [ 5388.433728] [] class_process_config+0x163b/0x27c0 [obdclass] [ 5388.434945] [] ? __kmalloc+0x1e0/0x340 [ 5388.435881] [] class_manual_cleanup+0x1e0/0x770 [obdclass] [ 5388.437115] [] lov_tgts_putref+0x385/0xad0 [lov] [ 5388.438171] [] lov_disconnect+0x237/0x280 [lov] [ 5388.439178] [] obd_disconnect+0x56/0x300 [lustre] [ 5388.440276] [] ll_put_super+0x767/0xce0 [lustre] [ 5388.441341] [] ? call_rcu_sched+0x1d/0x20 [ 5388.442307] [] ? ll_destroy_inode+0x1c/0x20 [lustre] [ 5388.443408] [] ? destroy_inode+0x38/0x60 [ 5388.444361] [] ? evict+0x10e/0x180 [ 5388.445220] [] ? _raw_spin_unlock+0xe/0x20 [ 5388.446197] [] ? fsnotify_unmount_inodes+0x1d6/0x1e0 [ 5388.447300] [] generic_shutdown_super+0x6a/0xf0 [ 5388.448335] [] kill_anon_super+0x12/0x20 [ 5388.449275] [] lustre_kill_super+0x2b/0x30 [lustre] [ 5388.450347] [] deactivate_locked_super+0x49/0x60 [ 5388.451397] [] deactivate_super+0x46/0x60 [ 5388.452334] [] cleanup_mnt+0x3f/0x80 [ 5388.453213] [] __cleanup_mnt+0x12/0x20 [ 5388.454129] [] task_work_run+0xb5/0xf0 [ 5388.455070] [] do_notify_resume+0x92/0xb0 [ 5388.456025] [] int_signal+0x12/0x17 [ 5388.456860] ---[ end trace a193f2979542d3e3 ]--- [ 5388.457628] BUG: unable to handle kernel NULL pointer dereference at (null) [ 5388.458920] IP: [] xas_free_nodes+0xb8/0xf0 [libcfs] [ 5388.460023] PGD 0 [ 5388.460373] Oops: 0000 [#1] SMP DEBUG_PAGEALLOC [ 5388.461195] Modules linked in: lustre(OE) ofd(OE) osp(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) crc32_generic libcfs(OE) crc_t10dif crct10dif_generic crct10dif_common rpcsec_gss_krb5 squashfs i2c_piix4 i2c_core pcspkr binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi ata_piix serio_raw libata [ 5388.468704] CPU: 2 PID: 12374 Comm: umount Kdump: loaded Tainted: G W OE ------------ 3.10.0-7.9-debug #1 [ 5388.470441] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 5388.471875] task: ffff88012b485550 ti: ffff8800a9968000 task.ti: ffff8800a9968000 [ 5388.473121] RIP: 0010:[] [] xas_free_nodes+0xb8/0xf0 [libcfs] [ 5388.474643] RSP: 0018:ffff8800a996b980 EFLAGS: 00010083 [ 5388.475541] RAX: 0000000000002710 RBX: ffff8800b0a26910 RCX: 0000000000000005 [ 5388.476753] RDX: ffff8800b0a26b70 RSI: ffff8800b0a26928 RDI: 0000000000000046 [ 5388.477945] RBP: ffff8800a996b9a8 R08: 0000000000000000 R09: 5130000000000000 [ 5388.479144] R10: 6633393161206563 R11: 61727420646e6520 R12: 0000000000000001 [ 5388.480277] R13: 0000000000000000 R14: ffff8800b0aa06d8 R15: ffff8800a996b9b8 [ 5388.481433] FS: 00007fbcfa47f880(0000) GS:ffff88013e300000(0000) knlGS:0000000000000000 [ 5388.482807] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5388.483784] CR2: 0000000000000000 CR3: 00000000b6230000 CR4: 00000000000006e0 [ 5388.484962] Call Trace: [ 5388.485372] [] xa_destroy+0xdf/0xf0 [libcfs] [ 5388.486415] [] osc_quota_cleanup+0x15/0x20 [osc] [ 5388.487506] [] osc_cleanup_common+0xbf/0x1b0 [osc] [ 5388.488607] [] class_free_dev+0x219/0x730 [obdclass] [ 5388.489606] [] class_export_put+0x1e0/0x2e0 [obdclass] [ 5388.490799] [] class_unlink_export+0x125/0x160 [obdclass] [ 5388.492043] [] class_decref_free+0x4e/0x90 [obdclass] [ 5388.493112] [] class_decref+0x48/0xf0 [obdclass] [ 5388.494192] [] class_detach+0x1c1/0x310 [obdclass] [ 5388.495278] [] class_process_config+0x163b/0x27c0 [obdclass] [ 5388.496501] [] ? __kmalloc+0x1e0/0x340 [ 5388.497465] [] class_manual_cleanup+0x1e0/0x770 [obdclass] [ 5388.498699] [] lov_tgts_putref+0x385/0xad0 [lov] [ 5388.499813] [] lov_disconnect+0x237/0x280 [lov] [ 5388.500829] [] obd_disconnect+0x56/0x300 [lustre] [ 5388.501904] [] ll_put_super+0x767/0xce0 [lustre] [ 5388.503002] [] ? call_rcu_sched+0x1d/0x20 [ 5388.503986] [] ? ll_destroy_inode+0x1c/0x20 [lustre] [ 5388.505124] [] ? destroy_inode+0x38/0x60 [ 5388.506008] [] ? evict+0x10e/0x180 [ 5388.506891] [] ? _raw_spin_unlock+0xe/0x20 [ 5388.507887] [] ? fsnotify_unmount_inodes+0x1d6/0x1e0 [ 5388.509019] [] generic_shutdown_super+0x6a/0xf0 [ 5388.510087] [] kill_anon_super+0x12/0x20 [ 5388.511048] [] lustre_kill_super+0x2b/0x30 [lustre] [ 5388.512173] [] deactivate_locked_super+0x49/0x60 [ 5388.513269] [] deactivate_super+0x46/0x60 [ 5388.514218] [] cleanup_mnt+0x3f/0x80 [ 5388.515137] [] __cleanup_mnt+0x12/0x20 [ 5388.516044] [] task_work_run+0xb5/0xf0 [ 5388.516974] [] do_notify_resume+0x92/0xb0 [ 5388.517922] [] int_signal+0x12/0x17 [ 5388.518743] Code: 8d 7b 18 48 c7 43 10 01 00 00 00 48 c7 c6 60 be 18 a0 e8 dc 1f fc e0 4c 39 f3 75 b7 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 40 00 <41> 0f b6 4d 00 4c 89 eb e9 5c ff ff ff 0f 1f 00 48 81 fa 00 10 [ 5388.523115] RIP [] xas_free_nodes+0xb8/0xf0 [libcfs] [ 5388.524266] RSP [ 5388.524876] CR2: 0000000000000000