[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 446568500 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] [ 0.000000] RAMDISK: [mem 0xbcc64000-0xbffcffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F5970 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE1BB7 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE1A53 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 001A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE1AC7 000090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE1B57 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE1B8F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe1a53-0xbffe1ac6] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a52] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe1ac7-0xbffe1b56] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe1b57-0xbffe1b8e] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe1b8f-0xbffe1bb6] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffd9fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4744 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059618 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895288K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.003062] x2apic enabled [ 0.004007] Switched APIC routing to physical x2apic. [ 0.005012] kvm-guest: setup PV IPIs [ 0.008371] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.009000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.009023] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.010006] pid_max: default: 32768 minimum: 301 [ 0.011124] LSM: Security Framework initializing [ 0.012032] Yama: becoming mindful. [ 0.013023] SELinux: Initializing. [ 0.014062] *** VALIDATE selinux *** [ 0.021699] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025687] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026117] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028138] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029132] *** VALIDATE tmpfs *** [ 0.031000] *** VALIDATE proc *** [ 0.032326] *** VALIDATE cgroup *** [ 0.033012] *** VALIDATE cgroup2 *** [ 0.034408] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.035157] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.036003] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.037023] Spectre V2 : User space: Vulnerable [ 0.038005] Speculative Store Bypass: Vulnerable [ 0.041301] debug: unmapping init [mem 0xffffffffbbe59000-0xffffffffbbe60fff] [ 0.044000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.045013] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.046049] ... version: 2 [ 0.047018] ... bit width: 48 [ 0.048012] ... generic registers: 4 [ 0.049013] ... value mask: 0000ffffffffffff [ 0.050026] ... max period: 00007fffffffffff [ 0.051028] ... fixed-purpose events: 3 [ 0.052018] ... event mask: 000000070000000f [ 0.054544] rcu: Hierarchical SRCU implementation. [ 0.057073] smp: Bringing up secondary CPUs ... [ 0.058821] x86: Booting SMP configuration: [ 0.059062] .... node #0, CPUs: #1 #2 #3 [ 0.064241] smp: Brought up 1 node, 4 CPUs [ 0.065711] smpboot: Max logical packages: 1 [ 0.066010] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.181946] node 0 deferred pages initialised in 113ms [ 0.184188] devtmpfs: initialized [ 0.185197] x86/mm: Memory block size: 128MB [ 0.187834] gcov: version magic: 0x41383552 [ 0.189468] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.191213] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.195462] pinctrl core: initialized pinctrl subsystem [ 0.198230] [ 0.198826] ************************************************************* [ 0.201024] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.203014] ** ** [ 0.205013] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.208014] ** ** [ 0.210011] ** This means that this kernel is built to expose internal ** [ 0.212015] ** IOMMU data structures, which may compromise security on ** [ 0.215022] ** your system. ** [ 0.217017] ** ** [ 0.220022] ** If you see this message and you are not debugging the ** [ 0.222018] ** kernel, report this immediately to your vendor! ** [ 0.225015] ** ** [ 0.227014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.229015] ************************************************************* [ 0.233200] NET: Registered protocol family 16 [ 0.235764] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.240084] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.244058] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.247021] cpuidle: using governor menu [ 0.248566] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.250131] PCI: Using configuration type 1 for base access [ 0.253160] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.260120] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.262026] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.265096] cryptd: max_cpu_qlen set to 1000 [ 0.268336] ACPI: Added _OSI(Module Device) [ 0.269018] ACPI: Added _OSI(Processor Device) [ 0.271022] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.272008] ACPI: Added _OSI(Processor Aggregator Device) [ 0.276414] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.281521] ACPI: Interpreter enabled [ 0.282038] ACPI: PM: (supports S0 S3 S4 S5) [ 0.284010] ACPI: Using IOAPIC for interrupt routing [ 0.285068] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.288400] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.296000] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.299022] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.300009] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.303089] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.306972] acpiphp: Slot [2] registered [ 0.308133] acpiphp: Slot [3] registered [ 0.309055] acpiphp: Slot [4] registered [ 0.310057] acpiphp: Slot [5] registered [ 0.311090] acpiphp: Slot [6] registered [ 0.311856] acpiphp: Slot [7] registered [ 0.313067] acpiphp: Slot [8] registered [ 0.313840] acpiphp: Slot [9] registered [ 0.314044] acpiphp: Slot [10] registered [ 0.314804] acpiphp: Slot [11] registered [ 0.316038] acpiphp: Slot [12] registered [ 0.316993] acpiphp: Slot [13] registered [ 0.318058] acpiphp: Slot [14] registered [ 0.318962] acpiphp: Slot [15] registered [ 0.320114] acpiphp: Slot [16] registered [ 0.321041] acpiphp: Slot [17] registered [ 0.322078] acpiphp: Slot [18] registered [ 0.323051] acpiphp: Slot [19] registered [ 0.323798] acpiphp: Slot [20] registered [ 0.325040] acpiphp: Slot [21] registered [ 0.325889] acpiphp: Slot [22] registered [ 0.327040] acpiphp: Slot [23] registered [ 0.328043] acpiphp: Slot [24] registered [ 0.329052] acpiphp: Slot [25] registered [ 0.330095] acpiphp: Slot [26] registered [ 0.331061] acpiphp: Slot [27] registered [ 0.332051] acpiphp: Slot [28] registered [ 0.333058] acpiphp: Slot [29] registered [ 0.334043] acpiphp: Slot [30] registered [ 0.335066] acpiphp: Slot [31] registered [ 0.336059] PCI host bridge to bus 0000:00 [ 0.338036] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.339008] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.341010] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.343011] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.345012] pci_bus 0000:00: root bus resource [mem 0x180000000-0x1ffffffff window] [ 0.347013] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.349147] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.353379] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.356576] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.361526] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.364438] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.366015] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.369042] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.374027] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.376443] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.378520] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.380034] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.381499] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.384027] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.391007] pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.395021] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.400191] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.407013] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.413015] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.426013] pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.431000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.441023] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.446019] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.462039] pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.478730] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.480353] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.483361] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.485377] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.487166] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.491143] iommu: Default domain type: Passthrough [ 0.492468] SCSI subsystem initialized [ 0.494129] ACPI: bus type USB registered [ 0.495102] usbcore: registered new interface driver usbfs [ 0.497090] usbcore: registered new interface driver hub [ 0.498086] usbcore: registered new device driver usb [ 0.500186] pps_core: LinuxPPS API ver. 1 registered [ 0.502012] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.505074] PTP clock support registered [ 0.506125] EDAC MC: Ver: 3.0.0 [ 0.507338] PCI: Using ACPI for IRQ routing [ 0.508455] NetLabel: Initializing [ 0.509012] NetLabel: domain hash size = 128 [ 0.511009] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.512110] NetLabel: unlabeled traffic allowed by default [ 0.514138] vgaarb: loaded [ 0.515367] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.517007] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.520417] clocksource: Switched to clocksource kvm-clock [ 0.624680] VFS: Disk quotas dquot_6.6.0 [ 0.626788] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.630249] *** VALIDATE ramfs *** [ 0.631465] *** VALIDATE hugetlbfs *** [ 0.633052] pnp: PnP ACPI init [ 0.635583] pnp: PnP ACPI: found 6 devices [ 0.652378] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.655572] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.656939] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.658319] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.659836] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.661373] pci_bus 0000:00: resource 8 [mem 0x180000000-0x1ffffffff window] [ 0.663140] NET: Registered protocol family 2 [ 0.665087] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.668634] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.671382] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.681135] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.689390] TCP: Hash tables configured (established 65536 bind 65536) [ 0.693964] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.698590] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.703253] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.707989] NET: Registered protocol family 1 [ 0.711847] RPC: Registered named UNIX socket transport module. [ 0.714846] RPC: Registered udp transport module. [ 0.717820] RPC: Registered tcp transport module. [ 0.720768] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.724838] NET: Registered protocol family 44 [ 0.726294] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.728433] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.730193] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.732130] PCI: CLS 0 bytes, default 64 [ 0.733485] Unpacking initramfs... [ 2.111770] debug: unmapping init [mem 0xffff8d50fcc64000-0xffff8d50fffcffff] [ 2.115983] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.117956] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.120820] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.663237] Initialise system trusted keyrings [ 2.664551] Key type blacklist registered [ 2.669112] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.679071] zbud: loaded [ 2.681905] *** VALIDATE nfs *** [ 2.682849] *** VALIDATE nfs4 *** [ 2.684189] pstore: using deflate compression [ 2.687554] Platform Keyring initialized [ 2.820619] NET: Registered protocol family 38 [ 2.824505] Key type asymmetric registered [ 2.826163] Asymmetric key parser 'x509' registered [ 2.828012] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.835738] io scheduler mq-deadline registered [ 2.837132] io scheduler kyber registered [ 2.839247] io scheduler bfq registered [ 2.841132] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.843604] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.845934] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.848307] ACPI: Power Button [PWRF] [ 2.946453] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.058115] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.179232] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.210924] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.250265] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.261794] Non-volatile memory driver v1.3 [ 3.263271] Linux agpgart interface v0.103 [ 3.316147] virtio_blk virtio1: [vda] 132696 512-byte logical blocks (67.9 MB/64.8 MiB) [ 3.319869] vda: detected capacity change from 0 to 67940352 [ 3.332799] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.335971] vdb: detected capacity change from 0 to 1073741824 [ 3.347626] libphy: Fixed MDIO Bus: probed [ 3.356345] usbcore: registered new interface driver usbserial_generic [ 3.358747] usbserial: USB Serial support registered for generic [ 3.361278] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.368096] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.370684] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.372762] mousedev: PS/2 mouse device common for all mice [ 3.375989] rtc_cmos 00:05: RTC can wake from S4 [ 3.380238] rtc_cmos 00:05: registered as rtc0 [ 3.381125] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.383383] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.390377] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.391751] intel_pstate: CPU model not supported [ 3.398450] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.399541] hid: raw HID events driver (C) Jiri Kosina [ 3.406854] usbcore: registered new interface driver usbhid [ 3.408387] usbhid: USB HID core driver [ 3.409775] drop_monitor: Initializing network drop monitor service [ 3.411702] Initializing XFRM netlink socket [ 3.413390] NET: Registered protocol family 10 [ 3.416316] Segment Routing with IPv6 [ 3.417389] NET: Registered protocol family 17 [ 3.419035] mpls_gso: MPLS GSO support [ 3.423970] RAS: Correctable Errors collector initialized. [ 3.426157] AVX version of gcm_enc/dec engaged. [ 3.427624] AES CTR mode by8 optimization enabled [ 3.551579] sched_clock: Marking stable (3551561793, 0)->(4291054965, -739493172) [ 3.554598] registered taskstats version 1 [ 3.555820] Loading compiled-in X.509 certificates [ 3.557328] zswap: loaded using pool lzo/zbud [ 3.584032] Key type big_key registered [ 3.611172] Key type encrypted registered [ 3.615738] ima: No TPM chip found, activating TPM-bypass! [ 3.617922] ima: Allocated hash algorithm: sha1 [ 3.621620] ima: No architecture policies found [ 3.625271] evm: Initialising EVM extended attributes: [ 3.633160] evm: security.selinux [ 3.635579] evm: security.ima [ 3.639473] evm: security.capability [ 3.644851] evm: HMAC attrs: 0x1 [ 3.654832] rtc_cmos 00:05: setting system clock to 2025-07-24 13:40:31 UTC (1753364431) [ 3.667590] debug: unmapping init [mem 0xffffffffbce03000-0xffffffffbcffffff] [ 3.674744] debug: unmapping init [mem 0xffffffffbbb82000-0xffffffffbbe58fff] [ 3.686168] Write protecting the kernel read-only data: 28672k [ 3.694718] debug: unmapping init [mem 0xffffffffba203000-0xffffffffba3fffff] [ 3.698935] debug: unmapping init [mem 0xffffffffbab14000-0xffffffffbabfffff] [ 3.777085] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.789862] systemd[1]: Detected virtualization kvm. [ 3.793092] systemd[1]: Detected architecture x86-64. [ 3.796043] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.837274] systemd[1]: No hostname configured. [ 3.839930] systemd[1]: Set hostname to . [ 3.841717] random: systemd: uninitialized urandom read (16 bytes read) [ 3.843739] systemd[1]: Initializing machine ID from random generator. [ 4.005138] random: ln: uninitialized urandom read (6 bytes read) [ 4.135721] random: systemd: uninitialized urandom read (16 bytes read) [ 4.137534] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 4.146936] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.149463] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Reached target Paths. [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Timers. [ OK ] Listening on Journal Socket. Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Starting Create list of required st…ce nodes for the current kernel... Starting Setup Virtual Console... [ OK ] Started Memstrack Anylazing Service. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Swap. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Setup Virtual Console. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 5.011996] device-mapper: uevent: version 1.0.3 [ 5.014890] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 6.364420] virtio_net virtio0 ens2: renamed from eth0 [ 6.459973] scsi host0: ata_piix [ 6.482315] random: fast init done [ 6.491240] scsi host1: ata_piix [ 6.492651] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 6.494798] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 11.176644] random: crng init done [ 11.178886] random: 7 urandom warning(s) missed due to ratelimiting [ 13.009404] dracut-initqueue[588]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 14.041034] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 15.646362] printk: systemd: 26 output lines suppressed due to ratelimiting [ 15.979120] SELinux: Disabled at runtime. [ 16.052355] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 16.063533] systemd[1]: Detected virtualization kvm. [ 16.065695] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 16.734950] systemd[1]: initrd-switch-root.service: Succeeded. [ 16.740817] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 16.748544] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 16.755725] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 16.762827] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 16.778313] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.797398] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ OK ] Created slice User and Session Slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Created slice system-serial\x2dgetty.slice. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Listening on udev Control Socket. Mounting Huge Pages File System... [ OK ] Reached target Slices. [ OK ] Listening on udev Kernel Socket. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting Create list of required st…ce nodes for the current kernel... Mounting POSIX Message Queue File System... Starting Apply Kernel Variables... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. Starting udev Coldplug all Devices... [ OK ] Reached target Paths. [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-getty.slice. [ OK ] Listening on Process Core Dump Socket. Activating swap /dev/disk/by-label/SWAP... Starting Remount Root and Kernel File Systems... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on initctl Compatibility Named Pipe. [ 17.085213] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Apply Kernel Variables. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 17.535751] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 18.224295] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 18.269872] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 18.660374] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 18.737839] EDAC sbridge: Ver: 1.1.2 [ 20.911944] Key type dns_resolver registered [ 21.346340] NFS: Registering the id_resolver key type [ 21.348593] Key type id_resolver registered [ 21.350585] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... Starting Login Service... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started irqbalance daemon. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg432-client login: [ 49.168090] libcfs: loading out-of-tree module taints kernel. [ 49.218479] Key type ._llcrypt registered [ 49.219569] Key type .llcrypt registered [ 49.388733] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 49.392909] alg: No test for adler32 (adler32-zlib) [ 50.337501] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 50.598395] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 50.600821] LNet: Accept secure, port 988 [ 52.208150] Key type lgssc registered [ 52.655514] Lustre: Echo OBD driver; http://www.lustre.org/ [ 128.669223] Lustre: Mounted lustre-client [ 131.163264] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 143.946067] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing check_logdir /tmp/testlogs/ [ 145.413414] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing yml_node [ 147.224962] Lustre: DEBUG MARKER: Client: 2.16.57.3 [ 148.168563] Lustre: DEBUG MARKER: MDS: 2.16.57.3 [ 149.125331] Lustre: DEBUG MARKER: OSS: 2.16.57.3 [ 149.760927] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Jul 24 09:42:57 EDT 2025 [ 154.592229] Lustre: lustre-OST0000-osc-ffff8d5147006000: disconnect after 24s idle [ 156.024968] Lustre: DEBUG MARKER: excepting tests: 21e 32b 32c 32newtarball [ 156.592425] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 157.136833] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 167.399401] LustreError: 8960:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 167.416650] Lustre: Unmounted lustre-client [ 224.852613] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 226.273038] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 235.450726] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 258.189966] Lustre: DEBUG MARKER: == conf-sanity test 0: single mount setup ================ 09:44:45 (1753364685) [ 271.393187] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 273.118168] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 281.639814] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 287.239855] Lustre: Mounted lustre-client [ 289.427708] LustreError: 14034:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51504d3000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 289.440636] LustreError: 14034:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 289.442856] LustreError: 14034:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 289.484487] Lustre: Unmounted lustre-client [ 304.837278] Key type lgssc unregistered [ 304.989401] LNet: 14436:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 306.023362] LNet: Removed LNI 192.168.204.32@tcp [ 306.441278] Key type .llcrypt unregistered [ 306.442681] Key type ._llcrypt unregistered [ 315.503421] Key type ._llcrypt registered [ 315.504938] Key type .llcrypt registered [ 316.274903] Lustre: DEBUG MARKER: == conf-sanity test 1: start up ost twice (should return errors) ========================================================== 09:45:43 (1753364743) [ 317.305868] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 317.339409] alg: No test for adler32 (adler32-zlib) [ 318.234585] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 318.349469] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 318.351610] LNet: Accept secure, port 988 [ 319.944167] Key type lgssc registered [ 320.420682] Lustre: Echo OBD driver; http://www.lustre.org/ [ 340.147364] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 341.608025] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 348.630936] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 358.389760] Lustre: Mounted lustre-client [ 358.920166] LustreError: 17610:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5145109000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 358.930597] LustreError: 17610:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 358.960443] Lustre: Unmounted lustre-client [ 376.645433] Key type lgssc unregistered [ 376.794600] LNet: 18011:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 377.830665] LNet: Removed LNI 192.168.204.32@tcp [ 378.119547] Key type .llcrypt unregistered [ 378.120878] Key type ._llcrypt unregistered [ 384.671512] Key type ._llcrypt registered [ 384.673049] Key type .llcrypt registered [ 385.148383] Lustre: DEBUG MARKER: == conf-sanity test 2: start up mds twice (should return err) ========================================================== 09:46:52 (1753364812) [ 385.977280] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 385.985765] alg: No test for adler32 (adler32-zlib) [ 386.871193] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 386.965484] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 386.967945] LNet: Accept secure, port 988 [ 388.560244] Key type lgssc registered [ 388.954153] Lustre: Echo OBD driver; http://www.lustre.org/ [ 410.325429] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 411.886786] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 422.190306] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 428.526393] Lustre: Mounted lustre-client [ 434.170075] LustreError: 21176:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5147004000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 434.181491] LustreError: 21176:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 434.209788] Lustre: Unmounted lustre-client [ 442.531418] Key type lgssc unregistered [ 442.681790] LNet: 21576:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 443.750947] LNet: Removed LNI 192.168.204.32@tcp [ 444.052150] Key type .llcrypt unregistered [ 444.053324] Key type ._llcrypt unregistered [ 451.164895] Key type ._llcrypt registered [ 451.166337] Key type .llcrypt registered [ 451.731292] Lustre: DEBUG MARKER: == conf-sanity test 3: mount client twice (should return err) ========================================================== 09:47:58 (1753364878) [ 452.753945] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 452.767175] alg: No test for adler32 (adler32-zlib) [ 453.665432] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 453.773502] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 453.775988] LNet: Accept secure, port 988 [ 455.376141] Key type lgssc registered [ 455.908987] Lustre: Echo OBD driver; http://www.lustre.org/ [ 476.784234] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 478.439431] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 487.055190] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 492.547516] Lustre: Mounted lustre-client [ 494.547084] LustreError: 24687:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d514510a000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 494.558785] LustreError: 24687:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 494.580619] Lustre: Unmounted lustre-client [ 512.473728] Key type lgssc unregistered [ 512.621510] LNet: 25090:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 513.639345] LNet: Removed LNI 192.168.204.32@tcp [ 513.930729] Key type .llcrypt unregistered [ 513.932060] Key type ._llcrypt unregistered [ 525.492923] Key type ._llcrypt registered [ 525.494560] Key type .llcrypt registered [ 526.748590] Lustre: DEBUG MARKER: == conf-sanity test 4: force cleanup ost, then cleanup === 09:49:13 (1753364953) [ 529.220308] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 529.242752] alg: No test for adler32 (adler32-zlib) [ 530.360609] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 530.662412] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 530.691307] LNet: Accept secure, port 988 [ 532.440157] Key type lgssc registered [ 533.664980] Lustre: Echo OBD driver; http://www.lustre.org/ [ 557.204935] hrtimer: interrupt took 25923780 ns [ 577.761393] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 580.215625] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 591.242339] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 603.149828] Lustre: Mounted lustre-client [ 608.244142] Lustre: lustre-OST0000-osc-ffff8d5151297000: Connection to lustre-OST0000 (at 192.168.204.132@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 613.952238] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 624.244613] LustreError: 28220:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 624.283820] Lustre: Unmounted lustre-client [ 645.424321] Key type lgssc unregistered [ 645.600620] LNet: 28615:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 646.633777] LNet: Removed LNI 192.168.204.32@tcp [ 647.171504] Key type .llcrypt unregistered [ 647.175722] Key type ._llcrypt unregistered [ 657.916213] Key type ._llcrypt registered [ 657.917738] Key type .llcrypt registered [ 658.884373] Lustre: DEBUG MARKER: == conf-sanity test 5a: force cleanup mds, then cleanup == 09:51:25 (1753365085) [ 660.319193] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 660.349685] alg: No test for adler32 (adler32-zlib) [ 661.287518] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 661.441583] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 661.444764] LNet: Accept secure, port 988 [ 663.088257] Key type lgssc registered [ 663.710862] Lustre: Echo OBD driver; http://www.lustre.org/ [ 689.758752] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 691.487280] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 701.133984] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 709.092787] Lustre: Mounted lustre-client [ 719.336774] Lustre: lustre-MDT0000-mdc-ffff8d5150111800: Connection to lustre-MDT0000 (at 192.168.204.132@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 729.579225] Lustre: lustre-MDT0001-mdc-ffff8d5150111800: Connection to lustre-MDT0001 (at 192.168.204.132@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 731.627238] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 740.832347] Lustre: 29568:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1753365152/real 1753365152] req@00000000ac23c556 x1838536551569920/t0(0) o400->MGC192.168.204.132@tcp@192.168.204.132@tcp:26/25 lens 224/224 e 0 to 1 dl 1753365168 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 740.842748] LustreError: MGC192.168.204.132@tcp: Connection to MGS (at 192.168.204.132@tcp) was lost; in progress operations using this service will fail [ 741.865191] LustreError: 31783:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 741.883393] Lustre: Unmounted lustre-client [ 753.971674] Key type lgssc unregistered [ 754.101651] LNet: 32176:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 755.178822] LNet: Removed LNI 192.168.204.32@tcp [ 755.508295] Key type .llcrypt unregistered [ 755.511119] Key type ._llcrypt unregistered [ 765.085294] Key type ._llcrypt registered [ 765.087681] Key type .llcrypt registered [ 765.787978] Lustre: DEBUG MARKER: == conf-sanity test 5b: Try to start a client with no MGS (should return errs) ========================================================== 09:53:12 (1753365192) [ 767.000051] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 767.098194] alg: No test for adler32 (adler32-zlib) [ 768.085784] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 768.237589] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 768.241841] LNet: Accept secure, port 988 [ 769.872175] Key type lgssc registered [ 770.491472] Lustre: Echo OBD driver; http://www.lustre.org/ [ 839.732079] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 845.024318] LustreError: 34338:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.132@tcp: failed processing log, type 1: rc = -5 [ 855.008259] LustreError: 34347:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 1003.488277] LustreError: MGC192.168.204.132@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 1003.492620] Lustre: Unmounted lustre-client [ 1003.493760] LustreError: 34338:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 1003.497304] LustreError: 34338:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 1007.928148] Key type lgssc unregistered [ 1008.053431] LNet: 34763:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1009.062279] LNet: Removed LNI 192.168.204.32@tcp [ 1009.305669] Key type .llcrypt unregistered [ 1009.306887] Key type ._llcrypt unregistered [ 1015.799183] Key type ._llcrypt registered [ 1015.800675] Key type .llcrypt registered [ 1016.279223] Lustre: DEBUG MARKER: == conf-sanity test 5c: cleanup after failed mount (bug 2712) (should return errs) ========================================================== 09:57:23 (1753365443) [ 1017.033366] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1017.081100] alg: No test for adler32 (adler32-zlib) [ 1017.936067] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1018.014554] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1018.016187] LNet: Accept secure, port 988 [ 1019.592498] Key type lgssc registered [ 1019.952628] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1037.324695] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1038.676703] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1045.286508] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1045.389974] LustreError: 37751:0:(llite_lib.c:1416:ll_fill_super()) wrong.lustre: fsname longer than 8 characters: rc = -36 [ 1045.393789] Lustre: Unmounted wrong.lustre-client [ 1045.397363] LustreError: 37751:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 1045.402908] LustreError: 37751:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -36 [ 1062.733098] Key type lgssc unregistered [ 1062.851328] LNet: 38166:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1063.910279] LNet: Removed LNI 192.168.204.32@tcp [ 1064.164800] Key type .llcrypt unregistered [ 1064.166301] Key type ._llcrypt unregistered [ 1070.458312] Key type ._llcrypt registered [ 1070.459282] Key type .llcrypt registered [ 1070.913668] Lustre: DEBUG MARKER: == conf-sanity test 5d: mount with ost down ============== 09:58:18 (1753365498) [ 1071.754527] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1071.768816] alg: No test for adler32 (adler32-zlib) [ 1072.616452] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1072.692208] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1072.693697] LNet: Accept secure, port 988 [ 1074.280143] Key type lgssc registered [ 1074.622220] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1139.225439] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1148.841335] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1150.064547] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1155.584500] Lustre: Mounted lustre-client [ 1155.892948] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 1166.184501] LustreError: 41238:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1166.198135] Lustre: Unmounted lustre-client [ 1191.679140] Key type lgssc unregistered [ 1191.806405] LNet: 41636:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1192.870724] LNet: Removed LNI 192.168.204.32@tcp [ 1193.137570] Key type .llcrypt unregistered [ 1193.139338] Key type ._llcrypt unregistered [ 1199.230973] Key type ._llcrypt registered [ 1199.232071] Key type .llcrypt registered [ 1199.671889] Lustre: DEBUG MARKER: == conf-sanity test 5e: delayed connect, don't crash (bug 10268) ========================================================== 10:00:27 (1753365627) [ 1200.477212] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1200.495757] alg: No test for adler32 (adler32-zlib) [ 1201.367238] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1201.454337] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1201.455966] LNet: Accept secure, port 988 [ 1203.048148] Key type lgssc registered [ 1203.404309] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1219.702178] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1221.017624] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1227.293670] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1227.412294] LustreError: 42590:0:(niobuf.c:1068:ptl_send_rpc()) cfs_fail_timeout id 506 sleeping for 10000ms [ 1233.568230] LustreError: 44614:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.132@tcp: failed processing log, type 1: rc = -5 [ 1237.504115] LustreError: 42590:0:(niobuf.c:1068:ptl_send_rpc()) cfs_fail_timeout id 506 awake [ 1244.669808] Lustre: Mounted lustre-client [ 1245.025784] LustreError: 44686:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5147006800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1245.032432] LustreError: 44686:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1245.055812] Lustre: Unmounted lustre-client [ 1270.964230] Key type lgssc unregistered [ 1271.087626] LNet: 45089:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1272.102654] LNet: Removed LNI 192.168.204.32@tcp [ 1272.324217] Key type .llcrypt unregistered [ 1272.325307] Key type ._llcrypt unregistered [ 1278.087161] Key type ._llcrypt registered [ 1278.088044] Key type .llcrypt registered [ 1278.552699] Lustre: DEBUG MARKER: == conf-sanity test 5f: mds down, cleanup after failed mount (bug 2712) ========================================================== 10:01:45 (1753365705) [ 1279.130854] Lustre: DEBUG MARKER: SKIP: conf-sanity test_5f needs separate mgs and mds [ 1279.705021] Lustre: DEBUG MARKER: == conf-sanity test 5g: handle missing debugfs =========== 10:01:47 (1753365707) [ 1281.824368] Lustre: DEBUG MARKER: == conf-sanity test 5h: start mdt failure at mdt_fs_setup() ========================================================== 10:01:49 (1753365709) [ 1282.555353] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1282.573679] alg: No test for adler32 (adler32-zlib) [ 1283.439637] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1283.523981] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1283.525625] LNet: Accept secure, port 988 [ 1285.112229] Key type lgssc registered [ 1285.469858] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1329.476281] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1336.781947] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1367.715567] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1373.777712] Lustre: Mounted lustre-client [ 1383.940372] Lustre: lustre-MDT0000-mdc-ffff8d514934b800: Connection to lustre-MDT0000 (at 192.168.204.132@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1399.266910] Lustre: 46938:0:(client.c:2453:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1753365811/real 1753365811] req@00000000211836e3 x1838537203781888/t0(0) o400->MGC192.168.204.132@tcp@192.168.204.132@tcp:26/25 lens 224/224 e 0 to 1 dl 1753365827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1399.297980] LustreError: MGC192.168.204.132@tcp: Connection to MGS (at 192.168.204.132@tcp) was lost; in progress operations using this service will fail [ 1399.360266] Lustre: Evicted from MGS (at 192.168.204.132@tcp) after server handle changed from 0xaebaa16a700de074 to 0xaebaa16a700de242 [ 1399.371750] Lustre: MGC192.168.204.132@tcp: Connection restored to 192.168.204.132@tcp (at 192.168.204.132@tcp) [ 1407.519121] Lustre: lustre-MDT0000-mdc-ffff8d514934b800: Connection restored to 192.168.204.132@tcp (at 192.168.204.132@tcp) [ 1411.867617] LustreError: 49456:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d514934b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1411.890354] LustreError: 49456:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1411.939186] Lustre: Unmounted lustre-client [ 1438.720029] Key type lgssc unregistered [ 1439.005709] LNet: 49859:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1440.040374] LNet: Removed LNI 192.168.204.32@tcp [ 1440.803763] Key type .llcrypt unregistered [ 1440.826767] Key type ._llcrypt unregistered [ 1455.176220] Key type ._llcrypt registered [ 1455.178525] Key type .llcrypt registered [ 1456.578515] Lustre: DEBUG MARKER: == conf-sanity test 5i: start mdt failure at mdt_quota_init() ========================================================== 10:04:42 (1753365882) [ 1459.085279] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1459.210915] alg: No test for adler32 (adler32-zlib) [ 1460.371211] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1460.686095] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1460.693673] LNet: Accept secure, port 988 [ 1462.456174] Key type lgssc registered [ 1463.531460] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1508.499295] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1512.041548] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1528.761791] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1531.432056] Lustre: Mounted lustre-client [ 1536.492597] Lustre: lustre-MDT0000-mdc-ffff8d5150685000: Connection to lustre-MDT0000 (at 192.168.204.132@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1551.850404] LustreError: MGC192.168.204.132@tcp: Connection to MGS (at 192.168.204.132@tcp) was lost; in progress operations using this service will fail [ 1551.876551] Lustre: Evicted from MGS (at 192.168.204.132@tcp) after server handle changed from 0x1cf63a49e0c152f1 to 0x1cf63a49e0c15559 [ 1551.885172] Lustre: MGC192.168.204.132@tcp: Connection restored to (at 192.168.204.132@tcp) [ 1554.427854] Lustre: lustre-MDT0000-mdc-ffff8d5150685000: Connection restored to (at 192.168.204.132@tcp) [ 1555.973554] LustreError: 53323:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150685000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1555.984877] LustreError: 53323:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1556.032237] Lustre: Unmounted lustre-client [ 1581.048583] Key type lgssc unregistered [ 1581.267469] LNet: 53725:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1582.312582] LNet: Removed LNI 192.168.204.32@tcp [ 1582.959182] Key type .llcrypt unregistered [ 1582.960530] Key type ._llcrypt unregistered [ 1595.688323] Key type ._llcrypt registered [ 1595.689958] Key type .llcrypt registered [ 1596.829648] Lustre: DEBUG MARKER: == conf-sanity test 5j: verify libcfs doesn't crash when setting debug flags ========================================================== 10:07:03 (1753366023) [ 1597.381280] Key type .llcrypt unregistered [ 1597.384108] Key type ._llcrypt unregistered [ 1602.859087] Key type ._llcrypt registered [ 1602.873116] Key type .llcrypt registered [ 1602.914333] Key type .llcrypt unregistered [ 1602.915942] Key type ._llcrypt unregistered [ 1609.263275] Key type ._llcrypt registered [ 1609.264884] Key type .llcrypt registered [ 1610.688273] Lustre: DEBUG MARKER: == conf-sanity test 6: manual umount, then mount again === 10:07:16 (1753366036) [ 1613.112182] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1613.156970] alg: No test for adler32 (adler32-zlib) [ 1614.227233] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1614.447292] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1614.458482] LNet: Accept secure, port 988 [ 1616.120183] Key type lgssc registered [ 1617.251795] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1654.126269] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1656.954288] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1668.784597] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1671.113621] Lustre: Mounted lustre-client [ 1672.625400] LustreError: 57573:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d515192f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1672.640405] LustreError: 57573:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1672.680887] Lustre: Unmounted lustre-client [ 1672.858108] Lustre: Mounted lustre-client [ 1673.499038] LustreError: 57650:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d515864d000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1673.511073] LustreError: 57650:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1673.514465] LustreError: 57650:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1673.553042] Lustre: Unmounted lustre-client [ 1694.240732] Key type lgssc unregistered [ 1694.414768] LNet: 58053:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1695.463638] LNet: Removed LNI 192.168.204.32@tcp [ 1695.818130] Key type .llcrypt unregistered [ 1695.819847] Key type ._llcrypt unregistered [ 1704.846407] Key type ._llcrypt registered [ 1704.847975] Key type .llcrypt registered [ 1705.565367] Lustre: DEBUG MARKER: == conf-sanity test 7: manual umount, then cleanup ======= 10:08:52 (1753366132) [ 1706.619122] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1706.640178] alg: No test for adler32 (adler32-zlib) [ 1707.604931] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1707.713496] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1707.716375] LNet: Accept secure, port 988 [ 1709.320140] Key type lgssc registered [ 1709.851211] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1731.029898] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1732.490774] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1740.212369] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1751.033539] Lustre: Mounted lustre-client [ 1752.540672] LustreError: 61118:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51504d1000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1752.551743] LustreError: 61118:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1752.593226] Lustre: Unmounted lustre-client [ 1771.082241] Key type lgssc unregistered [ 1771.215722] LNet: 61529:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1772.264274] LNet: Removed LNI 192.168.204.32@tcp [ 1772.569664] Key type .llcrypt unregistered [ 1772.571401] Key type ._llcrypt unregistered [ 1779.434822] Key type ._llcrypt registered [ 1779.436472] Key type .llcrypt registered [ 1779.988721] Lustre: DEBUG MARKER: == conf-sanity test 8: double mount setup ================ 10:10:07 (1753366207) [ 1780.870498] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1780.881097] alg: No test for adler32 (adler32-zlib) [ 1781.742868] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1781.827668] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1781.829700] LNet: Accept secure, port 988 [ 1783.416309] Key type lgssc registered [ 1783.828286] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1802.803461] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1804.083489] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1810.428688] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1821.174040] Lustre: Mounted lustre-client [ 1822.631203] Lustre: Mounted lustre-client [ 1823.185839] LustreError: 64666:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d515110a000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1823.194795] LustreError: 64666:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 1823.218085] Lustre: Unmounted lustre-client [ 1841.322546] Key type lgssc unregistered [ 1841.450906] LNet: 65088:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1842.470555] LNet: Removed LNI 192.168.204.32@tcp [ 1842.699750] Key type .llcrypt unregistered [ 1842.701072] Key type ._llcrypt unregistered [ 1848.608367] Key type ._llcrypt registered [ 1848.609815] Key type .llcrypt registered [ 1849.067356] Lustre: DEBUG MARKER: == conf-sanity test 9: test ptldebug and subsystem for mkfs ========================================================== 10:11:16 (1753366276) [ 1849.845044] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1849.863163] alg: No test for adler32 (adler32-zlib) [ 1850.712681] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1850.787540] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1850.789163] LNet: Accept secure, port 988 [ 1852.368153] Key type lgssc registered [ 1852.746370] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1917.561686] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1922.854556] Lustre: DEBUG MARKER: == conf-sanity test 10a: find lctl param broken symlinks ========================================================== 10:12:30 (1753366350) [ 1933.410070] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1934.655668] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1940.932305] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1951.732051] Lustre: Mounted lustre-client [ 1954.366081] LustreError: 69303:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150116800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1954.373451] LustreError: 69303:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1954.394140] Lustre: Unmounted lustre-client [ 1963.450717] Key type lgssc unregistered [ 1963.560523] LNet: 69704:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1964.582888] LNet: Removed LNI 192.168.204.32@tcp [ 1964.846492] Key type .llcrypt unregistered [ 1964.848136] Key type ._llcrypt unregistered [ 1970.803565] Key type ._llcrypt registered [ 1970.805179] Key type .llcrypt registered [ 1971.222048] Lustre: DEBUG MARKER: == conf-sanity test 17: Verify failed mds_postsetup won't fail assertion (2936) (should return errs) ========================================================== 10:13:18 (1753366398) [ 1971.995904] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1972.031826] alg: No test for adler32 (adler32-zlib) [ 1972.888684] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 1972.975147] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 1972.977482] LNet: Accept secure, port 988 [ 1974.560238] Key type lgssc registered [ 1974.900344] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1991.436280] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1992.708759] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1998.607087] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2014.192377] Lustre: Mounted lustre-client [ 2015.860247] LustreError: 72814:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d514873b000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2015.867292] LustreError: 72814:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2015.890581] Lustre: Unmounted lustre-client [ 2033.392709] Key type lgssc unregistered [ 2033.521626] LNet: 73215:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2034.534745] LNet: Removed LNI 192.168.204.32@tcp [ 2034.801028] Key type .llcrypt unregistered [ 2034.802083] Key type ._llcrypt unregistered [ 2040.778582] Key type ._llcrypt registered [ 2040.780172] Key type .llcrypt registered [ 2041.103883] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2041.115839] alg: No test for adler32 (adler32-zlib) [ 2041.980024] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 2042.061991] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 2042.063300] LNet: Accept secure, port 988 [ 2043.640220] Key type lgssc registered [ 2044.018190] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2108.916611] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2150.853500] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2152.130949] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2159.875553] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2192.285336] Lustre: DEBUG MARKER: == conf-sanity test 18: check mkfs creates large journals ========================================================== 10:16:59 (1753366619) [ 2193.509155] Lustre: DEBUG MARKER: use device /dev/mapper/mds1_flakey with MIN=2000000 [ 2248.954217] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2251.126621] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2261.016792] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2294.323297] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2296.040152] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2304.610482] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2310.159326] Lustre: Mounted lustre-client [ 2312.632275] Lustre: DEBUG MARKER: Success: mkfs creates large journals. Size: 78M [ 2313.063390] LustreError: 84165:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150686800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2313.073578] LustreError: 84165:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2313.104619] Lustre: Unmounted lustre-client [ 2323.770451] Key type lgssc unregistered [ 2323.923023] LNet: 84565:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2324.967414] LNet: Removed LNI 192.168.204.32@tcp [ 2325.283254] Key type .llcrypt unregistered [ 2325.284521] Key type ._llcrypt unregistered [ 2337.123930] Key type ._llcrypt registered [ 2337.125320] Key type .llcrypt registered [ 2337.303296] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2337.310644] alg: No test for adler32 (adler32-zlib) [ 2338.164677] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 2338.253564] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 2338.255957] LNet: Accept secure, port 988 [ 2339.840248] Key type lgssc registered [ 2340.249574] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2378.650839] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2380.259410] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2389.700712] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2423.213986] Lustre: DEBUG MARKER: == conf-sanity test 19a: start/stop MDS without OSTs ===== 10:20:50 (1753366850) [ 2437.783660] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2439.475366] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2452.031398] Lustre: DEBUG MARKER: == conf-sanity test 19b: start/stop OSTs without MDS ===== 10:21:19 (1753366879) [ 2512.024879] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2516.796132] Lustre: DEBUG MARKER: == conf-sanity test 20: remount ro,rw mounts work and doesn't break /etc/mtab ========================================================== 10:22:24 (1753366944) [ 2530.013180] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2531.834793] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2540.916526] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2546.683880] Lustre: Mounted lustre-client [ 2547.025400] Lustre: Remounted lustre-client read-only [ 2547.862433] LustreError: 93036:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150686800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2547.871603] LustreError: 93036:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2547.902046] Lustre: Unmounted lustre-client [ 2573.413995] Lustre: DEBUG MARKER: == conf-sanity test 21a: start mds before ost, stop ost first ========================================================== 10:23:20 (1753367000) [ 2588.147750] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2590.001664] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2598.133765] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2628.683903] Lustre: DEBUG MARKER: == conf-sanity test 21b: start ost before mds, stop mds first ========================================================== 10:24:15 (1753367055) [ 2689.445996] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2703.169743] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2704.858736] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2734.626532] Lustre: DEBUG MARKER: == conf-sanity test 21c: start mds between two osts, stop mds last ========================================================== 10:26:01 (1753367161) [ 2794.700299] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2807.360839] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2808.917582] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2818.193289] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2865.955284] Lustre: DEBUG MARKER: == conf-sanity test 21d: start mgs then ost and then mds ========================================================== 10:28:13 (1753367293) [ 2866.611127] Lustre: DEBUG MARKER: SKIP: conf-sanity test_21d need separate mgs device [ 2867.267048] Lustre: DEBUG MARKER: SKIP: conf-sanity test_21e skipping excluded test 21e [ 2867.925395] Lustre: DEBUG MARKER: == conf-sanity test 22: start a client before osts (should return errs) ========================================================== 10:28:15 (1753367295) [ 2879.234654] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2880.596903] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2887.539655] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2902.936527] Lustre: Mounted lustre-client [ 2903.349811] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 2913.642315] LustreError: 102745:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2913.644395] LustreError: 102745:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2913.661404] Lustre: Unmounted lustre-client [ 2921.017154] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2921.252106] Lustre: Mounted lustre-client [ 2926.254473] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8d5150111800.ost_server_uuid 50 [ 2926.947471] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8d5150111800.ost_server_uuid in FULL state after 0 sec [ 2927.705793] LustreError: 103788:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150111800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2927.714264] LustreError: 103788:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2927.716711] LustreError: 103788:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2927.751787] Lustre: Unmounted lustre-client [ 2952.211090] Key type lgssc unregistered [ 2952.348627] LNet: 104190:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2953.383194] LNet: Removed LNI 192.168.204.32@tcp [ 2953.714285] Key type .llcrypt unregistered [ 2953.716029] Key type ._llcrypt unregistered [ 2960.368405] Key type ._llcrypt registered [ 2960.370424] Key type .llcrypt registered [ 2960.889270] Lustre: DEBUG MARKER: == conf-sanity test 23a: interrupt client during recovery mount delay ========================================================== 10:29:48 (1753367388) [ 2961.733177] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2961.764107] alg: No test for adler32 (adler32-zlib) [ 2962.631198] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 2962.728136] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 2962.730297] LNet: Accept secure, port 988 [ 2964.328158] Key type lgssc registered [ 2964.764250] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2985.180282] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2986.776423] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2994.395424] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3004.932945] Lustre: Mounted lustre-client [ 3008.309386] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 3018.607627] LustreError: 107293:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3018.609243] LustreError: MGC192.168.204.132@tcp: Connection to MGS (at 192.168.204.132@tcp) was lost; in progress operations using this service will fail [ 3018.630109] Lustre: Unmounted lustre-client [ 3024.537158] LustreError: lustre-MDT0000-mdc-ffff8d51467a8000: operation mds_connect to node 192.168.204.132@tcp failed: rc = -16 [ 3029.553884] LustreError: 107477:0:(lmv_obd.c:1468:lmv_statfs()) lustre-MDT0000-mdc-ffff8d51467a8000: can't stat MDS #0: rc = -16 [ 3029.572184] LustreError: 107477:0:(obd_class.h:479:obd_check_dev()) Device 3 not setup [ 3029.575320] LustreError: 107477:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3029.589448] Lustre: Unmounted lustre-client [ 3029.601710] LustreError: 107477:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -16 [ 3057.604741] Key type lgssc unregistered [ 3057.736838] LNet: 107930:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3058.791675] LNet: Removed LNI 192.168.204.32@tcp [ 3059.100932] Key type .llcrypt unregistered [ 3059.101910] Key type ._llcrypt unregistered [ 3066.964127] Key type ._llcrypt registered [ 3066.965984] Key type .llcrypt registered [ 3067.855703] Lustre: DEBUG MARKER: == conf-sanity test 23b: Simulate -EINTR during mount ==== 10:31:34 (1753367494) [ 3068.850593] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3068.871928] alg: No test for adler32 (adler32-zlib) [ 3069.770499] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3069.881252] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3069.883372] LNet: Accept secure, port 988 [ 3071.480208] Key type lgssc registered [ 3072.004056] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3092.529582] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3094.244659] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3101.734848] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3113.474378] Lustre: Mounted lustre-client [ 3114.170286] LustreError: 110965:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51504d3800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3114.179886] LustreError: 110965:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3114.208281] Lustre: Unmounted lustre-client [ 3133.113325] Key type lgssc unregistered [ 3133.249054] LNet: 111367:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3134.310509] LNet: Removed LNI 192.168.204.32@tcp [ 3134.613552] Key type .llcrypt unregistered [ 3134.615166] Key type ._llcrypt unregistered [ 3141.525421] Key type ._llcrypt registered [ 3141.526927] Key type .llcrypt registered [ 3142.116693] Lustre: DEBUG MARKER: == conf-sanity test 24a: Multiple MDTs on a single node == 10:32:49 (1753367569) [ 3143.047576] Lustre: DEBUG MARKER: SKIP: conf-sanity test_24a mixed loopback and real device not working [ 3143.732479] Lustre: DEBUG MARKER: == conf-sanity test 24b: Multiple MGSs on a single node (should return err) ========================================================== 10:32:51 (1753367571) [ 3144.704626] Lustre: DEBUG MARKER: SKIP: conf-sanity test_24b mixed loopback and real device not working [ 3145.386510] Lustre: DEBUG MARKER: == conf-sanity test 25: Verify modules are referenced ==== 10:32:52 (1753367572) [ 3146.244488] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3146.307659] alg: No test for adler32 (adler32-zlib) [ 3147.189719] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3147.287669] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3147.290310] LNet: Accept secure, port 988 [ 3148.880254] Key type lgssc registered [ 3149.302224] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3170.987869] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3173.047791] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3182.340771] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3188.713748] Lustre: Mounted lustre-client [ 3194.816576] LustreError: 115052:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d515110e000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3194.834834] LustreError: 115052:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3194.903510] Lustre: Unmounted lustre-client [ 3214.912869] Key type lgssc unregistered [ 3215.115375] LNet: 115454:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3216.166847] LNet: Removed LNI 192.168.204.32@tcp [ 3216.571877] Key type .llcrypt unregistered [ 3216.573675] Key type ._llcrypt unregistered [ 3224.443332] Key type ._llcrypt registered [ 3224.444725] Key type .llcrypt registered [ 3225.131887] Lustre: DEBUG MARKER: == conf-sanity test 26: MDT startup failure cleans LOV (should return errs) ========================================================== 10:34:12 (1753367652) [ 3225.684221] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3225.699198] alg: No test for adler32 (adler32-zlib) [ 3226.614481] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3226.723731] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3226.726666] LNet: Accept secure, port 988 [ 3228.328578] Key type lgssc registered [ 3228.826939] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3255.243744] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3257.013120] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3268.213875] Key type lgssc unregistered [ 3268.360952] LNet: 118463:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3268.370744] LNet: Removed LNI 192.168.204.32@tcp [ 3268.739842] Key type .llcrypt unregistered [ 3268.741376] Key type ._llcrypt unregistered [ 3276.193156] Key type ._llcrypt registered [ 3276.194633] Key type .llcrypt registered [ 3276.964801] Lustre: DEBUG MARKER: == conf-sanity test 27a: Reacquire MGS lock if OST started first ========================================================== 10:35:03 (1753367703) [ 3281.306579] Key type .llcrypt unregistered [ 3281.308200] Key type ._llcrypt unregistered [ 3285.296357] Key type ._llcrypt registered [ 3285.298231] Key type .llcrypt registered [ 3285.579620] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 3285.588717] alg: No test for adler32 (adler32-zlib) [ 3286.722929] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3286.964602] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3286.977834] LNet: Accept secure, port 988 [ 3288.697066] Key type lgssc registered [ 3290.124692] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3378.577205] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3399.749410] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3402.507204] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3435.502832] Key type lgssc unregistered [ 3435.728302] LNet: 122223:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3435.745183] LNet: Removed LNI 192.168.204.32@tcp [ 3436.277943] Key type .llcrypt unregistered [ 3436.279501] Key type ._llcrypt unregistered [ 3448.669257] Key type ._llcrypt registered [ 3448.670792] Key type .llcrypt registered [ 3449.831690] Lustre: DEBUG MARKER: == conf-sanity test 27b: Reacquire MGS lock after failover ========================================================== 10:37:56 (1753367876) [ 3451.631351] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3451.660344] alg: No test for adler32 (adler32-zlib) [ 3452.673550] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3452.899370] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3452.908266] LNet: Accept secure, port 988 [ 3454.573925] Key type lgssc registered [ 3455.407283] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3488.860583] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3491.729272] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3502.506208] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3503.952638] Lustre: Mounted lustre-client [ 3509.239789] Lustre: lustre-MDT0000-mdc-ffff8d5158616800: Connection to lustre-MDT0000 (at 192.168.204.132@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 3524.585652] LustreError: MGC192.168.204.132@tcp: Connection to MGS (at 192.168.204.132@tcp) was lost; in progress operations using this service will fail [ 3524.601440] Lustre: Evicted from MGS (at 192.168.204.132@tcp) after server handle changed from 0xc2741f7ad131f669 to 0xc2741f7ad131f7b2 [ 3524.612502] Lustre: MGC192.168.204.132@tcp: Connection restored to 192.168.204.132@tcp (at 192.168.204.132@tcp) [ 3528.705342] Lustre: lustre-MDT0000-mdc-ffff8d5158616800: Connection restored to 192.168.204.132@tcp (at 192.168.204.132@tcp) [ 3542.702107] LustreError: 125716:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5158616800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3542.731632] LustreError: 125716:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3542.789833] Lustre: Unmounted lustre-client [ 3567.110321] Key type lgssc unregistered [ 3567.353551] LNet: 126118:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3568.425319] LNet: Removed LNI 192.168.204.32@tcp [ 3569.143246] Key type .llcrypt unregistered [ 3569.147307] Key type ._llcrypt unregistered [ 3583.026672] Key type ._llcrypt registered [ 3583.028196] Key type .llcrypt registered [ 3584.408851] Lustre: DEBUG MARKER: == conf-sanity test 28A: permanent parameter setting ===== 10:40:10 (1753368010) [ 3586.280195] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3586.291305] alg: No test for adler32 (adler32-zlib) [ 3587.342455] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3587.555151] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3587.557917] LNet: Accept secure, port 988 [ 3589.210334] Key type lgssc registered [ 3590.315618] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3632.829652] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3637.354568] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3654.539189] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3660.308609] Lustre: Mounted lustre-client [ 3676.542110] LustreError: 129306:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51467af800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3676.571892] LustreError: 129306:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3676.622090] Lustre: Unmounted lustre-client [ 3677.032719] Lustre: Mounted lustre-client [ 3685.552312] LustreError: 129444:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150395800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3685.573085] LustreError: 129444:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3685.575690] LustreError: 129444:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3685.638546] Lustre: Unmounted lustre-client [ 3710.479299] Key type lgssc unregistered [ 3710.729905] LNet: 129846:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3711.784995] LNet: Removed LNI 192.168.204.32@tcp [ 3712.582662] Key type .llcrypt unregistered [ 3712.584869] Key type ._llcrypt unregistered [ 3725.711722] Key type ._llcrypt registered [ 3725.713445] Key type .llcrypt registered [ 3727.006810] Lustre: DEBUG MARKER: == conf-sanity test 28a: set symlink parameters permanently with lctl ========================================================== 10:42:33 (1753368153) [ 3729.081081] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3729.115335] alg: No test for adler32 (adler32-zlib) [ 3730.205253] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3730.412544] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3730.416823] LNet: Accept secure, port 988 [ 3732.056157] Key type lgssc registered [ 3732.990343] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3767.776566] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3770.823624] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3785.000379] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3787.522813] Lustre: Mounted lustre-client [ 3820.949125] LustreError: 133177:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150edc000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3820.958927] LustreError: 133177:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3821.020710] Lustre: Unmounted lustre-client [ 3853.274695] Key type lgssc unregistered [ 3853.532813] LNet: 133579:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3854.569229] LNet: Removed LNI 192.168.204.32@tcp [ 3855.104646] Key type .llcrypt unregistered [ 3855.106185] Key type ._llcrypt unregistered [ 3867.300100] Key type ._llcrypt registered [ 3867.301849] Key type .llcrypt registered [ 3868.471619] Lustre: DEBUG MARKER: == conf-sanity test 28b: verify client-side parameters are set upon mount ========================================================== 10:44:55 (1753368295) [ 3870.385468] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3870.402664] alg: No test for adler32 (adler32-zlib) [ 3871.560464] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3871.739778] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3871.742581] LNet: Accept secure, port 988 [ 3873.376255] Key type lgssc registered [ 3874.650661] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3909.811219] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3912.981863] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3922.661063] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3925.043258] Lustre: Mounted lustre-client [ 3926.037664] LustreError: 136645:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5147004000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3926.053401] LustreError: 136645:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3926.099741] Lustre: Unmounted lustre-client [ 3926.400877] Lustre: Mounted lustre-client [ 3930.719269] LustreError: 137139:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5147007800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3930.740428] LustreError: 137139:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3930.743233] LustreError: 137139:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3930.786713] Lustre: Unmounted lustre-client [ 3947.536539] Key type lgssc unregistered [ 3947.742349] LNet: 137541:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3948.779564] LNet: Removed LNI 192.168.204.32@tcp [ 3949.229992] Key type .llcrypt unregistered [ 3949.231660] Key type ._llcrypt unregistered [ 3955.353388] Key type ._llcrypt registered [ 3955.354716] Key type .llcrypt registered [ 3956.358046] Lustre: DEBUG MARKER: == conf-sanity test 28c: verify filesystem parameters are set upon mount ========================================================== 10:46:23 (1753368383) [ 3957.758101] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3957.783761] alg: No test for adler32 (adler32-zlib) [ 3958.770962] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 3958.947703] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 3958.951235] LNet: Accept secure, port 988 [ 3960.632947] Key type lgssc registered [ 3961.458053] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3985.539895] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3987.799926] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3997.540727] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4004.345166] Lustre: Mounted lustre-client [ 4005.257751] LustreError: 140181:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51467ad800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4005.272881] LustreError: 140181:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4005.306757] Lustre: Unmounted lustre-client [ 4005.597738] Lustre: Mounted lustre-client [ 4009.042862] LustreError: 140674:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5150ba0000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4009.054571] LustreError: 140674:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4009.057169] LustreError: 140674:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 4009.091887] Lustre: Unmounted lustre-client [ 4021.008531] Key type lgssc unregistered [ 4021.317323] LNet: 141076:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4022.376634] LNet: Removed LNI 192.168.204.32@tcp [ 4022.954973] Key type .llcrypt unregistered [ 4022.956755] Key type ._llcrypt unregistered [ 4028.831391] Key type ._llcrypt registered [ 4028.833039] Key type .llcrypt registered [ 4029.782497] Lustre: DEBUG MARKER: == conf-sanity test 29: permanently remove an OST ======== 10:47:36 (1753368456) [ 4031.007741] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4031.080808] alg: No test for adler32 (adler32-zlib) [ 4032.044133] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 4032.204543] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 4032.207558] LNet: Accept secure, port 988 [ 4033.872698] Key type lgssc registered [ 4034.679256] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4059.696784] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4061.855506] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4072.042980] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4078.569168] Lustre: Mounted lustre-client [ 4087.812868] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 4088.927805] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 4107.266934] Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request [ 4110.029263] LustreError: 144415:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d515145b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4110.035613] LustreError: 144415:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 4110.080735] Lustre: Unmounted lustre-client [ 4110.230865] Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request [ 4110.291713] Lustre: Mounted lustre-client [ 4120.102772] LustreError: 144576:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5145108800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4120.118841] LustreError: 144576:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 4120.122163] LustreError: 144576:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 4120.173553] Lustre: Unmounted lustre-client [ 4151.687230] Key type lgssc unregistered [ 4151.900725] LNet: 145024:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4152.936426] LNet: Removed LNI 192.168.204.32@tcp [ 4153.374948] Key type .llcrypt unregistered [ 4153.377154] Key type ._llcrypt unregistered [ 4175.146567] Key type ._llcrypt registered [ 4175.148625] Key type .llcrypt registered [ 4175.367713] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 4175.381541] alg: No test for adler32 (adler32-zlib) [ 4176.366635] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 4176.537384] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 4176.540435] LNet: Accept secure, port 988 [ 4178.208714] Key type lgssc registered [ 4178.978169] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4222.095909] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4224.356308] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4236.022786] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4271.446271] Lustre: DEBUG MARKER: == conf-sanity test 30a: Big config llog and permanent parameter deletion ========================================================== 10:51:38 (1753368698) [ 4286.763171] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4288.967077] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4298.406852] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4304.881059] Lustre: Mounted lustre-client [ 4465.637733] LustreError: 152505:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51504d2000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4465.645394] LustreError: 152505:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4465.695761] Lustre: Unmounted lustre-client [ 4466.058842] Lustre: Mounted lustre-client [ 4467.669795] LustreError: 152589:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5145109800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4467.691731] LustreError: 152589:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4467.698564] LustreError: 152589:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 4467.768857] Lustre: Unmounted lustre-client [ 4468.191905] Lustre: Mounted lustre-client [ 4469.361493] LustreError: 152664:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d5158244800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4469.379495] LustreError: 152664:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4469.383034] LustreError: 152664:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 4469.443764] Lustre: Unmounted lustre-client [ 4496.446395] Key type lgssc unregistered [ 4496.636472] LNet: 153067:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4497.703466] LNet: Removed LNI 192.168.204.32@tcp [ 4498.299253] Key type .llcrypt unregistered [ 4498.300856] Key type ._llcrypt unregistered [ 4509.524064] Key type ._llcrypt registered [ 4509.530270] Key type .llcrypt registered [ 4510.639877] Lustre: DEBUG MARKER: == conf-sanity test 30b: Remove failover nids ============ 10:55:37 (1753368937) [ 4512.368381] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4512.377801] alg: No test for adler32 (adler32-zlib) [ 4513.408960] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 4513.630159] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 4513.633980] LNet: Accept secure, port 988 [ 4515.297059] Key type lgssc registered [ 4516.258775] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4545.687235] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4548.131968] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4559.677526] Lustre: DEBUG MARKER: oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4562.211168] Lustre: Mounted lustre-client [ 4567.527450] LustreError: 156199:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51504d5800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4567.544371] LustreError: 156199:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4567.595858] Lustre: Unmounted lustre-client [ 4567.893789] Lustre: Mounted lustre-client [ 4568.752907] LustreError: 156277:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8d51467ab800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4568.766614] LustreError: 156277:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4568.770265] LustreError: 156277:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 4568.826434] Lustre: Unmounted lustre-client [ 4590.818722] Key type lgssc unregistered [ 4591.057974] LNet: 156678:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4592.106102] LNet: Removed LNI 192.168.204.32@tcp [ 4592.575822] Key type .llcrypt unregistered [ 4592.577766] Key type ._llcrypt unregistered [ 4602.696344] Key type ._llcrypt registered [ 4602.698338] Key type .llcrypt registered [ 4603.726857] Lustre: DEBUG MARKER: == conf-sanity test 31: Connect to non-existent node (shouldn't crash) ========================================================== 10:57:10 (1753369030) [ 4609.121369] Key type .llcrypt unregistered [ 4609.124567] Key type ._llcrypt unregistered [ 4626.865904] Key type ._llcrypt registered [ 4626.867446] Key type .llcrypt registered [ 4627.199199] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 4627.209827] alg: No test for adler32 (adler32-zlib) [ 4628.280588] Lustre: Lustre: Build Version: 2.16.57_3_g43b8dbf [ 4628.526811] LNet: Added LNI 192.168.204.32@tcp [8/256/0/180] [ 4628.532331] LNet: Accept secure, port 988 [ 4630.185850] Key type lgssc registered [ 4631.175961] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4662.830943] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 4512 sec ========== 10:58:09 (1753369089) [ 4664.007334] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 10:58:10 (1753369090) === [ 4666.539875] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 10:58:13 (1753369093) === [ 4686.819952] Key type lgssc unregistered [ 4687.005838] LNet: 161774:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4687.017590] LNet: Removed LNI 192.168.204.32@tcp [ 4687.481945] Key type .llcrypt unregistered [ 4687.484770] Key type ._llcrypt unregistered