[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-2.fc40 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 507142132 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5410-0x000f541f] [ 0.000000] RAMDISK: [mem 0xbcc64000-0xbffcffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F5220 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE1D6F 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE1C0B 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 001BCB (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE1C7F 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE1D0F 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE1D47 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe1c0b-0xbffe1c7e] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1c0a] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe1c7f-0xbffe1d0e] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe1d0f-0xbffe1d46] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe1d47-0xbffe1d6e] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffd9fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4744 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059618 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829700K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001015] APIC: Switch to symmetric I/O mode setup [ 0.002403] x2apic enabled [ 0.003016] Switched APIC routing to physical x2apic. [ 0.004022] kvm-guest: setup PV IPIs [ 0.007000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.007030] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.008020] pid_max: default: 32768 minimum: 301 [ 0.010031] LSM: Security Framework initializing [ 0.011080] Yama: becoming mindful. [ 0.011987] SELinux: Initializing. [ 0.012108] *** VALIDATE selinux *** [ 0.025638] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.031674] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.032172] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.033000] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.033163] *** VALIDATE tmpfs *** [ 0.035556] *** VALIDATE proc *** [ 0.036000] *** VALIDATE cgroup *** [ 0.036022] *** VALIDATE cgroup2 *** [ 0.037000] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037171] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.039012] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.040039] Spectre V2 : User space: Vulnerable [ 0.042011] Speculative Store Bypass: Vulnerable [ 0.046269] debug: unmapping init [mem 0xffffffffae059000-0xffffffffae060fff] [ 0.049125] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.050694] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.051028] ... version: 2 [ 0.052016] ... bit width: 48 [ 0.053017] ... generic registers: 4 [ 0.054027] ... value mask: 0000ffffffffffff [ 0.055017] ... max period: 00007fffffffffff [ 0.056026] ... fixed-purpose events: 3 [ 0.057016] ... event mask: 000000070000000f [ 0.059206] rcu: Hierarchical SRCU implementation. [ 0.061612] smp: Bringing up secondary CPUs ... [ 0.062610] x86: Booting SMP configuration: [ 0.063053] .... node #0, CPUs: #1 #2 #3 [ 0.076019] smp: Brought up 1 node, 4 CPUs [ 0.078022] smpboot: Max logical packages: 1 [ 0.079015] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.121019] node 0 deferred pages initialised in 39ms [ 0.126031] devtmpfs: initialized [ 0.127205] x86/mm: Memory block size: 128MB [ 0.128131] gcov: version magic: 0x41383552 [ 0.131356] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.135105] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.138476] pinctrl core: initialized pinctrl subsystem [ 0.141244] [ 0.142007] ************************************************************* [ 0.144015] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.147015] ** ** [ 0.150012] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.152014] ** ** [ 0.155015] ** This means that this kernel is built to expose internal ** [ 0.158022] ** IOMMU data structures, which may compromise security on ** [ 0.161015] ** your system. ** [ 0.164019] ** ** [ 0.166015] ** If you see this message and you are not debugging the ** [ 0.168016] ** kernel, report this immediately to your vendor! ** [ 0.170013] ** ** [ 0.172017] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.174013] ************************************************************* [ 0.177908] NET: Registered protocol family 16 [ 0.179519] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.180000] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.180000] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.180524] cpuidle: using governor menu [ 0.185036] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.188000] PCI: Using configuration type 1 for base access [ 0.190133] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.202411] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.204200] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.209053] cryptd: max_cpu_qlen set to 1000 [ 0.212287] ACPI: Added _OSI(Module Device) [ 0.214020] ACPI: Added _OSI(Processor Device) [ 0.216019] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.218017] ACPI: Added _OSI(Processor Aggregator Device) [ 0.221000] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.228598] ACPI: Interpreter enabled [ 0.229568] ACPI: PM: (supports S0 S3 S4 S5) [ 0.230016] ACPI: Using IOAPIC for interrupt routing [ 0.232141] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.235569] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.245234] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.248060] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.251021] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.256212] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.264209] acpiphp: Slot [2] registered [ 0.266279] acpiphp: Slot [5] registered [ 0.268584] acpiphp: Slot [6] registered [ 0.271198] acpiphp: Slot [3] registered [ 0.272578] acpiphp: Slot [4] registered [ 0.275160] acpiphp: Slot [7] registered [ 0.277151] acpiphp: Slot [8] registered [ 0.279141] acpiphp: Slot [9] registered [ 0.281148] acpiphp: Slot [10] registered [ 0.283164] acpiphp: Slot [11] registered [ 0.284110] acpiphp: Slot [12] registered [ 0.286142] acpiphp: Slot [13] registered [ 0.288144] acpiphp: Slot [14] registered [ 0.290313] acpiphp: Slot [15] registered [ 0.292202] acpiphp: Slot [16] registered [ 0.294150] acpiphp: Slot [17] registered [ 0.296123] acpiphp: Slot [18] registered [ 0.298095] acpiphp: Slot [19] registered [ 0.300151] acpiphp: Slot [20] registered [ 0.302140] acpiphp: Slot [21] registered [ 0.303123] acpiphp: Slot [22] registered [ 0.305122] acpiphp: Slot [23] registered [ 0.307194] acpiphp: Slot [24] registered [ 0.309147] acpiphp: Slot [25] registered [ 0.311473] acpiphp: Slot [26] registered [ 0.313117] acpiphp: Slot [27] registered [ 0.315103] acpiphp: Slot [28] registered [ 0.316124] acpiphp: Slot [29] registered [ 0.317105] acpiphp: Slot [30] registered [ 0.319146] acpiphp: Slot [31] registered [ 0.321078] PCI host bridge to bus 0000:00 [ 0.322021] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.325022] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.327028] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.330032] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.332032] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 0.335067] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.336196] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.339135] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.342310] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.355018] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.358019] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.367028] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.369258] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.370000] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.374434] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.377766] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.379043] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.383863] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.388018] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.399022] pci 0000:00:02.0: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref] [ 0.404019] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.411166] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.416797] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.426018] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.442019] pci 0000:00:05.0: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref] [ 0.450792] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.460028] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.469021] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.482022] pci 0000:00:06.0: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref] [ 0.493000] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.496602] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.500703] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.502832] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.506289] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.511119] iommu: Default domain type: Passthrough [ 0.512000] SCSI subsystem initialized [ 0.512244] ACPI: bus type USB registered [ 0.513000] usbcore: registered new interface driver usbfs [ 0.516138] usbcore: registered new interface driver hub [ 0.518108] usbcore: registered new device driver usb [ 0.520208] pps_core: LinuxPPS API ver. 1 registered [ 0.521019] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.524091] PTP clock support registered [ 0.527813] EDAC MC: Ver: 3.0.0 [ 0.530146] PCI: Using ACPI for IRQ routing [ 0.532439] NetLabel: Initializing [ 0.534014] NetLabel: domain hash size = 128 [ 0.535013] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.538109] NetLabel: unlabeled traffic allowed by default [ 0.540541] vgaarb: loaded [ 0.542593] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.543025] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.552065] clocksource: Switched to clocksource kvm-clock [ 0.710344] VFS: Disk quotas dquot_6.6.0 [ 0.711856] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.714420] *** VALIDATE ramfs *** [ 0.715733] *** VALIDATE hugetlbfs *** [ 0.717153] pnp: PnP ACPI init [ 0.720267] pnp: PnP ACPI: found 6 devices [ 0.735840] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.740511] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.744309] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.746920] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.753442] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.758783] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x38007fffffff window] [ 0.761995] NET: Registered protocol family 2 [ 0.764959] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.773955] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.790506] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.804737] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.809405] TCP: Hash tables configured (established 65536 bind 65536) [ 0.812717] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.816919] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.820263] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.823343] NET: Registered protocol family 1 [ 0.829768] RPC: Registered named UNIX socket transport module. [ 0.831775] RPC: Registered udp transport module. [ 0.833805] RPC: Registered tcp transport module. [ 0.836189] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.838891] NET: Registered protocol family 44 [ 0.840653] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.842860] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.845152] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.847323] PCI: CLS 0 bytes, default 64 [ 0.850842] Unpacking initramfs... [ 2.970702] debug: unmapping init [mem 0xffff994a7cc64000-0xffff994a7ffcffff] [ 2.983654] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.986393] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.994691] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.784247] Initialise system trusted keyrings [ 3.785862] Key type blacklist registered [ 3.787081] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.800373] zbud: loaded [ 3.809050] *** VALIDATE nfs *** [ 3.810677] *** VALIDATE nfs4 *** [ 3.812796] pstore: using deflate compression [ 3.816346] Platform Keyring initialized [ 3.943771] NET: Registered protocol family 38 [ 3.945881] Key type asymmetric registered [ 3.947594] Asymmetric key parser 'x509' registered [ 3.951710] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.956157] io scheduler mq-deadline registered [ 3.961766] io scheduler kyber registered [ 3.964100] io scheduler bfq registered [ 3.967971] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.971158] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.974283] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.977813] ACPI: Power Button [PWRF] [ 4.089639] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 4.180337] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 4.276339] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 4.307073] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.338371] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.343176] Non-volatile memory driver v1.3 [ 4.345108] Linux agpgart interface v0.103 [ 4.384338] virtio_blk virtio1: [vda] 133896 512-byte logical blocks (68.6 MB/65.4 MiB) [ 4.387411] vda: detected capacity change from 0 to 68554752 [ 4.403945] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 4.406879] vdb: detected capacity change from 0 to 1073741824 [ 4.412988] libphy: Fixed MDIO Bus: probed [ 4.418742] usbcore: registered new interface driver usbserial_generic [ 4.421276] usbserial: USB Serial support registered for generic [ 4.424132] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 4.428772] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 4.430764] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 4.433306] mousedev: PS/2 mouse device common for all mice [ 4.436517] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 4.438549] rtc_cmos 00:05: RTC can wake from S4 [ 4.443659] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 4.444486] rtc_cmos 00:05: registered as rtc0 [ 4.447509] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 4.448328] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 4.449942] intel_pstate: CPU model not supported [ 4.454317] hid: raw HID events driver (C) Jiri Kosina [ 4.456053] usbcore: registered new interface driver usbhid [ 4.458153] usbhid: USB HID core driver [ 4.459795] drop_monitor: Initializing network drop monitor service [ 4.462118] Initializing XFRM netlink socket [ 4.464105] NET: Registered protocol family 10 [ 4.466645] Segment Routing with IPv6 [ 4.468238] NET: Registered protocol family 17 [ 4.470795] mpls_gso: MPLS GSO support [ 4.477853] RAS: Correctable Errors collector initialized. [ 4.480074] AVX version of gcm_enc/dec engaged. [ 4.481817] AES CTR mode by8 optimization enabled [ 4.577390] sched_clock: Marking stable (4577368602, 0)->(5707793046, -1130424444) [ 4.580665] registered taskstats version 1 [ 4.582501] Loading compiled-in X.509 certificates [ 4.585189] zswap: loaded using pool lzo/zbud [ 4.609480] Key type big_key registered [ 4.622355] Key type encrypted registered [ 4.623948] ima: No TPM chip found, activating TPM-bypass! [ 4.625836] ima: Allocated hash algorithm: sha1 [ 4.627366] ima: No architecture policies found [ 4.629156] evm: Initialising EVM extended attributes: [ 4.631088] evm: security.selinux [ 4.632348] evm: security.ima [ 4.633457] evm: security.capability [ 4.634847] evm: HMAC attrs: 0x1 [ 4.637378] rtc_cmos 00:05: setting system clock to 2025-10-23 18:43:58 UTC (1761245038) [ 4.644092] debug: unmapping init [mem 0xffffffffaf003000-0xffffffffaf1fffff] [ 4.647476] debug: unmapping init [mem 0xffffffffadd82000-0xffffffffae058fff] [ 4.655568] Write protecting the kernel read-only data: 28672k [ 4.658831] debug: unmapping init [mem 0xffffffffac403000-0xffffffffac5fffff] [ 4.661446] debug: unmapping init [mem 0xffffffffacd14000-0xffffffffacdfffff] [ 4.699554] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.707496] systemd[1]: Detected virtualization kvm. [ 4.709436] systemd[1]: Detected architecture x86-64. [ 4.710639] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 4.737784] systemd[1]: No hostname configured. [ 4.739364] systemd[1]: Set hostname to . [ 4.741437] random: systemd: uninitialized urandom read (16 bytes read) [ 4.743163] systemd[1]: Initializing machine ID from random generator. [ 4.801314] random: ln: uninitialized urandom read (6 bytes read) [ 4.871763] random: systemd: uninitialized urandom read (16 bytes read) [ 4.875101] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.884175] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 4.889626] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. Starting Apply Kernel Variables... [ OK ] Reached target Swap. [ OK ] Started Memstrack Anylazing Service. Starting Setup Virtual Console... [ OK ] Reached target Slices. [ OK ] Reached target Local File Systems. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Timers. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Initrd Root Device. Starting Create Volatile Files and Directories... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 5.659115] device-mapper: uevent: version 1.0.3 [ 5.668595] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ 6.938511] virtio_net virtio0 ens2: renamed from eth0 [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 7.148917] scsi host0: ata_piix [ 7.183245] scsi host1: ata_piix [ 7.184640] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 7.187812] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 8.987153] random: fast init done [ 12.141475] random: crng init done [ 12.142929] random: 7 urandom warning(s) missed due to ratelimiting [ 12.152321] dracut-initqueue[579]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 13.741941] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped Apply Kernel Variables. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local File Systems. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 15.853311] printk: systemd: 26 output lines suppressed due to ratelimiting [ 16.517206] SELinux: Disabled at runtime. [ 16.620128] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 16.627781] systemd[1]: Detected virtualization kvm. [ 16.629727] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 17.824996] systemd[1]: initrd-switch-root.service: Succeeded. [ 17.832195] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 17.844678] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 17.858022] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 17.866647] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 17.885157] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.923396] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... Activating swap /dev/disk/by-label/SWAP... [ OK ] Listening on Process Core Dump Socket. [ OK ] Created slice system-serial\x2dgetty.slice. [ 18.027389] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Listening on initctl Compatibility Named Pipe. Mounting Kernel Debug File System... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Paths. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target RPC Port Mapper. Starting Create list of required st…ce nodes for the current kernel... Starting udev Coldplug all Devices... [ OK ] Created slice system-getty.slice. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting Apply Kernel Variables... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting Remount Root and Kernel File Systems... [ OK ] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Mounted /mnt. [ 18.851337] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 19.522971] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 19.524374] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 19.815870] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 19.880874] EDAC sbridge: Ver: 1.1.2 [ 22.900172] Key type dns_resolver registered [ 23.392603] NFS: Registering the id_resolver key type [ 23.394858] Key type id_resolver registered [ 23.396960] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Load/Save Random Seed... Starting Create Volatile Files and Directories... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. Starting Login Service... Starting Restore /run/initramfs on shutdown... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target sshd-keygen.target. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg103-client login: [ 65.416715] libcfs: loading out-of-tree module taints kernel. [ 65.445201] Key type ._llcrypt registered [ 65.451345] Key type .llcrypt registered [ 65.857881] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 65.875101] alg: No test for adler32 (adler32-zlib) [ 67.124847] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 67.692660] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 69.423606] Key type lgssc registered [ 70.824430] Lustre: Echo OBD driver; http://www.lustre.org/ [ 157.534010] hrtimer: interrupt took 2010030 ns [ 199.127724] Lustre: Mounted lustre-client [ 205.668940] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 224.739149] Lustre: lustre-OST0000-osc-ffff994ac5232000: disconnect after 23s idle [ 225.198151] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing check_logdir /tmp/testlogs/ [ 230.223598] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing yml_node [ 235.596710] Lustre: DEBUG MARKER: Client: 2.16.59.45 [ 238.106070] Lustre: DEBUG MARKER: MDS: 2.16.59.45 [ 240.564479] Lustre: DEBUG MARKER: OSS: 2.16.59.45 [ 241.874127] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Oct 23 14:47:54 EDT 2025 [ 257.543481] Lustre: DEBUG MARKER: excepting tests: 55 63 67 32newtarball [ 258.822457] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 261.109242] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 271.406244] LustreError: 8989:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 271.436273] Lustre: Unmounted lustre-client [ 370.284232] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 373.329689] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 390.020271] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 424.960460] Lustre: DEBUG MARKER: == conf-sanity test 33a: Mount ost with a large index number ========================================================== 14:50:57 (1761245457) [ 426.769159] Lustre: DEBUG MARKER: SKIP: conf-sanity test_33a mixed loopback and real device not working [ 428.065672] Lustre: DEBUG MARKER: == conf-sanity test 33b: Drop cancel during umount ======= 14:51:00 (1761245460) [ 453.477583] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 456.549247] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 472.020597] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 482.857569] Lustre: Mounted lustre-client [ 486.382660] LustreError: 14431:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac88e7000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 486.412333] LustreError: 14431:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 486.421204] LustreError: 14431:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 486.483403] Lustre: Unmounted lustre-client [ 512.270199] Key type lgssc unregistered [ 512.619933] LNet: 14839:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 512.629549] LNetError: 14839:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 512.650603] LNet: Removed LNI 192.168.201.3@tcp [ 513.493136] Key type .llcrypt unregistered [ 513.497654] Key type ._llcrypt unregistered [ 531.436450] Key type ._llcrypt registered [ 531.437971] Key type .llcrypt registered [ 532.832333] Lustre: DEBUG MARKER: == conf-sanity test 33c: Mount ost with a large index number ========================================================== 14:52:45 (1761245565) [ 534.542513] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 534.574564] alg: No test for adler32 (adler32-zlib) [ 535.856644] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 536.225260] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 537.911223] Key type lgssc registered [ 539.073429] Lustre: Echo OBD driver; http://www.lustre.org/ [ 604.728033] Lustre: Mounted lustre-client [ 690.859235] LustreError: 18244:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac5233800: lov tgt 1990 not cleaned! deathrow=0, lovrc=1 [ 690.871157] LustreError: 18244:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 690.907810] Lustre: Unmounted lustre-client [ 715.344776] Key type lgssc unregistered [ 715.614973] LNet: 18707:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 715.628378] LNetError: 18707:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 715.647741] LNet: Removed LNI 192.168.201.3@tcp [ 716.272096] Key type .llcrypt unregistered [ 716.274042] Key type ._llcrypt unregistered [ 724.132058] Key type ._llcrypt registered [ 724.133376] Key type .llcrypt registered [ 725.437533] Lustre: DEBUG MARKER: == conf-sanity test 33d: Don't panic when enable project quota ========================================================== 14:55:57 (1761245757) [ 727.406851] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 727.414716] alg: No test for adler32 (adler32-zlib) [ 728.493724] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 728.764043] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 730.463294] Key type lgssc registered [ 731.817894] Lustre: Echo OBD driver; http://www.lustre.org/ [ 773.360177] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 776.824606] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 791.747790] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 803.859072] Lustre: Mounted lustre-client [ 812.521820] LustreError: 21815:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994acc04d800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 812.541761] LustreError: 21815:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 812.599642] Lustre: Unmounted lustre-client [ 836.722294] Key type lgssc unregistered [ 836.990530] LNet: 22217:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 837.002824] LNetError: 22217:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 837.027428] LNet: Removed LNI 192.168.201.3@tcp [ 837.621740] Key type .llcrypt unregistered [ 837.629141] Key type ._llcrypt unregistered [ 846.097465] Key type ._llcrypt registered [ 846.098838] Key type .llcrypt registered [ 847.175354] Lustre: DEBUG MARKER: == conf-sanity test 34a: umount with opened file should be fail ========================================================== 14:57:59 (1761245879) [ 849.062171] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 849.119690] alg: No test for adler32 (adler32-zlib) [ 850.164993] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 850.358650] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 852.015253] Key type lgssc registered [ 853.084781] Lustre: Echo OBD driver; http://www.lustre.org/ [ 900.554486] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 903.177863] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 917.676043] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 924.681536] Lustre: Mounted lustre-client [ 929.389754] LustreError: 24920:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994aca06e800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 929.416819] LustreError: 24920:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 929.457772] Lustre: Unmounted lustre-client [ 963.495220] Key type lgssc unregistered [ 963.762588] LNet: 25324:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 963.768596] LNetError: 25324:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 963.788910] LNet: Removed LNI 192.168.201.3@tcp [ 964.432570] Key type .llcrypt unregistered [ 964.434466] Key type ._llcrypt unregistered [ 975.813907] Key type ._llcrypt registered [ 975.815687] Key type .llcrypt registered [ 976.822525] Lustre: DEBUG MARKER: == conf-sanity test 34b: force umount with failed mds should be normal ========================================================== 15:00:09 (1761246009) [ 979.377859] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 979.396667] alg: No test for adler32 (adler32-zlib) [ 980.431403] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 980.740936] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 982.431733] Key type lgssc registered [ 983.630250] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1024.006620] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1027.271556] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1048.439362] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1051.264224] Lustre: Mounted lustre-client [ 1056.245811] Lustre: lustre-MDT0000-mdc-ffff994ac673d000: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1061.358345] Lustre: lustre-MDT0001-mdc-ffff994ac673d000: Connection to lustre-MDT0001 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1067.443239] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 1072.607308] Lustre: 26280:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761246090/real 1761246090] req@0000000098f8e20d x1846800300381056/t0(0) o400->MGC192.168.201.103@tcp@192.168.201.103@tcp:26/25 lens 224/224 e 0 to 1 dl 1761246106 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1072.656527] LustreError: MGC192.168.201.103@tcp: Connection to MGS (at 192.168.201.103@tcp) was lost; in progress operations using this service will fail [ 1077.765210] LustreError: 28514:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1077.872489] Lustre: Unmounted lustre-client [ 1104.199731] Key type lgssc unregistered [ 1104.417821] LNet: 28906:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1104.423141] LNetError: 28906:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1104.439403] LNet: Removed LNI 192.168.201.3@tcp [ 1105.075057] Key type .llcrypt unregistered [ 1105.083570] Key type ._llcrypt unregistered [ 1119.818637] Key type ._llcrypt registered [ 1119.820434] Key type .llcrypt registered [ 1121.056326] Lustre: DEBUG MARKER: == conf-sanity test 34c: force umount with failed ost should be normal ========================================================== 15:02:33 (1761246153) [ 1123.061120] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1123.132393] alg: No test for adler32 (adler32-zlib) [ 1124.224257] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 1124.467402] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 1126.159209] Key type lgssc registered [ 1127.320948] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1174.077461] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1177.786252] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1194.551800] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1200.721367] Lustre: Mounted lustre-client [ 1210.864769] Lustre: lustre-OST0000-osc-ffff994ac88e2800: Connection to lustre-OST0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1214.098551] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 1224.382755] LustreError: 32034:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1224.453537] Lustre: Unmounted lustre-client [ 1251.353542] Key type lgssc unregistered [ 1251.720147] LNet: 32435:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1251.745113] LNetError: 32435:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1251.759811] LNet: Removed LNI 192.168.201.3@tcp [ 1252.628693] Key type .llcrypt unregistered [ 1252.638263] Key type ._llcrypt unregistered [ 1266.006251] Key type ._llcrypt registered [ 1266.008454] Key type .llcrypt registered [ 1267.487175] Lustre: DEBUG MARKER: == conf-sanity test 35a: Reconnect to the last active server first ========================================================== 15:04:59 (1761246299) [ 1269.225398] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1269.294268] alg: No test for adler32 (adler32-zlib) [ 1270.327297] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 1270.518580] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 1272.143276] Key type lgssc registered [ 1273.312493] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1316.133679] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1319.156695] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1333.920760] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1339.970692] Lustre: Mounted lustre-client [ 1343.253234] Lustre: DEBUG MARKER: Set up a fake failnode for the MDS [ 1346.134485] Lustre: DEBUG MARKER: Wait for RECONNECT_INTERVAL seconds (10s) [ 1357.452223] Lustre: DEBUG MARKER: conf-sanity.sh test_35a 2025-10-2315h06m30s [ 1358.844174] Lustre: DEBUG MARKER: Stopping the MDT: lustre-MDT0000 [ 1363.435545] Lustre: lustre-MDT0000-mdc-ffff994acc049000: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1368.279415] LustreError: 36134:0:(lmv_obd.c:1435:lmv_statfs()) lustre-MDT0000-mdc-ffff994acc049000: can't stat MDS #0: rc = -19 [ 1369.593623] Lustre: DEBUG MARKER: Restarting the MDT: lustre-MDT0000 [ 1380.844436] LustreError: MGC192.168.201.103@tcp: Connection to MGS (at 192.168.201.103@tcp) was lost; in progress operations using this service will fail [ 1380.873064] Lustre: Evicted from MGS (at 192.168.201.103@tcp) after server handle changed from 0x695cebb394adbae4 to 0x695cebb394adbe79 [ 1380.888708] Lustre: MGC192.168.201.103@tcp: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 1381.926947] LustreError: lustre-MDT0000-mdc-ffff994acc049000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 1381.955115] Lustre: lustre-MDT0000-mdc-ffff994acc049000: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 1384.017943] Lustre: DEBUG MARKER: Wait for df (36134) ... [ 1385.732231] Lustre: DEBUG MARKER: done [ 1387.557355] LustreError: 36744:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994acc049000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1387.561862] LustreError: 36744:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1387.673243] Lustre: Unmounted lustre-client [ 1413.023841] Key type lgssc unregistered [ 1413.253292] LNet: 37146:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1413.258558] LNetError: 37146:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1413.272310] LNet: Removed LNI 192.168.201.3@tcp [ 1413.849729] Key type .llcrypt unregistered [ 1413.851577] Key type ._llcrypt unregistered [ 1452.764923] Key type ._llcrypt registered [ 1452.766337] Key type .llcrypt registered [ 1453.186275] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 1453.203345] alg: No test for adler32 (adler32-zlib) [ 1454.209819] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 1454.381958] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 1456.023164] Key type lgssc registered [ 1456.995789] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1523.671500] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1526.591347] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1546.195054] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1585.103073] Lustre: DEBUG MARKER: == conf-sanity test 35b: Continue reconnection retries, if the active server is busy ========================================================== 15:10:17 (1761246617) [ 1610.255395] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1613.015272] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1629.288955] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1640.512634] Lustre: Mounted lustre-client [ 1646.155720] Lustre: DEBUG MARKER: conf-sanity.sh test_35b 2025-10-2315h11m18s [ 1647.302545] Lustre: DEBUG MARKER: Set up a fake failnode for the MDS [ 1653.086834] Lustre: DEBUG MARKER: Injecting EBUSY on MDS [ 1655.106421] Lustre: DEBUG MARKER: Creating a test file and stat it [ 1675.743323] Lustre: 44030:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761246689/real 1761246689] req@00000000a851094d x1846800797407104/t0(0) o101->lustre-MDT0000-mdc-ffff994ac4291800@192.168.201.103@tcp:12/10 lens 576/1152 e 0 to 1 dl 1761246709 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1675.773720] Lustre: lustre-MDT0000-mdc-ffff994ac4291800: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1675.832715] Lustre: lustre-MDT0000-mdc-ffff994ac4291800: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 1696.403306] Lustre: DEBUG MARKER: Stop injecting EBUSY on MDS [ 1699.162476] Lustre: DEBUG MARKER: done [ 1701.566697] LustreError: 44506:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4291800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1701.584781] LustreError: 44506:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1701.625093] Lustre: Unmounted lustre-client [ 1730.305907] Key type lgssc unregistered [ 1730.527431] LNet: 44908:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1730.537977] LNetError: 44908:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1731.559284] LNet: Removed LNI 192.168.201.3@tcp [ 1732.131519] Key type .llcrypt unregistered [ 1732.137924] Key type ._llcrypt unregistered [ 1768.459437] Key type ._llcrypt registered [ 1768.494292] Key type .llcrypt registered [ 1769.008813] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 1769.031837] alg: No test for adler32 (adler32-zlib) [ 1770.158361] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 1770.416882] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 1772.111129] Key type lgssc registered [ 1773.251200] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1843.912806] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1847.928707] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1866.707986] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1898.288456] Lustre: DEBUG MARKER: == conf-sanity test 36: df report consistency on OSTs with different block size ========================================================== 15:15:31 (1761246931) [ 1899.505809] Lustre: DEBUG MARKER: SKIP: conf-sanity test_36 remote OST [ 1900.894186] Lustre: DEBUG MARKER: == conf-sanity test 37: verify set tunables works for symlink device ========================================================== 15:15:33 (1761246933) [ 1917.900298] Lustre: DEBUG MARKER: == conf-sanity test 38: MDS recreates missing lov_objid file from OST data ========================================================== 15:15:50 (1761246950) [ 1943.570277] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1946.604230] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1959.463402] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1971.244240] Lustre: Mounted lustre-client [ 1974.254347] Lustre: DEBUG MARKER: copying 10 files to /mnt/lustre/d38.conf-sanity [ 1977.173658] LustreError: 52739:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac910b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1977.197404] LustreError: 52739:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1977.260443] Lustre: Unmounted lustre-client [ 1987.010307] Lustre: DEBUG MARKER: delete lov_objid file on MDS [ 2024.940981] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2027.323049] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2027.791445] Lustre: Mounted lustre-client [ 2030.314279] LustreError: 53996:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994acb92a800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2030.329909] LustreError: 53996:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2030.333410] LustreError: 53996:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2030.375850] Lustre: Unmounted lustre-client [ 2087.949809] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2091.055895] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2091.901526] Lustre: Mounted lustre-client [ 2094.613311] LustreError: 55117:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994aca069000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2094.634634] LustreError: 55117:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2094.639095] LustreError: 55117:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2094.693372] Lustre: Unmounted lustre-client [ 2116.373197] Lustre: DEBUG MARKER: files compared the same [ 2136.883259] Key type lgssc unregistered [ 2137.131699] LNet: 55823:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2137.135209] LNetError: 55823:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2137.157858] LNet: Removed LNI 192.168.201.3@tcp [ 2137.704561] Key type .llcrypt unregistered [ 2137.706216] Key type ._llcrypt unregistered [ 2155.229084] Key type ._llcrypt registered [ 2155.235483] Key type .llcrypt registered [ 2156.908742] Lustre: DEBUG MARKER: == conf-sanity test 39: leak_finder recognizes both LUSTRE and LNET malloc messages ========================================================== 15:19:48 (1761247188) [ 2159.771343] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2159.800425] alg: No test for adler32 (adler32-zlib) [ 2161.099976] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 2161.409824] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 2163.089124] Key type lgssc registered [ 2165.219080] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2204.446103] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2206.815889] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2220.823275] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2223.340580] Lustre: Mounted lustre-client [ 2226.368116] LustreError: 58916:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac673f000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2226.390358] LustreError: 58916:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2226.474819] Lustre: Unmounted lustre-client [ 2259.867490] Key type lgssc unregistered [ 2260.112823] LNet: 59321:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2260.129712] LNetError: 59321:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2260.173565] LNet: Removed LNI 192.168.201.3@tcp [ 2260.638919] Key type .llcrypt unregistered [ 2260.640727] Key type ._llcrypt unregistered [ 2272.554807] Key type ._llcrypt registered [ 2272.556292] Key type .llcrypt registered [ 2273.688854] Lustre: DEBUG MARKER: == conf-sanity test 40: race during service thread startup ========================================================== 15:21:46 (1761247306) [ 2275.498439] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2275.523034] alg: No test for adler32 (adler32-zlib) [ 2276.529561] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 2276.688183] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 2278.327246] Key type lgssc registered [ 2279.259274] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2352.380287] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2375.789313] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2378.882096] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2404.012780] Key type lgssc unregistered [ 2404.242573] LNet: 62716:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2404.250994] LNetError: 62716:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2404.267774] LNet: Removed LNI 192.168.201.3@tcp [ 2404.751299] Key type .llcrypt unregistered [ 2404.752952] Key type ._llcrypt unregistered [ 2415.363077] Key type ._llcrypt registered [ 2415.364385] Key type .llcrypt registered [ 2416.252328] Lustre: DEBUG MARKER: == conf-sanity test 41a: mount mds with --nosvc and --nomgs ========================================================== 15:24:09 (1761247449) [ 2418.640192] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2418.670771] alg: No test for adler32 (adler32-zlib) [ 2419.630572] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 2419.809990] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 2421.471824] Key type lgssc registered [ 2422.229161] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2482.704864] Lustre: Mounted lustre-client [ 2489.090778] LustreError: 65201:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac5866800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2489.140290] LustreError: 65201:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2489.198847] Lustre: Unmounted lustre-client [ 2522.245713] Lustre: DEBUG MARKER: == conf-sanity test 41b: mount mds with --nosvc and --nomgs on first mount ========================================================== 15:25:54 (1761247554) [ 2619.683248] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2638.900578] Lustre: Mounted lustre-client [ 2645.254372] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 2645.260575] LustreError: 69166:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff994ac5913000: inode [0x200000402:0x1:0x0] mdc close failed: rc = -108 [ 2645.274657] Lustre: 63694:0:(llite_lib.c:4238:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.201.103@tcp:/lustre/fid: [0x200000402:0x1:0x0]/ may get corrupted (rc -108) [ 2655.545253] LustreError: 69166:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 2655.550885] LustreError: 69166:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2655.576983] Lustre: Unmounted lustre-client [ 2696.137304] Lustre: DEBUG MARKER: == conf-sanity test 41c: concurrent mounts of MDT/OST should all fail but one ========================================================== 15:28:48 (1761247728) [ 2707.377527] Key type lgssc unregistered [ 2707.630724] LNet: 70376:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2707.641521] LNetError: 70376:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2707.659351] LNet: Removed LNI 192.168.201.3@tcp [ 2708.268919] Key type .llcrypt unregistered [ 2708.270400] Key type ._llcrypt unregistered [ 2717.873733] Key type ._llcrypt registered [ 2717.875396] Key type .llcrypt registered [ 2718.206992] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2718.233160] alg: No test for adler32 (adler32-zlib) [ 2719.278829] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 2719.452182] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 2721.111270] Key type lgssc registered [ 2722.286915] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2759.311412] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2762.246531] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2778.013313] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2788.911819] Lustre: Mounted lustre-client [ 2791.440265] LustreError: 72901:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac673c800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2791.454870] LustreError: 72901:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 2791.488250] Lustre: Unmounted lustre-client [ 2823.122119] Key type lgssc unregistered [ 2823.331284] LNet: 73303:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2823.340771] LNetError: 73303:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2823.362545] LNet: Removed LNI 192.168.201.3@tcp [ 2823.899062] Key type .llcrypt unregistered [ 2823.900763] Key type ._llcrypt unregistered [ 2830.884893] Key type ._llcrypt registered [ 2830.886814] Key type .llcrypt registered [ 2831.190359] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2831.210341] alg: No test for adler32 (adler32-zlib) [ 2832.266757] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 2832.433693] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 2834.058865] Key type lgssc registered [ 2834.893979] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2924.315208] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2927.744477] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2943.532310] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2954.269044] Lustre: Mounted lustre-client [ 2955.763569] LustreError: 76248:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac88e5000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2955.781528] LustreError: 76248:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 2955.813790] Lustre: Unmounted lustre-client [ 2978.052187] Key type lgssc unregistered [ 2978.244128] LNet: 76650:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2978.250627] LNetError: 76650:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2978.275603] LNet: Removed LNI 192.168.201.3@tcp [ 2978.828719] Key type .llcrypt unregistered [ 2978.830303] Key type ._llcrypt unregistered [ 2989.677427] Key type ._llcrypt registered [ 2989.678685] Key type .llcrypt registered [ 2990.531485] Lustre: DEBUG MARKER: == conf-sanity test 42: allow client/server mount/unmount with invalid config param ========================================================== 15:33:43 (1761248023) [ 2991.857474] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2991.873654] alg: No test for adler32 (adler32-zlib) [ 2992.835916] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 2992.980650] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 2994.623212] Key type lgssc registered [ 2995.460392] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3029.912590] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3032.669268] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3046.502297] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3048.145238] Lustre: Mounted lustre-client [ 3052.245979] LustreError: 79768:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994aca06b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3052.284650] LustreError: 79768:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3052.349922] Lustre: Unmounted lustre-client [ 3052.827560] Lustre: Mounted lustre-client [ 3055.238894] LustreError: 79845:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4cf2800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3055.260211] LustreError: 79845:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3055.263184] LustreError: 79845:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3055.312410] Lustre: Unmounted lustre-client [ 3076.044712] Key type lgssc unregistered [ 3076.282580] LNet: 80247:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3076.293393] LNetError: 80247:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3076.315357] LNet: Removed LNI 192.168.201.3@tcp [ 3076.973928] Key type .llcrypt unregistered [ 3076.975729] Key type ._llcrypt unregistered [ 3085.538891] Key type ._llcrypt registered [ 3085.540758] Key type .llcrypt registered [ 3085.879170] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 3085.892675] alg: No test for adler32 (adler32-zlib) [ 3086.959310] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 3087.157441] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 3088.839138] Key type lgssc registered [ 3090.096898] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3132.178476] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3135.068930] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3149.813798] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3160.661824] Lustre: Mounted lustre-client [ 3164.542732] LustreError: 82792:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac9fa2000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3164.568397] LustreError: 82792:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3164.627155] Lustre: Unmounted lustre-client [ 3190.879419] Key type lgssc unregistered [ 3191.142557] LNet: 83195:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3191.151383] LNetError: 83195:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3191.179058] LNet: Removed LNI 192.168.201.3@tcp [ 3191.875505] Key type .llcrypt unregistered [ 3191.878782] Key type ._llcrypt unregistered [ 3204.512836] Key type ._llcrypt registered [ 3204.519789] Key type .llcrypt registered [ 3205.571987] Lustre: DEBUG MARKER: == conf-sanity test 43a: check root_squash and nosquash_nids ========================================================== 15:37:18 (1761248238) [ 3207.375213] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3207.392654] alg: No test for adler32 (adler32-zlib) [ 3208.534731] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 3208.724328] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 3210.442321] Key type lgssc registered [ 3211.552938] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3253.233649] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3256.435768] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3269.284420] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3279.922624] Lustre: Mounted lustre-client [ 3291.704457] Lustre: lustre: nosquash_nids is cleared [ 3291.725210] Lustre: lustre: root_squash is set to 500:500 [ 3298.644637] Lustre: lustre: nosquash_nids set to 2@gni 0@lo 192.168.201.3@tcp 192.168.0.[2,10]@tcp [ 3308.523599] Lustre: lustre: nosquash_nids set to 192.168.201.3/24@tcp [ 3314.277753] LustreError: 86649:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac3f35800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3314.299132] LustreError: 86649:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3314.346966] Lustre: Unmounted lustre-client [ 3343.711197] Key type lgssc unregistered [ 3343.991135] LNet: 87052:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3343.999630] LNetError: 87052:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3344.018279] LNet: Removed LNI 192.168.201.3@tcp [ 3344.612275] Key type .llcrypt unregistered [ 3344.618411] Key type ._llcrypt unregistered [ 3357.224539] Key type ._llcrypt registered [ 3357.226067] Key type .llcrypt registered [ 3358.297357] Lustre: DEBUG MARKER: == conf-sanity test 43b: parse nosquash_nids with commas in expr_list ========================================================== 15:39:50 (1761248390) [ 3360.544266] Lustre: DEBUG MARKER: SKIP: conf-sanity test_43b mixed loopback and real device not working [ 3362.158663] Lustre: DEBUG MARKER: == conf-sanity test 44: mounted client proc entry exists ========================================================== 15:39:54 (1761248394) [ 3364.400722] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3364.435081] alg: No test for adler32 (adler32-zlib) [ 3365.464262] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 3365.730743] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 3367.393054] Key type lgssc registered [ 3368.614452] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3411.799322] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3414.662026] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3432.256244] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3433.814450] Lustre: lustre: root_squash is set to 500:500 [ 3433.839673] Lustre: lustre: nosquash_nids set to 192.168.201.3/24@tcp [ 3439.161363] Lustre: Mounted lustre-client [ 3443.739523] LustreError: 90520:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac673e800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3443.767819] LustreError: 90520:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3443.824626] Lustre: Unmounted lustre-client [ 3469.136102] Key type lgssc unregistered [ 3469.406904] LNet: 90923:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3469.435565] LNetError: 90923:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3469.449723] LNet: Removed LNI 192.168.201.3@tcp [ 3470.056693] Key type .llcrypt unregistered [ 3470.058395] Key type ._llcrypt unregistered [ 3482.667469] Key type ._llcrypt registered [ 3482.669195] Key type .llcrypt registered [ 3483.732876] Lustre: DEBUG MARKER: SKIP: conf-sanity test_45 skipping SLOW test 45 [ 3485.187764] Lustre: DEBUG MARKER: == conf-sanity test 46a: handle ost additional - wide striped file ========================================================== 15:41:57 (1761248517) [ 3499.238021] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3499.251407] alg: No test for adler32 (adler32-zlib) [ 3500.248848] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 3500.420953] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 3502.103180] Key type lgssc registered [ 3502.926132] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3567.595621] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3570.973653] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3587.117393] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3649.649039] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3653.440472] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3672.340153] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3683.514925] Lustre: Mounted lustre-client [ 3709.224254] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff994ac4cf2800.ost_server_uuid 50 [ 3710.605200] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff994ac4cf2800.ost_server_uuid in FULL state after 0 sec [ 3710.939977] Lustre: Mounted lustre-client [ 3713.647452] LustreError: 97822:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac9fa0000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3713.667955] LustreError: 97822:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 3713.730284] Lustre: Unmounted lustre-client [ 3714.879231] LustreError: 97842:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4cf2800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3714.902659] LustreError: 97842:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 3714.923145] LustreError: 97842:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 3714.926321] LustreError: 97842:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3714.978243] Lustre: Unmounted lustre-client [ 3757.028714] Key type lgssc unregistered [ 3757.210876] LNet: 98394:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3757.219610] LNetError: 98394:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3757.237829] LNet: Removed LNI 192.168.201.3@tcp [ 3757.729677] Key type .llcrypt unregistered [ 3757.732492] Key type ._llcrypt unregistered [ 3793.766406] Key type ._llcrypt registered [ 3793.768127] Key type .llcrypt registered [ 3794.502729] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 3794.557518] alg: No test for adler32 (adler32-zlib) [ 3795.762981] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 3796.098695] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 3797.799210] Key type lgssc registered [ 3799.022502] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3870.232355] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3873.593793] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3889.943349] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3929.681749] Lustre: DEBUG MARKER: == conf-sanity test 47a: server restart does not lose lru_resize ========================================================== 15:49:22 (1761248962) [ 4019.582502] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4024.511380] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4046.249090] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4047.851216] Lustre: Mounted lustre-client [ 4068.303168] Lustre: 99180:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761249086/real 1761249086] req@000000002eb4227d x1846803252122752/t0(0) o400->lustre-OST0000-osc-ffff994ac88e5000@192.168.201.103@tcp:28/4 lens 224/224 e 0 to 1 dl 1761249102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4068.344288] Lustre: lustre-OST0000-osc-ffff994ac88e5000: Connection to lustre-OST0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4073.199727] Lustre: lustre-OST0000-osc-ffff994ac88e5000: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 4073.503164] Lustre: 99180:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761249091/real 1761249091] req@00000000d0ee4925 x1846803252123264/t0(0) o400->lustre-OST0000-osc-ffff994ac88e5000@192.168.201.103@tcp:28/4 lens 224/224 e 0 to 1 dl 1761249107 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4078.582358] Lustre: lustre-MDT0000-mdc-ffff994ac88e5000: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4079.647167] Lustre: 99179:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761249097/real 1761249097] req@000000001896bc4f x1846803252123776/t0(0) o400->lustre-OST0000-osc-ffff994ac88e5000@192.168.201.103@tcp:28/4 lens 224/224 e 0 to 1 dl 1761249113 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4093.920458] Lustre: 106323:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761249111/real 1761249111] req@00000000e48c0949 x1846803252125184/t0(0) o101->MGC192.168.201.103@tcp@192.168.201.103@tcp:26/25 lens 328/344 e 0 to 1 dl 1761249127 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4093.947280] LustreError: MGC192.168.201.103@tcp: Connection to MGS (at 192.168.201.103@tcp) was lost; in progress operations using this service will fail [ 4093.966841] Lustre: 106323:0:(mgc_request.c:1910:mgc_process_log()) MGC192.168.201.103@tcp: IR log lustre-cliir failed, not fatal: rc = -5 [ 4104.182809] Lustre: Evicted from MGS (at 192.168.201.103@tcp) after server handle changed from 0xb5126709810e2b91 to 0xb5126709810e2e07 [ 4104.204201] Lustre: MGC192.168.201.103@tcp: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 4109.547923] Lustre: lustre-MDT0000-mdc-ffff994ac88e5000: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 4113.064721] LustreError: 107051:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac88e5000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4113.085693] LustreError: 107051:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4113.160478] Lustre: Unmounted lustre-client [ 4143.919792] Key type lgssc unregistered [ 4144.256617] LNet: 107454:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4144.262414] LNetError: 107454:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4144.292266] LNet: Removed LNI 192.168.201.3@tcp [ 4145.034196] Key type .llcrypt unregistered [ 4145.036357] Key type ._llcrypt unregistered [ 4161.062357] Key type ._llcrypt registered [ 4161.068711] Key type .llcrypt registered [ 4162.756772] Lustre: DEBUG MARKER: == conf-sanity test 47b: client restart does not lose lru_resize ========================================================== 15:53:14 (1761249194) [ 4178.248511] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4178.306849] alg: No test for adler32 (adler32-zlib) [ 4179.371789] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 4179.636603] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 4181.351249] Key type lgssc registered [ 4182.481503] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4213.919403] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4291.810287] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4295.941673] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4315.890853] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4317.454217] Lustre: Mounted lustre-client [ 4319.101350] Lustre: DEBUG MARKER: SKIP: conf-sanity test_47b Can not create symlink /usr/sbin/lctl [ 4320.598124] Lustre: DEBUG MARKER: == conf-sanity test 48: too many acls on file ============ 15:55:53 (1761249353) [ 4516.569267] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 4526.840108] LustreError: 118220:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4526.869327] Lustre: Unmounted lustre-client [ 4647.368373] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4650.187446] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4667.391627] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4701.043553] Lustre: DEBUG MARKER: == conf-sanity test 49a: check PARAM_SYS_LDLM_TIMEOUT option of mkfs.lustre ========================================================== 16:02:13 (1761249733) [ 4776.510234] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4779.983191] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4799.407520] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4799.966521] Lustre: Mounted lustre-client [ 4803.087153] LustreError: 125644:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac47c7000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4803.113106] LustreError: 125644:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4803.119100] LustreError: 125644:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 4803.178502] Lustre: Unmounted lustre-client [ 4830.105798] Lustre: DEBUG MARKER: == conf-sanity test 49b: check PARAM_SYS_LDLM_TIMEOUT option of mkfs.lustre ========================================================== 16:04:22 (1761249862) [ 4911.673290] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4914.419273] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4929.167821] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4929.791618] Lustre: Mounted lustre-client [ 4933.063335] LustreError: 129689:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994acf4c1800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4933.084576] LustreError: 129689:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4933.090659] LustreError: 129689:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 4933.149827] Lustre: Unmounted lustre-client [ 4965.432278] Key type lgssc unregistered [ 4965.645417] LNet: 130093:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4965.651302] LNetError: 130093:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4965.668869] LNet: Removed LNI 192.168.201.3@tcp [ 4966.089063] Key type .llcrypt unregistered [ 4966.090806] Key type ._llcrypt unregistered [ 4976.623071] Key type ._llcrypt registered [ 4976.624647] Key type .llcrypt registered [ 4977.727544] Lustre: DEBUG MARKER: == conf-sanity test 50a: lazystatfs all servers available ========================================================== 16:06:50 (1761250010) [ 4979.640632] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4979.650578] alg: No test for adler32 (adler32-zlib) [ 4980.755695] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 4980.936439] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 4982.615175] Key type lgssc registered [ 4983.999594] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5023.733668] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5026.567390] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5040.450522] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5052.421952] Lustre: Mounted lustre-client [ 5064.775301] LustreError: 133201:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac46fe800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5064.800428] LustreError: 133201:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 5064.849659] Lustre: Unmounted lustre-client [ 5090.558931] Key type lgssc unregistered [ 5090.827500] LNet: 133603:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5090.844425] LNetError: 133603:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5090.871077] LNet: Removed LNI 192.168.201.3@tcp [ 5091.385912] Key type .llcrypt unregistered [ 5091.388975] Key type ._llcrypt unregistered [ 5102.610765] Key type ._llcrypt registered [ 5102.612345] Key type .llcrypt registered [ 5103.375528] Lustre: DEBUG MARKER: == conf-sanity test 50b: lazystatfs all servers down ===== 16:08:56 (1761250136) [ 5104.723635] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5104.756187] alg: No test for adler32 (adler32-zlib) [ 5105.719947] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 5105.886288] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 5107.503210] Key type lgssc registered [ 5108.373919] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5143.025427] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5145.575975] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5159.646934] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5161.157988] Lustre: Mounted lustre-client [ 5166.571344] Lustre: lustre-OST0000-osc-ffff994ac765f800: Connection to lustre-OST0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5175.179484] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state DISCONN osc.lustre-OST0000-osc-ffff994ac765f800.ost_server_uuid 50 [ 5176.511366] Lustre: DEBUG MARKER: OSCs should all be DISCONN [ 5186.838639] LustreError: 137135:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac765f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5186.854016] LustreError: 137135:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 5186.896184] Lustre: Unmounted lustre-client [ 5205.777860] Lustre: DEBUG MARKER: == conf-sanity test 50c: lazystatfs one server down ====== 16:10:38 (1761250238) [ 5228.984447] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5231.991495] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5246.202194] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5263.324671] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5263.843546] Lustre: Mounted lustre-client [ 5268.970383] Lustre: lustre-OST0000-osc-ffff994ac7659800: Connection to lustre-OST0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5291.120617] LustreError: 139791:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac7659800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5291.152813] LustreError: 139791:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 5291.173797] LustreError: 139791:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 5291.244813] Lustre: Unmounted lustre-client [ 5336.490635] Lustre: DEBUG MARKER: == conf-sanity test 50d: lazystatfs client/server conn race ========================================================== 16:12:49 (1761250369) [ 5362.800967] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5365.884702] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5382.010516] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5395.859365] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5396.426045] Lustre: Mounted lustre-client [ 5401.581754] Lustre: lustre-OST0000-osc-ffff994ac4662800: Connection to lustre-OST0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5425.533335] LustreError: 142548:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4662800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5425.537917] LustreError: 142548:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 5425.552680] LustreError: 142548:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 5425.556566] LustreError: 142548:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 5425.606721] Lustre: Unmounted lustre-client [ 5472.672672] Lustre: DEBUG MARKER: == conf-sanity test 50e: normal statfs all servers down == 16:15:05 (1761250505) [ 5552.856471] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5556.396725] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5572.755740] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5627.489396] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5630.797956] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5644.941456] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5674.484537] Lustre: Mounted lustre-client [ 5715.554955] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5721.417559] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 4 sec [ 5722.654265] LustreError: 149180:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4a42800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5722.659808] LustreError: 149180:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 5722.680591] LustreError: 149180:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 5722.683618] LustreError: 149180:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 5722.717985] Lustre: Unmounted lustre-client [ 5762.762447] Lustre: DEBUG MARKER: == conf-sanity test 50f: normal statfs one server in down ========================================================== 16:19:55 (1761250795) [ 5791.188312] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5794.117864] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5810.328261] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5836.450697] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5867.582248] Lustre: Mounted lustre-client [ 5905.498154] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5907.334416] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 5913.576312] Lustre: lustre-OST0001-osc-ffff994aca069000: Connection to lustre-OST0001 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5926.267150] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 5936.558613] LustreError: 152770:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 5936.562283] LustreError: 152770:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 5936.613273] Lustre: Unmounted lustre-client [ 5989.392279] Lustre: DEBUG MARKER: == conf-sanity test 50g: deactivated OST should not cause panic ========================================================== 16:23:42 (1761251022) [ 6012.386472] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6015.494695] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6030.633156] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6031.257497] Lustre: Mounted lustre-client [ 6049.100402] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6050.857781] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6060.215628] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff994aca616800.ost_server_uuid 50 [ 6061.462664] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff994aca616800.ost_server_uuid in FULL state after 0 sec [ 6063.691744] LustreError: 156196:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994aca616800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6063.719448] LustreError: 156196:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6063.724947] LustreError: 156196:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6063.787165] Lustre: Unmounted lustre-client [ 6064.021036] Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request [ 6064.027337] Lustre: Skipped 3 previous similar messages [ 6064.139446] Lustre: Mounted lustre-client [ 6065.004581] LustreError: 156259:0:(sec.c:410:import_sec_validate_get()) import 000000005bc8654a (NEW) with no sec [ 6109.468679] Lustre: DEBUG MARKER: == conf-sanity test 50h: LU-642: activate deactivated OST ========================================================== 16:25:42 (1761251142) [ 6134.380415] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6136.958789] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6152.721232] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6167.266843] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6167.640514] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6167.776949] Lustre: Mounted lustre-client [ 6178.085512] LustreError: 159104:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac8ee1000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6178.091352] LustreError: 159104:0:(lov_obd.c:783:lov_cleanup()) Skipped 2 previous similar messages [ 6178.106736] LustreError: 159104:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6178.110032] LustreError: 159104:0:(obd_class.h:479:obd_check_dev()) Skipped 18 previous similar messages [ 6178.169067] Lustre: Unmounted lustre-client [ 6178.170888] Lustre: Skipped 1 previous similar message [ 6210.997780] Key type lgssc unregistered [ 6211.203908] LNet: 159553:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6211.208769] LNetError: 159553:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6211.223276] LNet: Removed LNI 192.168.201.3@tcp [ 6211.748379] Key type .llcrypt unregistered [ 6211.753204] Key type ._llcrypt unregistered [ 6222.843478] Key type ._llcrypt registered [ 6222.845978] Key type .llcrypt registered [ 6223.838980] Lustre: DEBUG MARKER: == conf-sanity test 50i: activate deactivated MDT ======== 16:27:36 (1761251256) [ 6224.547392] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6224.561320] alg: No test for adler32 (adler32-zlib) [ 6225.582858] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 6225.740614] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 6227.360566] Key type lgssc registered [ 6228.287209] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6263.089810] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6266.376656] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6282.912076] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6298.429422] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6298.730863] Lustre: setting import lustre-MDT0001_UUID INACTIVE by administrator request [ 6299.892154] Lustre: Mounted lustre-client [ 6305.799637] LustreError: lustre-MDT0001-mdc-ffff994ac8ee3800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. [ 6305.809809] Lustre: lustre-MDT0001-mdc-ffff994ac8ee3800: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 6308.634683] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6310.052237] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 6325.250498] Lustre: setting import lustre-MDT0001_UUID INACTIVE by administrator request [ 6327.657202] LustreError: 163763:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac8ee3800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6327.678182] LustreError: 163763:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6327.727771] Lustre: Unmounted lustre-client [ 6356.779417] Lustre: DEBUG MARKER: == conf-sanity test 51: Verify that mdt_reint handles RMF_MDT_MD correctly when an OST is added ========================================================== 16:29:49 (1761251389) [ 6427.087352] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6430.178917] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6450.086602] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6450.555123] Lustre: Mounted lustre-client [ 6471.270716] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6472.413622] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6475.753742] Lustre: lustre-OST0001-osc-ffff994ac765b800: Connection to lustre-OST0001 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 6483.194901] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 6493.490545] LustreError: 168493:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6493.503097] LustreError: 168493:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6493.608570] Lustre: Unmounted lustre-client [ 6525.009433] Key type lgssc unregistered [ 6525.183910] LNet: 168899:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6525.198962] LNetError: 168899:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6525.226087] LNet: Removed LNI 192.168.201.3@tcp [ 6525.680470] Key type .llcrypt unregistered [ 6525.682325] Key type ._llcrypt unregistered [ 6559.354976] Key type ._llcrypt registered [ 6559.356696] Key type .llcrypt registered [ 6559.741437] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 6559.758832] alg: No test for adler32 (adler32-zlib) [ 6560.754185] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 6560.969674] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 6562.655335] Key type lgssc registered [ 6563.964845] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6626.524299] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6629.202633] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6644.192631] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6687.559941] Lustre: DEBUG MARKER: == conf-sanity test 52: check recovering objects from lost+found ========================================================== 16:35:20 (1761251720) [ 6714.821850] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6717.691674] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6731.253636] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6742.029911] Lustre: Mounted lustre-client [ 6783.262197] LustreError: 174981:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4a43000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6783.299971] LustreError: 174981:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 6783.372475] Lustre: Unmounted lustre-client [ 6814.376502] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6814.974718] Lustre: Mounted lustre-client [ 6849.537710] LustreError: 175645:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994aca06c000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6849.566636] LustreError: 175645:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 6849.571168] LustreError: 175645:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6849.657291] Lustre: Unmounted lustre-client [ 6874.065444] Key type lgssc unregistered [ 6874.306837] LNet: 176053:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6874.316130] LNetError: 176053:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6874.332238] LNet: Removed LNI 192.168.201.3@tcp [ 6874.962271] Key type .llcrypt unregistered [ 6874.964081] Key type ._llcrypt unregistered [ 6888.009141] Key type ._llcrypt registered [ 6888.010683] Key type .llcrypt registered [ 6889.021122] Lustre: DEBUG MARKER: == conf-sanity test 53a: check OSS thread count params === 16:38:41 (1761251921) [ 6891.305242] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6891.319507] alg: No test for adler32 (adler32-zlib) [ 6892.322410] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 6892.516451] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 6894.191184] Key type lgssc registered [ 6895.227391] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6929.273472] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6932.096710] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6946.694572] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6958.643126] Lustre: Mounted lustre-client [ 6975.646666] LustreError: 179312:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994accaca000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6975.679573] LustreError: 179312:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 6975.742372] Lustre: Unmounted lustre-client [ 7000.426953] Key type lgssc unregistered [ 7000.736779] LNet: 179715:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7000.748549] LNetError: 179715:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7000.771840] LNet: Removed LNI 192.168.201.3@tcp [ 7001.399569] Key type .llcrypt unregistered [ 7001.404222] Key type ._llcrypt unregistered [ 7010.454907] Key type ._llcrypt registered [ 7010.456550] Key type .llcrypt registered [ 7010.758904] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 7010.776163] alg: No test for adler32 (adler32-zlib) [ 7011.786442] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 7012.001981] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 7013.663176] Key type lgssc registered [ 7014.542977] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7055.994402] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7059.026494] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7076.526608] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7083.589454] Lustre: Mounted lustre-client [ 7090.566858] LustreError: 182285:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac673b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7090.599646] LustreError: 182285:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7090.670045] Lustre: Unmounted lustre-client [ 7114.439333] Key type lgssc unregistered [ 7114.743740] LNet: 182686:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7114.755631] LNetError: 182686:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7114.777200] LNet: Removed LNI 192.168.201.3@tcp [ 7115.460049] Key type .llcrypt unregistered [ 7115.462695] Key type ._llcrypt unregistered [ 7133.017364] Key type ._llcrypt registered [ 7133.020437] Key type .llcrypt registered [ 7134.349955] Lustre: DEBUG MARKER: == conf-sanity test 53b: check MDS thread count params === 16:42:46 (1761252166) [ 7136.583793] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7136.638931] alg: No test for adler32 (adler32-zlib) [ 7137.695610] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 7138.012341] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 7139.727218] Key type lgssc registered [ 7140.747442] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7182.335124] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7186.430502] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7206.000425] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7212.053183] Lustre: Mounted lustre-client [ 7231.960686] LustreError: 185948:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac765d800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7231.997095] LustreError: 185948:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7232.089471] Lustre: Unmounted lustre-client [ 7259.450556] Key type lgssc unregistered [ 7259.656319] LNet: 186350:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7259.666127] LNetError: 186350:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7259.967193] LNet: Removed LNI 192.168.201.3@tcp [ 7260.525453] Key type .llcrypt unregistered [ 7260.527306] Key type ._llcrypt unregistered [ 7271.356439] Key type ._llcrypt registered [ 7271.360605] Key type .llcrypt registered [ 7271.938032] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 7271.955479] alg: No test for adler32 (adler32-zlib) [ 7273.040908] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 7273.378668] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 7275.111174] Key type lgssc registered [ 7276.498756] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7321.842874] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7325.511935] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7342.146057] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7349.322560] Lustre: Mounted lustre-client [ 7356.674301] LustreError: 188928:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994accace800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7356.699665] LustreError: 188928:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7356.757458] Lustre: Unmounted lustre-client [ 7379.781341] Key type lgssc unregistered [ 7380.018142] LNet: 189329:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7380.052387] LNetError: 189329:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7381.093796] LNet: Removed LNI 192.168.201.3@tcp [ 7381.713913] Key type .llcrypt unregistered [ 7381.715647] Key type ._llcrypt unregistered [ 7395.272253] Key type ._llcrypt registered [ 7395.273798] Key type .llcrypt registered [ 7396.581020] Lustre: DEBUG MARKER: == conf-sanity test 54a: test llverdev and partial verify of device ========================================================== 16:47:08 (1761252428) [ 7416.162371] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7416.212803] alg: No test for adler32 (adler32-zlib) [ 7417.594418] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 7418.069937] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 7419.871190] Key type lgssc registered [ 7421.701116] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7502.281701] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7505.770090] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7526.868624] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7569.534248] Lustre: DEBUG MARKER: == conf-sanity test 54b: test llverfs and partial verify of filesystem ========================================================== 16:50:02 (1761252602) [ 7600.272513] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7603.943325] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7622.806741] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7625.361958] Lustre: Mounted lustre-client [ 7629.415412] LustreError: 195847:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac37f0800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7629.440944] LustreError: 195847:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7629.507372] Lustre: Unmounted lustre-client [ 7663.832558] Key type lgssc unregistered [ 7664.010673] LNet: 196251:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7664.015407] LNetError: 196251:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7664.033692] LNet: Removed LNI 192.168.201.3@tcp [ 7664.615536] Key type .llcrypt unregistered [ 7664.617089] Key type ._llcrypt unregistered [ 7679.235275] Key type ._llcrypt registered [ 7679.236764] Key type .llcrypt registered [ 7680.403864] Lustre: DEBUG MARKER: SKIP: conf-sanity test_55 skipping excluded test 55 [ 7682.244978] Lustre: DEBUG MARKER: == conf-sanity test 56a: check big OST indexes and out-of-index-order start ========================================================== 16:51:54 (1761252714) [ 7699.061657] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7699.091089] alg: No test for adler32 (adler32-zlib) [ 7700.210492] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 7700.532753] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 7702.215191] Key type lgssc registered [ 7703.196491] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7788.832905] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7791.697364] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7809.747919] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST2710-osc-[-0-9a-f]*.ost_server_uuid [ 7826.514435] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST03e8-osc-[-0-9a-f]*.ost_server_uuid [ 7828.248599] Lustre: Mounted lustre-client [ 7848.522734] LustreError: 201791:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac7659800: lov tgt 1000 not cleaned! deathrow=0, lovrc=1 [ 7848.568493] LustreError: 201791:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7848.681462] Lustre: Unmounted lustre-client [ 7962.537783] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7965.678743] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7985.066564] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8036.343209] Lustre: DEBUG MARKER: == conf-sanity test 56b: test target_obd correctness with nonconsecutive MDTs ========================================================== 16:57:48 (1761253068) [ 8037.934055] Lustre: DEBUG MARKER: SKIP: conf-sanity test_56b needs >= 3 MDTs [ 8040.123261] Lustre: DEBUG MARKER: == conf-sanity test 57a: initial registration from failnode should fail (should return errs) ========================================================== 16:57:52 (1761253072) [ 8099.555890] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8103.223932] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8130.678130] Key type lgssc unregistered [ 8130.982672] LNet: 207974:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8130.993938] LNetError: 207974:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8131.008648] LNet: Removed LNI 192.168.201.3@tcp [ 8131.655453] Key type .llcrypt unregistered [ 8131.665983] Key type ._llcrypt unregistered [ 8145.722358] Key type ._llcrypt registered [ 8145.724174] Key type .llcrypt registered [ 8147.071573] Lustre: DEBUG MARKER: == conf-sanity test 57b: initial registration from servicenode should not fail ========================================================== 16:59:39 (1761253179) [ 8176.414423] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8176.430825] alg: No test for adler32 (adler32-zlib) [ 8177.508073] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 8177.818463] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 8179.543177] Key type lgssc registered [ 8180.696833] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8218.596574] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8221.903678] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8238.622808] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8275.217295] Key type lgssc unregistered [ 8275.613667] LNet: 211620:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8275.628559] LNetError: 211620:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8275.654317] LNet: Removed LNI 192.168.201.3@tcp [ 8276.443604] Key type .llcrypt unregistered [ 8276.452231] Key type ._llcrypt unregistered [ 8291.811410] Key type ._llcrypt registered [ 8291.816481] Key type .llcrypt registered [ 8293.139701] Lustre: DEBUG MARKER: == conf-sanity test 58: missing llog files must not prevent MDT from mounting ========================================================== 17:02:05 (1761253325) [ 8295.581235] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8295.618540] alg: No test for adler32 (adler32-zlib) [ 8296.649525] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 8296.883992] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 8298.575280] Key type lgssc registered [ 8299.612448] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8346.853303] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8350.317685] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8368.498633] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8371.132142] Lustre: Mounted lustre-client [ 8381.420967] Lustre: lustre-MDT0000-mdc-ffff994ac4292000: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 8386.547089] Lustre: lustre-MDT0001-mdc-ffff994ac4292000: Connection to lustre-MDT0001 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 8402.912127] Lustre: 212605:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761253420/real 1761253420] req@000000005b720ee5 x1846807971840128/t0(0) o400->MGC192.168.201.103@tcp@192.168.201.103@tcp:26/25 lens 224/224 e 0 to 1 dl 1761253436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 8402.946952] LustreError: MGC192.168.201.103@tcp: Connection to MGS (at 192.168.201.103@tcp) was lost; in progress operations using this service will fail [ 8428.527552] Lustre: Evicted from MGS (at 192.168.201.103@tcp) after server handle changed from 0x16df062a2222cc3e to 0x16df062a2222e788 [ 8428.544605] Lustre: MGC192.168.201.103@tcp: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 8451.992248] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8452.080854] LustreError: lustre-MDT0000-mdc-ffff994ac4292000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 8452.104517] Lustre: lustre-MDT0000-mdc-ffff994ac4292000: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 8453.347897] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 8455.885395] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8457.092142] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 8459.006409] LustreError: 216036:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4292000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 8459.024984] LustreError: 216036:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 8459.068638] Lustre: Unmounted lustre-client [ 8484.439161] Key type lgssc unregistered [ 8484.712697] LNet: 216439:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8484.726894] LNetError: 216439:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8484.747992] LNet: Removed LNI 192.168.201.3@tcp [ 8485.368169] Key type .llcrypt unregistered [ 8485.374605] Key type ._llcrypt unregistered [ 8500.116670] Key type ._llcrypt registered [ 8500.119514] Key type .llcrypt registered [ 8501.653966] Lustre: DEBUG MARKER: == conf-sanity test 59: writeconf mount option =========== 17:05:33 (1761253533) [ 8504.271384] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8504.342073] alg: No test for adler32 (adler32-zlib) [ 8505.550289] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 8505.845520] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 8507.583168] Key type lgssc registered [ 8508.805693] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8551.380816] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8554.963149] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8597.717381] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8600.649855] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8629.116233] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8645.211505] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 8678.854273] Key type lgssc unregistered [ 8679.159552] LNet: 221549:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8679.169583] LNetError: 221549:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8679.192595] LNet: Removed LNI 192.168.201.3@tcp [ 8679.813428] Key type .llcrypt unregistered [ 8679.815302] Key type ._llcrypt unregistered [ 8718.031822] Key type ._llcrypt registered [ 8718.033583] Key type .llcrypt registered [ 8718.342472] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 8718.352629] alg: No test for adler32 (adler32-zlib) [ 8719.356649] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 8719.499280] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 8721.113327] Key type lgssc registered [ 8722.333389] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8787.553086] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8790.981698] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8807.037369] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8840.299536] Lustre: DEBUG MARKER: == conf-sanity test 60a: check mkfs.lustre --mkfsoptions -E -O options setting ========================================================== 17:11:12 (1761253872) [ 8924.498743] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8927.765110] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8945.823986] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8993.630995] Lustre: DEBUG MARKER: == conf-sanity test 60b: check mkfs.lustre MDT default features ========================================================== 17:13:46 (1761254026) [ 9000.073698] Lustre: DEBUG MARKER: == conf-sanity test 61a: large xattr ===================== 17:13:52 (1761254032) [ 9030.512563] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9033.689362] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9053.182923] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9059.383286] Lustre: Mounted lustre-client [ 9064.365753] Lustre: DEBUG MARKER: save large xattr of 65536 bytes on trusted.big on /mnt/lustre/f61a.conf-sanity [ 9066.275865] Lustre: DEBUG MARKER: shrink value of trusted.big on /mnt/lustre/f61a.conf-sanity [ 9067.649513] Lustre: DEBUG MARKER: grow value of trusted.big on /mnt/lustre/f61a.conf-sanity [ 9068.926878] Lustre: DEBUG MARKER: check value of trusted.big on /mnt/lustre/f61a.conf-sanity after remounting MDS [ 9074.665081] Lustre: lustre-MDT0000-mdc-ffff994ac4290800: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 9090.026492] LustreError: MGC192.168.201.103@tcp: Connection to MGS (at 192.168.201.103@tcp) was lost; in progress operations using this service will fail [ 9090.042296] Lustre: Evicted from MGS (at 192.168.201.103@tcp) after server handle changed from 0xab5c6a44f0b1b8fe to 0xab5c6a44f0b1ba78 [ 9090.051089] Lustre: MGC192.168.201.103@tcp: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 9102.605484] Lustre: lustre-MDT0000-mdc-ffff994ac4290800: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 9108.431430] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9110.235891] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 9113.448877] Lustre: DEBUG MARKER: remove large xattr trusted.big from /mnt/lustre/f61a.conf-sanity [ 9118.697830] Lustre: lustre-MDT0000-mdc-ffff994ac4290800: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 9134.092562] LustreError: MGC192.168.201.103@tcp: Connection to MGS (at 192.168.201.103@tcp) was lost; in progress operations using this service will fail [ 9134.120418] Lustre: Evicted from MGS (at 192.168.201.103@tcp) after server handle changed from 0xab5c6a44f0b1ba78 to 0xab5c6a44f0b1be6f [ 9134.145499] Lustre: MGC192.168.201.103@tcp: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 9138.420531] Lustre: lustre-MDT0000-mdc-ffff994ac4290800: Connection restored to 192.168.201.103@tcp (at 192.168.201.103@tcp) [ 9143.532615] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9145.025303] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 9148.315859] LustreError: 235178:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4290800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9148.335050] LustreError: 235178:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9148.376948] Lustre: Unmounted lustre-client [ 9209.730389] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9213.106163] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9229.705495] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9235.485434] Lustre: Mounted lustre-client [ 9236.740449] LustreError: 236803:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac3f36000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9236.753540] LustreError: 236803:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9236.756199] LustreError: 236803:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 9236.807037] Lustre: Unmounted lustre-client [ 9258.637389] Key type lgssc unregistered [ 9258.861557] LNet: 237207:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9258.873923] LNetError: 237207:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9258.895682] LNet: Removed LNI 192.168.201.3@tcp [ 9259.483519] Key type .llcrypt unregistered [ 9259.485280] Key type ._llcrypt unregistered [ 9274.084090] Key type ._llcrypt registered [ 9274.088878] Key type .llcrypt registered [ 9275.134088] Lustre: DEBUG MARKER: == conf-sanity test 61b: large xattr ===================== 17:18:27 (1761254307) [ 9279.279659] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9279.299643] alg: No test for adler32 (adler32-zlib) [ 9280.381892] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 9280.712224] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 9282.359226] Key type lgssc registered [ 9283.778392] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9330.541716] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9333.832763] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9350.262821] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9357.334316] Lustre: Mounted lustre-client [ 9362.142438] LustreError: 240377:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac765e000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9362.165780] LustreError: 240377:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9362.225681] Lustre: Unmounted lustre-client [ 9418.214550] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9421.528083] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9437.056822] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9447.965389] Lustre: Mounted lustre-client [ 9457.090085] LustreError: 241980:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994accaca000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9457.128825] LustreError: 241980:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9457.145649] LustreError: 241980:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 9457.208202] Lustre: Unmounted lustre-client [ 9515.115596] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9518.137273] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9533.777479] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9544.728164] Lustre: Mounted lustre-client [ 9545.990794] LustreError: 243597:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994acdc71000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9546.010505] LustreError: 243597:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9546.015154] LustreError: 243597:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 9546.082510] Lustre: Unmounted lustre-client [ 9570.466834] Key type lgssc unregistered [ 9570.672773] LNet: 243999:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9570.681943] LNetError: 243999:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9570.707252] LNet: Removed LNI 192.168.201.3@tcp [ 9571.263525] Key type .llcrypt unregistered [ 9571.266534] Key type ._llcrypt unregistered [ 9583.323458] Key type ._llcrypt registered [ 9583.325135] Key type .llcrypt registered [ 9584.489062] Lustre: DEBUG MARKER: == conf-sanity test 62: start with disabled journal ====== 17:23:37 (1761254617) [ 9587.242040] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9587.267959] alg: No test for adler32 (adler32-zlib) [ 9588.282217] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 9588.487061] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 9590.159144] Key type lgssc registered [ 9591.189534] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9628.593171] Key type lgssc unregistered [ 9628.828064] LNet: 246314:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9628.833135] LNetError: 246314:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9628.857036] LNet: Removed LNI 192.168.201.3@tcp [ 9629.429460] Key type .llcrypt unregistered [ 9629.431276] Key type ._llcrypt unregistered [ 9652.178755] Key type ._llcrypt registered [ 9652.180376] Key type .llcrypt registered [ 9652.674310] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 9652.689337] alg: No test for adler32 (adler32-zlib) [ 9653.978747] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 9654.282234] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 9656.015173] Key type lgssc registered [ 9657.128486] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9722.330499] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9725.189842] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9742.231646] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9791.912501] Lustre: DEBUG MARKER: SKIP: conf-sanity test_63 skipping excluded test 63 [ 9793.410988] Lustre: DEBUG MARKER: == conf-sanity test 64: check lfs df --lazy ============== 17:27:06 (1761254826) [ 9818.609509] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9821.624639] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9835.328923] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9851.053964] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 9852.500573] Lustre: Mounted lustre-client [ 9857.521700] Lustre: lustre-OST0001-osc-ffff994ac4291000: Connection to lustre-OST0001 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 9862.829078] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 9873.148281] LustreError: 252811:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 9873.193990] Lustre: Unmounted lustre-client [ 9905.100422] Key type lgssc unregistered [ 9905.328971] LNet: 253216:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9905.340401] LNetError: 253216:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9905.359743] LNet: Removed LNI 192.168.201.3@tcp [ 9905.878328] Key type .llcrypt unregistered [ 9905.883619] Key type ._llcrypt unregistered [ 9944.521459] Key type ._llcrypt registered [ 9944.581766] Key type .llcrypt registered [ 9944.935856] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 9944.963960] alg: No test for adler32 (adler32-zlib) [ 9945.988451] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [ 9946.259582] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [ 9947.943198] Key type lgssc registered [ 9949.369267] Lustre: Echo OBD driver; http://www.lustre.org/ [10029.354990] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10033.216455] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10053.504586] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10094.260437] Lustre: DEBUG MARKER: == conf-sanity test 65: re-create the lost last_rcvd file when server mount ========================================================== 17:32:06 (1761255126) [10131.877542] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10135.308260] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10157.083436] Lustre: DEBUG MARKER: == conf-sanity test 66: replace nids ===================== 17:33:09 (1761255189) [10186.691167] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10190.165737] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10206.070911] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10211.929403] Lustre: Mounted lustre-client [10222.615298] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [10229.296628] LustreError: 261058:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10229.376238] Lustre: Unmounted lustre-client [10317.299996] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10320.393209] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10375.609351] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10376.359853] Lustre: Mounted lustre-client [10378.206505] LustreError: 263111:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac3f35000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [10378.236368] LustreError: 263111:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10378.240775] LustreError: 263111:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10378.310942] Lustre: Unmounted lustre-client [10402.887488] Key type lgssc unregistered [10403.090912] LNet: 263512:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10403.098714] LNetError: 263512:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10404.135239] LNet: Removed LNI 192.168.201.3@tcp [10404.680892] Key type .llcrypt unregistered [10404.682214] Key type ._llcrypt unregistered [10425.093616] Key type ._llcrypt registered [10425.095234] Key type .llcrypt registered [10425.306442] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [10425.319210] alg: No test for adler32 (adler32-zlib) [10426.376425] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [10426.557837] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [10428.199230] Key type lgssc registered [10429.040029] Lustre: Echo OBD driver; http://www.lustre.org/ [10497.976576] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10500.921997] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10517.678658] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10553.928823] Lustre: DEBUG MARKER: SKIP: conf-sanity test_67 skipping excluded test 67 [10555.254862] Lustre: DEBUG MARKER: == conf-sanity test 68: be able to reserve specific sequences in FLDB ========================================================== 17:39:48 (1761255588) [10582.965452] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10585.769326] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10605.998468] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10610.414592] Lustre: Mounted lustre-client [10612.683428] LustreError: 269566:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4a46800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [10612.705985] LustreError: 269566:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10612.778335] Lustre: Unmounted lustre-client [10646.868336] Key type lgssc unregistered [10647.079027] LNet: 269970:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10647.084886] LNetError: 269970:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10647.106439] LNet: Removed LNI 192.168.201.3@tcp [10647.808947] Key type .llcrypt unregistered [10647.820915] Key type ._llcrypt unregistered [10662.673093] Key type ._llcrypt registered [10662.674780] Key type .llcrypt registered [10663.929592] Lustre: DEBUG MARKER: SKIP: conf-sanity test_69 skipping SLOW test 69 [10665.339453] Lustre: DEBUG MARKER: == conf-sanity test 70a: start MDT0, then OST, then MDT1 ========================================================== 17:41:38 (1761255698) [10672.886568] Key type .llcrypt unregistered [10672.889407] Key type ._llcrypt unregistered [10679.602379] Key type ._llcrypt registered [10679.605250] Key type .llcrypt registered [10680.057580] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [10680.089776] alg: No test for adler32 (adler32-zlib) [10681.247869] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [10681.521264] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [10683.271197] Key type lgssc registered [10684.492523] Lustre: Echo OBD driver; http://www.lustre.org/ [10729.077110] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10744.740220] Lustre: Mounted lustre-client [10747.109858] LustreError: 272989:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4cf0000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [10747.137823] LustreError: 272989:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10747.261046] Lustre: Unmounted lustre-client [10774.035427] Key type lgssc unregistered [10774.286134] LNet: 273392:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10774.300904] LNetError: 273392:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10774.323475] LNet: Removed LNI 192.168.201.3@tcp [10775.077342] Key type .llcrypt unregistered [10775.080114] Key type ._llcrypt unregistered [10788.128304] Key type ._llcrypt registered [10788.129910] Key type .llcrypt registered [10789.253546] Lustre: DEBUG MARKER: == conf-sanity test 70b: start OST, MDT1, MDT0 =========== 17:43:41 (1761255821) [10791.373336] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10791.461508] alg: No test for adler32 (adler32-zlib) [10792.570809] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [10792.785850] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [10794.488709] Key type lgssc registered [10795.812798] Lustre: Echo OBD driver; http://www.lustre.org/ [10870.976293] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10898.959707] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10903.210596] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10904.998544] Lustre: Mounted lustre-client [10907.540103] LustreError: 276447:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac5234800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [10907.574275] LustreError: 276447:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10907.624224] Lustre: Unmounted lustre-client [10935.216242] Key type lgssc unregistered [10935.542996] LNet: 276848:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10935.546365] LNetError: 276848:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10935.568549] LNet: Removed LNI 192.168.201.3@tcp [10936.310568] Key type .llcrypt unregistered [10936.312662] Key type ._llcrypt unregistered [10948.965411] Key type ._llcrypt registered [10948.967072] Key type .llcrypt registered [10950.137113] Lustre: DEBUG MARKER: == conf-sanity test 70c: stop MDT0, mkdir fail, create remote dir fail ========================================================== 17:46:22 (1761255982) [10951.680119] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10951.705153] alg: No test for adler32 (adler32-zlib) [10952.767873] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [10952.973398] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [10954.640485] Key type lgssc registered [10955.692459] Lustre: Echo OBD driver; http://www.lustre.org/ [10997.021158] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11000.288148] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11016.219805] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11022.382960] Lustre: Mounted lustre-client [11027.435904] Lustre: lustre-MDT0000-mdc-ffff994ac4661800: Connection to lustre-MDT0000 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [11032.072286] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [11032.103433] LustreError: 279930:0:(file.c:6108:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 [11032.417052] LustreError: 279949:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4661800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11032.427792] LustreError: MGC192.168.201.103@tcp: Connection to MGS (at 192.168.201.103@tcp) was lost; in progress operations using this service will fail [11032.438801] LustreError: 279949:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11032.487446] Lustre: Unmounted lustre-client [11049.987625] Key type lgssc unregistered [11050.241242] LNet: 280342:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11050.255097] LNetError: 280342:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11050.271708] LNet: Removed LNI 192.168.201.3@tcp [11050.781052] Key type .llcrypt unregistered [11050.782813] Key type ._llcrypt unregistered [11063.961979] Key type ._llcrypt registered [11063.963722] Key type .llcrypt registered [11065.295508] Lustre: DEBUG MARKER: == conf-sanity test 70d: stop MDT1, mkdir succeed, create remote dir fail ========================================================== 17:48:17 (1761256097) [11067.284483] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11067.326594] alg: No test for adler32 (adler32-zlib) [11068.473068] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [11068.671592] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [11070.415214] Key type lgssc registered [11071.550594] Lustre: Echo OBD driver; http://www.lustre.org/ [11117.430254] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11121.209518] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11137.981574] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11140.529328] Lustre: Mounted lustre-client [11145.719088] Lustre: lustre-MDT0001-mdc-ffff994ac3582800: Connection to lustre-MDT0001 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [11150.544429] Lustre: setting import lustre-MDT0001_UUID INACTIVE by administrator request [11152.579626] LustreError: 283446:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac3582800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11152.601881] LustreError: 283446:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11152.666536] Lustre: Unmounted lustre-client [11171.552430] Key type lgssc unregistered [11171.813044] LNet: 283840:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11171.830765] LNetError: 283840:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11171.843890] LNet: Removed LNI 192.168.201.3@tcp [11172.397952] Key type .llcrypt unregistered [11172.400492] Key type ._llcrypt unregistered [11185.140978] Key type ._llcrypt registered [11185.142613] Key type .llcrypt registered [11186.280678] Lustre: DEBUG MARKER: == conf-sanity test 70e: Sync-on-Cancel will be enabled by default on DNE ========================================================== 17:50:18 (1761256218) [11200.649420] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11200.673415] alg: No test for adler32 (adler32-zlib) [11201.734479] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [11201.892031] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [11203.535195] Key type lgssc registered [11204.410032] Lustre: Echo OBD driver; http://www.lustre.org/ [11285.495957] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11288.180166] Lustre: Mounted lustre-client [11321.837436] Lustre: lustre-MDT0001-mdc-ffff994ac673f800: Connection to lustre-MDT0001 (at 192.168.201.103@tcp) was lost; in progress operations using this service will wait for recovery to complete [11330.973260] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [11341.240822] LustreError: 289195:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [11341.284863] Lustre: Unmounted lustre-client [11375.487540] Key type lgssc unregistered [11375.699894] LNet: 289597:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11375.710298] LNetError: 289597:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11375.726558] LNet: Removed LNI 192.168.201.3@tcp [11376.391073] Key type .llcrypt unregistered [11376.392417] Key type ._llcrypt unregistered [11389.045301] Key type ._llcrypt registered [11389.046870] Key type .llcrypt registered [11390.117927] Lustre: DEBUG MARKER: == conf-sanity test 71a: start MDT0 OST0, MDT1, OST1 ===== 17:53:42 (1761256422) [11391.592647] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71a needs separate MGS/MDT [11392.953933] Lustre: DEBUG MARKER: == conf-sanity test 71b: start MDT1, OST0, MDT0, OST1 ==== 17:53:45 (1761256425) [11394.408635] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71b needs separate MGS/MDT [11396.170589] Lustre: DEBUG MARKER: == conf-sanity test 71c: start OST0, OST1, MDT1, MDT0 ==== 17:53:48 (1761256428) [11397.417208] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71c needs separate MGS/MDT [11398.871119] Lustre: DEBUG MARKER: == conf-sanity test 71d: start OST0, MDT1, MDT0, OST1 ==== 17:53:51 (1761256431) [11400.008877] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71d needs separate MGS/MDT [11401.432101] Lustre: DEBUG MARKER: == conf-sanity test 71e: start OST0, MDT1, OST1, MDT0 ==== 17:53:54 (1761256434) [11402.912793] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71e needs separate MGS/MDT [11404.391617] Lustre: DEBUG MARKER: == conf-sanity test 72: test fast symlink with extents flag enabled ========================================================== 17:53:57 (1761256437) [11412.233767] Key type .llcrypt unregistered [11412.235105] Key type ._llcrypt unregistered [11416.339047] Key type ._llcrypt registered [11416.343215] Key type .llcrypt registered [11416.597794] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [11416.617571] alg: No test for adler32 (adler32-zlib) [11417.695388] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [11417.954737] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [11419.634373] Key type lgssc registered [11420.749478] Lustre: Echo OBD driver; http://www.lustre.org/ [11488.289895] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11491.472224] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11512.376913] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11514.149365] Lustre: Mounted lustre-client [11516.105631] LustreError: 295202:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac3f32800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11516.120612] LustreError: 295202:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11516.186696] Lustre: Unmounted lustre-client [11551.681345] Lustre: DEBUG MARKER: == conf-sanity test 73a: failnode to update from mountdata properly ========================================================== 17:56:23 (1761256583) [11587.525782] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11591.255512] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11610.099641] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11610.674519] Lustre: Mounted lustre-client [11611.876822] LustreError: 297318:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994acc906800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11611.902070] LustreError: 297318:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11611.906269] LustreError: 297318:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [11611.994920] Lustre: Unmounted lustre-client [11642.267612] Lustre: DEBUG MARKER: == conf-sanity test 73b: Large failnode NID list in mountdata ========================================================== 17:57:54 (1761256674) [11729.667283] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11733.703755] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11750.462456] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11837.537889] Lustre: DEBUG MARKER: == conf-sanity test 73c: Server mount doesn't fail with > 32 nets ========================================================== 18:01:09 (1761256869) [11848.750838] Key type lgssc unregistered [11848.988861] LNet: 302786:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11849.000447] LNetError: 302786:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11849.019603] LNet: Removed LNI 192.168.201.3@tcp [11849.545796] Key type .llcrypt unregistered [11849.547498] Key type ._llcrypt unregistered [11879.240948] Key type ._llcrypt registered [11879.242798] Key type .llcrypt registered [11879.794093] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [11879.830833] alg: No test for adler32 (adler32-zlib) [11881.050973] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [11881.360264] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [11883.079365] Key type lgssc registered [11884.952620] Lustre: Echo OBD driver; http://www.lustre.org/ [11907.187598] Lustre: DEBUG MARKER: SKIP: conf-sanity test_73c unable to configure net [11920.802349] Key type lgssc unregistered [11921.162776] LNet: 304456:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11921.174257] LNetError: 304456:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11921.210796] LNet: Removed LNI 192.168.201.3@tcp [11922.014691] Key type .llcrypt unregistered [11922.020433] Key type ._llcrypt unregistered [11934.125073] Key type ._llcrypt registered [11934.126612] Key type .llcrypt registered [11936.032102] Lustre: DEBUG MARKER: == conf-sanity test 73d: erase + new parameter doesn't corrupt mountdata ========================================================== 18:02:47 (1761256967) [11959.683916] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11959.729167] alg: No test for adler32 (adler32-zlib) [11960.882500] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [11961.084390] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [11962.743255] Key type lgssc registered [11963.999658] Lustre: Echo OBD driver; http://www.lustre.org/ [12013.641663] Lustre: DEBUG MARKER: == conf-sanity test 73e: Mount client with dynamic server NIDs ========================================================== 18:04:06 (1761257046) [12024.271201] Key type lgssc unregistered [12024.505810] LNet: 308012:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12024.523618] LNetError: 308012:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12024.534993] LNet: Removed LNI 192.168.201.3@tcp [12025.104890] Key type .llcrypt unregistered [12025.110570] Key type ._llcrypt unregistered [12036.231723] Key type ._llcrypt registered [12036.233321] Key type .llcrypt registered [12037.033585] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [12037.059144] alg: No test for adler32 (adler32-zlib) [12038.129337] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [12038.327324] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [12039.991189] Key type lgssc registered [12041.376856] Lustre: Echo OBD driver; http://www.lustre.org/ [12095.217232] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12098.237609] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12118.010325] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12127.803414] LNet: Added LNI 192.168.201.3@tcp42 [8/256/0/180] [12129.810701] LNet: Removed LNI 192.168.201.3@tcp [12131.940682] Lustre: 310909:0:(ldlm_lib.c:563:client_obd_setup()) lustre-MDT0000-mdc-ffff994ac4660000: config has no valid NIDs, force dynamic NIDs [12133.108126] Lustre: Mounted lustre-client [12133.202640] LustreError: 310925:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4660000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [12133.238421] LustreError: 310925:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [12133.317001] Lustre: Unmounted lustre-client [12163.845185] Key type lgssc unregistered [12164.226738] LNet: 311762:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12164.238923] LNetError: 311762:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12164.263855] LNet: Removed LNI 192.168.201.3@tcp42 [12164.877655] Key type .llcrypt unregistered [12164.884297] Key type ._llcrypt unregistered [12176.472701] Key type ._llcrypt registered [12176.474191] Key type .llcrypt registered [12177.776065] Lustre: DEBUG MARKER: == conf-sanity test 74: Test per-device adaptive timeout parameters ========================================================== 18:06:50 (1761257210) [12180.200053] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12180.448060] alg: No test for adler32 (adler32-zlib) [12181.554392] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [12181.761396] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [12183.407223] Key type lgssc registered [12185.222503] Lustre: Echo OBD driver; http://www.lustre.org/ [12236.852203] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12240.672337] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12260.132835] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12262.097049] Lustre: Mounted lustre-client [12320.895143] Lustre: Mounted fs15246-client [12336.543413] LustreError: 315904:0:(lov_obd.c:783:lov_cleanup()) fs15246-clilov-ffff994ac673b000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [12336.561908] LustreError: 315904:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [12336.596571] Lustre: Unmounted fs15246-client [12360.449384] LustreError: 316122:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff994ac4482800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [12360.459260] LustreError: 316122:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [12360.467898] LustreError: 316122:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [12360.534234] Lustre: Unmounted lustre-client [12387.854654] Key type lgssc unregistered [12388.175071] LNet: 316525:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12388.195100] LNetError: 316525:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12388.226216] LNet: Removed LNI 192.168.201.3@tcp [12388.959521] Key type .llcrypt unregistered [12388.969352] Key type ._llcrypt unregistered [12401.304408] Key type ._llcrypt registered [12401.306421] Key type .llcrypt registered [12402.737816] Lustre: DEBUG MARKER: == conf-sanity test 75: The order of --index should be irrelevant ========================================================== 18:10:35 (1761257435) [12404.551744] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12404.618891] alg: No test for adler32 (adler32-zlib) [12405.693981] Lustre: Lustre: Build Version: 2.16.59_45_g8a89fa6 [12405.883792] LNet: Added LNI 192.168.201.3@tcp [8/256/0/180] [12407.543277] Key type lgssc registered [12409.017700] Lustre: Echo OBD driver; http://www.lustre.org/ [12524.167531] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12527.657666] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12546.481930] Lustre: DEBUG MARKER: oleg103-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12632.152023] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 12388 sec ========= 18:14:24 (1761257664) [12633.742291] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 18:14:26 (1761257666) === [12636.801348] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 18:14:29 (1761257669) === [12665.602401] Key type lgssc unregistered [12665.870356] LNet: 325683:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12665.877411] LNetError: 325683:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12665.891675] LNet: Removed LNI 192.168.201.3@tcp [12666.482456] Key type .llcrypt unregistered [12666.488992] Key type ._llcrypt unregistered