[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 439935562 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] [ 0.000000] RAMDISK: [mem 0xbcc64000-0xbffcffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F5970 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE1BB7 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE1A53 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 001A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE1AC7 000090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE1B57 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE1B8F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe1a53-0xbffe1ac6] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a52] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe1ac7-0xbffe1b56] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe1b57-0xbffe1b8e] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe1b8f-0xbffe1bb6] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffd9fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4744 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059618 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829700K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.002337] x2apic enabled [ 0.003007] Switched APIC routing to physical x2apic. [ 0.004000] kvm-guest: setup PV IPIs [ 0.004000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.004000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.004027] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.005009] pid_max: default: 32768 minimum: 301 [ 0.007005] LSM: Security Framework initializing [ 0.008040] Yama: becoming mindful. [ 0.009028] SELinux: Initializing. [ 0.009929] *** VALIDATE selinux *** [ 0.017761] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.023453] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.025033] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.026123] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.027124] *** VALIDATE tmpfs *** [ 0.028486] *** VALIDATE proc *** [ 0.029277] *** VALIDATE cgroup *** [ 0.030011] *** VALIDATE cgroup2 *** [ 0.031284] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.033006] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.034010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.035032] Spectre V2 : User space: Vulnerable [ 0.036009] Speculative Store Bypass: Vulnerable [ 0.038735] debug: unmapping init [mem 0xffffffffb5859000-0xffffffffb5860fff] [ 0.040162] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.041721] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.042022] ... version: 2 [ 0.043013] ... bit width: 48 [ 0.044012] ... generic registers: 4 [ 0.045015] ... value mask: 0000ffffffffffff [ 0.046013] ... max period: 00007fffffffffff [ 0.047016] ... fixed-purpose events: 3 [ 0.048011] ... event mask: 000000070000000f [ 0.049309] rcu: Hierarchical SRCU implementation. [ 0.051468] smp: Bringing up secondary CPUs ... [ 0.052615] x86: Booting SMP configuration: [ 0.053024] .... node #0, CPUs: #1 #2 #3 [ 0.056171] smp: Brought up 1 node, 4 CPUs [ 0.058013] smpboot: Max logical packages: 1 [ 0.059019] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.131844] node 0 deferred pages initialised in 70ms [ 0.134392] devtmpfs: initialized [ 0.135227] x86/mm: Memory block size: 128MB [ 0.137688] gcov: version magic: 0x41383552 [ 0.139307] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.140089] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.141245] pinctrl core: initialized pinctrl subsystem [ 0.142174] [ 0.142525] ************************************************************* [ 0.143011] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.144013] ** ** [ 0.145012] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.146015] ** ** [ 0.147014] ** This means that this kernel is built to expose internal ** [ 0.148014] ** IOMMU data structures, which may compromise security on ** [ 0.149013] ** your system. ** [ 0.150015] ** ** [ 0.151016] ** If you see this message and you are not debugging the ** [ 0.152013] ** kernel, report this immediately to your vendor! ** [ 0.153014] ** ** [ 0.154014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.155015] ************************************************************* [ 0.156624] NET: Registered protocol family 16 [ 0.157466] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.158058] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.159064] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.160459] cpuidle: using governor menu [ 0.162853] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.165627] PCI: Using configuration type 1 for base access [ 0.168129] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.176151] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.178052] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.181262] cryptd: max_cpu_qlen set to 1000 [ 0.183244] ACPI: Added _OSI(Module Device) [ 0.185014] ACPI: Added _OSI(Processor Device) [ 0.186011] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.188013] ACPI: Added _OSI(Processor Aggregator Device) [ 0.191979] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.197608] ACPI: Interpreter enabled [ 0.198067] ACPI: PM: (supports S0 S3 S4 S5) [ 0.200011] ACPI: Using IOAPIC for interrupt routing [ 0.201096] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.204385] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.213759] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.216037] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.219021] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.221068] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.227263] acpiphp: Slot [2] registered [ 0.228081] acpiphp: Slot [3] registered [ 0.230097] acpiphp: Slot [4] registered [ 0.231281] acpiphp: Slot [5] registered [ 0.233141] acpiphp: Slot [6] registered [ 0.234101] acpiphp: Slot [7] registered [ 0.235086] acpiphp: Slot [8] registered [ 0.236092] acpiphp: Slot [9] registered [ 0.238091] acpiphp: Slot [10] registered [ 0.239086] acpiphp: Slot [11] registered [ 0.239852] acpiphp: Slot [12] registered [ 0.241106] acpiphp: Slot [13] registered [ 0.242096] acpiphp: Slot [14] registered [ 0.244105] acpiphp: Slot [15] registered [ 0.246100] acpiphp: Slot [16] registered [ 0.248159] acpiphp: Slot [17] registered [ 0.249082] acpiphp: Slot [18] registered [ 0.252158] acpiphp: Slot [19] registered [ 0.253097] acpiphp: Slot [20] registered [ 0.255087] acpiphp: Slot [21] registered [ 0.256080] acpiphp: Slot [22] registered [ 0.257095] acpiphp: Slot [23] registered [ 0.259111] acpiphp: Slot [24] registered [ 0.260118] acpiphp: Slot [25] registered [ 0.262112] acpiphp: Slot [26] registered [ 0.263104] acpiphp: Slot [27] registered [ 0.265113] acpiphp: Slot [28] registered [ 0.267113] acpiphp: Slot [29] registered [ 0.268096] acpiphp: Slot [30] registered [ 0.269104] acpiphp: Slot [31] registered [ 0.271056] PCI host bridge to bus 0000:00 [ 0.272018] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.275023] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.277020] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.280022] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.282023] pci_bus 0000:00: root bus resource [mem 0x180000000-0x1ffffffff window] [ 0.285025] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.287161] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.291252] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.294962] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.302000] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.306389] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.309019] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.310017] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.313017] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.315478] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.318738] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.320038] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.323615] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.326014] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.335912] pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.341014] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.345131] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.355019] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.361018] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.372030] pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.381446] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.386013] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.395034] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.408020] pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.416532] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.419320] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.420383] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.421365] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.423235] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.427314] iommu: Default domain type: Passthrough [ 0.428341] SCSI subsystem initialized [ 0.430214] ACPI: bus type USB registered [ 0.431134] usbcore: registered new interface driver usbfs [ 0.433066] usbcore: registered new interface driver hub [ 0.434111] usbcore: registered new device driver usb [ 0.436117] pps_core: LinuxPPS API ver. 1 registered [ 0.437008] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.440061] PTP clock support registered [ 0.442040] EDAC MC: Ver: 3.0.0 [ 0.444128] PCI: Using ACPI for IRQ routing [ 0.445702] NetLabel: Initializing [ 0.446010] NetLabel: domain hash size = 128 [ 0.448015] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.449078] NetLabel: unlabeled traffic allowed by default [ 0.451188] vgaarb: loaded [ 0.453259] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.455016] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.459329] clocksource: Switched to clocksource kvm-clock [ 0.565159] VFS: Disk quotas dquot_6.6.0 [ 0.566674] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.569181] *** VALIDATE ramfs *** [ 0.570401] *** VALIDATE hugetlbfs *** [ 0.571650] pnp: PnP ACPI init [ 0.573702] pnp: PnP ACPI: found 6 devices [ 0.591133] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.594518] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.596656] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.598984] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.601361] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.603343] pci_bus 0000:00: resource 8 [mem 0x180000000-0x1ffffffff window] [ 0.605540] NET: Registered protocol family 2 [ 0.607904] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.611963] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.615195] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.619714] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.623027] TCP: Hash tables configured (established 65536 bind 65536) [ 0.625636] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.628196] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.630832] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.633466] NET: Registered protocol family 1 [ 0.635605] RPC: Registered named UNIX socket transport module. [ 0.637445] RPC: Registered udp transport module. [ 0.639220] RPC: Registered tcp transport module. [ 0.640633] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.642817] NET: Registered protocol family 44 [ 0.644288] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.646079] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.648080] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.650344] PCI: CLS 0 bytes, default 64 [ 0.651665] Unpacking initramfs... [ 2.033719] debug: unmapping init [mem 0xffff9716bcc64000-0xffff9716bffcffff] [ 2.037414] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.039686] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.042401] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.537851] Initialise system trusted keyrings [ 2.539504] Key type blacklist registered [ 2.541285] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.549885] zbud: loaded [ 2.553061] *** VALIDATE nfs *** [ 2.553877] *** VALIDATE nfs4 *** [ 2.555070] pstore: using deflate compression [ 2.557610] Platform Keyring initialized [ 2.666422] NET: Registered protocol family 38 [ 2.668320] Key type asymmetric registered [ 2.669552] Asymmetric key parser 'x509' registered [ 2.671147] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.675540] io scheduler mq-deadline registered [ 2.677063] io scheduler kyber registered [ 2.678539] io scheduler bfq registered [ 2.680265] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.682886] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.685421] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.687887] ACPI: Power Button [PWRF] [ 2.781924] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.875158] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.968220] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.998828] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.029096] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.034102] Non-volatile memory driver v1.3 [ 3.036117] Linux agpgart interface v0.103 [ 3.063900] virtio_blk virtio1: [vda] 133848 512-byte logical blocks (68.5 MB/65.4 MiB) [ 3.066608] vda: detected capacity change from 0 to 68530176 [ 3.080546] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.082932] vdb: detected capacity change from 0 to 1073741824 [ 3.089126] libphy: Fixed MDIO Bus: probed [ 3.093990] usbcore: registered new interface driver usbserial_generic [ 3.095849] usbserial: USB Serial support registered for generic [ 3.098202] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.103135] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.104778] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.107129] mousedev: PS/2 mouse device common for all mice [ 3.109646] rtc_cmos 00:05: RTC can wake from S4 [ 3.112214] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.115206] rtc_cmos 00:05: registered as rtc0 [ 3.117026] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.120509] intel_pstate: CPU model not supported [ 3.121268] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.126091] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.128032] hid: raw HID events driver (C) Jiri Kosina [ 3.131389] usbcore: registered new interface driver usbhid [ 3.133453] usbhid: USB HID core driver [ 3.134668] drop_monitor: Initializing network drop monitor service [ 3.136761] Initializing XFRM netlink socket [ 3.138852] NET: Registered protocol family 10 [ 3.141654] Segment Routing with IPv6 [ 3.143171] NET: Registered protocol family 17 [ 3.145057] mpls_gso: MPLS GSO support [ 3.151433] RAS: Correctable Errors collector initialized. [ 3.153095] AVX version of gcm_enc/dec engaged. [ 3.154882] AES CTR mode by8 optimization enabled [ 3.223583] sched_clock: Marking stable (3223559456, 0)->(4101596180, -878036724) [ 3.226962] registered taskstats version 1 [ 3.229098] Loading compiled-in X.509 certificates [ 3.230794] zswap: loaded using pool lzo/zbud [ 3.254837] Key type big_key registered [ 3.265654] Key type encrypted registered [ 3.267509] ima: No TPM chip found, activating TPM-bypass! [ 3.269815] ima: Allocated hash algorithm: sha1 [ 3.271827] ima: No architecture policies found [ 3.273816] evm: Initialising EVM extended attributes: [ 3.275930] evm: security.selinux [ 3.277309] evm: security.ima [ 3.278380] evm: security.capability [ 3.279664] evm: HMAC attrs: 0x1 [ 3.281835] rtc_cmos 00:05: setting system clock to 2025-11-17 00:12:57 UTC (1763338377) [ 3.287743] debug: unmapping init [mem 0xffffffffb6803000-0xffffffffb69fffff] [ 3.291273] debug: unmapping init [mem 0xffffffffb5582000-0xffffffffb5858fff] [ 3.304498] Write protecting the kernel read-only data: 28672k [ 3.307583] debug: unmapping init [mem 0xffffffffb3c03000-0xffffffffb3dfffff] [ 3.309786] debug: unmapping init [mem 0xffffffffb4514000-0xffffffffb45fffff] [ 3.341048] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.348762] systemd[1]: Detected virtualization kvm. [ 3.350755] systemd[1]: Detected architecture x86-64. [ 3.352596] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.378161] systemd[1]: No hostname configured. [ 3.379632] systemd[1]: Set hostname to . [ 3.381543] random: systemd: uninitialized urandom read (16 bytes read) [ 3.383204] systemd[1]: Initializing machine ID from random generator. [ 3.416205] random: ln: uninitialized urandom read (6 bytes read) [ 3.506366] random: systemd: uninitialized urandom read (16 bytes read) [ 3.508927] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 3.513611] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 3.517476] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Kernel Socket. Starting Setup Virtual Console... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Local File Systems. [ OK ] Reached target Timers. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Started Memstrack Anylazing Service. Starting Create Volatile Files and Directories... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... Starting Apply Kernel Variables... [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.166347] device-mapper: uevent: version 1.0.3 [ 4.168758] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 4.966096] random: fast init done [ 4.982707] virtio_net virtio0 ens2: renamed from eth0 [ 5.025800] scsi host0: ata_piix [ 5.066219] scsi host1: ata_piix [ 5.068248] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 5.071080] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 8.788290] dracut-initqueue[582]: RTNETLINK answers: File exists [ 9.784769] random: crng init done [ 9.786137] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 10.280908] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Timers. [ OK ] Stopped dracut initqueue hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.415509] printk: systemd: 26 output lines suppressed due to ratelimiting [ 11.674151] SELinux: Disabled at runtime. [ 11.734627] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 11.743521] systemd[1]: Detected virtualization kvm. [ 11.747277] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.264544] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.268076] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.273313] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.277271] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.280881] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.288425] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.297051] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. Starting Apply Kernel Variables... [ OK ] Listening on udev Control Socket. [ OK ] Reached target rpc_pipefs.target. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Listening on Process Core Dump Socket. Starting udev Coldplug all Devices... Starting Remount Root and Kernel File Systems... Mounting Huge Pages File System... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice system-getty.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target Paths. Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ 12.442270] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Huge Pages File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 12.688647] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 12.966366] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 12.967386] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.066745] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.092360] EDAC sbridge: Ver: 1.1.2 [ 14.203369] Key type dns_resolver registered [ 14.500970] NFS: Registering the id_resolver key type [ 14.502943] Key type id_resolver registered [ 14.504052] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started dnf makecache --timer. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Login Service... Starting Restore /run/initramfs on shutdown... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting System Logging Service... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Authorization Manager. [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg216-client login: [ 43.705621] libcfs: loading out-of-tree module taints kernel. [ 43.720816] Key type ._llcrypt registered [ 43.722418] Key type .llcrypt registered [ 44.014422] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 44.022434] alg: No test for adler32 (adler32-zlib) [ 45.051719] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 45.396125] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 47.023183] Key type lgssc registered [ 47.730205] Lustre: Echo OBD driver; http://www.lustre.org/ [ 152.290025] hrtimer: interrupt took 6015378 ns [ 185.451990] Lustre: Mounted lustre-client [ 189.873442] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 203.502740] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing check_logdir /tmp/testlogs/ [ 207.909614] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing yml_node [ 210.913448] Lustre: lustre-OST0000-osc-ffff97170a8ad000: disconnect after 24s idle [ 211.474477] Lustre: DEBUG MARKER: Client: 2.16.61.50 [ 213.581282] Lustre: DEBUG MARKER: MDS: 2.16.61.50 [ 215.537894] Lustre: DEBUG MARKER: OSS: 2.16.61.50 [ 216.829671] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Sun Nov 16 19:16:29 EST 2025 [ 232.134558] Lustre: DEBUG MARKER: excepting tests: 55 63 67 32newtarball [ 233.394227] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 235.129841] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 245.422948] LustreError: 8991:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 245.466126] Lustre: Unmounted lustre-client [ 341.913341] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 345.455152] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 366.709946] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 407.185866] Lustre: DEBUG MARKER: == conf-sanity test 33a: Mount ost with a large index number ========================================================== 19:19:40 (1763338780) [ 408.703514] Lustre: DEBUG MARKER: SKIP: conf-sanity test_33a mixed loopback and real device not working [ 409.828330] Lustre: DEBUG MARKER: == conf-sanity test 33b: Drop cancel during umount ======= 19:19:43 (1763338783) [ 433.994857] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 436.312976] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 451.146682] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 461.883341] Lustre: Mounted lustre-client [ 465.347632] LustreError: 14441:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709d6b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 465.371260] LustreError: 14441:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 465.377205] LustreError: 14441:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 465.456890] Lustre: Unmounted lustre-client [ 490.376904] Key type lgssc unregistered [ 490.606308] LNet: 14848:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 490.611424] LNetError: 14848:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 491.625697] LNet: Removed LNI 192.168.202.16@tcp [ 492.228305] Key type .llcrypt unregistered [ 492.230133] Key type ._llcrypt unregistered [ 504.892948] Key type ._llcrypt registered [ 504.894632] Key type .llcrypt registered [ 505.870187] Lustre: DEBUG MARKER: == conf-sanity test 33c: Mount ost with a large index number ========================================================== 19:21:19 (1763338879) [ 506.957944] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 507.074637] alg: No test for adler32 (adler32-zlib) [ 508.167849] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 508.319910] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 509.959214] Key type lgssc registered [ 511.083857] Lustre: Echo OBD driver; http://www.lustre.org/ [ 575.508432] Lustre: Mounted lustre-client [ 662.124043] LustreError: 18174:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971718841800: lov tgt 1990 not cleaned! deathrow=0, lovrc=1 [ 662.144368] LustreError: 18174:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 662.175915] Lustre: Unmounted lustre-client [ 697.882630] Key type lgssc unregistered [ 698.178933] LNet: 18638:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 698.195391] LNetError: 18638:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 698.213985] LNet: Removed LNI 192.168.202.16@tcp [ 698.993573] Key type .llcrypt unregistered [ 698.994867] Key type ._llcrypt unregistered [ 708.104374] Key type ._llcrypt registered [ 708.107201] Key type .llcrypt registered [ 709.199980] Lustre: DEBUG MARKER: == conf-sanity test 33d: Don't panic when enable project quota ========================================================== 19:24:42 (1763339082) [ 711.555782] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 711.590242] alg: No test for adler32 (adler32-zlib) [ 712.605404] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 712.797547] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 714.487393] Key type lgssc registered [ 715.666575] Lustre: Echo OBD driver; http://www.lustre.org/ [ 756.012926] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 759.285168] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 774.896520] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 786.001499] Lustre: Mounted lustre-client [ 796.717638] LustreError: 21747:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709787000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 796.737753] LustreError: 21747:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 796.808853] Lustre: Unmounted lustre-client [ 825.332623] Key type lgssc unregistered [ 825.582072] LNet: 22149:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 825.591214] LNetError: 22149:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 826.598330] LNet: Removed LNI 192.168.202.16@tcp [ 827.344132] Key type .llcrypt unregistered [ 827.361731] Key type ._llcrypt unregistered [ 836.769119] Key type ._llcrypt registered [ 836.770596] Key type .llcrypt registered [ 837.952325] Lustre: DEBUG MARKER: == conf-sanity test 34a: umount with opened file should be fail ========================================================== 19:26:50 (1763339210) [ 840.501926] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 840.533553] alg: No test for adler32 (adler32-zlib) [ 841.558099] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 841.769211] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 843.431244] Key type lgssc registered [ 844.670074] Lustre: Echo OBD driver; http://www.lustre.org/ [ 885.948975] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 889.550939] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 906.902874] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 913.455551] Lustre: Mounted lustre-client [ 918.720817] LustreError: 24851:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717053f6800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 918.745098] LustreError: 24851:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 918.786564] Lustre: Unmounted lustre-client [ 947.341458] Key type lgssc unregistered [ 947.651613] LNet: 25252:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 947.657869] LNetError: 25252:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 947.670713] LNet: Removed LNI 192.168.202.16@tcp [ 948.370345] Key type .llcrypt unregistered [ 948.374425] Key type ._llcrypt unregistered [ 965.585225] Key type ._llcrypt registered [ 965.586955] Key type .llcrypt registered [ 966.875326] Lustre: DEBUG MARKER: == conf-sanity test 34b: force umount with failed mds should be normal ========================================================== 19:28:59 (1763339339) [ 969.181422] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 969.216870] alg: No test for adler32 (adler32-zlib) [ 970.330277] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 970.589784] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 972.303179] Key type lgssc registered [ 973.402468] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1019.761420] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1023.444930] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1041.875892] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1043.538265] Lustre: Mounted lustre-client [ 1048.573213] Lustre: lustre-MDT0000-mdc-ffff971702da5800: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1069.044448] Lustre: lustre-MDT0001-mdc-ffff971702da5800: Connection to lustre-MDT0001 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1080.289044] Lustre: 26211:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763339438/real 1763339438] req@000000001d51e1de x1848995315980672/t0(0) o400->MGC192.168.202.116@tcp@192.168.202.116@tcp:26/25 lens 224/224 e 0 to 1 dl 1763339454 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1080.320848] LustreError: MGC192.168.202.116@tcp: Connection to MGS (at 192.168.202.116@tcp) was lost; in progress operations using this service will fail [ 1082.406195] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 1092.730818] LustreError: 28431:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1092.749954] Lustre: Unmounted lustre-client [ 1106.161881] Key type lgssc unregistered [ 1106.423169] LNet: 28821:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1106.432308] LNetError: 28821:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1106.457274] LNet: Removed LNI 192.168.202.16@tcp [ 1107.261196] Key type .llcrypt unregistered [ 1107.268525] Key type ._llcrypt unregistered [ 1123.793453] Key type ._llcrypt registered [ 1123.795104] Key type .llcrypt registered [ 1125.212848] Lustre: DEBUG MARKER: == conf-sanity test 34c: force umount with failed ost should be normal ========================================================== 19:31:37 (1763339497) [ 1127.595518] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1127.611813] alg: No test for adler32 (adler32-zlib) [ 1128.707384] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 1128.907942] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 1130.591129] Key type lgssc registered [ 1131.702534] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1172.580102] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1175.924579] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1193.922250] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1201.198947] Lustre: Mounted lustre-client [ 1206.257291] Lustre: lustre-OST0000-osc-ffff971705aa3800: Connection to lustre-OST0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1213.110575] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 1223.412765] LustreError: 31938:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1223.447426] Lustre: Unmounted lustre-client [ 1249.718816] Key type lgssc unregistered [ 1250.085619] LNet: 32339:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1250.093582] LNetError: 32339:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1250.130984] LNet: Removed LNI 192.168.202.16@tcp [ 1250.858986] Key type .llcrypt unregistered [ 1250.860727] Key type ._llcrypt unregistered [ 1264.266102] Key type ._llcrypt registered [ 1264.267719] Key type .llcrypt registered [ 1265.316605] Lustre: DEBUG MARKER: == conf-sanity test 35a: Reconnect to the last active server first ========================================================== 19:33:58 (1763339638) [ 1267.097323] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1267.105328] alg: No test for adler32 (adler32-zlib) [ 1268.136172] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 1268.338126] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 1270.049223] Key type lgssc registered [ 1271.017497] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1314.613076] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1318.814824] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1337.802458] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1339.603223] Lustre: Mounted lustre-client [ 1343.483566] Lustre: DEBUG MARKER: Set up a fake failnode for the MDS [ 1346.839237] Lustre: DEBUG MARKER: Wait for RECONNECT_INTERVAL seconds (10s) [ 1358.270612] Lustre: DEBUG MARKER: conf-sanity.sh test_35a 2025-11-1619h35m31s [ 1360.521409] Lustre: DEBUG MARKER: Stopping the MDT: lustre-MDT0000 [ 1365.481336] Lustre: lustre-MDT0000-mdc-ffff9717076a5800: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1370.762290] LustreError: 36034:0:(lmv_obd.c:1435:lmv_statfs()) lustre-MDT0000-mdc-ffff9717076a5800: can't stat MDS #0: rc = -19 [ 1372.932984] Lustre: DEBUG MARKER: Restarting the MDT: lustre-MDT0000 [ 1382.884717] LustreError: MGC192.168.202.116@tcp: Connection to MGS (at 192.168.202.116@tcp) was lost; in progress operations using this service will fail [ 1382.904685] Lustre: Evicted from MGS (at 192.168.202.116@tcp) after server handle changed from 0x4d1334835d521685 to 0x4d1334835d52193a [ 1382.920842] Lustre: MGC192.168.202.116@tcp: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 1383.984841] LustreError: lustre-MDT0000-mdc-ffff9717076a5800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 1384.003281] Lustre: lustre-MDT0000-mdc-ffff9717076a5800: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 1389.399560] Lustre: DEBUG MARKER: Wait for df (36034) ... [ 1391.144297] Lustre: DEBUG MARKER: done [ 1392.577084] LustreError: 36646:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717076a5800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1392.597675] LustreError: 36646:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1392.703610] Lustre: Unmounted lustre-client [ 1422.443508] Key type lgssc unregistered [ 1422.802905] LNet: 37049:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1422.815925] LNetError: 37049:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1422.846935] LNet: Removed LNI 192.168.202.16@tcp [ 1423.481916] Key type .llcrypt unregistered [ 1423.484491] Key type ._llcrypt unregistered [ 1470.259191] Key type ._llcrypt registered [ 1470.260667] Key type .llcrypt registered [ 1470.774198] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 1470.794240] alg: No test for adler32 (adler32-zlib) [ 1472.032755] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 1472.298231] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 1474.024836] Key type lgssc registered [ 1475.662393] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1563.463343] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1567.725606] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1588.788780] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1638.602849] Lustre: DEBUG MARKER: == conf-sanity test 35b: Continue reconnection retries, if the active server is busy ========================================================== 19:40:11 (1763340011) [ 1666.806438] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1670.098482] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1688.026106] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1693.714575] Lustre: Mounted lustre-client [ 1697.184238] Lustre: DEBUG MARKER: conf-sanity.sh test_35b 2025-11-1619h41m10s [ 1698.357955] Lustre: DEBUG MARKER: Set up a fake failnode for the MDS [ 1704.036628] Lustre: DEBUG MARKER: Injecting EBUSY on MDS [ 1706.029546] Lustre: DEBUG MARKER: Creating a test file and stat it [ 1726.431183] Lustre: 43929:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763340080/real 1763340080] req@00000000180c5d5b x1848995842365696/t0(0) o101->lustre-MDT0000-mdc-ffff971706e11000@192.168.202.116@tcp:12/10 lens 576/1152 e 0 to 1 dl 1763340100 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1726.445827] Lustre: lustre-MDT0000-mdc-ffff971706e11000: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1726.479532] Lustre: lustre-MDT0000-mdc-ffff971706e11000: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 1747.752249] Lustre: DEBUG MARKER: Stop injecting EBUSY on MDS [ 1750.935769] Lustre: DEBUG MARKER: done [ 1754.933179] LustreError: 44402:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971706e11000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1754.956884] LustreError: 44402:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1755.018328] Lustre: Unmounted lustre-client [ 1790.380851] Key type lgssc unregistered [ 1790.692813] LNet: 44804:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1790.699100] LNetError: 44804:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1790.727291] LNet: Removed LNI 192.168.202.16@tcp [ 1791.346492] Key type .llcrypt unregistered [ 1791.356907] Key type ._llcrypt unregistered [ 1829.807073] Key type ._llcrypt registered [ 1829.808654] Key type .llcrypt registered [ 1830.209581] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 1830.268368] alg: No test for adler32 (adler32-zlib) [ 1831.397105] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 1831.768635] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 1833.455208] Key type lgssc registered [ 1834.597735] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1910.096426] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1914.045196] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1933.791829] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1989.146626] Lustre: DEBUG MARKER: == conf-sanity test 36: df report consistency on OSTs with different block size ========================================================== 19:46:01 (1763340361) [ 1990.685150] Lustre: DEBUG MARKER: SKIP: conf-sanity test_36 remote OST [ 1992.471175] Lustre: DEBUG MARKER: == conf-sanity test 37: verify set tunables works for symlink device ========================================================== 19:46:05 (1763340365) [ 2015.274794] Lustre: DEBUG MARKER: == conf-sanity test 38: MDS recreates missing lov_objid file from OST data ========================================================== 19:46:28 (1763340388) [ 2041.747470] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2045.701395] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2063.795543] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2069.565717] Lustre: Mounted lustre-client [ 2073.089090] Lustre: DEBUG MARKER: copying 10 files to /mnt/lustre/d38.conf-sanity [ 2076.541599] LustreError: 52642:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971718841000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2076.568469] LustreError: 52642:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2076.639474] Lustre: Unmounted lustre-client [ 2093.866996] Lustre: DEBUG MARKER: delete lov_objid file on MDS [ 2137.228560] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2140.465159] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2141.148933] Lustre: Mounted lustre-client [ 2144.211302] LustreError: 53902:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709615000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2144.249709] LustreError: 53902:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2144.252392] LustreError: 53902:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2144.315089] Lustre: Unmounted lustre-client [ 2201.673938] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2205.425793] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2206.313400] Lustre: Mounted lustre-client [ 2210.587460] LustreError: 55023:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709785000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2210.626115] LustreError: 55023:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2210.638766] LustreError: 55023:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2210.745047] Lustre: Unmounted lustre-client [ 2233.270821] Lustre: DEBUG MARKER: files compared the same [ 2255.637440] Key type lgssc unregistered [ 2255.922724] LNet: 55728:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2255.934274] LNetError: 55728:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2257.000253] LNet: Removed LNI 192.168.202.16@tcp [ 2257.607377] Key type .llcrypt unregistered [ 2257.609116] Key type ._llcrypt unregistered [ 2270.245259] Key type ._llcrypt registered [ 2270.247066] Key type .llcrypt registered [ 2271.239485] Lustre: DEBUG MARKER: == conf-sanity test 39: leak_finder recognizes both LUSTRE and LNET malloc messages ========================================================== 19:50:44 (1763340644) [ 2273.341246] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2273.365646] alg: No test for adler32 (adler32-zlib) [ 2274.446157] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 2274.684041] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 2276.351961] Key type lgssc registered [ 2277.496477] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2319.983622] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2323.483640] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2340.335908] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2346.023560] Lustre: Mounted lustre-client [ 2348.609754] LustreError: 58821:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971705a49800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2348.633458] LustreError: 58821:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2348.705749] Lustre: Unmounted lustre-client [ 2375.340739] Key type lgssc unregistered [ 2375.650170] LNet: 59223:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2375.663534] LNetError: 59223:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2376.754878] LNet: Removed LNI 192.168.202.16@tcp [ 2377.571685] Key type .llcrypt unregistered [ 2377.573449] Key type ._llcrypt unregistered [ 2391.441655] Key type ._llcrypt registered [ 2391.443948] Key type .llcrypt registered [ 2392.673513] Lustre: DEBUG MARKER: == conf-sanity test 40: race during service thread startup ========================================================== 19:52:45 (1763340765) [ 2394.816069] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2394.975865] alg: No test for adler32 (adler32-zlib) [ 2396.033525] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 2396.346520] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 2398.055164] Key type lgssc registered [ 2399.362589] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2478.127347] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2505.980705] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2509.808548] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2536.426878] Key type lgssc unregistered [ 2536.650735] LNet: 62616:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2536.661664] LNetError: 62616:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2536.674516] LNet: Removed LNI 192.168.202.16@tcp [ 2537.231802] Key type .llcrypt unregistered [ 2537.233437] Key type ._llcrypt unregistered [ 2551.149079] Key type ._llcrypt registered [ 2551.150583] Key type .llcrypt registered [ 2552.545333] Lustre: DEBUG MARKER: == conf-sanity test 41a: mount mds with --nosvc and --nomgs ========================================================== 19:55:25 (1763340925) [ 2556.676182] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2556.770102] alg: No test for adler32 (adler32-zlib) [ 2558.032989] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 2558.303968] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 2560.007206] Key type lgssc registered [ 2561.221701] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2627.453657] Lustre: Mounted lustre-client [ 2633.988698] LustreError: 65101:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717076a2000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2634.011967] LustreError: 65101:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2634.075596] Lustre: Unmounted lustre-client [ 2675.971128] Lustre: DEBUG MARKER: == conf-sanity test 41b: mount mds with --nosvc and --nomgs on first mount ========================================================== 19:57:28 (1763341048) [ 2777.442228] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2795.030446] Lustre: Mounted lustre-client [ 2801.111423] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 2801.117908] LustreError: 69061:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff971705a4c000: inode [0x200000402:0x1:0x0] mdc close failed: rc = -108 [ 2801.132925] Lustre: 63596:0:(llite_lib.c:4226:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.116@tcp:/lustre/fid: [0x200000402:0x1:0x0]/ may get corrupted (rc -108) [ 2811.444611] LustreError: 69061:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 2811.448288] LustreError: 69061:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2811.486168] Lustre: Unmounted lustre-client [ 2862.984868] Lustre: DEBUG MARKER: == conf-sanity test 41c: concurrent mounts of MDT/OST should all fail but one ========================================================== 20:00:35 (1763341235) [ 2872.578705] Key type lgssc unregistered [ 2872.817392] LNet: 70274:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2872.834362] LNetError: 70274:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2873.896365] LNet: Removed LNI 192.168.202.16@tcp [ 2874.467269] Key type .llcrypt unregistered [ 2874.468896] Key type ._llcrypt unregistered [ 2881.859655] Key type ._llcrypt registered [ 2881.863078] Key type .llcrypt registered [ 2882.241327] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2882.256432] alg: No test for adler32 (adler32-zlib) [ 2883.317706] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 2883.528190] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 2885.207547] Key type lgssc registered [ 2886.389144] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2926.159908] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2929.507226] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2946.123960] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2957.370983] Lustre: Mounted lustre-client [ 2960.454620] LustreError: 72805:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717046b6800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2960.481156] LustreError: 72805:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 2960.533904] Lustre: Unmounted lustre-client [ 2985.863381] Key type lgssc unregistered [ 2986.111607] LNet: 73207:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2986.116755] LNetError: 73207:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2986.139074] LNet: Removed LNI 192.168.202.16@tcp [ 2986.674968] Key type .llcrypt unregistered [ 2986.677374] Key type ._llcrypt unregistered [ 2994.257802] Key type ._llcrypt registered [ 2994.264711] Key type .llcrypt registered [ 2994.616412] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2994.627803] alg: No test for adler32 (adler32-zlib) [ 2995.645806] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 2995.866937] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 2997.535702] Key type lgssc registered [ 2998.807167] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3081.703021] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3084.712846] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3101.559809] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3112.552738] Lustre: Mounted lustre-client [ 3114.463513] LustreError: 76149:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971702da6000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3114.486900] LustreError: 76149:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3114.548327] Lustre: Unmounted lustre-client [ 3138.974309] Key type lgssc unregistered [ 3139.205867] LNet: 76551:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3139.213428] LNetError: 76551:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3139.228973] LNet: Removed LNI 192.168.202.16@tcp [ 3139.784805] Key type .llcrypt unregistered [ 3139.789358] Key type ._llcrypt unregistered [ 3151.486825] Key type ._llcrypt registered [ 3151.488309] Key type .llcrypt registered [ 3152.457451] Lustre: DEBUG MARKER: == conf-sanity test 42: allow client/server mount/unmount with invalid config param ========================================================== 20:05:25 (1763341525) [ 3153.876646] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3153.894530] alg: No test for adler32 (adler32-zlib) [ 3154.899363] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 3155.100419] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 3156.783251] Key type lgssc registered [ 3157.716596] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3191.652155] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3194.537321] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3208.372941] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3210.126907] Lustre: Mounted lustre-client [ 3218.109119] LustreError: 79670:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971707538000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3218.131761] LustreError: 79670:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3218.181698] Lustre: Unmounted lustre-client [ 3218.656815] Lustre: Mounted lustre-client [ 3220.929139] LustreError: 79747:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971702da6000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3220.963509] LustreError: 79747:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3220.968146] LustreError: 79747:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3221.033560] Lustre: Unmounted lustre-client [ 3248.199948] Key type lgssc unregistered [ 3248.481666] LNet: 80150:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3248.487611] LNetError: 80150:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3248.504601] LNet: Removed LNI 192.168.202.16@tcp [ 3249.081421] Key type .llcrypt unregistered [ 3249.083775] Key type ._llcrypt unregistered [ 3258.926854] Key type ._llcrypt registered [ 3258.928518] Key type .llcrypt registered [ 3259.462793] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 3259.484061] alg: No test for adler32 (adler32-zlib) [ 3260.657264] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 3260.959687] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 3262.712693] Key type lgssc registered [ 3263.980520] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3305.459806] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3308.983044] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3329.050640] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3335.226909] Lustre: Mounted lustre-client [ 3339.662623] LustreError: 82705:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971705c3e000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3339.682365] LustreError: 82705:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3339.751727] Lustre: Unmounted lustre-client [ 3374.636282] Key type lgssc unregistered [ 3374.840983] LNet: 83108:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3374.851158] LNetError: 83108:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3374.865941] LNet: Removed LNI 192.168.202.16@tcp [ 3375.474431] Key type .llcrypt unregistered [ 3375.479326] Key type ._llcrypt unregistered [ 3387.144556] Key type ._llcrypt registered [ 3387.145828] Key type .llcrypt registered [ 3388.116790] Lustre: DEBUG MARKER: == conf-sanity test 43a: check root_squash and nosquash_nids ========================================================== 20:09:21 (1763341761) [ 3389.701581] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3389.718351] alg: No test for adler32 (adler32-zlib) [ 3390.753835] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 3390.947499] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 3392.617343] Key type lgssc registered [ 3393.674927] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3434.820919] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3438.281809] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3453.065068] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3460.154302] Lustre: Mounted lustre-client [ 3466.872664] Lustre: lustre: root_squash is set to 0:0 [ 3474.481930] Lustre: lustre: nosquash_nids is cleared [ 3474.497904] Lustre: lustre: root_squash is set to 500:500 [ 3482.444773] Lustre: lustre: nosquash_nids set to 2@gni 0@lo 192.168.202.16@tcp 192.168.0.[2,10]@tcp [ 3489.377803] Lustre: lustre: nosquash_nids set to 192.168.202.16/24@tcp [ 3492.246828] LustreError: 86538:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971719531800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3492.263185] LustreError: 86538:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3492.325241] Lustre: Unmounted lustre-client [ 3513.301805] Key type lgssc unregistered [ 3513.557168] LNet: 86939:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3513.562288] LNetError: 86939:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3513.579494] LNet: Removed LNI 192.168.202.16@tcp [ 3514.387503] Key type .llcrypt unregistered [ 3514.389263] Key type ._llcrypt unregistered [ 3527.186676] Key type ._llcrypt registered [ 3527.189433] Key type .llcrypt registered [ 3528.375111] Lustre: DEBUG MARKER: == conf-sanity test 43b: parse nosquash_nids with commas in expr_list ========================================================== 20:11:41 (1763341901) [ 3530.727416] Lustre: DEBUG MARKER: SKIP: conf-sanity test_43b mixed loopback and real device not working [ 3532.812978] Lustre: DEBUG MARKER: == conf-sanity test 44: mounted client proc entry exists ========================================================== 20:11:45 (1763341905) [ 3534.939309] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3535.073479] alg: No test for adler32 (adler32-zlib) [ 3536.110882] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 3536.301587] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 3537.984492] Key type lgssc registered [ 3538.973663] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3584.041452] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3588.495929] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3609.500500] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3610.264505] Lustre: lustre: root_squash is set to 500:500 [ 3610.311713] Lustre: lustre: nosquash_nids set to 192.168.202.16/24@tcp [ 3611.435902] Lustre: Mounted lustre-client [ 3616.983092] LustreError: 90405:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971705a4f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3617.022923] LustreError: 90405:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 3617.078277] Lustre: Unmounted lustre-client [ 3651.947299] Key type lgssc unregistered [ 3652.217660] LNet: 90808:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3652.222422] LNetError: 90808:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3652.238144] LNet: Removed LNI 192.168.202.16@tcp [ 3652.821813] Key type .llcrypt unregistered [ 3652.825813] Key type ._llcrypt unregistered [ 3666.662685] Key type ._llcrypt registered [ 3666.664442] Key type .llcrypt registered [ 3667.797481] Lustre: DEBUG MARKER: SKIP: conf-sanity test_45 skipping SLOW test 45 [ 3669.365536] Lustre: DEBUG MARKER: == conf-sanity test 46a: handle ost additional - wide striped file ========================================================== 20:14:02 (1763342042) [ 3686.748252] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3686.910397] alg: No test for adler32 (adler32-zlib) [ 3687.960441] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 3688.151677] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 3689.823153] Key type lgssc registered [ 3690.933838] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3763.686567] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3767.167924] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3787.268306] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3856.351618] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3859.783404] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3876.582232] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3887.708276] Lustre: Mounted lustre-client [ 3914.197690] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff971709615000.ost_server_uuid 50 [ 3915.719886] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff971709615000.ost_server_uuid in FULL state after 0 sec [ 3916.098136] Lustre: Mounted lustre-client [ 3918.794339] LustreError: 97710:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170791f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3918.821618] LustreError: 97710:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 3918.911861] Lustre: Unmounted lustre-client [ 3920.085427] LustreError: 97729:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709615000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3920.100405] LustreError: 97729:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 3920.114892] LustreError: 97729:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 3920.118171] LustreError: 97729:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3920.178415] Lustre: Unmounted lustre-client [ 3970.407880] Key type lgssc unregistered [ 3970.787593] LNet: 98281:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3970.800515] LNetError: 98281:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3970.825431] LNet: Removed LNI 192.168.202.16@tcp [ 3971.511667] Key type .llcrypt unregistered [ 3971.513529] Key type ._llcrypt unregistered [ 4007.272629] Key type ._llcrypt registered [ 4007.274806] Key type .llcrypt registered [ 4007.608563] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 4007.628902] alg: No test for adler32 (adler32-zlib) [ 4008.606307] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 4008.780463] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 4010.431438] Key type lgssc registered [ 4011.553779] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4095.387736] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4099.514987] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4122.352836] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4171.131434] Lustre: DEBUG MARKER: == conf-sanity test 47a: server restart does not lose lru_resize ========================================================== 20:22:24 (1763342544) [ 4256.061085] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4259.845394] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4280.431343] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4282.202850] Lustre: Mounted lustre-client [ 4302.793448] Lustre: 99067:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763342661/real 1763342661] req@00000000e0438527 x1848998501553280/t0(0) o400->lustre-OST0000-osc-ffff97171a6df800@192.168.202.116@tcp:28/4 lens 224/224 e 0 to 1 dl 1763342677 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4302.824588] Lustre: lustre-OST0000-osc-ffff97171a6df800: Connection to lustre-OST0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4307.999438] Lustre: 99067:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763342666/real 1763342666] req@00000000ba647ef6 x1848998501553792/t0(0) o400->lustre-OST0000-osc-ffff97171a6df800@192.168.202.116@tcp:28/4 lens 224/224 e 0 to 1 dl 1763342682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4313.058162] Lustre: 99066:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763342671/real 1763342671] req@000000000e451ffe x1848998501554304/t0(0) o400->lustre-OST0000-osc-ffff97171a6df800@192.168.202.116@tcp:28/4 lens 224/224 e 0 to 1 dl 1763342687 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4313.068528] Lustre: lustre-MDT0000-mdc-ffff97171a6df800: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4329.439375] Lustre: 99068:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763342687/real 1763342687] req@00000000ba647ef6 x1848998501555840/t0(0) o400->MGC192.168.202.116@tcp@192.168.202.116@tcp:26/25 lens 224/224 e 0 to 1 dl 1763342703 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4329.506359] LustreError: MGC192.168.202.116@tcp: Connection to MGS (at 192.168.202.116@tcp) was lost; in progress operations using this service will fail [ 4339.706123] Lustre: Evicted from MGS (at 192.168.202.116@tcp) after server handle changed from 0xb8749d70be8942a1 to 0xb8749d70be894510 [ 4339.713883] Lustre: MGC192.168.202.116@tcp: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 4344.701840] Lustre: lustre-MDT0000-mdc-ffff97171a6df800: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 4350.993700] LustreError: 106944:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97171a6df800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 4351.050608] LustreError: 106944:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4351.116790] Lustre: Unmounted lustre-client [ 4378.895376] Key type lgssc unregistered [ 4379.193856] LNet: 107346:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4379.205813] LNetError: 107346:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4379.232940] LNet: Removed LNI 192.168.202.16@tcp [ 4379.969907] Key type .llcrypt unregistered [ 4379.977153] Key type ._llcrypt unregistered [ 4393.621419] Key type ._llcrypt registered [ 4393.622937] Key type .llcrypt registered [ 4394.934214] Lustre: DEBUG MARKER: == conf-sanity test 47b: client restart does not lose lru_resize ========================================================== 20:26:07 (1763342767) [ 4409.756770] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4409.802718] alg: No test for adler32 (adler32-zlib) [ 4411.041376] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 4411.321116] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 4413.071241] Key type lgssc registered [ 4414.328335] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4449.019972] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4542.767391] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4546.611654] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4570.601470] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4572.581649] Lustre: Mounted lustre-client [ 4574.867514] Lustre: DEBUG MARKER: SKIP: conf-sanity test_47b Can not create symlink /usr/sbin/lctl [ 4576.697996] Lustre: DEBUG MARKER: == conf-sanity test 48: too many acls on file ============ 20:29:09 (1763342949) [ 4800.470082] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 4810.735445] LustreError: 118120:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 4810.821664] Lustre: Unmounted lustre-client [ 4919.095542] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4923.007103] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4943.363078] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4981.748737] Lustre: DEBUG MARKER: == conf-sanity test 49a: check PARAM_SYS_LDLM_TIMEOUT option of mkfs.lustre ========================================================== 20:35:54 (1763343354) [ 5062.526513] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5065.870819] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5083.763413] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5084.257821] Lustre: Mounted lustre-client [ 5087.114635] LustreError: 125531:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971705c77800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5087.149804] LustreError: 125531:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 5087.153271] LustreError: 125531:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 5087.228262] Lustre: Unmounted lustre-client [ 5118.452610] Lustre: DEBUG MARKER: == conf-sanity test 49b: check PARAM_SYS_LDLM_TIMEOUT option of mkfs.lustre ========================================================== 20:38:11 (1763343491) [ 5191.788390] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5195.741891] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5215.733099] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5216.285733] Lustre: Mounted lustre-client [ 5219.613900] LustreError: 129579:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971705a0a800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5219.631322] LustreError: 129579:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 5219.634575] LustreError: 129579:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 5219.683824] Lustre: Unmounted lustre-client [ 5241.381365] Key type lgssc unregistered [ 5241.626809] LNet: 129981:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5241.636950] LNetError: 129981:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5241.663383] LNet: Removed LNI 192.168.202.16@tcp [ 5242.477655] Key type .llcrypt unregistered [ 5242.480493] Key type ._llcrypt unregistered [ 5257.310681] Key type ._llcrypt registered [ 5257.315845] Key type .llcrypt registered [ 5258.473214] Lustre: DEBUG MARKER: == conf-sanity test 50a: lazystatfs all servers available ========================================================== 20:40:31 (1763343631) [ 5260.554516] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5260.573116] alg: No test for adler32 (adler32-zlib) [ 5261.632279] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 5261.885871] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 5263.551159] Key type lgssc registered [ 5264.562466] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5309.579299] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5312.941520] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5330.458990] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5337.130375] Lustre: Mounted lustre-client [ 5349.120967] LustreError: 133084:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717077fd000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5349.138849] LustreError: 133084:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 5349.209089] Lustre: Unmounted lustre-client [ 5377.856582] Key type lgssc unregistered [ 5378.115078] LNet: 133484:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5378.120522] LNetError: 133484:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5378.135188] LNet: Removed LNI 192.168.202.16@tcp [ 5378.818264] Key type .llcrypt unregistered [ 5378.825384] Key type ._llcrypt unregistered [ 5396.200055] Key type ._llcrypt registered [ 5396.210522] Key type .llcrypt registered [ 5398.610624] Lustre: DEBUG MARKER: == conf-sanity test 50b: lazystatfs all servers down ===== 20:42:50 (1763343770) [ 5401.771189] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5401.803985] alg: No test for adler32 (adler32-zlib) [ 5402.998712] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 5403.273271] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 5405.023938] Key type lgssc registered [ 5406.727407] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5458.973819] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5463.555393] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5483.802917] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5486.685658] Lustre: Mounted lustre-client [ 5491.688495] Lustre: lustre-OST0000-osc-ffff9717077f8800: Connection to lustre-OST0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5503.389926] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state DISCONN osc.lustre-OST0000-osc-ffff9717077f8800.ost_server_uuid 50 [ 5505.324454] Lustre: DEBUG MARKER: OSCs should all be DISCONN [ 5516.398794] LustreError: 137022:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717077f8800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5516.417947] LustreError: 137022:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 5516.458912] Lustre: Unmounted lustre-client [ 5538.447282] Lustre: DEBUG MARKER: == conf-sanity test 50c: lazystatfs one server down ====== 20:45:11 (1763343911) [ 5569.295754] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5573.466888] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5594.476607] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5615.944601] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5616.760894] Lustre: Mounted lustre-client [ 5621.745735] Lustre: lustre-OST0000-osc-ffff97170753e000: Connection to lustre-OST0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5646.705459] LustreError: 139690:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170753e000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5646.731316] LustreError: 139690:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 5646.734807] LustreError: 139690:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 5646.812499] Lustre: Unmounted lustre-client [ 5692.648774] Lustre: DEBUG MARKER: == conf-sanity test 50d: lazystatfs client/server conn race ========================================================== 20:47:45 (1763344065) [ 5722.494470] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5726.618192] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5744.728689] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5764.097145] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5764.787269] Lustre: Mounted lustre-client [ 5770.227939] Lustre: lustre-OST0000-osc-ffff971709783000: Connection to lustre-OST0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5785.344597] LustreError: 142453:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709783000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 5785.359889] LustreError: 142453:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 5785.377812] LustreError: 142453:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 5785.380736] LustreError: 142453:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 5785.467123] Lustre: Unmounted lustre-client [ 5833.292413] Lustre: DEBUG MARKER: == conf-sanity test 50e: normal statfs all servers down == 20:50:05 (1763344205) [ 5922.751191] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5926.685455] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5952.307652] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6018.843476] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6022.340843] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6039.694376] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6065.050906] Lustre: Mounted lustre-client [ 6101.210596] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6112.250620] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 9 sec [ 6114.056069] LustreError: 149130:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717192ba800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6114.075603] LustreError: 149130:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message [ 6114.106574] LustreError: 149130:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 6114.116156] LustreError: 149130:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6114.212475] Lustre: Unmounted lustre-client [ 6143.047602] Lustre: DEBUG MARKER: == conf-sanity test 50f: normal statfs one server in down ========================================================== 20:55:16 (1763344516) [ 6164.735759] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6168.110912] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6183.512733] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6215.906552] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6240.198346] Lustre: Mounted lustre-client [ 6273.004782] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6274.093822] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6276.071960] Lustre: lustre-OST0001-osc-ffff9717197a9000: Connection to lustre-OST0001 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 6279.765706] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 6290.032504] LustreError: 152715:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6290.046483] LustreError: 152715:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6290.102186] Lustre: Unmounted lustre-client [ 6349.876935] Lustre: DEBUG MARKER: == conf-sanity test 50g: deactivated OST should not cause panic ========================================================== 20:58:42 (1763344722) [ 6377.699508] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6380.949699] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6397.232527] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6397.742380] Lustre: Mounted lustre-client [ 6413.985379] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6416.510216] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 1 sec [ 6428.245086] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff97170a8ad800.ost_server_uuid 50 [ 6429.900455] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff97170a8ad800.ost_server_uuid in FULL state after 0 sec [ 6432.829394] LustreError: 156151:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170a8ad800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6432.860601] LustreError: 156151:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6432.868441] LustreError: 156151:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6432.957222] Lustre: Unmounted lustre-client [ 6433.478434] Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request [ 6433.481569] Lustre: Skipped 3 previous similar messages [ 6433.631046] Lustre: Mounted lustre-client [ 6434.898376] LustreError: 156214:0:(sec.c:410:import_sec_validate_get()) import 00000000505070ea (NEW) with no sec [ 6484.555927] Lustre: DEBUG MARKER: == conf-sanity test 50h: LU-642: activate deactivated OST ========================================================== 21:00:57 (1763344857) [ 6515.017802] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6518.347624] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6537.992520] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6556.384616] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6557.032144] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6557.314354] Lustre: Mounted lustre-client [ 6568.983825] LustreError: 159074:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170753b000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6568.992474] LustreError: 159074:0:(lov_obd.c:783:lov_cleanup()) Skipped 2 previous similar messages [ 6569.024851] LustreError: 159074:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6569.034860] LustreError: 159074:0:(obd_class.h:479:obd_check_dev()) Skipped 18 previous similar messages [ 6569.113611] Lustre: Unmounted lustre-client [ 6569.117947] Lustre: Skipped 1 previous similar message [ 6596.197933] Key type lgssc unregistered [ 6596.487149] LNet: 159521:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6596.519087] LNetError: 159521:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6596.540128] LNet: Removed LNI 192.168.202.16@tcp [ 6597.436481] Key type .llcrypt unregistered [ 6597.444229] Key type ._llcrypt unregistered [ 6610.899082] Key type ._llcrypt registered [ 6610.900742] Key type .llcrypt registered [ 6612.044871] Lustre: DEBUG MARKER: == conf-sanity test 50i: activate deactivated MDT ======== 21:03:04 (1763344984) [ 6612.997650] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6613.027986] alg: No test for adler32 (adler32-zlib) [ 6614.268694] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 6614.634247] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 6616.361080] Key type lgssc registered [ 6617.479533] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6664.964960] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6667.573752] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6684.436357] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6701.055953] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6702.594939] Lustre: setting import lustre-MDT0001_UUID INACTIVE by administrator request [ 6703.742700] Lustre: Mounted lustre-client [ 6710.287623] LustreError: lustre-MDT0001-mdc-ffff9717074fa800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. [ 6710.301696] Lustre: lustre-MDT0001-mdc-ffff9717074fa800: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 6714.195334] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6715.631092] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 6734.338932] Lustre: setting import lustre-MDT0001_UUID INACTIVE by administrator request [ 6737.137622] LustreError: 163755:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717074fa800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6737.152236] LustreError: 163755:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6737.197834] Lustre: Unmounted lustre-client [ 6769.630545] Lustre: DEBUG MARKER: == conf-sanity test 51: Verify that mdt_reint handles RMF_MDT_MD correctly when an OST is added ========================================================== 21:05:42 (1763345142) [ 6848.175481] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6851.912587] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6871.642559] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6872.344865] Lustre: Mounted lustre-client [ 6894.397259] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 6896.037652] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6898.668960] Lustre: lustre-OST0001-osc-ffff971709613000: Connection to lustre-OST0001 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 6906.459330] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 6916.719840] LustreError: 168487:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6916.732946] LustreError: 168487:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6916.772691] Lustre: Unmounted lustre-client [ 6951.881685] Key type lgssc unregistered [ 6952.167755] LNet: 168891:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6952.173090] LNetError: 168891:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6952.198893] LNet: Removed LNI 192.168.202.16@tcp [ 6953.180212] Key type .llcrypt unregistered [ 6953.182074] Key type ._llcrypt unregistered [ 6997.923792] Key type ._llcrypt registered [ 6997.925242] Key type .llcrypt registered [ 6998.219862] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 6998.231453] alg: No test for adler32 (adler32-zlib) [ 6999.225394] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 6999.459940] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 7001.167209] Key type lgssc registered [ 7002.612333] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7082.416388] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7086.851476] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7113.625386] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7159.738720] Lustre: DEBUG MARKER: == conf-sanity test 52: check recovering objects from lost+found ========================================================== 21:12:11 (1763345531) [ 7191.938921] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7195.598416] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7215.168921] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7216.836314] Lustre: Mounted lustre-client [ 7265.951462] LustreError: 174983:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971719530800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7265.994653] LustreError: 174983:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7266.078273] Lustre: Unmounted lustre-client [ 7302.994790] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7303.622602] Lustre: Mounted lustre-client [ 7338.979071] LustreError: 175648:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709783000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7339.000676] LustreError: 175648:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7339.004631] LustreError: 175648:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7339.088324] Lustre: Unmounted lustre-client [ 7365.261086] Key type lgssc unregistered [ 7365.529994] LNet: 176053:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7365.537782] LNetError: 176053:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7365.555192] LNet: Removed LNI 192.168.202.16@tcp [ 7366.243362] Key type .llcrypt unregistered [ 7366.245965] Key type ._llcrypt unregistered [ 7381.332273] Key type ._llcrypt registered [ 7381.334382] Key type .llcrypt registered [ 7382.512953] Lustre: DEBUG MARKER: == conf-sanity test 53a: check OSS thread count params === 21:15:55 (1763345755) [ 7384.512441] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7384.540075] alg: No test for adler32 (adler32-zlib) [ 7385.619847] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 7385.820707] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 7387.487223] Key type lgssc registered [ 7388.660890] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7433.702732] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7438.572476] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7457.679547] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7460.653880] Lustre: Mounted lustre-client [ 7480.238224] LustreError: 179318:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170427b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7480.266241] LustreError: 179318:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7480.356725] Lustre: Unmounted lustre-client [ 7508.097303] Key type lgssc unregistered [ 7508.398326] LNet: 179719:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7508.425388] LNetError: 179719:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7508.457733] LNet: Removed LNI 192.168.202.16@tcp [ 7509.258176] Key type .llcrypt unregistered [ 7509.269719] Key type ._llcrypt unregistered [ 7521.596455] Key type ._llcrypt registered [ 7521.597762] Key type .llcrypt registered [ 7522.027252] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 7522.046659] alg: No test for adler32 (adler32-zlib) [ 7523.175641] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 7523.399080] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 7525.073529] Key type lgssc registered [ 7526.389233] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7575.586277] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7579.289879] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7597.671704] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7599.762039] Lustre: Mounted lustre-client [ 7607.230941] LustreError: 182290:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971707497800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7607.268114] LustreError: 182290:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7607.342372] Lustre: Unmounted lustre-client [ 7639.651364] Key type lgssc unregistered [ 7639.895608] LNet: 182693:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7639.915841] LNetError: 182693:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7639.941657] LNet: Removed LNI 192.168.202.16@tcp [ 7640.604943] Key type .llcrypt unregistered [ 7640.608143] Key type ._llcrypt unregistered [ 7655.174187] Key type ._llcrypt registered [ 7655.176053] Key type .llcrypt registered [ 7656.460872] Lustre: DEBUG MARKER: == conf-sanity test 53b: check MDS thread count params === 21:20:29 (1763346029) [ 7658.424234] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7658.538993] alg: No test for adler32 (adler32-zlib) [ 7659.681923] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 7659.952492] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 7661.640509] Key type lgssc registered [ 7662.830487] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7705.317224] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7709.756852] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7727.660475] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7730.384455] Lustre: Mounted lustre-client [ 7747.393810] LustreError: 185958:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717192ba800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7747.411532] LustreError: 185958:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7747.459401] Lustre: Unmounted lustre-client [ 7773.724590] Key type lgssc unregistered [ 7773.995254] LNet: 186360:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7774.001858] LNetError: 186360:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7774.021417] LNet: Removed LNI 192.168.202.16@tcp [ 7774.719728] Key type .llcrypt unregistered [ 7774.722642] Key type ._llcrypt unregistered [ 7785.321866] Key type ._llcrypt registered [ 7785.328681] Key type .llcrypt registered [ 7786.034148] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 7786.052937] alg: No test for adler32 (adler32-zlib) [ 7787.229645] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 7787.689557] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 7789.431162] Key type lgssc registered [ 7790.873567] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7837.989719] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7841.646038] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7859.289773] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7865.396369] Lustre: Mounted lustre-client [ 7871.349089] LustreError: 188932:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717053f6800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7871.371665] LustreError: 188932:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7871.419591] Lustre: Unmounted lustre-client [ 7898.429746] Key type lgssc unregistered [ 7898.678533] LNet: 189334:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7898.689877] LNetError: 189334:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7898.715485] LNet: Removed LNI 192.168.202.16@tcp [ 7899.282728] Key type .llcrypt unregistered [ 7899.285267] Key type ._llcrypt unregistered [ 7913.528673] Key type ._llcrypt registered [ 7913.534230] Key type .llcrypt registered [ 7914.725457] Lustre: DEBUG MARKER: == conf-sanity test 54a: test llverdev and partial verify of device ========================================================== 21:24:47 (1763346287) [ 7931.829545] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7931.852084] alg: No test for adler32 (adler32-zlib) [ 7932.990747] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 7933.192250] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 7934.831153] Key type lgssc registered [ 7936.022453] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8015.790548] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8019.537468] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8037.866519] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8077.150916] Lustre: DEBUG MARKER: == conf-sanity test 54b: test llverfs and partial verify of filesystem ========================================================== 21:27:30 (1763346450) [ 8104.517589] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8108.223054] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8124.869985] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8131.640706] Lustre: Mounted lustre-client [ 8135.992831] LustreError: 195853:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971707490000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 8136.025223] LustreError: 195853:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 8136.080987] Lustre: Unmounted lustre-client [ 8164.094425] Key type lgssc unregistered [ 8164.390988] LNet: 196255:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8164.394701] LNetError: 196255:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8164.418682] LNet: Removed LNI 192.168.202.16@tcp [ 8165.063129] Key type .llcrypt unregistered [ 8165.064827] Key type ._llcrypt unregistered [ 8178.754742] Key type ._llcrypt registered [ 8178.756658] Key type .llcrypt registered [ 8179.920264] Lustre: DEBUG MARKER: SKIP: conf-sanity test_55 skipping excluded test 55 [ 8181.501869] Lustre: DEBUG MARKER: == conf-sanity test 56a: check big OST indexes and out-of-index-order start ========================================================== 21:29:14 (1763346554) [ 8198.151075] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8198.158079] alg: No test for adler32 (adler32-zlib) [ 8199.219389] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 8199.399058] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 8201.071283] Key type lgssc registered [ 8202.075405] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8286.620935] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8290.332186] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8308.980977] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST2710-osc-[-0-9a-f]*.ost_server_uuid [ 8330.435565] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST03e8-osc-[-0-9a-f]*.ost_server_uuid [ 8332.147691] Lustre: Mounted lustre-client [ 8349.590047] LustreError: 201795:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971704dce000: lov tgt 1000 not cleaned! deathrow=0, lovrc=1 [ 8349.612419] LustreError: 201795:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 8349.664985] Lustre: Unmounted lustre-client [ 8478.711593] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8482.984851] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8502.218369] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8551.306309] Lustre: DEBUG MARKER: == conf-sanity test 56b: test target_obd correctness with nonconsecutive MDTs ========================================================== 21:35:24 (1763346924) [ 8552.948556] Lustre: DEBUG MARKER: SKIP: conf-sanity test_56b needs >= 3 MDTs [ 8554.916038] Lustre: DEBUG MARKER: == conf-sanity test 57a: initial registration from failnode should fail (should return errs) ========================================================== 21:35:27 (1763346927) [ 8606.624613] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8609.924812] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8638.581637] Key type lgssc unregistered [ 8638.812576] LNet: 207977:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8638.827100] LNetError: 207977:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8638.844494] LNet: Removed LNI 192.168.202.16@tcp [ 8639.536692] Key type .llcrypt unregistered [ 8639.538473] Key type ._llcrypt unregistered [ 8656.750143] Key type ._llcrypt registered [ 8656.755221] Key type .llcrypt registered [ 8658.379940] Lustre: DEBUG MARKER: == conf-sanity test 57b: initial registration from servicenode should not fail ========================================================== 21:37:10 (1763347030) [ 8687.214919] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8687.324376] alg: No test for adler32 (adler32-zlib) [ 8688.451512] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 8688.670267] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 8690.343198] Key type lgssc registered [ 8691.771534] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8731.719107] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8736.352827] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8757.687542] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8781.438356] Key type lgssc unregistered [ 8781.742800] LNet: 211613:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8781.749572] LNetError: 211613:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8781.764791] LNet: Removed LNI 192.168.202.16@tcp [ 8782.542680] Key type .llcrypt unregistered [ 8782.544572] Key type ._llcrypt unregistered [ 8797.946934] Key type ._llcrypt registered [ 8797.948349] Key type .llcrypt registered [ 8799.260030] Lustre: DEBUG MARKER: == conf-sanity test 58: missing llog files must not prevent MDT from mounting ========================================================== 21:39:32 (1763347172) [ 8801.712078] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8801.726452] alg: No test for adler32 (adler32-zlib) [ 8802.934666] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 8803.238103] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 8804.951808] Key type lgssc registered [ 8806.193539] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8849.295299] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8853.953842] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8872.842605] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8875.551426] Lustre: Mounted lustre-client [ 8885.744940] Lustre: lustre-MDT0000-mdc-ffff971704279800: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 8895.974737] Lustre: lustre-MDT0001-mdc-ffff971704279800: Connection to lustre-MDT0001 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 8907.040072] Lustre: 212600:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763347265/real 1763347265] req@0000000007c531af x1849003529552000/t0(0) o400->MGC192.168.202.116@tcp@192.168.202.116@tcp:26/25 lens 224/224 e 0 to 1 dl 1763347281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 8907.077272] LustreError: MGC192.168.202.116@tcp: Connection to MGS (at 192.168.202.116@tcp) was lost; in progress operations using this service will fail [ 8917.422368] Lustre: Evicted from MGS (at 192.168.202.116@tcp) after server handle changed from 0xd15311b74b8b40be to 0xd15311b74b8b5dcf [ 8917.444024] Lustre: MGC192.168.202.116@tcp: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 8936.951490] LustreError: lustre-MDT0000-mdc-ffff971704279800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 8936.985853] Lustre: lustre-MDT0000-mdc-ffff971704279800: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 8941.465878] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8943.584305] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 8947.438465] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8949.088022] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 8952.007709] LustreError: 216028:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971704279800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 8952.024114] LustreError: 216028:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 8952.113891] Lustre: Unmounted lustre-client [ 8981.822870] Key type lgssc unregistered [ 8982.154352] LNet: 216432:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8982.171563] LNetError: 216432:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8982.210088] LNet: Removed LNI 192.168.202.16@tcp [ 8983.100950] Key type .llcrypt unregistered [ 8983.106520] Key type ._llcrypt unregistered [ 8999.666309] Key type ._llcrypt registered [ 8999.668152] Key type .llcrypt registered [ 9001.208752] Lustre: DEBUG MARKER: == conf-sanity test 59: writeconf mount option =========== 21:42:53 (1763347373) [ 9003.737150] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9003.777667] alg: No test for adler32 (adler32-zlib) [ 9004.922116] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 9005.229787] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 9006.896442] Key type lgssc registered [ 9008.462964] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9054.678944] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9058.421428] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9110.091853] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9113.716875] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9143.536425] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9161.830522] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 9207.921936] Key type lgssc unregistered [ 9208.212216] LNet: 221544:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9208.226110] LNetError: 221544:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9208.248463] LNet: Removed LNI 192.168.202.16@tcp [ 9209.039145] Key type .llcrypt unregistered [ 9209.040818] Key type ._llcrypt unregistered [ 9249.575368] Key type ._llcrypt registered [ 9249.576996] Key type .llcrypt registered [ 9249.973990] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 9249.990918] alg: No test for adler32 (adler32-zlib) [ 9250.990800] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 9251.163934] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 9252.799951] Key type lgssc registered [ 9253.916563] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9328.579580] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9332.644935] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9353.049964] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9397.548479] Lustre: DEBUG MARKER: == conf-sanity test 60a: check mkfs.lustre --mkfsoptions -E -O options setting ========================================================== 21:49:30 (1763347770) [ 9496.910851] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9500.456562] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9521.473028] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9568.972396] Lustre: DEBUG MARKER: == conf-sanity test 60b: check mkfs.lustre MDT default features ========================================================== 21:52:21 (1763347941) [ 9576.106259] Lustre: DEBUG MARKER: == conf-sanity test 61a: large xattr ===================== 21:52:28 (1763347948) [ 9600.223031] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9603.461962] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9617.250941] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9618.907811] Lustre: Mounted lustre-client [ 9623.795608] Lustre: DEBUG MARKER: save large xattr of 65536 bytes on trusted.big on /mnt/lustre/f61a.conf-sanity [ 9625.195780] Lustre: DEBUG MARKER: shrink value of trusted.big on /mnt/lustre/f61a.conf-sanity [ 9626.373234] Lustre: DEBUG MARKER: grow value of trusted.big on /mnt/lustre/f61a.conf-sanity [ 9627.780202] Lustre: DEBUG MARKER: check value of trusted.big on /mnt/lustre/f61a.conf-sanity after remounting MDS [ 9634.284397] Lustre: lustre-MDT0000-mdc-ffff971719536800: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 9649.647423] LustreError: MGC192.168.202.116@tcp: Connection to MGS (at 192.168.202.116@tcp) was lost; in progress operations using this service will fail [ 9649.664749] Lustre: Evicted from MGS (at 192.168.202.116@tcp) after server handle changed from 0x2faf5cce9ab28526 to 0x2faf5cce9ab287aa [ 9649.673073] Lustre: MGC192.168.202.116@tcp: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 9653.135964] Lustre: lustre-MDT0000-mdc-ffff971719536800: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 9659.082354] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9661.043247] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 9664.465640] Lustre: DEBUG MARKER: remove large xattr trusted.big from /mnt/lustre/f61a.conf-sanity [ 9670.118910] Lustre: lustre-MDT0000-mdc-ffff971719536800: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 9685.505340] LustreError: MGC192.168.202.116@tcp: Connection to MGS (at 192.168.202.116@tcp) was lost; in progress operations using this service will fail [ 9685.567447] Lustre: Evicted from MGS (at 192.168.202.116@tcp) after server handle changed from 0x2faf5cce9ab287aa to 0x2faf5cce9ab28aac [ 9685.588746] Lustre: MGC192.168.202.116@tcp: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 9688.952041] Lustre: lustre-MDT0000-mdc-ffff971719536800: Connection restored to 192.168.202.116@tcp (at 192.168.202.116@tcp) [ 9693.857744] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9695.518329] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 9698.733329] LustreError: 235179:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971719536800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9698.754773] LustreError: 235179:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9698.806716] Lustre: Unmounted lustre-client [ 9755.528572] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9758.670868] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9777.500316] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9783.865148] Lustre: Mounted lustre-client [ 9785.898157] LustreError: 236801:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170427e800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9785.930457] LustreError: 236801:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9785.934175] LustreError: 236801:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 9786.009519] Lustre: Unmounted lustre-client [ 9819.191434] Key type lgssc unregistered [ 9819.445626] LNet: 237205:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9819.454977] LNetError: 237205:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9819.475166] LNet: Removed LNI 192.168.202.16@tcp [ 9820.025350] Key type .llcrypt unregistered [ 9820.026793] Key type ._llcrypt unregistered [ 9833.647827] Key type ._llcrypt registered [ 9833.651925] Key type .llcrypt registered [ 9835.139939] Lustre: DEBUG MARKER: == conf-sanity test 61b: large xattr ===================== 21:56:47 (1763348207) [ 9839.115941] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9839.264793] alg: No test for adler32 (adler32-zlib) [ 9840.469398] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [ 9840.750313] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [ 9842.463635] Key type lgssc registered [ 9843.685910] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9889.421318] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9893.216798] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9910.017668] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9912.765338] Lustre: Mounted lustre-client [ 9917.960419] LustreError: 240383:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971709610000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 9917.982469] LustreError: 240383:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 9918.037356] Lustre: Unmounted lustre-client [ 9973.739686] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9977.051255] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9995.119292] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10006.051415] Lustre: Mounted lustre-client [10014.675414] LustreError: 241987:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170a8ad800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [10014.705187] LustreError: 241987:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10014.712659] LustreError: 241987:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10014.790513] Lustre: Unmounted lustre-client [10072.298024] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10075.660172] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10091.599722] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10102.862461] Lustre: Mounted lustre-client [10103.958544] LustreError: 243617:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717073da000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [10103.983219] LustreError: 243617:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10103.986557] LustreError: 243617:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10104.053192] Lustre: Unmounted lustre-client [10130.235675] Key type lgssc unregistered [10130.496132] LNet: 244019:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10130.510055] LNetError: 244019:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10131.558224] LNet: Removed LNI 192.168.202.16@tcp [10132.152918] Key type .llcrypt unregistered [10132.155477] Key type ._llcrypt unregistered [10144.719820] Key type ._llcrypt registered [10144.721419] Key type .llcrypt registered [10145.842735] Lustre: DEBUG MARKER: == conf-sanity test 62: start with disabled journal ====== 22:01:58 (1763348518) [10148.421520] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10148.431357] alg: No test for adler32 (adler32-zlib) [10149.523349] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [10149.764892] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [10151.431320] Key type lgssc registered [10152.129868] Lustre: Echo OBD driver; http://www.lustre.org/ [10186.612850] Key type lgssc unregistered [10186.853297] LNet: 246335:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10186.860505] LNetError: 246335:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10186.877726] LNet: Removed LNI 192.168.202.16@tcp [10187.472113] Key type .llcrypt unregistered [10187.473806] Key type ._llcrypt unregistered [10212.967926] Key type ._llcrypt registered [10212.971307] Key type .llcrypt registered [10213.539289] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [10213.564232] alg: No test for adler32 (adler32-zlib) [10214.669519] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [10214.868273] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [10216.575177] Key type lgssc registered [10218.189354] Lustre: Echo OBD driver; http://www.lustre.org/ [10287.670901] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10291.684672] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10309.176526] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10350.882489] Lustre: DEBUG MARKER: SKIP: conf-sanity test_63 skipping excluded test 63 [10352.343506] Lustre: DEBUG MARKER: == conf-sanity test 64: check lfs df --lazy ============== 22:05:25 (1763348725) [10375.770964] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10378.618822] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10394.352861] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10409.852991] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [10411.386536] Lustre: Mounted lustre-client [10416.533712] LustreError: lustre-OST0001-osc-ffff97170a8ab000: operation ost_statfs to node 192.168.202.116@tcp failed: rc = -107 [10416.544722] Lustre: lustre-OST0001-osc-ffff97170a8ab000: Connection to lustre-OST0001 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [10417.390360] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [10427.693401] LustreError: 252836:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [10427.773691] Lustre: Unmounted lustre-client [10461.320384] Key type lgssc unregistered [10461.525364] LNet: 253239:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10461.531114] LNetError: 253239:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10461.546694] LNet: Removed LNI 192.168.202.16@tcp [10462.270876] Key type .llcrypt unregistered [10462.276374] Key type ._llcrypt unregistered [10507.031444] Key type ._llcrypt registered [10507.034979] Key type .llcrypt registered [10507.548469] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [10507.569924] alg: No test for adler32 (adler32-zlib) [10508.700168] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [10509.003651] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [10510.711212] Key type lgssc registered [10511.901804] Lustre: Echo OBD driver; http://www.lustre.org/ [10588.802461] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10592.174204] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10610.941972] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10647.443915] Lustre: DEBUG MARKER: == conf-sanity test 65: re-create the lost last_rcvd file when server mount ========================================================== 22:10:20 (1763349020) [10688.477384] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10692.005444] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10714.833073] Lustre: DEBUG MARKER: == conf-sanity test 66: replace nids ===================== 22:11:27 (1763349087) [10745.714831] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10750.099975] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10769.303652] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10771.082941] Lustre: Mounted lustre-client [10782.736236] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [10787.925484] LustreError: 261087:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10787.980214] Lustre: Unmounted lustre-client [10880.773399] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10883.992594] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10932.197677] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10932.609593] Lustre: Mounted lustre-client [10933.744911] LustreError: 263141:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170428c800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [10933.762049] LustreError: 263141:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [10933.764679] LustreError: 263141:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10933.811773] Lustre: Unmounted lustre-client [10967.033843] Key type lgssc unregistered [10967.254594] LNet: 263547:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10967.259478] LNetError: 263547:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10967.285341] LNet: Removed LNI 192.168.202.16@tcp [10967.890663] Key type .llcrypt unregistered [10967.892631] Key type ._llcrypt unregistered [10989.638369] Key type ._llcrypt registered [10989.639749] Key type .llcrypt registered [10990.054384] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [10990.071964] alg: No test for adler32 (adler32-zlib) [10991.160384] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [10991.358918] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [10993.031181] Key type lgssc registered [10993.970305] Lustre: Echo OBD driver; http://www.lustre.org/ [11066.686190] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11070.060593] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11087.051695] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11128.610340] Lustre: DEBUG MARKER: SKIP: conf-sanity test_67 skipping excluded test 67 [11130.074687] Lustre: DEBUG MARKER: == conf-sanity test 68: be able to reserve specific sequences in FLDB ========================================================== 22:18:23 (1763349503) [11158.097391] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11162.030664] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11182.140963] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11187.815658] Lustre: Mounted lustre-client [11190.196135] LustreError: 269606:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971705e5f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11190.209457] LustreError: 269606:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11190.263104] Lustre: Unmounted lustre-client [11217.038586] Key type lgssc unregistered [11217.267807] LNet: 270009:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11217.275680] LNetError: 270009:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11217.296927] LNet: Removed LNI 192.168.202.16@tcp [11218.021438] Key type .llcrypt unregistered [11218.025435] Key type ._llcrypt unregistered [11231.906263] Key type ._llcrypt registered [11231.907633] Key type .llcrypt registered [11233.416468] Lustre: DEBUG MARKER: SKIP: conf-sanity test_69 skipping SLOW test 69 [11235.330067] Lustre: DEBUG MARKER: == conf-sanity test 70a: start MDT0, then OST, then MDT1 ========================================================== 22:20:07 (1763349607) [11244.019343] Key type .llcrypt unregistered [11244.020852] Key type ._llcrypt unregistered [11252.781646] Key type ._llcrypt registered [11252.785365] Key type .llcrypt registered [11253.297959] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [11253.320599] alg: No test for adler32 (adler32-zlib) [11254.506728] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [11254.800869] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [11256.535179] Key type lgssc registered [11257.900504] Lustre: Echo OBD driver; http://www.lustre.org/ [11306.552981] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11320.832224] Lustre: Mounted lustre-client [11322.817214] LustreError: 273031:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971704541800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11322.861207] LustreError: 273031:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11322.956240] Lustre: Unmounted lustre-client [11357.317450] Key type lgssc unregistered [11357.625353] LNet: 273435:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11357.638845] LNetError: 273435:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11357.657563] LNet: Removed LNI 192.168.202.16@tcp [11358.395093] Key type .llcrypt unregistered [11358.396916] Key type ._llcrypt unregistered [11377.317936] Key type ._llcrypt registered [11377.323219] Key type .llcrypt registered [11378.583516] Lustre: DEBUG MARKER: == conf-sanity test 70b: start OST, MDT1, MDT0 =========== 22:22:31 (1763349751) [11381.095303] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11381.120370] alg: No test for adler32 (adler32-zlib) [11382.212192] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [11382.405144] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [11384.113678] Key type lgssc registered [11385.545813] Lustre: Echo OBD driver; http://www.lustre.org/ [11469.105943] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11497.752869] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11501.373585] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11504.116911] Lustre: Mounted lustre-client [11506.732433] LustreError: 276487:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971710db7800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11506.769651] LustreError: 276487:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11506.829901] Lustre: Unmounted lustre-client [11544.510868] Key type lgssc unregistered [11544.802452] LNet: 276892:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11544.811965] LNetError: 276892:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11544.823269] LNet: Removed LNI 192.168.202.16@tcp [11545.513119] Key type .llcrypt unregistered [11545.519216] Key type ._llcrypt unregistered [11562.006405] Key type ._llcrypt registered [11562.007753] Key type .llcrypt registered [11563.582317] Lustre: DEBUG MARKER: == conf-sanity test 70c: stop MDT0, mkdir fail, create remote dir fail ========================================================== 22:25:36 (1763349936) [11565.775442] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11565.859097] alg: No test for adler32 (adler32-zlib) [11566.994993] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [11567.249399] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [11568.959869] Key type lgssc registered [11570.294514] Lustre: Echo OBD driver; http://www.lustre.org/ [11615.551111] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11618.655481] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11637.061504] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11643.994421] Lustre: Mounted lustre-client [11649.028490] Lustre: lustre-MDT0000-mdc-ffff9717073d8800: Connection to lustre-MDT0000 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [11655.404629] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [11655.448590] LustreError: 279966:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 [11655.933972] LustreError: 279985:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717073d8800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11655.981354] LustreError: MGC192.168.202.116@tcp: Connection to MGS (at 192.168.202.116@tcp) was lost; in progress operations using this service will fail [11656.007383] LustreError: 279985:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11656.048396] Lustre: Unmounted lustre-client [11677.598543] Key type lgssc unregistered [11677.871685] LNet: 280380:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11677.885314] LNetError: 280380:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11677.903649] LNet: Removed LNI 192.168.202.16@tcp [11678.676364] Key type .llcrypt unregistered [11678.678087] Key type ._llcrypt unregistered [11695.972791] Key type ._llcrypt registered [11695.974523] Key type .llcrypt registered [11697.246558] Lustre: DEBUG MARKER: == conf-sanity test 70d: stop MDT1, mkdir succeed, create remote dir fail ========================================================== 22:27:50 (1763350070) [11699.452987] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11699.585762] alg: No test for adler32 (adler32-zlib) [11700.734211] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [11700.997297] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [11702.656652] Key type lgssc registered [11703.877500] Lustre: Echo OBD driver; http://www.lustre.org/ [11750.303075] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11754.053508] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11770.603521] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11776.557513] Lustre: Mounted lustre-client [11781.612863] Lustre: lustre-MDT0001-mdc-ffff97170428d800: Connection to lustre-MDT0001 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [11786.554762] Lustre: setting import lustre-MDT0001_UUID INACTIVE by administrator request [11788.233443] LustreError: 283482:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170428d800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [11788.274236] LustreError: 283482:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [11788.333177] Lustre: Unmounted lustre-client [11807.533886] Key type lgssc unregistered [11807.782391] LNet: 283877:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11807.795688] LNetError: 283877:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11807.815604] LNet: Removed LNI 192.168.202.16@tcp [11808.534981] Key type .llcrypt unregistered [11808.536722] Key type ._llcrypt unregistered [11824.279057] Key type ._llcrypt registered [11824.280228] Key type .llcrypt registered [11825.536388] Lustre: DEBUG MARKER: == conf-sanity test 70e: Sync-on-Cancel will be enabled by default on DNE ========================================================== 22:29:58 (1763350198) [11844.423799] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11844.452545] alg: No test for adler32 (adler32-zlib) [11845.664843] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [11846.000860] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [11847.735179] Key type lgssc registered [11849.208598] Lustre: Echo OBD driver; http://www.lustre.org/ [11958.757502] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11961.500571] Lustre: Mounted lustre-client [12005.866340] Lustre: lustre-MDT0001-mdc-ffff971719a0f800: Connection to lustre-MDT0001 (at 192.168.202.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [12010.509418] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [12020.799484] LustreError: 289235:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [12020.824547] Lustre: Unmounted lustre-client [12054.827853] Key type lgssc unregistered [12055.088847] LNet: 289636:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12055.102663] LNetError: 289636:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12055.129045] LNet: Removed LNI 192.168.202.16@tcp [12055.873747] Key type .llcrypt unregistered [12055.875558] Key type ._llcrypt unregistered [12068.234821] Key type ._llcrypt registered [12068.236281] Key type .llcrypt registered [12069.376679] Lustre: DEBUG MARKER: == conf-sanity test 71a: start MDT0 OST0, MDT1, OST1 ===== 22:34:02 (1763350442) [12071.005325] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71a needs separate MGS/MDT [12072.730435] Lustre: DEBUG MARKER: == conf-sanity test 71b: start MDT1, OST0, MDT0, OST1 ==== 22:34:05 (1763350445) [12074.400190] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71b needs separate MGS/MDT [12075.950480] Lustre: DEBUG MARKER: == conf-sanity test 71c: start OST0, OST1, MDT1, MDT0 ==== 22:34:08 (1763350448) [12077.306258] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71c needs separate MGS/MDT [12078.754399] Lustre: DEBUG MARKER: == conf-sanity test 71d: start OST0, MDT1, MDT0, OST1 ==== 22:34:11 (1763350451) [12080.399690] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71d needs separate MGS/MDT [12082.074038] Lustre: DEBUG MARKER: == conf-sanity test 71e: start OST0, MDT1, OST1, MDT0 ==== 22:34:14 (1763350454) [12083.565851] Lustre: DEBUG MARKER: SKIP: conf-sanity test_71e needs separate MGS/MDT [12085.214945] Lustre: DEBUG MARKER: == conf-sanity test 72: test fast symlink with extents flag enabled ========================================================== 22:34:18 (1763350458) [12093.387395] Key type .llcrypt unregistered [12093.393522] Key type ._llcrypt unregistered [12098.889823] Key type ._llcrypt registered [12098.895237] Key type .llcrypt registered [12099.399860] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [12099.455786] alg: No test for adler32 (adler32-zlib) [12100.553882] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [12100.803677] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [12102.519564] Key type lgssc registered [12103.689034] Lustre: Echo OBD driver; http://www.lustre.org/ [12167.844264] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12170.695471] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12191.189211] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12192.892228] Lustre: Mounted lustre-client [12194.607644] LustreError: 295230:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9717192bb800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [12194.631677] LustreError: 295230:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [12194.699747] Lustre: Unmounted lustre-client [12229.858487] Lustre: DEBUG MARKER: == conf-sanity test 73a: failnode to update from mountdata properly ========================================================== 22:36:42 (1763350602) [12256.409619] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12260.017693] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12278.543896] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12284.476769] Lustre: Mounted lustre-client [12285.865115] LustreError: 297344:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971719534800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [12285.905029] LustreError: 297344:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [12285.912115] LustreError: 297344:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [12285.994432] Lustre: Unmounted lustre-client [12323.785776] Lustre: DEBUG MARKER: == conf-sanity test 73b: Large failnode NID list in mountdata ========================================================== 22:38:16 (1763350696) [12338.403442] LNet: 1 local NIs in recovery (showing 1): 192.168.202.16@tcp [12395.424414] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12399.037367] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12417.382432] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12510.658348] Lustre: DEBUG MARKER: == conf-sanity test 73c: Server mount doesn't fail with > 32 nets ========================================================== 22:41:23 (1763350883) [12521.329457] Key type lgssc unregistered [12521.643442] LNet: 302803:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12521.659340] LNetError: 302803:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12521.680429] LNet: Removed LNI 192.168.202.16@tcp [12522.557586] Key type .llcrypt unregistered [12522.559078] Key type ._llcrypt unregistered [12660.386285] Key type ._llcrypt registered [12660.391703] Key type .llcrypt registered [12660.801181] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [12660.809995] alg: No test for adler32 (adler32-zlib) [12661.880614] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [12662.061232] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [12663.719289] Key type lgssc registered [12664.582421] Lustre: Echo OBD driver; http://www.lustre.org/ [12734.179458] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12737.324378] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12753.912230] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12790.245744] Key type lgssc unregistered [12790.478235] LNet: 306406:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12790.485713] LNetError: 306406:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12790.497981] LNet: Removed LNI 192.168.202.16@tcp [12791.075593] Key type .llcrypt unregistered [12791.077212] Key type ._llcrypt unregistered [12825.534773] Key type ._llcrypt registered [12825.535935] Key type .llcrypt registered [12826.790645] Lustre: DEBUG MARKER: == conf-sanity test 73d: erase + new parameter doesn't corrupt mountdata ========================================================== 22:46:39 (1763351199) [12843.719597] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12843.758830] alg: No test for adler32 (adler32-zlib) [12844.766922] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [12844.932363] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [12846.609268] Key type lgssc registered [12847.736203] Lustre: Echo OBD driver; http://www.lustre.org/ [12891.874373] Lustre: DEBUG MARKER: == conf-sanity test 73e: Mount client with dynamic server NIDs ========================================================== 22:47:44 (1763351264) [12901.952843] Key type lgssc unregistered [12902.219543] LNet: 309956:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12902.223986] LNetError: 309956:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12902.242290] LNet: Removed LNI 192.168.202.16@tcp [12902.917615] Key type .llcrypt unregistered [12902.919388] Key type ._llcrypt unregistered [12913.237745] Key type ._llcrypt registered [12913.239018] Key type .llcrypt registered [12913.743840] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [12913.756568] alg: No test for adler32 (adler32-zlib) [12914.903026] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [12915.129741] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [12916.784123] Key type lgssc registered [12917.955489] Lustre: Echo OBD driver; http://www.lustre.org/ [12963.487463] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12966.392789] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12985.236797] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [13214.146879] LNet: Added LNI 192.168.202.16@tcp50 [8/256/0/180] [13215.721608] LNet: Removed LNI 192.168.202.16@tcp [13217.580384] Lustre: 314248:0:(ldlm_lib.c:563:client_obd_setup()) lustre-MDT0000-mdc-ffff971705e5c000: config has no valid NIDs, force dynamic NIDs [13218.773899] Lustre: Mounted lustre-client [13218.838513] LustreError: 314265:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff971705e5c000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [13218.861991] LustreError: 314265:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [13218.908764] Lustre: Unmounted lustre-client [13247.607730] Key type lgssc unregistered [13247.927844] LNet: 315103:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13247.942066] LNetError: 315103:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [13249.001774] LNet: Removed LNI 192.168.202.16@tcp50 [13249.525180] Key type .llcrypt unregistered [13249.527666] Key type ._llcrypt unregistered [13277.436672] Key type ._llcrypt registered [13277.438024] Key type .llcrypt registered [13278.642295] Lustre: DEBUG MARKER: == conf-sanity test 74: Test per-device adaptive timeout parameters ========================================================== 22:54:11 (1763351651) [13280.674542] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [13280.684113] alg: No test for adler32 (adler32-zlib) [13281.790089] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [13281.972444] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [13283.671233] Key type lgssc registered [13284.869827] Lustre: Echo OBD driver; http://www.lustre.org/ [13324.619837] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [13328.130828] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [13345.297619] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [13351.972547] Lustre: Mounted lustre-client [13402.869694] Lustre: Mounted fs15246-client [13415.281193] LustreError: 319250:0:(lov_obd.c:783:lov_cleanup()) fs15246-clilov-ffff971705e5b800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [13415.303763] LustreError: 319250:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [13415.335029] Lustre: Unmounted fs15246-client [13439.139066] LustreError: 319470:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff97170a8ad800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [13439.147697] LustreError: 319470:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [13439.152581] LustreError: 319470:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [13439.208563] Lustre: Unmounted lustre-client [13463.018329] Key type lgssc unregistered [13463.240920] LNet: 319872:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13463.248094] LNetError: 319872:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [13463.270725] LNet: Removed LNI 192.168.202.16@tcp [13463.736349] Key type .llcrypt unregistered [13463.739960] Key type ._llcrypt unregistered [13471.804228] Key type ._llcrypt registered [13471.805911] Key type .llcrypt registered [13472.871373] Lustre: DEBUG MARKER: == conf-sanity test 75: The order of --index should be irrelevant ========================================================== 22:57:25 (1763351845) [13474.090962] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [13474.107539] alg: No test for adler32 (adler32-zlib) [13475.081745] Lustre: Lustre: Build Version: 2.16.61_50_g1f7afa2 [13475.249161] LNet: Added LNI 192.168.202.16@tcp [8/256/0/180] [13476.895210] Key type lgssc registered [13477.735616] Lustre: Echo OBD driver; http://www.lustre.org/ [13576.823987] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [13579.056754] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [13593.320042] Lustre: DEBUG MARKER: oleg216-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [13664.558711] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 13446 sec ========= 23:00:37 (1763352037) [13665.728651] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 23:00:38 (1763352038) === [13667.951474] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 23:00:41 (1763352041) === [13689.201495] Key type lgssc unregistered [13689.376456] LNet: 329040:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13689.380762] LNetError: 329040:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [13689.394563] LNet: Removed LNI 192.168.202.16@tcp [13689.749779] Key type .llcrypt unregistered [13689.751429] Key type ._llcrypt unregistered