[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] mapped at [ffffffffff200b50] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2f2000-0xbffcffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5970 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1bb7 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1a53 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1ac7 00090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1b57 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1b8f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 299864919 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffd9fff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043832 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782298 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027499 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 3820316k/5224448k available (8172k kernel code, 1049120k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.368498] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.370316] pid_max: default: 32768 minimum: 301 [ 0.371289] Security Framework initialized [ 0.372244] SELinux: Initializing. [ 0.373039] SELinux: Starting in permissive mode [ 0.374369] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.377557] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.379652] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.381088] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.383016] Initializing cgroup subsys memory [ 0.383990] Initializing cgroup subsys devices [ 0.384970] Initializing cgroup subsys freezer [ 0.386022] Initializing cgroup subsys net_cls [ 0.386968] Initializing cgroup subsys blkio [ 0.387904] Initializing cgroup subsys perf_event [ 0.388941] Initializing cgroup subsys hugetlb [ 0.389930] Initializing cgroup subsys pids [ 0.390823] Initializing cgroup subsys net_prio [ 0.391974] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.394310] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.395392] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.396414] tlb_flushall_shift: 6 [ 0.397242] FEATURE SPEC_CTRL Present [ 0.397986] FEATURE IBPB_SUPPORT Present [ 0.398807] Spectre V2 : Enabling Indirect Branch Prediction Barrier [ 0.400144] Spectre V2 : Vulnerable [ 0.400896] Speculative Store Bypass: Vulnerable [ 0.402633] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.408762] ACPI: Core revision 20130517 [ 0.410998] ACPI: All ACPI Tables successfully acquired [ 0.412409] ftrace: allocating 30294 entries in 119 pages [ 0.466269] Enabling x2apic [ 0.467316] Enabled x2apic [ 0.468982] Switched APIC routing to physical x2apic. [ 0.473569] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.476183] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (fam: 06, model: 3e, stepping: 04) [ 0.480285] TSC deadline timer enabled [ 0.480510] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.482546] ... version: 2 [ 0.483898] ... bit width: 48 [ 0.485157] ... generic registers: 4 [ 0.486856] ... value mask: 0000ffffffffffff [ 0.489062] ... max period: 00007fffffffffff [ 0.491103] ... fixed-purpose events: 3 [ 0.492781] ... event mask: 000000070000000f [ 0.495107] KVM setup paravirtual spinlock [ 0.501879] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.505052] KVM setup async PF for cpu 1 [ 0.506285] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.508875] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.512243] KVM setup async PF for cpu 2 [ 0.499496] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.512824] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.515061] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.516835] Brought up 4 CPUs [ 0.516857] KVM setup async PF for cpu 3 [ 0.516866] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.521290] smpboot: Max logical packages: 1 [ 0.523008] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.527640] devtmpfs: initialized [ 0.529339] x86/mm: Memory block size: 128MB [ 0.535096] EVM: security.selinux [ 0.536528] EVM: security.ima [ 0.537493] EVM: security.capability [ 0.541141] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.544276] NET: Registered protocol family 16 [ 0.546619] cpuidle: using governor haltpoll [ 0.548903] ACPI: bus type PCI registered [ 0.550650] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.553418] PCI: Using configuration type 1 for base access [ 0.555564] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.564996] ACPI: Added _OSI(Module Device) [ 0.566731] ACPI: Added _OSI(Processor Device) [ 0.568375] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.570187] ACPI: Added _OSI(Processor Aggregator Device) [ 0.572248] ACPI: Added _OSI(Linux-Dell-Video) [ 0.574730] ACPI: EC: Look up EC in DSDT [ 0.577020] ACPI: Interpreter enabled [ 0.578092] ACPI: (supports S0 S3 S4 S5) [ 0.579693] ACPI: Using IOAPIC for interrupt routing [ 0.581536] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.585320] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.590771] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.592064] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.593471] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.594774] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.597605] acpiphp: Slot [2] registered [ 0.598457] acpiphp: Slot [3] registered [ 0.599295] acpiphp: Slot [4] registered [ 0.600129] acpiphp: Slot [5] registered [ 0.600978] acpiphp: Slot [6] registered [ 0.601816] acpiphp: Slot [7] registered [ 0.602673] acpiphp: Slot [8] registered [ 0.603538] acpiphp: Slot [9] registered [ 0.604380] acpiphp: Slot [10] registered [ 0.605339] acpiphp: Slot [11] registered [ 0.606182] acpiphp: Slot [12] registered [ 0.607030] acpiphp: Slot [13] registered [ 0.607919] acpiphp: Slot [14] registered [ 0.608858] acpiphp: Slot [15] registered [ 0.609708] acpiphp: Slot [16] registered [ 0.610671] acpiphp: Slot [17] registered [ 0.611534] acpiphp: Slot [18] registered [ 0.612483] acpiphp: Slot [19] registered [ 0.613394] acpiphp: Slot [20] registered [ 0.614361] acpiphp: Slot [21] registered [ 0.615216] acpiphp: Slot [22] registered [ 0.616120] acpiphp: Slot [23] registered [ 0.616997] acpiphp: Slot [24] registered [ 0.617890] acpiphp: Slot [25] registered [ 0.618730] acpiphp: Slot [26] registered [ 0.619626] acpiphp: Slot [27] registered [ 0.620476] acpiphp: Slot [28] registered [ 0.621408] acpiphp: Slot [29] registered [ 0.622266] acpiphp: Slot [30] registered [ 0.623112] acpiphp: Slot [31] registered [ 0.623964] PCI host bridge to bus 0000:00 [ 0.624793] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.626133] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.627691] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.629178] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.630677] pci_bus 0000:00: root bus resource [mem 0x140000000-0x1bfffffff window] [ 0.632223] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.633347] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.633948] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.634614] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.637655] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.638599] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.640036] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.641291] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.642669] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.644254] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.644675] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.646105] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.648275] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.649224] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.654404] pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.655857] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.656676] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.660024] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.661745] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.667454] pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.671759] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.673750] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.675593] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.681015] pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.685985] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 0.687355] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 0.688676] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 0.689953] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 0.691314] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 0.693195] vgaarb: loaded [ 0.693897] SCSI subsystem initialized [ 0.694732] ACPI: bus type USB registered [ 0.695537] usbcore: registered new interface driver usbfs [ 0.696655] usbcore: registered new interface driver hub [ 0.697684] usbcore: registered new device driver usb [ 0.698933] PCI: Using ACPI for IRQ routing [ 0.699821] PCI: pci_cache_line_size set to 64 bytes [ 0.699952] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 0.699956] e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] [ 0.699957] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 0.700743] NetLabel: Initializing [ 0.701409] NetLabel: domain hash size = 128 [ 0.702626] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.703691] NetLabel: unlabeled traffic allowed by default [ 0.705138] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.706342] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.710916] amd_nb: Cannot enumerate AMD northbridges [ 0.712126] Switched to clocksource kvm-clock [ 0.729346] pnp: PnP ACPI init [ 0.730066] ACPI: bus type PNP registered [ 0.731112] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 0.731221] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 0.731283] pnp 00:02: [dma 2] [ 0.731332] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 0.731407] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.731471] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.731537] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.731925] pnp: PnP ACPI: found 6 devices [ 0.733172] ACPI: bus type PNP unregistered [ 0.743617] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.743622] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.743624] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.743627] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.743630] pci_bus 0000:00: resource 8 [mem 0x140000000-0x1bfffffff window] [ 0.743690] NET: Registered protocol family 2 [ 0.745157] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 0.747338] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 0.749926] TCP: Hash tables configured (established 32768 bind 32768) [ 0.752441] TCP: reno registered [ 0.753439] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 0.754934] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 0.756730] NET: Registered protocol family 1 [ 0.758719] RPC: Registered named UNIX socket transport module. [ 0.762735] RPC: Registered udp transport module. [ 0.764321] RPC: Registered tcp transport module. [ 0.765889] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.768150] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.769503] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.771250] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.772570] PCI: CLS 0 bytes, default 64 [ 0.773275] Unpacking initramfs... [ 2.054836] debug: unmapping init [mem 0xffff8800bc2f2000-0xffff8800bffcffff] [ 2.058097] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.060136] software IO TLB [mem 0xb82f2000-0xbc2f2000] (64MB) mapped at [ffff8800b82f2000-ffff8800bc2f1fff] [ 2.063070] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 10737418240 ms ovfl timer [ 2.065651] RAPL PMU: hw unit of domain pp0-core 2^-0 Joules [ 2.067430] RAPL PMU: hw unit of domain package 2^-0 Joules [ 2.069056] RAPL PMU: hw unit of domain dram 2^-0 Joules [ 2.072243] cryptomgr_test (51) used greatest stack depth: 14128 bytes left [ 2.072650] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 2.072695] Initialise system trusted keyring [ 2.102654] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 2.105046] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 2.111213] zpool: loaded [ 2.112177] zbud: loaded [ 2.113305] VFS: Disk quotas dquot_6.6.0 [ 2.114636] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.117655] NFS: Registering the id_resolver key type [ 2.119271] Key type id_resolver registered [ 2.120565] Key type id_legacy registered [ 2.121799] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 2.124284] Key type big_key registered [ 2.125473] SELinux: Registering netfilter hooks [ 2.126764] cryptomgr_test (57) used greatest stack depth: 14048 bytes left [ 2.129085] cryptomgr_test (58) used greatest stack depth: 13968 bytes left [ 2.131840] NET: Registered protocol family 38 [ 2.133376] Key type asymmetric registered [ 2.134780] Asymmetric key parser 'x509' registered [ 2.136331] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 2.138618] io scheduler noop registered [ 2.139592] io scheduler deadline registered (default) [ 2.140996] io scheduler cfq registered [ 2.141954] io scheduler mq-deadline registered [ 2.143119] io scheduler kyber registered [ 2.146943] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 2.148070] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 2.149734] intel_idle: does not run on family 6 model 62 [ 2.149846] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.151284] ACPI: Power Button [PWRF] [ 2.152483] GHES: HEST is not enabled! [ 2.210234] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 2.269950] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 2.348726] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.379092] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 2.409259] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 2.412919] Non-volatile memory driver v1.3 [ 2.414576] Linux agpgart interface v0.103 [ 2.416549] crash memory driver: version 1.1 [ 2.418767] nbd: registered device at major 43 [ 2.424175] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 2.424232] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 2.424284] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 2.424329] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 2.424372] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 2.431412] virtio_blk virtio1: [vda] 116096 512-byte logical blocks (59.4 MB/56.6 MiB) [ 2.438725] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 2.438764] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 2.438798] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 2.438832] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 2.438865] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 2.445072] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.455317] rdac: device handler registered [ 2.457153] hp_sw: device handler registered [ 2.458530] emc: device handler registered [ 2.459969] libphy: Fixed MDIO Bus: probed [ 2.463678] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.465800] ehci-pci: EHCI PCI platform driver [ 2.467276] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.469401] ohci-pci: OHCI PCI platform driver [ 2.470760] uhci_hcd: USB Universal Host Controller Interface driver [ 2.472923] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.476777] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.478563] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.480614] mousedev: PS/2 mouse device common for all mice [ 2.483044] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.486417] rtc_cmos 00:05: RTC can wake from S4 [ 2.488061] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 2.490575] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.494477] hidraw: raw HID events driver (C) Jiri Kosina [ 2.497581] usbcore: registered new interface driver usbhid [ 2.499749] usbhid: USB HID core driver [ 2.501457] drop_monitor: Initializing network drop monitor service [ 2.504213] Netfilter messages via NETLINK v0.30. [ 2.506315] TCP: cubic registered [ 2.507689] Initializing XFRM netlink socket [ 2.509915] NET: Registered protocol family 10 [ 2.513346] NET: Registered protocol family 17 [ 2.516014] Key type dns_resolver registered [ 2.518986] mce: Using 10 MCE banks [ 2.521425] Loading compiled-in X.509 certificates [ 2.524276] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 2.527831] registered taskstats version 1 [ 2.532676] modprobe (70) used greatest stack depth: 13456 bytes left [ 2.537466] Key type trusted registered [ 2.545053] Key type encrypted registered [ 2.547743] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 2.550844] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 2.553510] rtc_cmos 00:05: setting system clock to 2025-06-11 01:29:54 UTC (1749605394) [ 2.557078] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 2.558794] Write protecting the kernel read-only data: 12288k [ 2.560210] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 2.561809] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 2.571318] random: systemd: uninitialized urandom read (16 bytes read) [ 2.575473] random: systemd: uninitialized urandom read (16 bytes read) [ 2.578143] random: systemd: uninitialized urandom read (16 bytes read) [ 2.583135] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 2.590208] systemd[1]: Detected virtualization kvm. [ 2.592062] systemd[1]: Detected architecture x86-64. [ 2.594112] systemd[1]: Running in initial RAM disk. [ 2.598651] systemd[1]: No hostname configured. [ 2.599610] systemd[1]: Set hostname to . [ 2.600843] random: systemd: uninitialized urandom read (16 bytes read) [ 2.602436] systemd[1]: Initializing machine ID from random generator. [ 2.648119] dracut-rootfs-g (84) used greatest stack depth: 13264 bytes left [ 2.651186] random: systemd: uninitialized urandom read (16 bytes read) [ 2.652965] random: systemd: uninitialized urandom read (16 bytes read) [ 2.655000] random: systemd: uninitialized urandom read (16 bytes read) [ 2.656450] random: systemd: uninitialized urandom read (16 bytes read) [ 2.659653] random: systemd: uninitialized urandom read (16 bytes read) [ 2.662037] random: systemd: uninitialized urandom read (16 bytes read) [ 2.673283] systemd[1]: Reached target Swap. [ 2.675660] systemd[1]: Reached target Timers. [ 2.678429] systemd[1]: Reached target Local File Systems. [ 2.682485] systemd[1]: Created slice Root Slice. [ 2.687312] systemd[1]: Listening on Journal Socket. [ 2.692286] systemd[1]: Created slice System Slice. [ 2.696477] systemd[1]: Starting Journal Service... [ 2.699749] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 2.706468] systemd[1]: Starting Load Kernel Modules... [ 2.709495] systemd[1]: Reached target Slices. [ 2.711845] systemd[1]: Listening on udev Control Socket. [ 2.717181] systemd[1]: Starting dracut cmdline hook... [ 2.722899] systemd[1]: Starting Setup Virtual Console... [ 2.726613] systemd[1]: Listening on udev Kernel Socket. [ 2.731011] systemd[1]: Reached target Sockets. [ 2.734834] systemd[1]: Started Journal Service. [ 2.896061] random: fast init done [ 3.072267] tsc: Refined TSC clocksource calibration: 2399.986 MHz [ 3.244145] libata version 3.00 loaded. [ 3.255446] ata_piix 0000:00:01.1: version 2.13 [ 3.262105] scsi host0: ata_piix [ 3.265662] scsi host1: ata_piix [ 3.267793] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 3.269257] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 3.320541] ip (320) used greatest stack depth: 13080 bytes left [ 3.329323] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 3.369742] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 3.372269] ip (344) used greatest stack depth: 12464 bytes left [ 3.464310] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 6.377099] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 6.755564] systemd-journald[98]: Received SIGTERM from PID 1 (systemd). [ 7.069059] SELinux: Disabled at runtime. [ 7.070755] SELinux: Unregistering netfilter hooks [ 7.165711] ip_tables: (C) 2000-2006 Netfilter Core Team [ 7.167720] systemd[1]: Inserted module 'ip_tables' [ 7.699443] systemd-journald[565]: Received request to flush runtime journal from PID 1 [ 7.881663] cryptd: max_cpu_qlen set to 1000 [ 7.883832] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 7.911460] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 7.939389] AVX version of gcm_enc/dec engaged. [ 7.941383] AES CTR mode by8 optimization enabled [ 7.967588] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 7.981304] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 8.001867] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 8.003731] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 8.113816] EDAC MC: Ver: 3.0.0 [ 8.121160] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 8.121169] EDAC sbridge: Ver: 1.1.2 [ 10.469280] mount.nfs (767) used greatest stack depth: 10704 bytes left [ 27.914262] libcfs: loading out-of-tree module taints kernel. [ 27.915746] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 28.021986] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 28.026159] alg: No test for adler32 (adler32-zlib) [ 28.901185] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 29.063021] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 29.064449] LNet: Accept secure, port 988 [ 30.603257] Key type lgssc registered [ 30.875623] Lustre: Echo OBD driver; http://www.lustre.org/ [ 83.190820] Lustre: Mounted lustre-client [ 85.624820] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 96.443580] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing check_logdir /tmp/testlogs/ [ 97.338014] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing yml_node [ 98.380844] Lustre: DEBUG MARKER: Client: 2.16.56.1 [ 98.998424] Lustre: DEBUG MARKER: MDS: 2.16.56.1 [ 99.634292] Lustre: DEBUG MARKER: OSS: 2.16.56.1 [ 100.018489] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Jun 10 21:31:31 EDT 2025 [ 104.496468] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 104.857266] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 105.112228] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 115.133271] LustreError: 8710:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 115.145184] Lustre: Unmounted lustre-client [ 148.387873] random: crng init done [ 162.239382] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 163.008326] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 168.590449] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 186.255375] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 21:32:57 (1749605577) [ 192.909377] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 193.697480] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 197.840985] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 202.954494] Lustre: Mounted lustre-client [ 206.586432] LustreError: 14076:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b5a70800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 206.591973] LustreError: 14076:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 206.593783] LustreError: 14076:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 206.610935] Lustre: Unmounted lustre-client [ 243.839867] Lustre: Mounted lustre-client [ 245.759741] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 254.292389] LustreError: 16658:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b5a70000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 254.297884] LustreError: 16658:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 254.299878] LustreError: 16658:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 254.319120] Lustre: Unmounted lustre-client [ 300.464944] Lustre: Mounted lustre-client [ 306.120272] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 312.565005] LustreError: 18928:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012a468800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 312.568036] LustreError: 18928:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 312.571665] LustreError: 18928:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 312.573302] LustreError: 18928:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 312.590190] Lustre: Unmounted lustre-client [ 344.582461] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 21:35:36 (1749605736) [ 364.750347] Lustre: Mounted lustre-client [ 370.342760] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 376.503510] LustreError: 22247:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800a8450800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 376.506393] LustreError: 22247:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 376.510241] LustreError: 22247:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 376.512115] LustreError: 22247:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 376.529219] Lustre: Unmounted lustre-client [ 408.098871] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 21:36:39 (1749605799) [ 428.638483] Lustre: Mounted lustre-client [ 431.059491] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 438.643545] Lustre: lustre-MDT0000-mdc-ffff8800aa769000: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 448.659620] Lustre: lustre-MDT0001-mdc-ffff8800aa769000: Connection to lustre-MDT0001 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 453.664900] Lustre: lustre-OST0000-osc-ffff8800aa769000: disconnect after 23s idle [ 458.674926] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail [ 458.684558] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0xfd55da63514a7003 to 0xfd55da63514a7264 [ 458.691616] Lustre: MGC192.168.203.144@tcp: Connection restored to (at 192.168.203.144@tcp) [ 462.661150] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 478.692753] LustreError: lustre-MDT0000-mdc-ffff8800aa769000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 478.704058] Lustre: lustre-MDT0000-mdc-ffff8800aa769000: Connection restored to 192.168.203.144@tcp (at 192.168.203.144@tcp) [ 479.562777] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 16 sec [ 480.671359] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 481.293788] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 481.870439] LustreError: 26841:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800aa769000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 481.875651] LustreError: 26841:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 481.880920] LustreError: 26841:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 481.884793] LustreError: 26841:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 481.914277] Lustre: Unmounted lustre-client [ 515.785788] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 21:38:27 (1749605907) [ 541.043677] Lustre: Mounted lustre-client [ 543.423342] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 552.339658] LustreError: 30012:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b3b23000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 552.344982] LustreError: 30012:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 552.351665] LustreError: 30012:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 552.354682] LustreError: 30012:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 552.381211] Lustre: Unmounted lustre-client [ 588.341789] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 21:39:39 (1749605979) [ 589.187892] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 589.798430] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 21:39:41 (1749605981) [ 607.550890] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 615.208536] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 615.384797] Lustre: Mounted lustre-client [ 615.386892] Lustre: Skipped 2 previous similar messages [ 615.960171] Lustre: DEBUG MARKER: create test files [ 616.114685] dd (1211) used greatest stack depth: 10640 bytes left [ 624.180149] LustreError: 1334:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012b4d6800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 624.183964] LustreError: 1334:0:(lov_obd.c:784:lov_cleanup()) Skipped 5 previous similar messages [ 624.205235] LustreError: 1334:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 624.208677] LustreError: 1334:0:(obd_class.h:479:obd_check_dev()) Skipped 27 previous similar messages [ 624.237903] Lustre: Unmounted lustre-client [ 624.238987] Lustre: Skipped 2 previous similar messages [ 634.092928] Key type lgssc unregistered [ 634.191871] LNet: 1655:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 635.199854] LNet: Removed LNI 192.168.203.44@tcp [ 643.817235] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 643.821871] alg: No test for adler32 (adler32-zlib) [ 644.667182] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 644.746042] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 644.750584] LNet: Accept secure, port 988 [ 646.299311] Key type lgssc registered [ 646.683203] Lustre: Echo OBD driver; http://www.lustre.org/ [ 658.959075] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 665.599067] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 671.802199] Lustre: Mounted lustre-client [ 673.682781] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 673.753578] checkstat (3859) used greatest stack depth: 10624 bytes left [ 675.504434] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 676.652019] LustreError: 4159:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800aa62c800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 676.678185] LustreError: 4159:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 676.705199] Lustre: Unmounted lustre-client [ 686.506861] Key type lgssc unregistered [ 686.617819] LNet: 4479:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 687.625993] LNet: Removed LNI 192.168.203.44@tcp [ 697.113453] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 697.117881] alg: No test for adler32 (adler32-zlib) [ 697.966442] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 698.048761] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 698.051739] LNet: Accept secure, port 988 [ 699.603293] Key type lgssc registered [ 699.984479] Lustre: Echo OBD driver; http://www.lustre.org/ [ 712.552354] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 719.061952] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 725.255259] Lustre: Mounted lustre-client [ 727.151266] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 728.746051] LustreError: 6850:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b5a69000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 728.765268] LustreError: 6850:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 728.794249] Lustre: Unmounted lustre-client [ 744.270957] Key type lgssc unregistered [ 744.357745] LNet: 7173:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 745.365826] LNet: Removed LNI 192.168.203.44@tcp [ 754.818179] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 754.821808] alg: No test for adler32 (adler32-zlib) [ 755.662664] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 755.739851] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 755.742683] LNet: Accept secure, port 988 [ 757.294373] Key type lgssc registered [ 757.670043] Lustre: Echo OBD driver; http://www.lustre.org/ [ 787.861192] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 789.156503] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 797.028925] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 818.409067] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 21:43:30 (1749606210) [ 858.578507] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 859.816704] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 867.593707] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 899.321525] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 21:44:50 (1749606290) [ 909.647799] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 910.886550] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 917.188839] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 956.232472] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 976.540583] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 21:46:08 (1749606368) [ 977.069370] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 977.675205] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 21:46:09 (1749606369) [ 978.266781] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 978.907510] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 21:46:10 (1749606370) [ 979.473339] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 980.153162] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 21:46:11 (1749606371) [ 980.754520] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 983.641735] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 985.560760] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1027.630509] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1028.890997] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1036.631456] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1067.582895] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 21:47:39 (1749606459) [ 1077.523891] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1078.710165] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1085.173929] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1104.693099] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1108.325637] Lustre: Mounted lustre-client [ 1117.290657] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 [ 1128.485643] Lustre: lustre-MDT0000-mdc-ffff8800b5a6d000: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1143.507859] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail [ 1143.517038] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0xfbf4b94aa0b57fee to 0xfbf4b94aa0b641b7 [ 1143.524097] Lustre: MGC192.168.203.144@tcp: Connection restored to (at 192.168.203.144@tcp) [ 1145.681783] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800aa5a6300 x1834595015206656/t8589934597(8589934597) o101->lustre-MDT0000-mdc-ffff8800b5a6d000@192.168.203.144@tcp:12/10 lens 592/608 e 0 to 0 dl 1749606553 ref 2 fl Interpret:RQU/604/0 rc 301/301 job:'' uid:0 gid:0 projid:0 [ 1146.399074] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800aa5a6a00 x1834595015207296/t8589934599(8589934599) o101->lustre-MDT0000-mdc-ffff8800b5a6d000@192.168.203.144@tcp:12/10 lens 592/608 e 0 to 0 dl 1749606553 ref 2 fl Interpret:RQU/604/0 rc 301/301 job:'' uid:0 gid:0 projid:0 [ 1147.765220] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800aa5a7800 x1834595015208576/t8589934603(8589934603) o101->lustre-MDT0000-mdc-ffff8800b5a6d000@192.168.203.144@tcp:12/10 lens 592/608 e 0 to 0 dl 1749606555 ref 2 fl Interpret:RQU/604/0 rc 301/301 job:'' uid:0 gid:0 projid:0 [ 1147.778810] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) Skipped 1 previous similar message [ 1150.113002] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a8398a80 x1834595015210496/t8589934609(8589934609) o101->lustre-MDT0000-mdc-ffff8800b5a6d000@192.168.203.144@tcp:12/10 lens 592/608 e 0 to 0 dl 1749606557 ref 2 fl Interpret:RQU/604/0 rc 301/301 job:'' uid:0 gid:0 projid:0 [ 1150.127868] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) Skipped 2 previous similar messages [ 1154.650985] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a839b480 x1834595015214336/t8589934621(8589934621) o101->lustre-MDT0000-mdc-ffff8800b5a6d000@192.168.203.144@tcp:12/10 lens 592/608 e 0 to 0 dl 1749606562 ref 2 fl Interpret:RQU/604/0 rc 301/301 job:'' uid:0 gid:0 projid:0 [ 1154.660031] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) Skipped 5 previous similar messages [ 1163.416072] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a954c380 x1834595015221376/t8589934643(8589934643) o101->lustre-MDT0000-mdc-ffff8800b5a6d000@192.168.203.144@tcp:12/10 lens 592/608 e 0 to 0 dl 1749606570 ref 2 fl Interpret:RQU/604/0 rc 301/301 job:'' uid:0 gid:0 projid:0 [ 1163.429712] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) Skipped 10 previous similar messages [ 1179.806249] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff880136b79880 x1834595015234816/t8589934685(8589934685) o101->lustre-MDT0000-mdc-ffff8800b5a6d000@192.168.203.144@tcp:12/10 lens 592/608 e 0 to 0 dl 1749606587 ref 2 fl Interpret:RQU/604/0 rc 301/301 job:'' uid:0 gid:0 projid:0 [ 1179.819998] LustreError: 7772:0:(client.c:3393:ptlrpc_replay_interpret()) Skipped 20 previous similar messages [ 1202.830935] LustreError: lustre-MDT0000-mdc-ffff8800b5a6d000: operation mds_close to node 192.168.203.144@tcp failed: rc = -107 [ 1202.853340] Lustre: lustre-MDT0000-mdc-ffff880136bae000: Connection restored to (at 192.168.203.144@tcp) [ 1206.628823] LustreError: lustre-MDT0000-mdc-ffff8800b5a6d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 1206.710641] LustreError: 29303:0:(file.c:6187:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 [ 1206.783145] Lustre: lustre-MDT0000-mdc-ffff8800b5a6d000: Connection restored to (at 192.168.203.144@tcp) [ 1208.384647] LustreError: 29453:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b5a6d000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1208.389206] LustreError: 29453:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 1208.416250] Lustre: Unmounted lustre-client [ 1234.773061] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 21:50:26 (1749606626) [ 1293.418256] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1297.119207] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 21:51:28 (1749606688) [ 1315.310292] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1353.971002] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1355.194393] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1362.624325] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1383.625008] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 21:52:55 (1749606775) [ 1384.528391] Key type lgssc unregistered [ 1384.647698] LNet: 4533:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1385.659011] LNet: Removed LNI 192.168.203.44@tcp [ 1394.619875] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 1394.623463] alg: No test for adler32 (adler32-zlib) [ 1395.478560] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 1395.556910] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 1395.559644] LNet: Accept secure, port 988 [ 1397.112332] Key type lgssc registered [ 1397.482320] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1433.907654] Lustre: Mounted lustre-client [ 1434.112744] LustreError: 7750:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b58b6000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1434.117611] LustreError: 7750:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1434.128176] Lustre: Unmounted lustre-client [ 1448.582371] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 21:54:00 (1749606840) [ 1457.657061] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 21:54:09 (1749606849) [ 1494.675544] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1495.630068] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1502.077255] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1518.125714] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 21:55:09 (1749606909) [ 1526.481178] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1527.527834] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1532.618419] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1532.807194] Lustre: Mounted lustre-client [ 1537.931798] touch (16275) used greatest stack depth: 10416 bytes left [ 1554.178258] Lustre: 16290:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749606930/real 1749606930] req@ffff8800b6fdce00 x1834595686310784/t0(0) o36->lustre-MDT0000-mdc-ffff88012b4d5000@192.168.203.144@tcp:12/10 lens 488/512 e 0 to 1 dl 1749606946 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1554.180469] Lustre: lustre-MDT0000-mdc-ffff88012b4d5000: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1554.193169] Lustre: 16290:0:(client.c:2451:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 1554.193762] Lustre: lustre-MDT0000-mdc-ffff88012b4d5000: Connection restored to (at 192.168.203.144@tcp) [ 1570.464330] Lustre: 16333:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749606946/real 1749606946] req@ffff8800b6fdea00 x1834595686319232/t0(0) o36->lustre-MDT0000-mdc-ffff88012b4d5000@192.168.203.144@tcp:12/10 lens 488/512 e 0 to 1 dl 1749606962 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1570.469210] Lustre: lustre-MDT0000-mdc-ffff88012b4d5000: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1570.475463] Lustre: 16333:0:(client.c:2451:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 1570.476054] Lustre: lustre-MDT0000-mdc-ffff88012b4d5000: Connection restored to (at 192.168.203.144@tcp) [ 1570.598230] LustreError: 16390:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012b4d5000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1570.600955] LustreError: 16390:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 1570.605506] LustreError: 16390:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1570.607146] LustreError: 16390:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1570.622010] Lustre: Unmounted lustre-client [ 1587.260351] Key type lgssc unregistered [ 1587.358036] LNet: 16766:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1588.368883] LNet: Removed LNI 192.168.203.44@tcp [ 1593.988887] Lustre: DEBUG MARKER: == conf-sanity test 90b: check max_mod_rpcs_in_flight is enforced after update ========================================================== 21:56:25 (1749606985) [ 1594.625518] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1594.631882] alg: No test for adler32 (adler32-zlib) [ 1595.445703] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 1595.499305] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 1595.501001] LNet: Accept secure, port 988 [ 1597.046405] Key type lgssc registered [ 1597.437499] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1608.021597] Lustre: DEBUG MARKER: conf-sanity test_90b: @@@@@@ FAIL: MDT start failed [ 1609.917642] Lustre: DEBUG MARKER: == conf-sanity test 90c: check max_mod_rpcs_in_flight update limits ========================================================== 21:56:41 (1749607001) [ 1613.187281] Lustre: DEBUG MARKER: conf-sanity test_90c: @@@@@@ FAIL: MDT start failed [ 1614.992654] Lustre: DEBUG MARKER: == conf-sanity test 90d: check one close RPC is allowed above max_mod_rpcs_in_flight ========================================================== 21:56:46 (1749607006) [ 1618.216044] Lustre: DEBUG MARKER: conf-sanity test_90d: @@@@@@ FAIL: MDT start failed [ 1620.012625] Lustre: DEBUG MARKER: == conf-sanity test 91: evict-by-nid support ============= 21:56:51 (1749607011) [ 1623.365869] Lustre: DEBUG MARKER: conf-sanity test_91: @@@@@@ FAIL: MDS start failed [ 1625.134750] Lustre: DEBUG MARKER: == conf-sanity test 92: ldev returns MGS NID correctly in command substitution ========================================================== 21:56:56 (1749607016) [ 1628.318341] Lustre: DEBUG MARKER: == conf-sanity test 93: register mulitple MDT at the same time ========================================================== 21:56:59 (1749607019) [ 1628.843863] Lustre: DEBUG MARKER: SKIP: conf-sanity test_93 needs >= 3 MDTs [ 1629.442327] Lustre: DEBUG MARKER: == conf-sanity test 94: ldev outputs correct labels for file system name query ========================================================== 21:57:00 (1749607020) [ 1632.161355] Lustre: DEBUG MARKER: == conf-sanity test 95: ldev should only allow one label filter ========================================================== 21:57:03 (1749607023) [ 1635.157518] Lustre: DEBUG MARKER: == conf-sanity test 96: ldev returns hostname and backend fs correctly in command sub ========================================================== 21:57:06 (1749607026) [ 1637.865642] Lustre: DEBUG MARKER: == conf-sanity test 97: ldev returns correct ouput when querying based on role ========================================================== 21:57:09 (1749607029) [ 1640.551187] Lustre: DEBUG MARKER: == conf-sanity test 98: Buffer-overflow check while parsing mount_opts ========================================================== 21:57:11 (1749607031) [ 1643.843208] Lustre: DEBUG MARKER: conf-sanity test_98: @@@@@@ FAIL: MDT start failed [ 1645.448256] Lustre: DEBUG MARKER: == conf-sanity test 99: Adding meta_bg option ============ 21:57:17 (1749607037) [ 1652.257380] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 21:57:23 (1749607043) [ 1677.549042] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1678.760281] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1686.012271] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1688.181643] Lustre: Mounted lustre-client [ 1689.246952] LustreError: 31655:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800ab8e4000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 1689.252189] LustreError: 31655:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 1689.269172] Lustre: Unmounted lustre-client [ 1705.072926] Key type lgssc unregistered [ 1705.154540] LNet: 32029:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1706.162548] LNet: Removed LNI 192.168.203.44@tcp [ 1710.605173] Lustre: DEBUG MARKER: == conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 21:58:22 (1749607102) [ 1711.012894] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1711.018207] alg: No test for adler32 (adler32-zlib) [ 1711.845877] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 1711.917099] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 1711.919577] LNet: Accept secure, port 988 [ 1713.465373] Key type lgssc registered [ 1713.827113] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1722.056979] Lustre: DEBUG MARKER: conf-sanity test_101a: @@@@@@ FAIL: MDT start failed [ 1723.367928] Lustre: DEBUG MARKER: == conf-sanity test 101b: Race events DISCONNECT and ACTIVE in osp ========================================================== 21:58:34 (1749607114) [ 1725.535559] Lustre: DEBUG MARKER: conf-sanity test_101b: @@@@@@ FAIL: MDT start failed [ 1726.605879] Lustre: DEBUG MARKER: SKIP: conf-sanity test_102 skipping excluded test 102 [ 1726.974399] Lustre: DEBUG MARKER: == conf-sanity test 103: rename filesystem name ========== 21:58:38 (1749607118) [ 1892.858606] LustreError: 4677:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 2048.864421] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 2048.871481] Lustre: Unmounted lustre-client [ 2048.876196] LustreError: 4677:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 2048.881632] LustreError: 4677:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 2054.964866] LustreError: 4833:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 2061.296533] LustreError: 4842:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 2210.969351] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 2210.975363] Lustre: Unmounted lustre-client [ 2210.976622] LustreError: 4833:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 2210.978988] LustreError: 4833:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 2210.982437] LustreError: 4833:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 2212.834847] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2219.053512] Lustre: DEBUG MARKER: conf-sanity test_103: @@@@@@ FAIL: Fail to mkdir /mnt/lustre/d103.conf-sanity. [ 2220.913407] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 22:06:52 (1749607612) [ 2292.689880] Lustre: client wants to enable acl, but mdt not! [ 2292.699177] Lustre: Mounted lustre-client [ 2294.438025] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 22:08:06 (1749607686) [ 2294.561563] Lustre: client wants to enable acl, but mdt not! [ 2294.569640] Lustre: Mounted lustre-client [ 2294.794979] LustreError: 9566:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b6ca6800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2294.803284] LustreError: 9566:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 2294.805276] LustreError: 9566:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 2294.831271] Lustre: Unmounted lustre-client [ 2297.070556] LustreError: 10136:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800ab8ea000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2297.074619] LustreError: 10136:0:(lov_obd.c:784:lov_cleanup()) Skipped 3 previous similar messages [ 2297.080730] LustreError: 10136:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 2297.083124] LustreError: 10136:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 2297.110201] Lustre: Unmounted lustre-client [ 2297.111172] Lustre: Skipped 1 previous similar message [ 2297.563683] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 22:08:09 (1749607689) [ 2297.737701] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 2307.762236] LustreError: 10320:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 2307.766482] LustreError: 10320:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2307.784677] Lustre: Unmounted lustre-client [ 2329.956370] Key type lgssc unregistered [ 2330.050490] LNet: 10707:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2331.055635] LNet: Removed LNI 192.168.203.44@tcp [ 2342.326734] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2342.331350] alg: No test for adler32 (adler32-zlib) [ 2343.144961] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 2343.195166] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 2343.196794] LNet: Accept secure, port 988 [ 2344.727437] Key type lgssc registered [ 2344.954575] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2362.909888] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2363.771157] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2369.239300] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2370.340306] Lustre: Mounted lustre-client [ 2370.411396] Lustre: Remounted lustre-client read-only [ 2370.619898] LustreError: 14456:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800ab8eb800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2370.627362] LustreError: 14456:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2370.646233] Lustre: Unmounted lustre-client [ 2386.317824] Key type lgssc unregistered [ 2386.399412] LNet: 14832:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2387.404565] LNet: Removed LNI 192.168.203.44@tcp [ 2391.722638] Lustre: DEBUG MARKER: SKIP: conf-sanity test_106 skipping SLOW test 106 [ 2392.104590] Lustre: DEBUG MARKER: == conf-sanity test 107: Unknown config param should not fail target mounting ========================================================== 22:09:43 (1749607783) [ 2392.571069] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2392.575967] alg: No test for adler32 (adler32-zlib) [ 2393.383276] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 2393.425658] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 2393.426967] LNet: Accept secure, port 988 [ 2394.954263] Key type lgssc registered [ 2395.163412] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2402.745712] Lustre: DEBUG MARKER: conf-sanity test_107: @@@@@@ FAIL: start_mgsmds failed [ 2403.934365] Lustre: DEBUG MARKER: == conf-sanity test 108a: migrate from ldiskfs to ZFS ==== 22:09:55 (1749607795) [ 2404.274675] Lustre: DEBUG MARKER: SKIP: conf-sanity test_108a zfs only test [ 2404.649828] Lustre: DEBUG MARKER: == conf-sanity test 108b: migrate from ZFS to ldiskfs ==== 22:09:56 (1749607796) [ 2419.600859] Lustre: DEBUG MARKER: conf-sanity test_108b: @@@@@@ FAIL: failed to mount mdt1 [ 2420.772168] Lustre: DEBUG MARKER: conf-sanity test_108b: @@@@@@ FAIL: failed to umount client [ 2421.853074] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 22:10:13 (1749607813) [ 2447.279437] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2448.155219] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2453.857237] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2460.997971] Lustre: Mounted lustre-client [ 2517.348337] LustreError: 24048:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b7b40000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2517.352484] LustreError: 24048:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2517.371214] Lustre: Unmounted lustre-client [ 2544.413890] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2545.229670] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2549.742523] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2549.861334] Lustre: Mounted lustre-client [ 2567.250474] LustreError: 25986:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b6210800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2567.258678] LustreError: 25986:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2567.261101] LustreError: 25986:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2567.281685] Lustre: Unmounted lustre-client [ 2583.543381] Key type lgssc unregistered [ 2583.636509] LNet: 26361:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2584.643549] LNet: Removed LNI 192.168.203.44@tcp [ 2589.261271] Lustre: DEBUG MARKER: == conf-sanity test 109b: test lctl clear_conf one config ========================================================== 22:13:00 (1749607980) [ 2596.520955] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2596.525832] alg: No test for adler32 (adler32-zlib) [ 2597.340417] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 2597.388577] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 2597.390248] LNet: Accept secure, port 988 [ 2598.921275] Key type lgssc registered [ 2599.161921] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2621.257407] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2622.095867] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2627.679176] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2633.793770] Lustre: Mounted lustre-client [ 2687.279322] LustreError: 31389:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b6ed2800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2687.283598] LustreError: 31389:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2687.299181] Lustre: Unmounted lustre-client [ 2714.538196] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2715.333803] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2719.579531] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2719.685608] Lustre: Mounted lustre-client [ 2733.730291] LustreError: 893:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b6e7f000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2733.735528] LustreError: 893:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 2733.737225] LustreError: 893:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2733.751962] Lustre: Unmounted lustre-client [ 2749.538916] Key type lgssc unregistered [ 2749.625550] LNet: 1271:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2750.630434] LNet: Removed LNI 192.168.203.44@tcp [ 2755.189998] Lustre: DEBUG MARKER: == conf-sanity test 110: Adding large_dir with 3-level htree ========================================================== 22:15:46 (1749608146) [ 2758.282276] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2758.286928] alg: No test for adler32 (adler32-zlib) [ 2759.104481] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 2759.156668] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 2759.159279] LNet: Accept secure, port 988 [ 2760.695300] Key type lgssc registered [ 2760.930270] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2784.886417] Lustre: Mounted lustre-client [ 2786.243857] Lustre: Mounted lustre-client [ 2923.533147] LustreError: 5362:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012b4d5000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 2923.536799] LustreError: 5362:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup [ 2923.545566] Lustre: Unmounted lustre-client [ 2956.135030] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2956.971652] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2962.730640] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2983.017273] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 2983.390951] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 22:19:35 (1749608375) [ 2990.505263] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2991.336426] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2995.786829] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3001.058392] Lustre: Mounted lustre-client [ 3002.684069] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6fc7000.ost_server_uuid 50 [ 3003.063599] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8800b6fc7000.ost_server_uuid in FULL state after 0 sec [ 3003.943714] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6fc7000.ost_server_uuid 50 [ 3004.316884] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8800b6fc7000.ost_server_uuid in FULL state after 0 sec [ 3016.082359] Lustre: lustre-OST0001-osc-ffff8800b6fc7000: Connection to lustre-OST0001 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 3022.163471] LustreError: 12445:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b6fc7000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3022.168122] LustreError: 12445:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message [ 3022.172307] LustreError: 12445:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 3022.175107] LustreError: 12445:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 3022.194220] Lustre: Unmounted lustre-client [ 3022.195640] Lustre: Skipped 1 previous similar message [ 3038.047898] Key type lgssc unregistered [ 3038.131516] LNet: 12821:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3039.136525] LNet: Removed LNI 192.168.203.44@tcp [ 3043.581790] Lustre: DEBUG MARKER: == conf-sanity test 112b: mount MDT with no_create option ========================================================== 22:20:35 (1749608435) [ 3044.033530] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3044.063860] alg: No test for adler32 (adler32-zlib) [ 3044.874152] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 3044.921068] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 3044.924039] LNet: Accept secure, port 988 [ 3046.455249] Key type lgssc registered [ 3046.688966] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3054.674922] Lustre: DEBUG MARKER: conf-sanity test_112b: @@@@@@ FAIL: MDS start failed [ 3055.985175] Lustre: DEBUG MARKER: == conf-sanity test 113: Shadow mountpoint correctly report ro/rw for mounts ========================================================== 22:20:47 (1749608447) [ 3240.518245] LustreError: 17257:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 3247.196482] LustreError: 17266:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 3396.521382] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 3396.528233] Lustre: Unmounted lustre-client [ 3396.530276] LustreError: 17257:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 3396.533225] LustreError: 17257:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 3402.576408] LustreError: 17414:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 3410.956457] LustreError: 17423:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 3558.578349] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 3558.586691] Lustre: Unmounted lustre-client [ 3558.589282] LustreError: 17414:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 3558.592045] LustreError: 17414:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 3558.597210] LustreError: 17414:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 3560.485740] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3601.019558] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 3601.399011] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 3601.763268] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 22:29:53 (1749608993) [ 3633.877119] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3634.813720] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3640.066566] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3659.999176] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 22:30:51 (1749609051) [ 3666.679804] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3667.500007] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3671.736225] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3672.854586] Lustre: Mounted lustre-client [ 3678.478196] LustreError: 26675:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012b43f000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3678.483067] LustreError: 26675:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3678.484787] LustreError: 26675:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 3678.500212] Lustre: Unmounted lustre-client [ 3690.390667] Key type lgssc unregistered [ 3690.481594] LNet: 27047:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3691.486522] LNet: Removed LNI 192.168.203.44@tcp [ 3696.301136] Lustre: DEBUG MARKER: == conf-sanity test 119: writeconf on slave mdt shouldn't duplicate mdc/osp and crash ========================================================== 22:31:27 (1749609087) [ 3697.547092] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3697.550797] alg: No test for adler32 (adler32-zlib) [ 3698.355895] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 3698.398458] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 3698.400344] LNet: Accept secure, port 988 [ 3699.925303] Key type lgssc registered [ 3700.116401] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3707.872086] Lustre: DEBUG MARKER: conf-sanity test_119: @@@@@@ FAIL: MDT start failed [ 3709.030493] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 22:31:40 (1749609100) [ 3711.453948] Lustre: DEBUG MARKER: conf-sanity test_120: @@@@@@ FAIL: MDT start failed [ 3712.711896] Lustre: DEBUG MARKER: == conf-sanity test 121: failover MGS ==================== 22:31:44 (1749609104) [ 3717.828671] Lustre: DEBUG MARKER: conf-sanity test_121: @@@@@@ FAIL: MGS MDS Start failed [ 3719.064178] Lustre: DEBUG MARKER: == conf-sanity test 122a: Check OST sequence update ====== 22:31:50 (1749609110) [ 3743.611096] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3744.458439] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3749.972223] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3756.081758] Lustre: Mounted lustre-client [ 3759.280769] LustreError: 3019:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b6e79000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 3759.285409] LustreError: 3019:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 3759.491342] Lustre: Unmounted lustre-client [ 3775.222804] Key type lgssc unregistered [ 3775.304524] LNet: 3393:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3776.310542] LNet: Removed LNI 192.168.203.44@tcp [ 3780.702297] Lustre: DEBUG MARKER: == conf-sanity test 123aa: llog_print works with FIDs and simple names ========================================================== 22:32:52 (1749609172) [ 3781.141266] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3781.164325] alg: No test for adler32 (adler32-zlib) [ 3781.978103] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 3782.033329] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 3782.034903] LNet: Accept secure, port 988 [ 3783.566242] Key type lgssc registered [ 3783.770242] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3791.537586] Lustre: DEBUG MARKER: conf-sanity test_123aa: @@@@@@ FAIL: MDT start failed [ 3792.704938] Lustre: DEBUG MARKER: == conf-sanity test 123ab: llog_print params output values from set_param -P ========================================================== 22:33:04 (1749609184) [ 3794.913742] Lustre: DEBUG MARKER: conf-sanity test_123ab: @@@@@@ FAIL: MDT start failed [ 3796.088159] Lustre: DEBUG MARKER: == conf-sanity test 123ac: llog_print with --start and --end ========================================================== 22:33:07 (1749609187) [ 3798.631562] Lustre: DEBUG MARKER: conf-sanity test_123ac: @@@@@@ FAIL: MDT start failed [ 3799.866627] Lustre: DEBUG MARKER: == conf-sanity test 123ad: llog_print shows all records == 22:33:11 (1749609191) [ 3802.217580] Lustre: DEBUG MARKER: conf-sanity test_123ad: @@@@@@ FAIL: MDT start failed [ 3803.385322] Lustre: DEBUG MARKER: == conf-sanity test 123ae: llog_cancel can cancel requested record ========================================================== 22:33:15 (1749609195) [ 3965.030427] LustreError: 9845:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 3973.428401] LustreError: 9854:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 4121.032293] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 4121.036419] Lustre: Unmounted lustre-client [ 4121.037786] LustreError: 9845:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 4121.041539] LustreError: 9845:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 4127.082386] LustreError: 10001:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 4283.084280] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 4283.089094] Lustre: Unmounted lustre-client [ 4283.090469] LustreError: 10001:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 4283.093015] LustreError: 10001:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 4283.097502] LustreError: 10001:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 4284.913220] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4292.295059] Lustre: DEBUG MARKER: conf-sanity test_123ae: @@@@@@ FAIL: new set_param -P wasn't stored in params log [ 4294.217888] Lustre: DEBUG MARKER: == conf-sanity test 123af: llog_catlist can show all config files correctly ========================================================== 22:41:25 (1749609685) [ 4331.239285] LustreError: 12775:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 4487.241285] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 4487.245773] Lustre: Unmounted lustre-client [ 4487.247671] LustreError: 12775:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 4487.249995] LustreError: 12775:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 4487.254143] LustreError: 12775:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 4493.299329] LustreError: 12932:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 4649.303355] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 4649.310683] Lustre: Unmounted lustre-client [ 4649.312877] LustreError: 12932:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 4649.316079] LustreError: 12932:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 4649.321700] LustreError: 12932:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 4651.149537] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4657.969834] Lustre: DEBUG MARKER: conf-sanity test_123af: @@@@@@ FAIL: 0 != 0 - 1 [ 4659.476710] Lustre: DEBUG MARKER: == conf-sanity test 123ag: llog_print skips values deleted by set_param -P -d ========================================================== 22:47:31 (1749610051) [ 4661.755739] Lustre: DEBUG MARKER: conf-sanity test_123ag: @@@@@@ FAIL: MDT start failed [ 4662.938633] Lustre: DEBUG MARKER: == conf-sanity test 123ah: del_ost cancels config log entries correctly ========================================================== 22:47:34 (1749610054) [ 4699.942352] LustreError: 16432:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 4855.944285] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 4855.948638] Lustre: Unmounted lustre-client [ 4855.950029] LustreError: 16432:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 4855.952083] LustreError: 16432:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 4855.954243] LustreError: 16432:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 4861.993390] LustreError: 16587:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 5017.996340] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 5018.003046] Lustre: Unmounted lustre-client [ 5018.005592] LustreError: 16587:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 5018.008045] LustreError: 16587:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 5018.010907] LustreError: 16587:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 5019.824366] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5026.473252] Lustre: DEBUG MARKER: conf-sanity test_123ah: @@@@@@ FAIL: lustre-OST0000 not found (client) [ 5028.001012] Lustre: DEBUG MARKER: == conf-sanity test 123ai: llog_print display all non skipped records ========================================================== 22:53:39 (1749610419) [ 5030.438768] Lustre: DEBUG MARKER: conf-sanity test_123ai: @@@@@@ FAIL: MDT start failed [ 5031.568236] Lustre: DEBUG MARKER: == conf-sanity test 123aj: check permanent TBF rules ===== 22:53:43 (1749610423) [ 5033.654335] Lustre: DEBUG MARKER: conf-sanity test_123aj: @@@@@@ FAIL: MDT start failed [ 5034.760354] Lustre: DEBUG MARKER: == conf-sanity test 123F: clear and reset all parameters using set_param -F ========================================================== 22:53:46 (1749610426) [ 5036.824206] Lustre: DEBUG MARKER: conf-sanity test_123F: @@@@@@ FAIL: MDT start failed [ 5037.953361] Lustre: DEBUG MARKER: == conf-sanity test 123G: clear and reset all parameters using apply_yaml ========================================================== 22:53:49 (1749610429) [ 5040.127826] Lustre: DEBUG MARKER: conf-sanity test_123G: @@@@@@ FAIL: MDT start failed [ 5041.258937] Lustre: DEBUG MARKER: == conf-sanity test 123H: check concurent accesses with 'lctl llog_print ========================================================== 22:53:52 (1749610432) [ 5043.384783] Lustre: DEBUG MARKER: conf-sanity test_123H: @@@@@@ FAIL: MDT start failed [ 5044.538024] Lustre: DEBUG MARKER: == conf-sanity test 124: check failover after replace_nids ========================================================== 22:53:56 (1749610436) [ 5044.864210] Lustre: DEBUG MARKER: SKIP: conf-sanity test_124 needs MDT failover setup [ 5045.254554] Lustre: DEBUG MARKER: == conf-sanity test 126: mount in parallel shouldn't cause a crash ========================================================== 22:53:56 (1749610436) [ 5070.557915] Key type lgssc unregistered [ 5070.650819] LNet: 22323:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5071.659557] LNet: Removed LNI 192.168.203.44@tcp [ 5074.124591] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 5074.129688] alg: No test for adler32 (adler32-zlib) [ 5074.940912] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 5074.990744] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 5074.992236] LNet: Accept secure, port 988 [ 5076.519255] Key type lgssc registered [ 5076.713200] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5080.418279] Lustre: DEBUG MARKER: conf-sanity test_126: @@@@@@ FAIL: test_126 failed with 17 [ 5094.319743] Lustre: DEBUG MARKER: == conf-sanity test 127: direct io overwrite on full ost ========================================================== 22:54:45 (1749610485) [ 5097.640632] Key type lgssc unregistered [ 5097.713448] LNet: 24598:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5097.722405] LNet: Removed LNI 192.168.203.44@tcp [ 5099.478071] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 5099.481990] alg: No test for adler32 (adler32-zlib) [ 5100.329685] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 5100.407587] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 5100.410811] LNet: Accept secure, port 988 [ 5101.965342] Key type lgssc registered [ 5102.230502] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5107.272083] Lustre: DEBUG MARKER: conf-sanity test_127: @@@@@@ FAIL: MDT start failed [ 5109.077306] Lustre: DEBUG MARKER: == conf-sanity test 128: Force using remote logs with --nolocallogs ========================================================== 22:55:00 (1749610500) [ 5109.642182] Lustre: DEBUG MARKER: SKIP: conf-sanity test_128 need separate mgs device [ 5110.265916] Lustre: DEBUG MARKER: == conf-sanity test 129: attempt to connect an OST with the same index should fail ========================================================== 22:55:01 (1749610501) [ 5117.979268] Lustre: DEBUG MARKER: conf-sanity test_129: @@@@@@ FAIL: MGS/MDS start failed [ 5119.871901] Lustre: DEBUG MARKER: == conf-sanity test 130: re-register an MDT after writeconf ========================================================== 22:55:11 (1749610511) [ 5288.426436] LustreError: 29408:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 5296.703450] LustreError: 29422:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 5444.432508] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 5444.441018] Lustre: Unmounted lustre-client [ 5444.444140] LustreError: 29408:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 5444.447810] LustreError: 29408:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 5450.532573] LustreError: 29570:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 5458.966549] LustreError: 29584:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 5606.538470] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 5606.550444] Lustre: Unmounted lustre-client [ 5606.554058] LustreError: 29570:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 5606.557806] LustreError: 29570:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 5606.561977] LustreError: 29570:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 5608.822397] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5651.362527] Lustre: DEBUG MARKER: conf-sanity test_130: @@@@@@ FAIL: mdt2 start failed [ 5653.915719] Lustre: DEBUG MARKER: == conf-sanity test 131: MDT backup restore with project ID ========================================================== 23:04:05 (1749611045) [ 5708.971468] LustreError: 32506:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 5864.977519] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 5864.986473] Lustre: Unmounted lustre-client [ 5864.989310] LustreError: 32506:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 5864.993298] LustreError: 32506:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 5864.997699] LustreError: 32506:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 5871.076530] LustreError: 32667:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.144@tcp: failed processing log, type 1: rc = -5 [ 6027.081464] LustreError: MGC192.168.203.144@tcp: Confguration from log lustre-client failed from MGS -5. Communication error between node & MGS, a bad configuration, or other errors. See syslog for more info [ 6027.089791] Lustre: Unmounted lustre-client [ 6027.092657] LustreError: 32667:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup [ 6027.096334] LustreError: 32667:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 6027.100644] LustreError: 32667:0:(super25.c:181:lustre_fill_super()) llite: Unable to mount : rc = -5 [ 6029.258698] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6036.140255] Lustre: DEBUG MARKER: conf-sanity test_131: @@@@@@ FAIL: set dir project id failed [ 6038.041410] Lustre: DEBUG MARKER: == conf-sanity test 132: hsm_actions processed after failover ========================================================== 23:10:29 (1749611429) [ 6071.189530] Lustre: DEBUG MARKER: == conf-sanity test 133: stripe QOS: free space balance in a pool ========================================================== 23:11:02 (1749611462) [ 6071.666050] Lustre: DEBUG MARKER: SKIP: conf-sanity test_133 needs >= 4 OSTs [ 6072.182111] Lustre: DEBUG MARKER: == conf-sanity test 134: check_iam works without faults == 23:11:03 (1749611463) [ 6100.770895] Lustre: Mounted lustre-client [ 6102.781094] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6343.552021] Lustre: DEBUG MARKER: == conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 23:15:34 (1749611734) [ 6343.755416] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 6353.786047] LustreError: 21889:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup [ 6353.789879] LustreError: 21889:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 6353.810339] Lustre: Unmounted lustre-client [ 6402.478088] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6403.679955] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6411.266779] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6411.423143] Lustre: Mounted lustre-client [ 6931.163855] Lustre: 25618:0:(llog_cat.c:971:llog_cat_process_or_fork()) lustre-MDT0000-mdc-ffff8800aba09000: catlog [0xa:0x5:0x0] crosses index zero [ 6944.431051] LustreError: 1436:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800aba09000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 6944.434726] LustreError: 1436:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 6944.436337] LustreError: 1436:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6944.450184] Lustre: Unmounted lustre-client [ 6960.502719] Key type lgssc unregistered [ 6960.589685] LNet: 1813:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6961.596895] LNet: Removed LNI 192.168.203.44@tcp [ 6965.149281] Lustre: DEBUG MARKER: == conf-sanity test 136: don't panic with bad obdecho setup ========================================================== 23:25:56 (1749612356) [ 6971.097016] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6971.100907] alg: No test for adler32 (adler32-zlib) [ 6971.932487] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 6972.007383] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 6972.010489] LNet: Accept secure, port 988 [ 6973.557227] Key type lgssc registered [ 6973.727806] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7001.553784] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7002.788956] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7010.558548] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7017.768609] Lustre: Mounted lustre-client [ 7022.480576] LustreError: 6276:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800b6214000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7022.487285] LustreError: 6276:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7022.504194] Lustre: Unmounted lustre-client [ 7070.787238] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7072.028143] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7078.525946] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7098.380886] Lustre: DEBUG MARKER: == conf-sanity test 137: a new MDT should inherit pools, parameters and failnode ========================================================== 23:28:09 (1749612489) [ 7098.894919] Lustre: DEBUG MARKER: SKIP: conf-sanity test_137 needs >= 3 MDTs [ 7099.458663] Lustre: DEBUG MARKER: == conf-sanity test 140: remove_updatelog script actions ========================================================== 23:28:10 (1749612490) [ 7107.069001] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7108.224008] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7114.120329] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7114.299976] Lustre: Mounted lustre-client [ 7124.306138] Lustre: lustre-MDT0000-mdc-ffff8800abcd6800: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 7129.314973] Lustre: lustre-MDT0001-mdc-ffff8800abcd6800: Connection to lustre-MDT0001 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 7145.328194] Lustre: 2571:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749612521/real 1749612521] req@ffff8800a8006a00 x1834601533221120/t0(0) o400->MGC192.168.203.144@tcp@192.168.203.144@tcp:26/25 lens 224/224 e 0 to 1 dl 1749612537 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 7145.336508] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail [ 7248.394052] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7250.501557] LustreError: lustre-MDT0000-mdc-ffff8800abcd6800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 7250.516968] Lustre: lustre-MDT0000-mdc-ffff8800abcd6800: Connection restored to (at 192.168.203.144@tcp) [ 7250.918041] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 2 sec [ 7251.812860] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7255.508112] LustreError: lustre-MDT0001-mdc-ffff8800abcd6800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. [ 7255.521833] Lustre: lustre-MDT0001-mdc-ffff8800abcd6800: Connection restored to (at 192.168.203.144@tcp) [ 7256.344455] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 4 sec [ 7260.314490] LustreError: 13540:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8800abcd6800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7260.320976] LustreError: 13540:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7260.324569] LustreError: 13540:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7260.361241] Lustre: Unmounted lustre-client [ 7319.171981] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7320.413067] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7328.013003] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7349.440865] Lustre: DEBUG MARKER: == conf-sanity test 150: test setting max_cached_mb to a % ========================================================== 23:32:20 (1749612740) [ 7359.385204] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7360.639999] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7366.879108] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7382.098522] Lustre: Mounted lustre-client [ 7383.547840] LustreError: 19388:0:(lproc_llite.c:593:ll_max_cached_mb_seq_write()) lustre: can't set max cache more than 3730 MB [ 7386.033607] Lustre: DEBUG MARKER: == conf-sanity test 151a: damaged local config doesn't prevent mounting ========================================================== 23:32:57 (1749612777) [ 7386.256420] LustreError: 20049:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff88012b0b8800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 [ 7386.264710] LustreError: 20049:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup [ 7386.267427] LustreError: 20049:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7386.290240] Lustre: Unmounted lustre-client [ 7403.585985] Key type lgssc unregistered [ 7403.687728] LNet: 20425:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7404.698878] LNet: Removed LNI 192.168.203.44@tcp [ 7409.287277] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 7409.290375] alg: No test for adler32 (adler32-zlib) [ 7410.141310] Lustre: Lustre: Build Version: 2.16.56_1_g45307c0 [ 7410.227428] LNet: Added LNI 192.168.203.44@tcp [8/256/0/180] [ 7410.230669] LNet: Accept secure, port 988 [ 7411.782396] Key type lgssc registered [ 7412.161221] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7455.019557] Lustre: DEBUG MARKER: conf-sanity test_151a: @@@@@@ FAIL: MDS start failed