[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] mapped at [ffffffffff200b50] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2f2000-0xbffcffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5970 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1bb7 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1a53 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1ac7 00090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1b57 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1b8f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 302991752 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffd9fff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043832 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782298 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027499 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 3820316k/5224448k available (8172k kernel code, 1049120k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.361337] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.363178] pid_max: default: 32768 minimum: 301 [ 0.364330] Security Framework initialized [ 0.365288] SELinux: Initializing. [ 0.366050] SELinux: Starting in permissive mode [ 0.367355] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.370383] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.372402] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.373858] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.375550] Initializing cgroup subsys memory [ 0.376441] Initializing cgroup subsys devices [ 0.377439] Initializing cgroup subsys freezer [ 0.378391] Initializing cgroup subsys net_cls [ 0.379465] Initializing cgroup subsys blkio [ 0.380482] Initializing cgroup subsys perf_event [ 0.381569] Initializing cgroup subsys hugetlb [ 0.382543] Initializing cgroup subsys pids [ 0.383401] Initializing cgroup subsys net_prio [ 0.384579] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.386911] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.388010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.388990] tlb_flushall_shift: 6 [ 0.389742] FEATURE SPEC_CTRL Present [ 0.390551] FEATURE IBPB_SUPPORT Present [ 0.391444] Spectre V2 : Enabling Indirect Branch Prediction Barrier [ 0.392812] Spectre V2 : Vulnerable [ 0.393559] Speculative Store Bypass: Vulnerable [ 0.395322] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.401317] ACPI: Core revision 20130517 [ 0.403495] ACPI: All ACPI Tables successfully acquired [ 0.404742] ftrace: allocating 30294 entries in 119 pages [ 0.449491] Enabling x2apic [ 0.450219] Enabled x2apic [ 0.451142] Switched APIC routing to physical x2apic. [ 0.453552] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.454956] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (fam: 06, model: 3e, stepping: 04) [ 0.457285] TSC deadline timer enabled [ 0.457393] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.459313] ... version: 2 [ 0.460232] ... bit width: 48 [ 0.461088] ... generic registers: 4 [ 0.461913] ... value mask: 0000ffffffffffff [ 0.463057] ... max period: 00007fffffffffff [ 0.464305] ... fixed-purpose events: 3 [ 0.465137] ... event mask: 000000070000000f [ 0.466321] KVM setup paravirtual spinlock [ 0.470132] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.472336] KVM setup async PF for cpu 1 [ 0.473048] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.474471] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.476810] KVM setup async PF for cpu 2 [ 0.468983] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.477206] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.478531] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.479435] Brought up 4 CPUs [ 0.479443] KVM setup async PF for cpu 3 [ 0.479449] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.481916] smpboot: Max logical packages: 1 [ 0.482789] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.485798] devtmpfs: initialized [ 0.486671] x86/mm: Memory block size: 128MB [ 0.490376] EVM: security.selinux [ 0.491213] EVM: security.ima [ 0.491813] EVM: security.capability [ 0.493994] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.495531] NET: Registered protocol family 16 [ 0.496682] cpuidle: using governor haltpoll [ 0.497836] ACPI: bus type PCI registered [ 0.498700] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.500215] PCI: Using configuration type 1 for base access [ 0.501446] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.507985] ACPI: Added _OSI(Module Device) [ 0.509153] ACPI: Added _OSI(Processor Device) [ 0.510715] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.512198] ACPI: Added _OSI(Processor Aggregator Device) [ 0.513908] ACPI: Added _OSI(Linux-Dell-Video) [ 0.516127] ACPI: EC: Look up EC in DSDT [ 0.518721] ACPI: Interpreter enabled [ 0.519992] ACPI: (supports S0 S3 S4 S5) [ 0.521076] ACPI: Using IOAPIC for interrupt routing [ 0.522204] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.524771] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.532226] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.534189] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.535913] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.537536] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.540905] acpiphp: Slot [2] registered [ 0.542020] acpiphp: Slot [3] registered [ 0.543048] acpiphp: Slot [4] registered [ 0.544067] acpiphp: Slot [5] registered [ 0.545107] acpiphp: Slot [6] registered [ 0.546073] acpiphp: Slot [7] registered [ 0.547049] acpiphp: Slot [8] registered [ 0.548150] acpiphp: Slot [9] registered [ 0.549130] acpiphp: Slot [10] registered [ 0.550085] acpiphp: Slot [11] registered [ 0.551026] acpiphp: Slot [12] registered [ 0.551906] acpiphp: Slot [13] registered [ 0.552831] acpiphp: Slot [14] registered [ 0.553707] acpiphp: Slot [15] registered [ 0.554611] acpiphp: Slot [16] registered [ 0.555497] acpiphp: Slot [17] registered [ 0.556373] acpiphp: Slot [18] registered [ 0.557287] acpiphp: Slot [19] registered [ 0.558133] acpiphp: Slot [20] registered [ 0.558949] acpiphp: Slot [21] registered [ 0.559812] acpiphp: Slot [22] registered [ 0.560618] acpiphp: Slot [23] registered [ 0.561314] acpiphp: Slot [24] registered [ 0.562090] acpiphp: Slot [25] registered [ 0.562893] acpiphp: Slot [26] registered [ 0.563765] acpiphp: Slot [27] registered [ 0.564598] acpiphp: Slot [28] registered [ 0.565373] acpiphp: Slot [29] registered [ 0.566161] acpiphp: Slot [30] registered [ 0.567011] acpiphp: Slot [31] registered [ 0.567749] PCI host bridge to bus 0000:00 [ 0.568580] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.569657] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.570791] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.572024] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.573191] pci_bus 0000:00: root bus resource [mem 0x140000000-0x1bfffffff window] [ 0.574429] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.575337] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.575846] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.576500] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.580008] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.581436] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.582687] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.583803] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.584951] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.586191] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.586614] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.587811] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.589723] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.590572] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.595091] pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 0.596441] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.597148] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.599658] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.601898] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.605843] pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 0.608008] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.609798] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.612137] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.618140] pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 0.620710] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 0.621991] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 0.623152] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 0.624682] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 0.625825] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 0.627345] vgaarb: loaded [ 0.628012] SCSI subsystem initialized [ 0.628643] ACPI: bus type USB registered [ 0.629350] usbcore: registered new interface driver usbfs [ 0.630349] usbcore: registered new interface driver hub [ 0.631269] usbcore: registered new device driver usb [ 0.632928] PCI: Using ACPI for IRQ routing [ 0.633689] PCI: pci_cache_line_size set to 64 bytes [ 0.633802] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 0.633805] e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] [ 0.633807] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 0.634025] NetLabel: Initializing [ 0.634604] NetLabel: domain hash size = 128 [ 0.635349] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.636181] NetLabel: unlabeled traffic allowed by default [ 0.637252] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.638130] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.642240] amd_nb: Cannot enumerate AMD northbridges [ 0.643158] Switched to clocksource kvm-clock [ 0.655408] pnp: PnP ACPI init [ 0.655997] ACPI: bus type PNP registered [ 0.656787] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 0.656840] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 0.656868] pnp 00:02: [dma 2] [ 0.656896] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 0.656948] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.657014] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.657066] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.657311] pnp: PnP ACPI: found 6 devices [ 0.658035] ACPI: bus type PNP unregistered [ 0.666485] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.666488] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.666490] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.666492] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.666494] pci_bus 0000:00: resource 8 [mem 0x140000000-0x1bfffffff window] [ 0.666530] NET: Registered protocol family 2 [ 0.667623] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 0.669285] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 0.671304] TCP: Hash tables configured (established 32768 bind 32768) [ 0.672465] TCP: reno registered [ 0.673125] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 0.674280] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 0.675786] NET: Registered protocol family 1 [ 0.677096] RPC: Registered named UNIX socket transport module. [ 0.679550] RPC: Registered udp transport module. [ 0.681643] RPC: Registered tcp transport module. [ 0.683774] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.686863] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.688107] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.689236] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.690404] PCI: CLS 0 bytes, default 64 [ 0.690490] Unpacking initramfs... [ 1.872779] debug: unmapping init [mem 0xffff8800bc2f2000-0xffff8800bffcffff] [ 1.875109] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.876292] software IO TLB [mem 0xb82f2000-0xbc2f2000] (64MB) mapped at [ffff8800b82f2000-ffff8800bc2f1fff] [ 1.878106] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 10737418240 ms ovfl timer [ 1.879538] RAPL PMU: hw unit of domain pp0-core 2^-0 Joules [ 1.880535] RAPL PMU: hw unit of domain package 2^-0 Joules [ 1.881562] RAPL PMU: hw unit of domain dram 2^-0 Joules [ 1.883819] cryptomgr_test (51) used greatest stack depth: 14128 bytes left [ 1.884187] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 1.884234] Initialise system trusted keyring [ 1.912864] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 1.914026] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 1.918314] zpool: loaded [ 1.918802] zbud: loaded [ 1.919548] VFS: Disk quotas dquot_6.6.0 [ 1.920317] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.922072] NFS: Registering the id_resolver key type [ 1.923027] Key type id_resolver registered [ 1.923769] Key type id_legacy registered [ 1.924482] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 1.925849] Key type big_key registered [ 1.926592] SELinux: Registering netfilter hooks [ 1.927468] cryptomgr_test (57) used greatest stack depth: 13968 bytes left [ 1.928845] cryptomgr_test (60) used greatest stack depth: 13664 bytes left [ 1.929123] NET: Registered protocol family 38 [ 1.929132] Key type asymmetric registered [ 1.929135] Asymmetric key parser 'x509' registered [ 1.929224] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 1.929294] io scheduler noop registered [ 1.929297] io scheduler deadline registered (default) [ 1.929351] io scheduler cfq registered [ 1.929355] io scheduler mq-deadline registered [ 1.929358] io scheduler kyber registered [ 1.933394] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 1.933409] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 1.952736] intel_idle: does not run on family 6 model 62 [ 1.952934] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 1.956023] ACPI: Power Button [PWRF] [ 1.958090] GHES: HEST is not enabled! [ 2.019518] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 2.068009] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 2.117533] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.144660] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 2.172162] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 2.174015] Non-volatile memory driver v1.3 [ 2.174869] Linux agpgart interface v0.103 [ 2.175817] crash memory driver: version 1.1 [ 2.176980] nbd: registered device at major 43 [ 2.180130] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 2.180178] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 2.180205] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 2.180229] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 2.180254] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 2.186815] virtio_blk virtio1: [vda] 112728 512-byte logical blocks (57.7 MB/55.0 MiB) [ 2.190045] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 2.190073] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 2.190098] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 2.190129] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 2.190175] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 2.195715] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.199302] rdac: device handler registered [ 2.201138] hp_sw: device handler registered [ 2.202865] emc: device handler registered [ 2.204302] libphy: Fixed MDIO Bus: probed [ 2.207710] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.208881] ehci-pci: EHCI PCI platform driver [ 2.209675] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.210678] ohci-pci: OHCI PCI platform driver [ 2.211460] uhci_hcd: USB Universal Host Controller Interface driver [ 2.212645] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.214736] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.215627] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.216777] mousedev: PS/2 mouse device common for all mice [ 2.218234] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.218568] rtc_cmos 00:05: RTC can wake from S4 [ 2.219246] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 2.219580] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.222180] hidraw: raw HID events driver (C) Jiri Kosina [ 2.222445] usbcore: registered new interface driver usbhid [ 2.222445] usbhid: USB HID core driver [ 2.222512] drop_monitor: Initializing network drop monitor service [ 2.222562] Netfilter messages via NETLINK v0.30. [ 2.222642] TCP: cubic registered [ 2.222651] Initializing XFRM netlink socket [ 2.222979] NET: Registered protocol family 10 [ 2.223392] NET: Registered protocol family 17 [ 2.223430] Key type dns_resolver registered [ 2.223874] mce: Using 10 MCE banks [ 2.224142] Loading compiled-in X.509 certificates [ 2.225299] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 2.225333] registered taskstats version 1 [ 2.227652] modprobe (70) used greatest stack depth: 13456 bytes left [ 2.230201] Key type trusted registered [ 2.233930] Key type encrypted registered [ 2.233983] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 2.235231] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 2.236428] rtc_cmos 00:05: setting system clock to 2024-10-22 14:24:03 UTC (1729607043) [ 2.252306] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 2.254063] Write protecting the kernel read-only data: 12288k [ 2.256971] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 2.260124] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 2.270075] random: systemd: uninitialized urandom read (16 bytes read) [ 2.273640] random: systemd: uninitialized urandom read (16 bytes read) [ 2.275986] random: systemd: uninitialized urandom read (16 bytes read) [ 2.280084] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 2.285456] systemd[1]: Detected virtualization kvm. [ 2.286872] systemd[1]: Detected architecture x86-64. [ 2.288429] systemd[1]: Running in initial RAM disk. [ 2.291877] systemd[1]: No hostname configured. [ 2.293196] systemd[1]: Set hostname to . [ 2.294671] random: systemd: uninitialized urandom read (16 bytes read) [ 2.296479] systemd[1]: Initializing machine ID from random generator. [ 2.347266] dracut-rootfs-g (85) used greatest stack depth: 13264 bytes left [ 2.351059] random: systemd: uninitialized urandom read (16 bytes read) [ 2.353794] random: systemd: uninitialized urandom read (16 bytes read) [ 2.356514] random: systemd: uninitialized urandom read (16 bytes read) [ 2.359147] random: systemd: uninitialized urandom read (16 bytes read) [ 2.362844] random: systemd: uninitialized urandom read (16 bytes read) [ 2.365416] random: systemd: uninitialized urandom read (16 bytes read) [ 2.375912] systemd[1]: Reached target Timers. [ 2.379028] systemd[1]: Created slice Root Slice. [ 2.382012] systemd[1]: Listening on udev Kernel Socket. [ 2.385628] systemd[1]: Created slice System Slice. [ 2.388996] systemd[1]: Reached target Slices. [ 2.392110] systemd[1]: Listening on udev Control Socket. [ 2.395699] systemd[1]: Listening on Journal Socket. [ 2.398844] systemd[1]: Reached target Sockets. [ 2.402693] systemd[1]: Starting Load Kernel Modules... [ 2.406678] systemd[1]: Starting dracut cmdline hook... [ 2.410147] systemd[1]: Starting Setup Virtual Console... [ 2.412855] systemd[1]: Reached target Swap. [ 2.415209] systemd[1]: Reached target Local File Systems. [ 2.418835] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 2.423421] systemd[1]: Starting Journal Service... [ 2.426204] systemd[1]: Started Load Kernel Modules. [ 2.430547] systemd[1]: Started Setup Virtual Console. [ 2.433251] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 2.438372] systemd[1]: Starting Create Static Device Nodes in /dev... [ 2.441750] systemd[1]: Starting Apply Kernel Variables... [ 2.445572] systemd[1]: Started Journal Service. [ 2.645462] random: fast init done [ 2.883340] tsc: Refined TSC clocksource calibration: 2399.982 MHz [ 3.038701] libata version 3.00 loaded. [ 3.042610] ata_piix 0000:00:01.1: version 2.13 [ 3.047343] scsi host0: ata_piix [ 3.049267] scsi host1: ata_piix [ 3.052620] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 3.054516] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 3.079571] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 3.081851] plymouth (296) used greatest stack depth: 13248 bytes left [ 3.117617] ip (321) used greatest stack depth: 13080 bytes left [ 3.153431] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 3.155438] ip (344) used greatest stack depth: 12464 bytes left [ 3.209201] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 6.047664] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 6.376471] systemd-journald[111]: Received SIGTERM from PID 1 (systemd). [ 6.582508] SELinux: Disabled at runtime. [ 6.584508] SELinux: Unregistering netfilter hooks [ 6.646880] ip_tables: (C) 2000-2006 Netfilter Core Team [ 6.649961] systemd[1]: Inserted module 'ip_tables' [ 7.138669] systemd-journald[565]: Received request to flush runtime journal from PID 1 [ 7.233172] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 7.241858] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 7.267392] cryptd: max_cpu_qlen set to 1000 [ 7.286945] AVX version of gcm_enc/dec engaged. [ 7.287852] AES CTR mode by8 optimization enabled [ 7.294718] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 7.330573] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 7.336183] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 7.338199] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 7.414840] EDAC MC: Ver: 3.0.0 [ 7.418765] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 7.418769] EDAC sbridge: Ver: 1.1.2 [ 10.028505] mount.nfs (766) used greatest stack depth: 10704 bytes left [ 28.675355] libcfs: loading out-of-tree module taints kernel. [ 28.678953] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 28.801112] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 28.804907] alg: No test for adler32 (adler32-zlib) [ 29.685166] Lustre: Lustre: Build Version: 2.16.0_RC4_1_g112c829 [ 29.853435] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 29.856030] LNet: Accept secure, port 988 [ 31.405292] Key type lgssc registered [ 31.852671] Lustre: Echo OBD driver; http://www.lustre.org/ [ 73.899071] Lustre: Mounted lustre-client [ 76.207267] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 86.440946] Lustre: DEBUG MARKER: oleg221-client.virtnet: executing check_logdir /tmp/testlogs/ [ 87.638999] Lustre: DEBUG MARKER: oleg221-client.virtnet: executing yml_node [ 89.164132] Lustre: DEBUG MARKER: Client: 2.16.0.RC4 [ 89.944099] Lustre: DEBUG MARKER: MDS: 2.16.0.RC4 [ 90.786694] Lustre: DEBUG MARKER: OSS: 2.16.0.RC4 [ 91.317011] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-lnet ============----- Tue Oct 22 10:25:32 EDT 2024 [ 96.156240] Lustre: Unmounted lustre-client [ 103.175551] Key type lgssc unregistered [ 103.261900] LNet: 7720:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 104.270737] LNet: Removed LNI 192.168.202.21@tcp [ 111.621602] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 111.625052] alg: No test for adler32 (adler32-zlib) [ 112.409875] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 112.459733] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 112.462607] LNet: Accept secure, port 988 [ 112.472619] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show [ 113.025229] Lustre: DEBUG MARKER: excepting tests: [ 113.070053] LNet: 8497:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 113.083663] LNet: Removed LNI 192.168.202.21@tcp [ 114.840515] Lustre: DEBUG MARKER: == sanity-lnet test 0: Export empty config, import the config, compare ========================================================== 10:25:55 (1729607155) [ 114.956340] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 114.963036] alg: No test for adler32 (adler32-zlib) [ 115.745769] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 115.768293] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 115.778867] LNet: 8904:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 115.787562] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 115.809223] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 115.817854] LNet: 8911:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 118.286466] Lustre: DEBUG MARKER: == sanity-lnet test 1: Add peer with single nid (tcp) ==== 10:25:59 (1729607159) [ 118.354321] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 118.366490] LNet: 9545:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 118.378057] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 118.410452] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp [ 120.532501] Lustre: DEBUG MARKER: == sanity-lnet test 2: Add peer with single nid (o2ib) === 10:26:01 (1729607161) [ 120.585746] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 120.595871] LNet: 10186:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 120.605200] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 120.635268] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 2.2.2.2@o2ib [ 122.761001] Lustre: DEBUG MARKER: == sanity-lnet test 3: Add peer with tcp primary o2ib secondary ========================================================== 10:26:03 (1729607163) [ 122.817429] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 122.826980] LNet: 10827:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 122.836609] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 122.865763] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 3.3.3.3@tcp --nid 3.3.3.3@o2ib [ 124.989913] Lustre: DEBUG MARKER: == sanity-lnet test 4: Add peer with nidrange (tcp) ====== 10:26:05 (1729607165) [ 125.033424] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 125.048528] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 125.077732] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 4.4.4.4@tcp --nid 4.4.4.[1-3]@tcp [ 125.207914] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 4.4.4.4@tcp --nid 4.4.4.[1-4]@tcp [ 127.320327] Lustre: DEBUG MARKER: == sanity-lnet test 5: Add peer with nidrange (o2ib) ===== 10:26:08 (1729607168) [ 127.365617] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 127.375056] LNet: 12115:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 127.378748] LNet: 12115:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 1 previous similar message [ 127.387313] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 127.414997] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1-4]@o2ib [ 127.551910] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1-4]@o2ib [ 127.661186] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1,2,3-4]@o2ib [ 129.726186] Lustre: DEBUG MARKER: == sanity-lnet test 6: Add peer with multiple nidranges == 10:26:10 (1729607170) [ 129.767033] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 129.782346] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 129.812372] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 6.6.6.6@tcp --nid 6.6.[6-7].[0-4/2]@tcp,6.6.[1-4/2].[0-6/3]@o2ib,[6-12/4]@gni,[6-12/4]@kfi [ 131.930331] Lustre: DEBUG MARKER: == sanity-lnet test 7: Various peer delete tests ========= 10:26:12 (1729607172) [ 131.976622] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 131.992460] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 132.017075] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp [ 132.031866] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp [ 132.157362] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@o2ib [ 132.164695] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@o2ib [ 132.270022] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp --nid 7.7.7.[8-12]@tcp [ 132.279728] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp [ 132.380707] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@o2ib --nid 7.7.7.[8-12]@o2ib [ 132.389403] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@o2ib [ 132.495437] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp --nid 7.7.7.[9-12]@tcp,7.7.7.[13-15]@o2ib [ 132.503331] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp [ 132.604475] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni [ 132.614292] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni [ 132.713930] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni --nid [8-12]@gni [ 132.721276] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni [ 132.820886] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@kfi [ 132.829719] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@kfi [ 132.933283] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@kfi --nid [8-12]@kfi [ 132.943989] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@kfi [ 133.045501] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni --nid [8-12]@gni,7.7.7.[1-4]@tcp,7.7.7.[5-9]@o2ib,[1-5]@kfi [ 133.055086] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni [ 133.188215] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim 1.1.1.1@tcp --nid 1.1.1.1@tcp,2.2.2.2@tcp,3.3.3.3@tcp,4.4.4.4@tcp [ 133.203902] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp --nid 1.1.1.1@tcp,2.2.2.2@tcp,3.3.3.3@tcp,4.4.4.4@tcp [ 135.304765] Lustre: DEBUG MARKER: == sanity-lnet test 8: Delete single secondary nid from peer (tcp) ========================================================== 10:26:16 (1729607176) [ 135.346034] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 135.363848] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 135.393320] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 8.8.8.8@tcp --nid 8.8.8.[10-15]@tcp [ 135.409816] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 8.8.8.8@tcp --nid 8.8.8.13@tcp [ 137.485837] Lustre: DEBUG MARKER: == sanity-lnet test 9: Delete all secondary nids from peer (tcp) ========================================================== 10:26:18 (1729607178) [ 137.528694] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 137.539044] LNet: 14778:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 137.542807] LNet: 14778:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 3 previous similar messages [ 137.552861] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 137.582548] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 9.9.9.9@tcp --nid 9.9.9.[11-16]@tcp [ 137.598602] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 9.9.9.9@tcp --nid 9.9.9.[11-16]@tcp [ 139.689602] Lustre: DEBUG MARKER: == sanity-lnet test 10: Delete single secondary nid from peer (o2ib) ========================================================== 10:26:20 (1729607180) [ 139.733845] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 139.749909] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 139.779571] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 10.10.10.10@tcp --nid 10.10.10.[12-16]@tcp [ 139.795918] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 10.10.10.10@tcp --nid 10.10.10.14@tcp [ 141.919425] Lustre: DEBUG MARKER: == sanity-lnet test 11: Delete all secondary nids from peer (o2ib) ========================================================== 10:26:22 (1729607182) [ 141.964939] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 141.980430] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 142.010371] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 11.11.11.11@tcp --nid 11.11.11.[13-17]@tcp [ 142.027071] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 11.11.11.11@tcp --nid 11.11.11.[13-17]@tcp [ 144.117133] Lustre: DEBUG MARKER: == sanity-lnet test 12: Delete a secondary nid from peer (tcp and o2ib) ========================================================== 10:26:24 (1729607184) [ 144.157534] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 144.173789] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 144.203783] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 12.12.12.12@o2ib --nid [13-14/1].[13-15/2].13.13@o2ib,[15-16/3].[17-19/4].[1].[5-20/5]@tcp [ 144.220901] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 12.12.12.12@o2ib --nid 13.15.13.13@o2ib,15.17.1.15@tcp [ 146.309080] Lustre: DEBUG MARKER: == sanity-lnet test 13: Delete all secondary nids from peer (tcp and o2ib) ========================================================== 10:26:27 (1729607187) [ 146.356225] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 146.371418] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 146.401286] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 13.13.13.13@o2ib --nid [14-15].[1-2/1].[1].[100-254/10]@tcp,14.14.[254].14@o2ib [ 146.422998] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 13.13.13.13@o2ib --nid [14-15].[1-2/1].[1].[100-254/10]@tcp,14.14.[254].14@o2ib [ 148.532719] Lustre: DEBUG MARKER: == sanity-lnet test 14: import peer create/delete with single nid ========================================================== 10:26:29 (1729607189) [ 148.574205] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 148.591626] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 148.624869] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 148.763917] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 150.836732] Lustre: DEBUG MARKER: == sanity-lnet test 15: import multi peer create/delete with single nid per peer ========================================================== 10:26:31 (1729607191) [ 150.859434] random: crng init done [ 150.877083] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 150.892403] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 150.967225] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 151.038926] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 153.168536] Lustre: DEBUG MARKER: == sanity-lnet test 16: import peer create/delete with multiple nids ========================================================== 10:26:33 (1729607193) [ 153.206644] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 153.225425] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 153.272960] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 153.344306] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 155.505665] Lustre: DEBUG MARKER: == sanity-lnet test 17: import multi peer create/delete with multiple nids ========================================================== 10:26:36 (1729607196) [ 155.544527] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 155.556039] LNet: 19990:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 155.562100] LNet: 19990:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 7 previous similar messages [ 155.572716] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 155.747028] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 155.844722] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 157.906420] Lustre: DEBUG MARKER: == sanity-lnet test 18a: Delete a subset of nids from a single peer using import --del ========================================================== 10:26:38 (1729607198) [ 157.952345] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 157.969920] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 157.999289] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 158.019528] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 160.133654] Lustre: DEBUG MARKER: == sanity-lnet test 18b: Delete multiple nids from multiple peers using import --del ========================================================== 10:26:40 (1729607200) [ 160.178904] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 160.194792] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 160.225835] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 160.247537] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 162.462016] Lustre: DEBUG MARKER: == sanity-lnet test 19: Add peer with single nid (gni) === 10:26:43 (1729607203) [ 162.507402] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 162.524455] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 162.555138] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 19@gni [ 164.737015] Lustre: DEBUG MARKER: == sanity-lnet test 20: Add peer with gni primary and tcp, o2ib secondary ========================================================== 10:26:45 (1729607205) [ 164.774232] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 164.791437] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 164.824356] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 20@gni --nid 20.20.20.20@tcp,20.20.20.20@o2ib [ 166.997560] Lustre: DEBUG MARKER: == sanity-lnet test 21: Add peer with nidrange (gni) ===== 10:26:47 (1729607207) [ 167.054240] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 167.068893] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 167.101511] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 21@gni --nid [22-25]@gni [ 167.217934] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 21@gni --nid [21-25]@gni [ 168.904795] Lustre: DEBUG MARKER: == sanity-lnet test 22: Delete single secondary nid from peer (gni) ========================================================== 10:26:49 (1729607209) [ 168.947359] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 168.963134] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 168.991606] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 22@gni --nid [24-29]@gni [ 169.005442] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 22@gni --nid 26@gni [ 171.115383] Lustre: DEBUG MARKER: == sanity-lnet test 23: Delete all secondary nids from peer (gni) ========================================================== 10:26:51 (1729607211) [ 171.152635] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 171.171536] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 171.205184] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 23@gni --nid [25-29]@gni [ 171.222123] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 23@gni --nid [25-29]@gni [ 173.118349] Lustre: DEBUG MARKER: == sanity-lnet test 24: Delete a secondary nid from peer (tcp, o2ib and gni) ========================================================== 10:26:54 (1729607214) [ 173.195232] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 173.202689] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 173.216984] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 24@gni --nid [13-14/1].[13-15/2].13.13@o2ib,[15-16/3].[17-19/4].[1].[5-20/5]@tcp,[5-12/6]@gni [ 173.225394] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 24@gni --nid 5@gni,13.15.13.13@o2ib,15.17.1.15@tcp [ 175.230350] Lustre: DEBUG MARKER: == sanity-lnet test 25: Delete all secondary nids from peer (tcp, gni and o2ib) ========================================================== 10:26:56 (1729607216) [ 175.269321] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 175.286204] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 175.316814] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 25@gni --nid [26-27].[4-10/3].26.26@tcp,26.26.26.26@o2ib,[30-35]@gni [ 175.334966] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 25@gni --nid [26-27].[4-10/3].26.26@tcp,26.26.26.26@o2ib,[30-35]@gni [ 177.481261] Lustre: DEBUG MARKER: == sanity-lnet test 26: Delete peer with primary nid locked ========================================================== 10:26:58 (1729607218) [ 177.527760] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 177.544680] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 177.565835] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --lock_prim [ 177.587937] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp [ 177.597723] LNetError: 26528:0:(peer.c:2171:lnet_del_peer_ni()) peer 1.1.1.1@tcp created by Lustre. Must preserve primary NID, but will remove other NIDs [ 177.614280] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp --force [ 177.629341] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer show --nid 1.1.1.1@tcp [ 179.618569] Lustre: DEBUG MARKER: == sanity-lnet test 27: Import bad config should fail gracefully ========================================================== 10:27:00 (1729607220) [ 179.645536] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 179.660633] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 179.690460] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.hqJslNFyG3 [ 179.718566] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.hqJslNFyG3 [ 179.739415] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.hqJslNFyG3 [ 181.710077] Lustre: DEBUG MARKER: == sanity-lnet test 28: Test peer_list =================== 10:27:02 (1729607222) [ 181.733682] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 181.749464] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 181.769482] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --ni 7.7.7.7@tcp [ 181.784281] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.2@tcp --nid 7.7.7.8@tcp [ 181.802630] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer list [ 183.909990] Lustre: DEBUG MARKER: == sanity-lnet test 99a: Check various invalid inputs to lnetctl peer ========================================================== 10:27:04 (1729607224) [ 183.938675] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 183.956283] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 183.982512] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid foobar [ 183.998410] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid foobar [ 184.014498] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@o2ib [ 184.030117] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --nid 1.1.1.1@tcp [ 184.044677] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --nid 1.1.1.1@tcp [ 184.058547] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add [ 184.070800] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid foobar [ 184.084940] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.1.1.[2-255]@tcp [ 184.108244] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@foo [ 184.120539] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@tcp [ 184.135984] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@o2ib [ 184.149774] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@gni [ 184.164619] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid [2-1]@gni [ 184.179129] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid [a-f/x]@gni [ 184.193433] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 256.256.256.256@tcp [ 184.206797] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.1.1.1.[2-5/f]@tcp [ 184.219807] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.]2[.3.4@o2ib1.[2-4,[5-6],7-8].1.1@tcp [ 184.232743] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid foobar [ 184.244444] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp --gateway 1@gni [ 184.251886] LNetError: 28499:0:(router.c:632:lnet_add_route()) Cannot add route with gateway 1@gni. There is no local interface configured on LNet gni [ 186.377431] Lustre: DEBUG MARKER: == sanity-lnet test 99b: Invalid value for Multi-Rail in yaml import ========================================================== 10:27:07 (1729607227) [ 186.411126] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 186.428478] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 186.459492] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 188.610131] Lustre: DEBUG MARKER: == sanity-lnet test 100: Add route with single gw ======== 10:27:09 (1729607229) [ 189.214878] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_100 Need at least 2 remote nodes found oleg221-server [ 189.814445] Lustre: DEBUG MARKER: == sanity-lnet test 101: Add route with multiple gw ====== 10:27:10 (1729607230) [ 189.860225] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 189.871248] LNet: 30141:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 189.875004] LNet: 30141:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 14 previous similar messages [ 189.884751] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 189.908689] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 189.919998] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 189.922101] LNet: Accept secure, port 988 [ 190.358934] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp1 --gateway 192.168.202.[22-26]@tcp [ 190.370493] LNet: 30445:0:(router.c:737:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled [ 192.489656] Lustre: DEBUG MARKER: == sanity-lnet test 102: Delete route with single gw ===== 10:27:13 (1729607233) [ 193.090573] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_102 Need at least 2 remote nodes found oleg221-server [ 193.429315] Lustre: DEBUG MARKER: == sanity-lnet test 103: Delete route with multiple gw === 10:27:14 (1729607234) [ 193.479043] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 200.483304] LNetError: 30147:0:(lib-lnet.h:1332:lnet_set_route_aliveness()) route to tcp1 through 192.168.202.22@tcp has gone from up to down [ 200.498794] LNet: Removed LNI 192.168.202.21@tcp [ 200.507745] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 200.530543] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 200.541298] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 200.544304] LNet: Accept secure, port 988 [ 200.742501] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp103 --gateway 192.168.202.[22-27/2]@tcp [ 200.751163] LNet: 31585:0:(router.c:737:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled [ 200.756548] LNet: 31585:0:(router.c:737:lnet_add_route()) Skipped 4 previous similar messages [ 200.764173] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route del --net tcp103 --gateway 192.168.202.[22-27/2]@tcp [ 202.880222] Lustre: DEBUG MARKER: == sanity-lnet test 104: Set/check response_tracking param ========================================================== 10:27:23 (1729607243) [ 202.942553] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 203.962671] LNet: Removed LNI 192.168.202.21@tcp [ 203.973132] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.005804] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking -1 [ 204.029524] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.045402] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.073813] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 204.099551] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.115910] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.141587] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 0 [ 204.170576] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.188444] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.218846] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 204.249440] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.265923] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.289582] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 1 [ 204.316379] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.332990] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.360328] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 204.389263] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.405291] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.428629] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 2 [ 204.456629] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.471867] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.500063] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 204.532282] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.549147] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.573074] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 3 [ 204.600243] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.615684] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.643012] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 204.672822] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.688995] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.712039] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 4 [ 204.732675] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 204.748110] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 204.774390] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 206.832449] Lustre: DEBUG MARKER: == sanity-lnet test 105: Adding duplicate GW peer should fail ========================================================== 10:27:27 (1729607247) [ 207.452772] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_105 Need at least 2 remote nodes found oleg221-server [ 208.004375] Lustre: DEBUG MARKER: == sanity-lnet test 106: Deleting GW peer should fail ==== 10:27:28 (1729607248) [ 208.598618] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_106 Need at least 2 remote nodes found oleg221-server [ 209.154101] Lustre: DEBUG MARKER: == sanity-lnet test 107: Deleting extra interface doesn't crash node ========================================================== 10:27:29 (1729607249) [ 210.535455] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 210.543746] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 210.545435] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 210.547262] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 210.615826] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 210.619120] alg: No test for adler32 (adler32-zlib) [ 211.400955] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 211.423887] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 211.437038] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 211.439702] LNet: Accept secure, port 988 [ 211.639398] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 211.649550] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 212.235272] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg [ 212.245409] LNet: Removed LNI 10.1.2.3@tcp [ 212.282677] LNet: 1983:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 212.293871] LNet: Removed LNI 192.168.202.21@tcp [ 215.738821] Lustre: DEBUG MARKER: == sanity-lnet test 108: Check Multi-Rail setup ========== 10:27:36 (1729607256) [ 217.073124] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 217.084499] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 217.087846] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 217.090964] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 217.156778] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 217.160911] alg: No test for adler32 (adler32-zlib) [ 217.946511] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 217.966372] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 217.973248] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 217.974885] LNet: Accept secure, port 988 [ 218.192495] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 218.202442] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 218.928317] LNet: 3459:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 218.932392] LNet: Removed LNI 192.168.202.21@tcp [ 218.943684] LNet: Removed LNI 10.1.2.3@tcp [ 221.686962] Lustre: DEBUG MARKER: == sanity-lnet test 109: Add NI using a network interface alias (LU-16859) ========================================================== 10:27:42 (1729607262) [ 222.908497] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 222.918838] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 222.922667] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 222.926268] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 222.999093] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 223.002445] alg: No test for adler32 (adler32-zlib) [ 223.785279] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 223.799350] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg:0 [ 223.805647] LNet: Added LNI 10.1.2.31@tcp [8/256/0/180] [ 223.808523] LNet: Accept secure, port 988 [ 224.374354] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 224.384748] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 224.970353] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg [ 224.980581] LNet: Removed LNI 10.1.2.3@tcp [ 224.986835] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg:0 [ 225.004793] LNet: Removed LNI 10.1.2.31@tcp [ 225.012384] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 225.023361] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 225.250534] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg:0 [ 225.260527] LNet: Added LNI 10.1.2.31@tcp [8/256/0/180] [ 225.541219] LNet: 5355:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 225.545295] LNet: Removed LNI 10.1.2.3@tcp [ 225.553663] LNet: Removed LNI 10.1.2.31@tcp [ 228.709859] Lustre: DEBUG MARKER: == sanity-lnet test 110: Configure NI using lnetctl net add --nid ========================================================== 10:27:49 (1729607269) [ 228.812740] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 228.819836] alg: No test for adler32 (adler32-zlib) [ 229.605992] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 229.621659] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 229.628605] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 229.630978] LNet: Accept secure, port 988 [ 229.868110] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 229.878640] LNet: 6343:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 229.890765] LNet: Removed LNI 192.168.202.21@tcp [ 229.899112] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 229.921091] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --nid 192.168.202.21@tcp [ 229.933010] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 229.936803] LNet: Accept secure, port 988 [ 230.174029] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --nid 192.168.202.21@tcp [ 230.192794] LNet: Removed LNI 192.168.202.21@tcp [ 233.472058] Lustre: DEBUG MARKER: == sanity-lnet test 111: Test many routes ================ 10:27:54 (1729607274) [ 233.909238] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_111 Unsupported on RHEL7 [ 234.495263] Lustre: DEBUG MARKER: == sanity-lnet test 112: multiple net configurations ===== 10:27:55 (1729607275) [ 235.720626] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 235.730694] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 235.732189] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 235.733753] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 235.797184] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 235.800341] alg: No test for adler32 (adler32-zlib) [ 236.583707] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 236.604644] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 236.608293] LNet: Accept secure, port 988 [ 236.827787] LNet: Added LNI 10.1.2.3@tcp2 [8/256/0/180] [ 237.440140] LNet: 8276:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 237.444310] LNet: Removed LNI 192.168.202.21@tcp1 [ 237.455739] LNet: Removed LNI 10.1.2.3@tcp2 [ 240.687297] Lustre: DEBUG MARKER: == sanity-lnet test 199: load lnet w/o module option, configure interface twice ========================================================== 10:28:01 (1729607281) [ 240.800603] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 240.807468] alg: No test for adler32 (adler32-zlib) [ 241.594258] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 241.611883] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 241.619498] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 241.621331] LNet: Accept secure, port 988 [ 241.819660] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --ip2net tcp 192.168.202.21 [ 241.830370] LNet: Removed LNI 192.168.202.21@tcp [ 243.887327] Lustre: DEBUG MARKER: == sanity-lnet test 200: load lnet w/o module option, configure in a non-default namespace ========================================================== 10:28:04 (1729607284) [ 243.932100] LNet: 9897:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 243.945746] LNet: Removed LNI 192.168.202.21@tcp [ 245.282168] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 245.340595] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 245.341699] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 245.342828] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 245.488866] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 245.495743] alg: No test for adler32 (adler32-zlib) [ 246.286216] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 246.288414] LNet: Accept secure, port 988 [ 248.348980] Lustre: DEBUG MARKER: == sanity-lnet test 201: load lnet using networks module options in a non-default namespace ========================================================== 10:28:09 (1729607289) [ 248.405874] LNet: 10804:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 248.416683] LNet: Removed LNI 10.1.2.3@tcp [ 249.763478] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 249.818631] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 249.819785] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 249.820895] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 249.926122] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 249.929316] alg: No test for adler32 (adler32-zlib) [ 250.726379] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 250.728660] LNet: Accept secure, port 988 [ 252.810837] Lustre: DEBUG MARKER: == sanity-lnet test 202: load lnet using ip2nets in a non-default namespace ========================================================== 10:28:13 (1729607293) [ 252.857405] LNet: 11706:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 252.867991] LNet: Removed LNI 10.1.2.3@tcp [ 254.207879] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 254.262697] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 254.263800] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 254.264915] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 254.416672] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 254.423145] alg: No test for adler32 (adler32-zlib) [ 255.218474] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 255.219622] LNet: Accept secure, port 988 [ 257.280804] Lustre: DEBUG MARKER: == sanity-lnet test 203: add a network using an interface in the non-default namespace ========================================================== 10:28:18 (1729607298) [ 257.335002] LNet: 12612:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 257.345981] LNet: Removed LNI 10.1.2.3@tcp [ 258.661075] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 258.718702] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 258.719821] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 258.721002] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 258.887624] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 258.892921] alg: No test for adler32 (adler32-zlib) [ 259.672933] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 259.700334] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 259.702775] LNet: Accept secure, port 988 [ 262.375929] Lustre: DEBUG MARKER: == sanity-lnet test 204: Check no health or resends for single-rail local failures ========================================================== 10:28:23 (1729607303) [ 262.513815] LNet: 13850:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 262.523817] LNet: Removed LNI 10.1.2.3@tcp [ 263.883172] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 263.886732] alg: No test for adler32 (adler32-zlib) [ 264.671742] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 264.679977] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 264.681217] LNet: Accept secure, port 988 [ 267.363184] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 267.489527] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 267.499543] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 267.574763] LNet: 14230:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 267.604630] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 267.620630] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 267.713768] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 267.824925] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 267.839256] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 267.929441] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 268.035384] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 268.050693] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 268.139888] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 268.152520] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 268.157874] LNet: Skipped 2 previous similar messages [ 268.229076] LNet: 14417:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 268.233358] LNet: 14417:0:(api-ni.c:337:recovery_interval_set()) Skipped 2 previous similar messages [ 268.258715] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 268.272421] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 268.356751] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 268.466013] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 268.480752] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 268.568316] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 268.670942] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 268.685220] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 268.774465] LNet: 14572:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 268.787717] LNet: Removed LNI 192.168.202.21@tcp [ 272.938137] Lustre: DEBUG MARKER: == sanity-lnet test 205: Check health and resends for multi-rail local failures ========================================================== 10:28:33 (1729607313) [ 274.387020] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 274.390636] alg: No test for adler32 (adler32-zlib) [ 275.171982] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 275.179338] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 275.180790] LNet: Accept secure, port 988 [ 277.811915] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 280.782403] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 280.793670] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 280.802311] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 281.139693] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 281.145286] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 281.149021] LNet: 1 local NIs in recovery (showing 1): 192.168.202.21@tcp [ 281.195056] LNet: 16026:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 281.210839] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 281.218694] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 281.290640] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 281.379750] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 281.391319] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 281.512379] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 281.624267] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 281.637564] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 281.756124] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 281.768103] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 281.772762] LNet: Skipped 9 previous similar messages [ 281.850874] LNet: 16230:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 281.855178] LNet: 16230:0:(api-ni.c:337:recovery_interval_set()) Skipped 2 previous similar messages [ 281.881961] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 281.896631] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 282.017896] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 282.125274] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 282.139006] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 282.257947] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 282.366146] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 282.380785] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 284.193787] LNet: 16433:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 285.197527] LNet: Removed LNI 192.168.202.21@tcp [ 285.207589] LNet: Removed LNI 192.168.202.21@tcp1 [ 289.333086] Lustre: DEBUG MARKER: == sanity-lnet test 206: Check no health or resends for single-rail remote failures ========================================================== 10:28:50 (1729607330) [ 290.771920] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 290.774995] alg: No test for adler32 (adler32-zlib) [ 291.557081] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 291.568789] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 291.570100] LNet: Accept secure, port 988 [ 294.237534] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 294.367553] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 294.377580] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 294.455669] LNet: 17677:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 294.486718] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 294.501253] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 294.587650] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 294.703779] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 294.715836] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 294.797053] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 294.900765] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 294.914505] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 295.002260] LNet: 17833:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 295.018717] LNet: Removed LNI 192.168.202.21@tcp [ 299.302432] Lustre: DEBUG MARKER: == sanity-lnet test 207: Check health and resends for multi-rail remote errors ========================================================== 10:29:00 (1729607340) [ 300.741925] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 300.745244] alg: No test for adler32 (adler32-zlib) [ 301.528231] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 301.538723] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 301.539916] LNet: Accept secure, port 988 [ 304.162432] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 306.447276] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 306.461569] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 306.471656] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 306.845574] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 306.855417] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 306.859662] LNet: 1 peer NIs in recovery (showing 1): 192.168.202.121@tcp [ 306.935046] LNet: 19284:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 306.961835] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 306.976515] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 306.995496] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 307.104021] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 307.208934] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 307.222982] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 307.241705] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 307.354908] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.121@tcp [ 307.365090] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 307.368920] LNet: Skipped 3 previous similar messages [ 307.444659] LNet: 19425:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 307.449017] LNet: 19425:0:(api-ni.c:337:recovery_interval_set()) Skipped 1 previous similar message [ 307.475457] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 307.490131] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 307.510882] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 309.432262] LNet: 19493:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 309.436618] LNet: Removed LNI 192.168.202.21@tcp [ 309.448755] LNet: Removed LNI 192.168.202.21@tcp1 [ 313.699083] Lustre: DEBUG MARKER: == sanity-lnet test 208: Test various kernel ip2nets configurations ========================================================== 10:29:14 (1729607354) [ 315.028789] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 315.037767] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 315.039234] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 315.040727] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 315.103359] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 315.106449] alg: No test for adler32 (adler32-zlib) [ 315.888308] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 315.891265] LNet: Accept secure, port 988 [ 315.900748] LNet: 20587:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 315.915511] LNet: Removed LNI 192.168.202.21@tcp [ 317.309348] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 317.312562] alg: No test for adler32 (adler32-zlib) [ 318.097127] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 318.098255] LNet: Added LNI 10.1.2.3@tcp1 [8/256/0/180] [ 318.099259] LNet: Accept secure, port 988 [ 318.110363] LNet: 20842:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 318.113610] LNet: Removed LNI 192.168.202.21@tcp [ 318.120554] LNet: Removed LNI 10.1.2.3@tcp1 [ 319.549729] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 319.553217] alg: No test for adler32 (adler32-zlib) [ 320.334095] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 320.336944] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 320.339590] LNet: Accept secure, port 988 [ 320.347479] LNet: 21097:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 320.349107] LNet: Removed LNI 192.168.202.21@tcp [ 320.360737] LNet: Removed LNI 10.1.2.3@tcp [ 321.772255] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 321.775338] alg: No test for adler32 (adler32-zlib) [ 322.559637] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 322.562014] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 322.564023] LNet: Accept secure, port 988 [ 322.574085] LNet: 21353:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 322.575850] LNet: Removed LNI 192.168.202.21@tcp [ 322.588521] LNet: Removed LNI 10.1.2.3@tcp [ 323.987412] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 323.990604] alg: No test for adler32 (adler32-zlib) [ 324.776464] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 324.778621] LNetError: 21597:0:(config.c:1558:lnet_inet_select()) ksocklnd: failed to find interface test1pg [ 324.782246] LNetError: Error -100 starting up LNI tcp [ 324.793492] LNet: Removed LNI 192.168.202.21@tcp [ 328.065804] Lustre: DEBUG MARKER: == sanity-lnet test 209: Check health, but not resends, for network timeout ========================================================== 10:29:28 (1729607368) [ 329.530326] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 329.533587] alg: No test for adler32 (adler32-zlib) [ 330.320256] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 330.328745] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 330.330124] LNet: Accept secure, port 988 [ 332.951376] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 333.072283] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 333.082617] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 333.154853] LNet: 22839:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 333.180426] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 333.193552] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 333.273743] LNet: 22870:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 333.287676] LNet: Removed LNI 192.168.202.21@tcp [ 336.776361] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 336.779924] alg: No test for adler32 (adler32-zlib) [ 337.562945] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 337.573610] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 337.576074] LNet: Accept secure, port 988 [ 340.214035] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 342.366977] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 342.382812] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 342.394693] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 342.779622] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 342.791183] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 342.868454] LNet: 23676:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 342.896848] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 342.912232] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 344.709057] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 344.798976] LNet: 23742:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 344.803092] LNet: Removed LNI 192.168.202.21@tcp [ 344.814651] LNet: Removed LNI 192.168.202.21@tcp1 [ 348.939560] Lustre: DEBUG MARKER: == sanity-lnet test 210: Local NI recovery checks ======== 10:29:49 (1729607389) [ 349.040143] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 349.046979] alg: No test for adler32 (adler32-zlib) [ 349.837401] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 349.853697] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 349.862791] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 349.865864] LNet: Accept secure, port 988 [ 350.100133] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 350.110380] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 350.373650] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.21@tcp [ 350.398261] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 10 [ 350.438718] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 0 --nid 192.168.202.21@tcp [ 350.449410] LNetError: 24878:0:(api-ni.c:4065:lnet_ni_set_healthv()) manually adding local NI 192.168.202.21@tcp to recovery [ 350.843423] LNet: 1 local NIs in recovery (showing 1): 192.168.202.21@tcp [ 350.843531] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 352.850954] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 353.604766] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 356.851120] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 357.786102] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 357.814656] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 357.825516] LNet: 24999:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 357.829605] LNet: Removed LNI 192.168.202.21@tcp [ 357.842655] LNet: Removed LNI 192.168.202.21@tcp1 [ 357.850820] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 357.874137] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 357.887079] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 357.889938] LNet: Accept secure, port 988 [ 358.128537] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 358.138738] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 358.414141] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.21@tcp [ 358.435779] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 [ 358.458599] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 4 [ 358.500501] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 0 --nid 192.168.202.21@tcp [ 358.510717] LNetError: 25264:0:(api-ni.c:4065:lnet_ni_set_healthv()) manually adding local NI 192.168.202.21@tcp to recovery [ 358.862604] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 361.650789] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 364.862535] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 364.866436] LNet: Skipped 1 previous similar message [ 368.930669] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 368.955410] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 900 [ 371.044126] Lustre: DEBUG MARKER: == sanity-lnet test 211: Remote NI recovery checks ======= 10:30:11 (1729607411) [ 371.090865] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 371.102445] LNet: 26043:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 372.106335] LNet: Removed LNI 192.168.202.21@tcp [ 372.111781] LNet: Removed LNI 192.168.202.21@tcp1 [ 372.120579] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 372.144050] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 372.155005] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 372.158215] LNet: Accept secure, port 988 [ 372.397279] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 372.407234] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 372.678123] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.21@tcp [ 372.707840] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 10 [ 372.745768] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.202.21@tcp --health 0 [ 372.785598] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 373.131294] LNet: 1 peer NIs in recovery (showing 1): 192.168.202.21@tcp [ 374.134735] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 374.138706] LNet: Skipped 1 previous similar message [ 388.223310] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 388.261902] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 [ 388.272338] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.202.21@tcp --health 500 [ 388.306020] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 394.495615] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 394.517259] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 394.526909] LNet: 26549:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 395.530294] LNet: Removed LNI 192.168.202.21@tcp [ 395.535674] LNet: Removed LNI 192.168.202.21@tcp1 [ 395.543612] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 395.566780] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 395.577691] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 395.580557] LNet: Accept secure, port 988 [ 395.809916] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 395.819891] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 396.077890] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.21@tcp [ 396.094726] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 [ 396.116382] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 4 [ 396.152737] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.202.21@tcp --health 0 [ 396.554533] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 396.558845] LNet: Skipped 3 previous similar messages [ 397.250443] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 407.607284] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 407.624913] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 900 [ 409.702701] Lustre: DEBUG MARKER: == sanity-lnet test 212: Check discovery refcount loss bug (LU-14627) ========================================================== 10:30:50 (1729607450) [ 409.841619] LNet: 27661:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 410.845405] LNet: Removed LNI 192.168.202.21@tcp [ 410.850675] LNet: Removed LNI 192.168.202.21@tcp1 [ 412.179046] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 412.182342] alg: No test for adler32 (adler32-zlib) [ 412.968028] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 412.976170] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 412.977289] LNet: Accept secure, port 988 [ 416.079479] Lustre: DEBUG MARKER: Initial discovery [ 416.116689] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.202.121@tcp [ 416.917395] Lustre: DEBUG MARKER: Fail local discover ping to set LNET_PEER_REDISCOVER flag [ 416.960096] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.202.121@tcp [ 416.967974] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 417.451896] Lustre: DEBUG MARKER: Force oleg221-client.virtnet to discover 192.168.202.121@tcp (in background) [ 417.496251] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.202.121@tcp [ 417.956767] Lustre: DEBUG MARKER: Force oleg221-server to discover 192.168.202.21@tcp [ 418.798577] Lustre: DEBUG MARKER: Wait for 28447 [ 420.515607] LNet: There was an unexpected network error while writing to 192.168.202.121: rc = -22 [ 420.990770] Lustre: DEBUG MARKER: Finished wait on 28447 [ 421.123066] LNet: 28935:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 422.130670] LNet: Removed LNI 192.168.202.21@tcp [ 426.190577] Lustre: DEBUG MARKER: == sanity-lnet test 213: Check LNetDist calculation for multiple local NIDs ========================================================== 10:31:06 (1729607466) [ 427.453754] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 427.463376] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 427.465222] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 427.466950] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 427.530626] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 427.533818] alg: No test for adler32 (adler32-zlib) [ 428.315932] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 428.335593] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 428.345651] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 428.348510] LNet: Accept secure, port 988 [ 428.575252] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 428.585268] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 431.212545] Lustre: DEBUG MARKER: == sanity-lnet test 214: Check local NI status when link is downed ========================================================== 10:31:12 (1729607472) [ 431.257097] LNet: 31060:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 431.261228] LNet: Removed LNI 192.168.202.21@tcp [ 431.273749] LNet: Removed LNI 10.1.2.3@tcp [ 432.620409] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 432.623706] alg: No test for adler32 (adler32-zlib) [ 433.402475] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 433.419298] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 433.425823] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 433.428492] LNet: Accept secure, port 988 [ 433.643387] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 433.653458] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 433.947392] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 10.1.2.3@tcp 192.168.202.21@tcp [ 434.959262] LNetError: Unexpected error -22 connecting to 192.168.202.21@tcp at host 192.168.202.21:988 [ 436.008224] Lustre: DEBUG MARKER: == sanity-lnet test 215: Test lnetctl ping --source option ========================================================== 10:31:16 (1729607476) [ 436.048337] LNet: 32214:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 437.052300] LNet: Removed LNI 192.168.202.21@tcp [ 437.057764] LNet: Removed LNI 10.1.2.3@tcp [ 438.402022] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 438.405522] alg: No test for adler32 (adler32-zlib) [ 439.192270] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 439.215382] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 439.225737] LNet: 32472:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 439.230528] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 439.233462] LNet: Accept secure, port 988 [ 439.459431] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp2 --if eth0 [ 439.469235] LNet: Added LNI 192.168.202.21@tcp2 [8/256/0/180] [ 439.734015] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim 192.168.202.21@tcp1 --nid 192.168.202.21@tcp2 [ 441.115231] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.21@tcp1 192.168.202.21@tcp2 [ 441.126280] LNetError: 571:0:(lib-move.c:2228:lnet_handle_find_routed_path()) Unable to send message from 192.168.202.21@tcp1 to 192.168.202.21@tcp2 - Route table may be misconfigured [ 441.138370] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.21@tcp2 192.168.202.21@tcp1 [ 443.192785] Lustre: DEBUG MARKER: == sanity-lnet test 216: Failed send to peer NI owned by local host should not trigger peer NI recovery ========================================================== 10:31:24 (1729607484) [ 443.234783] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 443.244926] LNet: 1238:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 444.248379] LNet: Removed LNI 192.168.202.21@tcp1 [ 445.253734] LNet: Removed LNI 192.168.202.21@tcp2 [ 445.262915] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 445.286414] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 445.296976] LNet: 1250:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 445.301379] LNet: 1250:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 1 previous similar message [ 445.306056] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 445.308960] LNet: Accept secure, port 988 [ 445.538698] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 445.548612] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 445.807407] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.21@tcp [ 445.824276] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.21@tcp 192.168.202.21@tcp [ 445.840675] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.21@tcp1 192.168.202.21@tcp1 [ 445.878931] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 445.888765] LNet: There was an unexpected network error while writing to 192.168.202.21: rc = -22 [ 445.925117] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 445.960759] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 446.274281] LNet: 1 local NIs in recovery (showing 1): 192.168.202.21@tcp [ 447.978349] Lustre: DEBUG MARKER: == sanity-lnet test 217: Don't leak memory when discovering peer with nnis <= 1 ========================================================== 10:31:28 (1729607488) [ 448.021988] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 448.032801] LNet: 2150:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 449.036293] LNet: Removed LNI 192.168.202.21@tcp [ 450.041750] LNet: Removed LNI 192.168.202.21@tcp1 [ 450.050560] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 450.082320] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 0@lo [ 450.163926] LNet: 2186:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 453.294663] Lustre: DEBUG MARKER: == sanity-lnet test 218: Local recovery pings should exercise all available paths ========================================================== 10:31:34 (1729607494) [ 453.419098] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 453.426114] alg: No test for adler32 (adler32-zlib) [ 454.209676] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 454.665392] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_218 Need two LNet interfaces [ 455.238611] Lustre: DEBUG MARKER: == sanity-lnet test 219: Consolidate peer entries ======== 10:31:36 (1729607496) [ 455.286655] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 455.300119] LNet: 3355:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 455.309771] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 455.332350] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 455.342933] LNet: 3362:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 455.347726] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 455.350412] LNet: Accept secure, port 988 [ 455.575927] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 455.583656] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 455.847070] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 455.860436] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp1 [ 455.876151] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.21@tcp1 [ 457.974530] Lustre: DEBUG MARKER: == sanity-lnet test 220: Add routes w/default options - check aliveness ========================================================== 10:31:38 (1729607498) [ 458.592123] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_220 Need at least 2 remote nodes found oleg221-server [ 459.169145] Lustre: DEBUG MARKER: == sanity-lnet test 221: Add routes w/DD disabled - check aliveness ========================================================== 10:31:39 (1729607499) [ 459.779353] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_221 Need at least 2 remote nodes found oleg221-server [ 460.356403] Lustre: DEBUG MARKER: == sanity-lnet test 222: Check avoid_asym_router_failure=1 ========================================================== 10:31:41 (1729607501) [ 460.958789] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_222 Need at least 2 remote nodes found oleg221-server [ 461.533420] Lustre: DEBUG MARKER: == sanity-lnet test 223: Check avoid_asym_router_failure=1 w/DD disabled ========================================================== 10:31:42 (1729607502) [ 462.023901] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_223 Need at least 2 remote nodes found oleg221-server [ 462.600676] Lustre: DEBUG MARKER: == sanity-lnet test 224: Check avoid_asym_router_failure=0 ========================================================== 10:31:43 (1729607503) [ 463.205038] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_224 Need at least 2 remote nodes found oleg221-server [ 463.777265] Lustre: DEBUG MARKER: == sanity-lnet test 225: Check avoid_asym_router_failure=0 w/DD disabled ========================================================== 10:31:44 (1729607504) [ 464.391482] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_225 Need at least 2 remote nodes found oleg221-server [ 464.967684] Lustre: DEBUG MARKER: == sanity-lnet test 226: test missing route for 1 of 2 routers ========================================================== 10:31:45 (1729607505) [ 465.569204] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_226 Need at least 3 remote nodes found oleg221-server [ 466.155272] Lustre: DEBUG MARKER: == sanity-lnet test 227: Check router peer health w/DD disabled ========================================================== 10:31:46 (1729607506) [ 466.760668] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_227 Need at least 3 remote nodes found oleg221-server [ 467.343138] Lustre: DEBUG MARKER: == sanity-lnet test 230: Test setting conns-per-peer ===== 10:31:48 (1729607508) [ 467.371867] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 467.381933] LNet: 7145:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 467.386653] LNet: Removed LNI 192.168.202.21@tcp [ 468.391697] LNet: Removed LNI 192.168.202.21@tcp1 [ 468.400796] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 468.424770] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 468.435505] LNet: 7163:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 468.439904] LNet: 7163:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 1 previous similar message [ 468.444296] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 468.447360] LNet: Accept secure, port 988 [ 468.675423] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 4 [ 468.704911] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 468.772628] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 468.782340] LNet: 7301:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 469.789676] LNet: Removed LNI 192.168.202.21@tcp [ 469.798320] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 469.821470] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 469.832193] LNet: 7309:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 469.836967] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 469.839625] LNet: Accept secure, port 988 [ 470.076285] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 5 [ 470.105533] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 470.178189] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 471.190629] LNet: Removed LNI 192.168.202.21@tcp [ 471.199822] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 471.226981] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 471.239982] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 471.242773] LNet: Accept secure, port 988 [ 471.480764] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 6 [ 471.510194] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 471.583740] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 471.593188] LNet: 7591:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 471.596964] LNet: 7591:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 1 previous similar message [ 472.604720] LNet: Removed LNI 192.168.202.21@tcp [ 472.613723] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 472.637101] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 472.647720] LNet: 7599:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 472.651995] LNet: 7599:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 1 previous similar message [ 472.656493] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 472.659410] LNet: Accept secure, port 988 [ 472.894561] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 7 [ 472.926318] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 473.007410] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 474.021615] LNet: Removed LNI 192.168.202.21@tcp [ 474.030461] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 474.053744] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 474.064753] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 474.067561] LNet: Accept secure, port 988 [ 474.302281] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 8 [ 474.331405] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 474.417109] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 475.431707] LNet: Removed LNI 192.168.202.21@tcp [ 475.440412] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 475.463663] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 475.475037] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 475.477924] LNet: Accept secure, port 988 [ 475.717343] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 9 [ 475.746313] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 475.832587] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 475.842742] LNet: 8026:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 475.846572] LNet: 8026:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 2 previous similar messages [ 476.853659] LNet: Removed LNI 192.168.202.21@tcp [ 476.862940] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 476.886811] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 476.897638] LNet: 8034:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 476.901991] LNet: 8034:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 2 previous similar messages [ 476.906657] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 476.909721] LNet: Accept secure, port 988 [ 477.148839] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 10 [ 477.180547] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 477.272516] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 478.288623] LNet: Removed LNI 192.168.202.21@tcp [ 478.298156] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 478.321891] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 478.332965] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 478.336084] LNet: Accept secure, port 988 [ 478.583563] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 11 [ 478.615017] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 478.707686] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 479.721704] LNet: Removed LNI 192.168.202.21@tcp [ 479.730088] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 479.752713] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 479.763628] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 479.766524] LNet: Accept secure, port 988 [ 479.994692] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 12 [ 480.023399] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 480.122471] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 481.134626] LNet: Removed LNI 192.168.202.21@tcp [ 481.143006] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 481.165666] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 481.176678] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 481.179493] LNet: Accept secure, port 988 [ 481.408458] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 13 [ 481.436786] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 481.535734] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 482.548685] LNet: Removed LNI 192.168.202.21@tcp [ 482.556901] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 482.579916] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 482.591329] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 482.594577] LNet: Accept secure, port 988 [ 482.823275] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 14 [ 482.852025] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 482.959336] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 483.972643] LNet: Removed LNI 192.168.202.21@tcp [ 483.981124] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 484.003372] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 484.014219] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 484.017258] LNet: Accept secure, port 988 [ 484.245451] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 15 [ 484.274721] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.21@tcp [ 484.385504] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 484.395317] LNet: 8897:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 484.399088] LNet: 8897:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 5 previous similar messages [ 485.406639] LNet: Removed LNI 192.168.202.21@tcp [ 485.414697] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 485.437654] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 485.448205] LNet: 8905:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 485.452984] LNet: 8905:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 5 previous similar messages [ 485.457981] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 485.460874] LNet: Accept secure, port 988 [ 485.692860] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 128 [ 485.715090] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 485.735565] LNet: Removed LNI 192.168.202.21@tcp [ 485.743485] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 485.765879] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 485.776561] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 485.779363] LNet: Accept secure, port 988 [ 486.014624] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer -1 [ 488.150820] Lustre: DEBUG MARKER: == sanity-lnet test 231: Check DLC handling of peer_timeout parameter ========================================================== 10:32:08 (1729607528) [ 488.196214] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 488.213963] LNet: Removed LNI 192.168.202.21@tcp [ 488.222351] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 488.246251] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 [ 488.256676] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/180] [ 488.259698] LNet: Accept secure, port 988 [ 488.645415] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 488.658739] LNet: Removed LNI 192.168.202.21@tcp231 [ 488.665996] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 488.691927] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 488.706515] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/180] [ 488.709572] LNet: Accept secure, port 988 [ 488.712149] LNet: 9929:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 488.864236] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 488.879704] LNet: Removed LNI 192.168.202.21@tcp231 [ 488.883953] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=-1 [ 488.894560] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/180] [ 489.257472] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 489.274908] LNet: Removed LNI 192.168.202.21@tcp231 [ 489.282060] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 489.307092] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 489.317309] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/0] [ 489.320112] LNet: Accept secure, port 988 [ 489.322448] LNet: 10079:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 489.452103] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 489.465126] LNet: Removed LNI 192.168.202.21@tcp231 [ 489.470772] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=0 [ 489.485067] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/0] [ 489.848194] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 489.862828] LNet: Removed LNI 192.168.202.21@tcp231 [ 489.869053] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 489.895418] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 489.906520] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/60] [ 489.909474] LNet: Accept secure, port 988 [ 490.037817] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 490.050822] LNet: Removed LNI 192.168.202.21@tcp231 [ 490.055232] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=60 [ 490.067762] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/60] [ 490.428327] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 490.446723] LNet: Removed LNI 192.168.202.21@tcp231 [ 490.454857] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 490.482481] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 490.493504] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/180] [ 490.496469] LNet: Accept secure, port 988 [ 490.498831] LNet: 10376:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 490.503381] LNet: 10376:0:(api-ni.c:337:recovery_interval_set()) Skipped 1 previous similar message [ 490.635468] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 490.648824] LNet: Removed LNI 192.168.202.21@tcp231 [ 490.653787] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=180 [ 490.665249] LNet: Added LNI 192.168.202.21@tcp231 [8/256/0/180] [ 493.112737] Lustre: DEBUG MARKER: == sanity-lnet test 232: Test setting ToS value ========== 10:32:13 (1729607533) [ 493.161734] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 493.184725] LNet: Removed LNI 192.168.202.21@tcp231 [ 493.193307] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 493.223323] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 [ 493.237477] LNet: Added LNI 192.168.202.21@tcp232 [8/256/0/180] [ 493.240401] LNet: Accept secure, port 988 [ 493.485686] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 493.502226] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 493.523788] LNet: Removed LNI 192.168.202.21@tcp232 [ 493.531459] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos -1 [ 493.542891] LNet: Added LNI 192.168.202.21@tcp232 [8/256/0/180] [ 493.778798] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 493.795185] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 493.816810] LNet: Removed LNI 192.168.202.21@tcp232 [ 493.824204] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos 104 [ 493.836639] LNet: Added LNI 192.168.202.21@tcp232 [8/256/0/180] [ 494.077082] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 494.093738] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 494.114568] LNet: Removed LNI 192.168.202.21@tcp232 [ 494.119812] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos 106 [ 494.127946] LNet: Added LNI 192.168.202.21@tcp232 [8/256/0/180] [ 494.343295] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 494.361798] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 494.384727] LNet: Removed LNI 192.168.202.21@tcp232 [ 494.391928] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos 300 [ 496.450126] Lustre: DEBUG MARKER: == sanity-lnet test 250: test that linux routes are added ========================================================== 10:32:17 (1729607537) [ 496.507326] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 496.523688] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 496.546418] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 496.557467] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 496.560246] LNet: Accept secure, port 988 [ 498.831748] Lustre: DEBUG MARKER: == sanity-lnet test 251: Define multiple kfi networks on single interface ========================================================== 10:32:19 (1729607539) [ 499.324851] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_251 Need kfi NETTYPE [ 499.892348] Lustre: DEBUG MARKER: == sanity-lnet test 252: Ping to down peer should unlink quickly ========================================================== 10:32:20 (1729607540) [ 500.051945] LNet: Removed LNI 192.168.202.21@tcp [ 501.438112] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 501.441355] alg: No test for adler32 (adler32-zlib) [ 502.222889] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 502.231208] LNet: 13633:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 502.233711] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 502.235129] LNet: Accept secure, port 988 [ 504.865188] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 506.954603] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --timeout 15 192.168.202.121@tcp [ 507.015963] LNet: 13789:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 507.030430] LNet: Removed LNI 192.168.202.21@tcp [ 510.193430] Lustre: DEBUG MARKER: == sanity-lnet test 253: Message delayed beyond deadline should be dropped (single-rail) ========================================================== 10:32:30 (1729607550) [ 511.626245] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 511.629566] alg: No test for adler32 (adler32-zlib) [ 512.411188] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 512.416980] LNet: 14863:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 512.419174] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 512.422239] LNet: Accept secure, port 988 [ 515.027488] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 515.090241] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set transaction_timeout 10 [ 526.631452] Lustre: DEBUG MARKER: sanity-lnet test_253: @@@@@@ FAIL: Expect 1 dropped GET but found 0 [ 529.962070] Lustre: DEBUG MARKER: == sanity-lnet test 254: Message delayed beyond deadline should be dropped (multi-rail) ========================================================== 10:32:50 (1729607570) [ 530.109652] LNet: 15788:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 531.116689] LNet: Removed LNI 192.168.202.21@tcp [ 532.589905] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 532.593195] alg: No test for adler32 (adler32-zlib) [ 533.380966] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 533.391823] LNet: 16032:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 533.395527] LNet: Added LNI 192.168.202.21@tcp [8/256/0/180] [ 533.397532] LNet: Accept secure, port 988 [ 536.052420] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.121@tcp [ 538.246328] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 538.260926] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 538.271991] LNet: 16201:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 538.277189] LNet: Added LNI 192.168.202.21@tcp1 [8/256/0/180] [ 538.536655] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set transaction_timeout 10 [ 550.100249] Lustre: DEBUG MARKER: sanity-lnet test_254: @@@@@@ FAIL: Expect 1 dropped GET but found 0