[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-2.fc40 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5410-0x000f541f] mapped at [ffffffffff200410] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2f2000-0xbffcffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5220 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1d6f 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1c0b 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01BCB (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1c7f 00090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1d0f 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1d47 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 329653814 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffd9fff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043832 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782298 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027499 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 3820316k/5224448k available (8172k kernel code, 1049120k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.351863] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.353502] pid_max: default: 32768 minimum: 301 [ 0.354366] Security Framework initialized [ 0.355162] SELinux: Initializing. [ 0.355889] SELinux: Starting in permissive mode [ 0.357181] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.359964] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.361775] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.363028] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.364569] Initializing cgroup subsys memory [ 0.365393] Initializing cgroup subsys devices [ 0.366215] Initializing cgroup subsys freezer [ 0.367105] Initializing cgroup subsys net_cls [ 0.367967] Initializing cgroup subsys blkio [ 0.368622] Initializing cgroup subsys perf_event [ 0.369453] Initializing cgroup subsys hugetlb [ 0.370277] Initializing cgroup subsys pids [ 0.371059] Initializing cgroup subsys net_prio [ 0.372016] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.374160] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.375203] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.376135] tlb_flushall_shift: 6 [ 0.376788] FEATURE SPEC_CTRL Present [ 0.377426] FEATURE IBPB_SUPPORT Present [ 0.378158] Spectre V2 : Enabling Indirect Branch Prediction Barrier [ 0.379387] Spectre V2 : Vulnerable [ 0.380064] Speculative Store Bypass: Vulnerable [ 0.381669] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.387078] ACPI: Core revision 20130517 [ 0.389093] ACPI: All ACPI Tables successfully acquired [ 0.390153] ftrace: allocating 30294 entries in 119 pages [ 0.431731] Enabling x2apic [ 0.432302] Enabled x2apic [ 0.433146] Switched APIC routing to physical x2apic. [ 0.435304] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.436449] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (fam: 06, model: 3e, stepping: 04) [ 0.438387] TSC deadline timer enabled [ 0.438499] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.440057] ... version: 2 [ 0.440838] ... bit width: 48 [ 0.441586] ... generic registers: 4 [ 0.442396] ... value mask: 0000ffffffffffff [ 0.443274] ... max period: 00007fffffffffff [ 0.444213] ... fixed-purpose events: 3 [ 0.444960] ... event mask: 000000070000000f [ 0.445859] KVM setup paravirtual spinlock [ 0.449392] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.452405] KVM setup async PF for cpu 1 [ 0.453505] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.455571] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.457783] KVM setup async PF for cpu 2 [ 0.448299] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.458198] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.459492] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.460372] Brought up 4 CPUs [ 0.460390] KVM setup async PF for cpu 3 [ 0.460396] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.462404] smpboot: Max logical packages: 1 [ 0.463179] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.465931] devtmpfs: initialized [ 0.466615] x86/mm: Memory block size: 128MB [ 0.470154] EVM: security.selinux [ 0.470786] EVM: security.ima [ 0.471306] EVM: security.capability [ 0.473419] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.474854] NET: Registered protocol family 16 [ 0.475888] cpuidle: using governor haltpoll [ 0.476939] ACPI: bus type PCI registered [ 0.477661] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.478924] PCI: Using configuration type 1 for base access [ 0.479987] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.485838] ACPI: Added _OSI(Module Device) [ 0.486652] ACPI: Added _OSI(Processor Device) [ 0.487451] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.488283] ACPI: Added _OSI(Processor Aggregator Device) [ 0.489238] ACPI: Added _OSI(Linux-Dell-Video) [ 0.490621] ACPI: EC: Look up EC in DSDT [ 0.492344] ACPI: Interpreter enabled [ 0.493037] ACPI: (supports S0 S3 S4 S5) [ 0.493816] ACPI: Using IOAPIC for interrupt routing [ 0.494665] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.496352] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.501355] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.502431] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.503766] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.504892] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.507340] acpiphp: Slot [2] registered [ 0.508158] acpiphp: Slot [5] registered [ 0.508928] acpiphp: Slot [6] registered [ 0.509685] acpiphp: Slot [3] registered [ 0.510342] acpiphp: Slot [4] registered [ 0.511079] acpiphp: Slot [7] registered [ 0.511840] acpiphp: Slot [8] registered [ 0.512508] acpiphp: Slot [9] registered [ 0.513275] acpiphp: Slot [10] registered [ 0.514039] acpiphp: Slot [11] registered [ 0.514822] acpiphp: Slot [12] registered [ 0.515536] acpiphp: Slot [13] registered [ 0.516308] acpiphp: Slot [14] registered [ 0.517093] acpiphp: Slot [15] registered [ 0.517872] acpiphp: Slot [16] registered [ 0.518547] acpiphp: Slot [17] registered [ 0.519308] acpiphp: Slot [18] registered [ 0.520062] acpiphp: Slot [19] registered [ 0.520762] acpiphp: Slot [20] registered [ 0.521430] acpiphp: Slot [21] registered [ 0.522258] acpiphp: Slot [22] registered [ 0.523099] acpiphp: Slot [23] registered [ 0.523863] acpiphp: Slot [24] registered [ 0.524615] acpiphp: Slot [25] registered [ 0.525356] acpiphp: Slot [26] registered [ 0.526136] acpiphp: Slot [27] registered [ 0.526961] acpiphp: Slot [28] registered [ 0.527707] acpiphp: Slot [29] registered [ 0.528438] acpiphp: Slot [30] registered [ 0.529232] acpiphp: Slot [31] registered [ 0.529955] PCI host bridge to bus 0000:00 [ 0.530675] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.531785] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.533002] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.534356] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.535612] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 0.536982] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.537943] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.538411] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.539047] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.542480] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.543562] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.544856] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.545986] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.547190] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.548500] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.548931] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.550279] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.551810] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.552747] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.557246] pci 0000:00:02.0: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref] [ 0.558781] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.559527] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.562180] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.564797] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.569818] pci 0000:00:05.0: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref] [ 0.572714] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.574416] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.576282] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.582399] pci 0000:00:06.0: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref] [ 0.584929] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 0.586233] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 0.587420] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 0.588715] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 0.590477] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 0.592209] vgaarb: loaded [ 0.592852] SCSI subsystem initialized [ 0.593538] ACPI: bus type USB registered [ 0.594306] usbcore: registered new interface driver usbfs [ 0.595320] usbcore: registered new interface driver hub [ 0.596371] usbcore: registered new device driver usb [ 0.597552] PCI: Using ACPI for IRQ routing [ 0.598277] PCI: pci_cache_line_size set to 64 bytes [ 0.598417] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 0.598420] e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] [ 0.598421] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 0.598646] NetLabel: Initializing [ 0.599321] NetLabel: domain hash size = 128 [ 0.600133] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.601078] NetLabel: unlabeled traffic allowed by default [ 0.602293] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.603304] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.607561] amd_nb: Cannot enumerate AMD northbridges [ 0.608644] Switched to clocksource kvm-clock [ 0.621380] pnp: PnP ACPI init [ 0.622023] ACPI: bus type PNP registered [ 0.622774] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 0.622835] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 0.622868] pnp 00:02: [dma 2] [ 0.622893] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 0.622952] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.623008] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.623061] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.623305] pnp: PnP ACPI: found 6 devices [ 0.624097] ACPI: bus type PNP unregistered [ 0.632580] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.632583] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.632585] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.632587] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.632589] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x38007fffffff window] [ 0.632647] NET: Registered protocol family 2 [ 0.633822] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 0.635496] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 0.637719] TCP: Hash tables configured (established 32768 bind 32768) [ 0.638901] TCP: reno registered [ 0.639478] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 0.640974] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 0.642313] NET: Registered protocol family 1 [ 0.644818] RPC: Registered named UNIX socket transport module. [ 0.647152] RPC: Registered udp transport module. [ 0.648767] RPC: Registered tcp transport module. [ 0.649853] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.651913] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.653533] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.656032] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.657948] PCI: CLS 0 bytes, default 64 [ 0.658094] Unpacking initramfs... [ 1.839932] debug: unmapping init [mem 0xffff8800bc2f2000-0xffff8800bffcffff] [ 1.842182] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.843350] software IO TLB [mem 0xb82f2000-0xbc2f2000] (64MB) mapped at [ffff8800b82f2000-ffff8800bc2f1fff] [ 1.845005] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 10737418240 ms ovfl timer [ 1.846322] RAPL PMU: hw unit of domain pp0-core 2^-0 Joules [ 1.847348] RAPL PMU: hw unit of domain package 2^-0 Joules [ 1.848309] RAPL PMU: hw unit of domain dram 2^-0 Joules [ 1.851239] cryptomgr_test (50) used greatest stack depth: 14128 bytes left [ 1.851592] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 1.851653] Initialise system trusted keyring [ 1.880726] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 1.881886] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 1.886267] zpool: loaded [ 1.886953] zbud: loaded [ 1.887741] VFS: Disk quotas dquot_6.6.0 [ 1.888502] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.890261] NFS: Registering the id_resolver key type [ 1.891202] Key type id_resolver registered [ 1.891935] Key type id_legacy registered [ 1.892590] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 1.893978] Key type big_key registered [ 1.894718] SELinux: Registering netfilter hooks [ 1.895669] cryptomgr_test (56) used greatest stack depth: 13968 bytes left [ 1.898276] cryptomgr_test (61) used greatest stack depth: 13536 bytes left [ 1.898452] NET: Registered protocol family 38 [ 1.898460] Key type asymmetric registered [ 1.898472] Asymmetric key parser 'x509' registered [ 1.898539] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 1.898626] io scheduler noop registered [ 1.898629] io scheduler deadline registered (default) [ 1.898704] io scheduler cfq registered [ 1.898709] io scheduler mq-deadline registered [ 1.898712] io scheduler kyber registered [ 1.900839] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 1.900849] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 1.910579] intel_idle: does not run on family 6 model 62 [ 1.910721] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 1.912029] ACPI: Power Button [PWRF] [ 1.913015] GHES: HEST is not enabled! [ 1.960366] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 2.008930] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 2.059222] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.086449] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 2.113543] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 2.115664] Non-volatile memory driver v1.3 [ 2.116487] Linux agpgart interface v0.103 [ 2.117517] crash memory driver: version 1.1 [ 2.118791] nbd: registered device at major 43 [ 2.122064] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 2.122092] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 2.122125] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 2.122151] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 2.122176] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 2.128812] virtio_blk virtio1: [vda] 112728 512-byte logical blocks (57.7 MB/55.0 MiB) [ 2.132348] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 2.132376] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 2.132409] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 2.132433] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 2.132458] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 2.138507] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.141702] rdac: device handler registered [ 2.142616] hp_sw: device handler registered [ 2.143404] emc: device handler registered [ 2.144247] libphy: Fixed MDIO Bus: probed [ 2.146838] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.148279] ehci-pci: EHCI PCI platform driver [ 2.149335] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.150417] ohci-pci: OHCI PCI platform driver [ 2.151216] uhci_hcd: USB Universal Host Controller Interface driver [ 2.152428] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.154690] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.155717] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.156845] mousedev: PS/2 mouse device common for all mice [ 2.158715] rtc_cmos 00:05: RTC can wake from S4 [ 2.159979] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.160108] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 2.160464] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.165634] hidraw: raw HID events driver (C) Jiri Kosina [ 2.165825] usbcore: registered new interface driver usbhid [ 2.165826] usbhid: USB HID core driver [ 2.165875] drop_monitor: Initializing network drop monitor service [ 2.165913] Netfilter messages via NETLINK v0.30. [ 2.165974] TCP: cubic registered [ 2.165980] Initializing XFRM netlink socket [ 2.166191] NET: Registered protocol family 10 [ 2.166593] NET: Registered protocol family 17 [ 2.166659] Key type dns_resolver registered [ 2.166993] mce: Using 10 MCE banks [ 2.167211] Loading compiled-in X.509 certificates [ 2.168076] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 2.168114] registered taskstats version 1 [ 2.170643] modprobe (71) used greatest stack depth: 12992 bytes left [ 2.172458] Key type trusted registered [ 2.175740] Key type encrypted registered [ 2.175775] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 2.176836] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 2.177303] rtc_cmos 00:05: setting system clock to 2024-10-22 14:24:01 UTC (1729607041) [ 2.196155] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 2.197841] Write protecting the kernel read-only data: 12288k [ 2.199372] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 2.200746] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 2.206853] random: systemd: uninitialized urandom read (16 bytes read) [ 2.209469] random: systemd: uninitialized urandom read (16 bytes read) [ 2.211348] random: systemd: uninitialized urandom read (16 bytes read) [ 2.214339] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 2.218269] systemd[1]: Detected virtualization kvm. [ 2.219457] systemd[1]: Detected architecture x86-64. [ 2.220559] systemd[1]: Running in initial RAM disk. [ 2.223397] systemd[1]: No hostname configured. [ 2.224247] systemd[1]: Set hostname to . [ 2.225209] random: systemd: uninitialized urandom read (16 bytes read) [ 2.226298] systemd[1]: Initializing machine ID from random generator. [ 2.258043] random: systemd: uninitialized urandom read (16 bytes read) [ 2.259272] random: systemd: uninitialized urandom read (16 bytes read) [ 2.260529] random: systemd: uninitialized urandom read (16 bytes read) [ 2.261723] random: systemd: uninitialized urandom read (16 bytes read) [ 2.263744] random: systemd: uninitialized urandom read (16 bytes read) [ 2.265219] random: systemd: uninitialized urandom read (16 bytes read) [ 2.272727] systemd[1]: Created slice Root Slice. [ 2.275102] systemd[1]: Listening on udev Kernel Socket. [ 2.277332] systemd[1]: Reached target Timers. [ 2.279354] systemd[1]: Listening on udev Control Socket. [ 2.281722] systemd[1]: Reached target Local File Systems. [ 2.284061] systemd[1]: Reached target Swap. [ 2.286118] systemd[1]: Listening on Journal Socket. [ 2.288267] systemd[1]: Reached target Sockets. [ 2.290430] systemd[1]: Created slice System Slice. [ 2.293416] systemd[1]: Starting Setup Virtual Console... [ 2.296568] systemd[1]: Starting dracut cmdline hook... [ 2.300303] systemd[1]: Starting Load Kernel Modules... [ 2.302486] systemd[1]: Reached target Slices. [ 2.305260] systemd[1]: Starting Journal Service... [ 2.308191] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 2.312123] systemd[1]: Started Setup Virtual Console. [ 2.317067] systemd[1]: Started Load Kernel Modules. [ 2.319731] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 2.325514] systemd[1]: Starting Create Static Device Nodes in /dev... [ 2.330060] systemd[1]: Starting Apply Kernel Variables... [ 2.334400] systemd[1]: Started Create Static Device Nodes in /dev. [ 2.338098] systemd[1]: Started Apply Kernel Variables. [ 2.341504] systemd[1]: Started Journal Service. [ 2.603318] random: fast init done [ 2.743751] libata version 3.00 loaded. [ 2.746446] ata_piix 0000:00:01.1: version 2.13 [ 2.757256] scsi host0: ata_piix [ 2.766458] scsi host1: ata_piix [ 2.768052] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 2.770693] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 2.851729] tsc: Refined TSC clocksource calibration: 2399.958 MHz [ 2.859188] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 2.862043] ip (344) used greatest stack depth: 12320 bytes left [ 3.037724] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 3.147780] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 8.947143] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 9.421058] systemd-journald[108]: Received SIGTERM from PID 1 (systemd). [ 9.624367] SELinux: Disabled at runtime. [ 9.626657] SELinux: Unregistering netfilter hooks [ 9.696463] ip_tables: (C) 2000-2006 Netfilter Core Team [ 9.700395] systemd[1]: Inserted module 'ip_tables' [ 10.227829] systemd-journald[569]: Received request to flush runtime journal from PID 1 [ 10.301444] find (633) used greatest stack depth: 11824 bytes left [ 10.313552] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 10.323943] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 10.338560] cryptd: max_cpu_qlen set to 1000 [ 10.358292] AVX version of gcm_enc/dec engaged. [ 10.359682] AES CTR mode by8 optimization enabled [ 10.361323] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 10.367980] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 10.399835] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 10.401110] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 10.473902] EDAC MC: Ver: 3.0.0 [ 10.477695] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 10.477699] EDAC sbridge: Ver: 1.1.2 [ 12.780304] mount.nfs (770) used greatest stack depth: 10704 bytes left [ 19.625199] mount.nfs (1120) used greatest stack depth: 10648 bytes left [ 32.962703] libcfs: loading out-of-tree module taints kernel. [ 32.965124] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 33.079508] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 33.082951] alg: No test for adler32 (adler32-zlib) [ 33.979473] Lustre: Lustre: Build Version: 2.16.0_RC4_1_g112c829 [ 34.141266] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 34.142515] LNet: Accept secure, port 988 [ 35.685813] Key type lgssc registered [ 36.153588] Lustre: Echo OBD driver; http://www.lustre.org/ [ 94.787190] Lustre: Mounted lustre-client [ 97.101946] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 109.497439] Lustre: DEBUG MARKER: oleg122-client.virtnet: executing check_logdir /tmp/testlogs/ [ 110.661907] Lustre: DEBUG MARKER: oleg122-client.virtnet: executing yml_node [ 112.150898] Lustre: DEBUG MARKER: Client: 2.16.0.RC4 [ 112.989055] Lustre: DEBUG MARKER: MDS: 2.16.0.RC4 [ 113.844569] Lustre: DEBUG MARKER: OSS: 2.16.0.RC4 [ 114.372956] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-lnet ============----- Tue Oct 22 10:25:53 EDT 2024 [ 119.343730] Lustre: Unmounted lustre-client [ 158.327476] Key type lgssc unregistered [ 158.417435] LNet: 8567:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 159.425402] LNet: Removed LNI 192.168.201.22@tcp [ 169.264977] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 169.271885] alg: No test for adler32 (adler32-zlib) [ 170.065694] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 170.114480] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 170.116621] LNet: Accept secure, port 988 [ 170.126010] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show [ 170.704685] Lustre: DEBUG MARKER: excepting tests: [ 170.740313] LNet: 9389:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 170.756395] LNet: Removed LNI 192.168.201.22@tcp [ 171.173311] random: crng init done [ 172.635894] Lustre: DEBUG MARKER: == sanity-lnet test 0: Export empty config, import the config, compare ========================================================== 10:26:51 (1729607211) [ 172.731479] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 172.738358] alg: No test for adler32 (adler32-zlib) [ 173.524019] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 173.550387] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 173.559048] LNet: 9806:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 173.568102] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 173.590250] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 173.599880] LNet: 9813:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 176.059007] Lustre: DEBUG MARKER: == sanity-lnet test 1: Add peer with single nid (tcp) ==== 10:26:54 (1729607214) [ 176.089953] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 176.100051] LNet: 10451:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 176.110316] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 176.142916] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp [ 178.309269] Lustre: DEBUG MARKER: == sanity-lnet test 2: Add peer with single nid (o2ib) === 10:26:57 (1729607217) [ 178.341683] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 178.352190] LNet: 11102:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 178.363480] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 178.394008] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 2.2.2.2@o2ib [ 180.557072] Lustre: DEBUG MARKER: == sanity-lnet test 3: Add peer with tcp primary o2ib secondary ========================================================== 10:26:59 (1729607219) [ 180.596528] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 180.608471] LNet: 11753:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 180.619500] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 180.651183] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 3.3.3.3@tcp --nid 3.3.3.3@o2ib [ 182.812447] Lustre: DEBUG MARKER: == sanity-lnet test 4: Add peer with nidrange (tcp) ====== 10:27:01 (1729607221) [ 182.846389] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 182.863260] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 182.894258] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 4.4.4.4@tcp --nid 4.4.4.[1-3]@tcp [ 183.032273] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 4.4.4.4@tcp --nid 4.4.4.[1-4]@tcp [ 185.159694] Lustre: DEBUG MARKER: == sanity-lnet test 5: Add peer with nidrange (o2ib) ===== 10:27:04 (1729607224) [ 185.208252] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 185.220547] LNet: 13058:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 185.224433] LNet: 13058:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 1 previous similar message [ 185.235615] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 185.266966] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1-4]@o2ib [ 185.397832] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1-4]@o2ib [ 185.543565] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1,2,3-4]@o2ib [ 187.706708] Lustre: DEBUG MARKER: == sanity-lnet test 6: Add peer with multiple nidranges == 10:27:06 (1729607226) [ 187.737045] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 187.754150] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 187.787057] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 6.6.6.6@tcp --nid 6.6.[6-7].[0-4/2]@tcp,6.6.[1-4/2].[0-6/3]@o2ib,[6-12/4]@gni,[6-12/4]@kfi [ 190.023454] Lustre: DEBUG MARKER: == sanity-lnet test 7: Various peer delete tests ========= 10:27:08 (1729607228) [ 190.055182] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 190.074080] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 190.101632] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp [ 190.118014] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp [ 190.246477] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@o2ib [ 190.255108] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@o2ib [ 190.365976] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp --nid 7.7.7.[8-12]@tcp [ 190.375634] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp [ 190.481434] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@o2ib --nid 7.7.7.[8-12]@o2ib [ 190.491899] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@o2ib [ 190.629404] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp --nid 7.7.7.[9-12]@tcp,7.7.7.[13-15]@o2ib [ 190.642305] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp [ 190.771115] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni [ 190.781797] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni [ 190.918314] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni --nid [8-12]@gni [ 190.930612] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni [ 191.069703] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@kfi [ 191.080499] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@kfi [ 191.203870] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@kfi --nid [8-12]@kfi [ 191.220027] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@kfi [ 191.353109] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni --nid [8-12]@gni,7.7.7.[1-4]@tcp,7.7.7.[5-9]@o2ib,[1-5]@kfi [ 191.363500] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni [ 191.503393] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim 1.1.1.1@tcp --nid 1.1.1.1@tcp,2.2.2.2@tcp,3.3.3.3@tcp,4.4.4.4@tcp [ 191.517010] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp --nid 1.1.1.1@tcp,2.2.2.2@tcp,3.3.3.3@tcp,4.4.4.4@tcp [ 193.743585] Lustre: DEBUG MARKER: == sanity-lnet test 8: Delete single secondary nid from peer (tcp) ========================================================== 10:27:12 (1729607232) [ 193.773205] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 193.784569] LNet: 15095:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 193.788395] LNet: 15095:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 2 previous similar messages [ 193.799561] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 193.832267] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 8.8.8.8@tcp --nid 8.8.8.[10-15]@tcp [ 193.850254] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 8.8.8.8@tcp --nid 8.8.8.13@tcp [ 196.072407] Lustre: DEBUG MARKER: == sanity-lnet test 9: Delete all secondary nids from peer (tcp) ========================================================== 10:27:14 (1729607234) [ 196.100532] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 196.117164] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 196.149964] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 9.9.9.9@tcp --nid 9.9.9.[11-16]@tcp [ 196.168081] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 9.9.9.9@tcp --nid 9.9.9.[11-16]@tcp [ 198.382616] Lustre: DEBUG MARKER: == sanity-lnet test 10: Delete single secondary nid from peer (o2ib) ========================================================== 10:27:17 (1729607237) [ 198.413828] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 198.432149] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 198.464095] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 10.10.10.10@tcp --nid 10.10.10.[12-16]@tcp [ 198.481707] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 10.10.10.10@tcp --nid 10.10.10.14@tcp [ 200.711675] Lustre: DEBUG MARKER: == sanity-lnet test 11: Delete all secondary nids from peer (o2ib) ========================================================== 10:27:19 (1729607239) [ 200.742030] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 200.758919] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 200.790945] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 11.11.11.11@tcp --nid 11.11.11.[13-17]@tcp [ 200.808426] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 11.11.11.11@tcp --nid 11.11.11.[13-17]@tcp [ 203.033710] Lustre: DEBUG MARKER: == sanity-lnet test 12: Delete a secondary nid from peer (tcp and o2ib) ========================================================== 10:27:21 (1729607241) [ 203.064179] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 203.079982] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 203.112247] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 12.12.12.12@o2ib --nid [13-14/1].[13-15/2].13.13@o2ib,[15-16/3].[17-19/4].[1].[5-20/5]@tcp [ 203.131082] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 12.12.12.12@o2ib --nid 13.15.13.13@o2ib,15.17.1.15@tcp [ 205.381077] Lustre: DEBUG MARKER: == sanity-lnet test 13: Delete all secondary nids from peer (tcp and o2ib) ========================================================== 10:27:24 (1729607244) [ 205.413464] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 205.429751] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 205.460881] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 13.13.13.13@o2ib --nid [14-15].[1-2/1].[1].[100-254/10]@tcp,14.14.[254].14@o2ib [ 205.478998] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 13.13.13.13@o2ib --nid [14-15].[1-2/1].[1].[100-254/10]@tcp,14.14.[254].14@o2ib [ 207.685519] Lustre: DEBUG MARKER: == sanity-lnet test 14: import peer create/delete with single nid ========================================================== 10:27:26 (1729607246) [ 207.720356] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 207.739312] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 207.775400] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 207.916466] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 210.063921] Lustre: DEBUG MARKER: == sanity-lnet test 15: import multi peer create/delete with single nid per peer ========================================================== 10:27:28 (1729607248) [ 210.099511] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 210.110234] LNet: 19664:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 210.114267] LNet: 19664:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 6 previous similar messages [ 210.126303] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 210.209173] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 210.289616] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 212.498483] Lustre: DEBUG MARKER: == sanity-lnet test 16: import peer create/delete with multiple nids ========================================================== 10:27:31 (1729607251) [ 212.527043] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 212.542325] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 212.590270] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 212.666306] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 214.867209] Lustre: DEBUG MARKER: == sanity-lnet test 17: import multi peer create/delete with multiple nids ========================================================== 10:27:33 (1729607253) [ 214.897230] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 214.914419] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 215.098528] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 215.198151] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 217.421610] Lustre: DEBUG MARKER: == sanity-lnet test 18a: Delete a subset of nids from a single peer using import --del ========================================================== 10:27:36 (1729607256) [ 217.454275] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 217.470458] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 217.501260] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 217.522865] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 219.708559] Lustre: DEBUG MARKER: == sanity-lnet test 18b: Delete multiple nids from multiple peers using import --del ========================================================== 10:27:38 (1729607258) [ 219.737631] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 219.754107] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 219.784244] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 219.805360] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del [ 222.042677] Lustre: DEBUG MARKER: == sanity-lnet test 19: Add peer with single nid (gni) === 10:27:40 (1729607260) [ 222.067926] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 222.085113] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 222.118552] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 19@gni [ 224.313507] Lustre: DEBUG MARKER: == sanity-lnet test 20: Add peer with gni primary and tcp, o2ib secondary ========================================================== 10:27:43 (1729607263) [ 224.343850] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 224.363836] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 224.396455] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 20@gni --nid 20.20.20.20@tcp,20.20.20.20@o2ib [ 226.607140] Lustre: DEBUG MARKER: == sanity-lnet test 21: Add peer with nidrange (gni) ===== 10:27:45 (1729607265) [ 226.638044] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 226.654999] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 226.687727] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 21@gni --nid [22-25]@gni [ 226.825310] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 21@gni --nid [21-25]@gni [ 229.028844] Lustre: DEBUG MARKER: == sanity-lnet test 22: Delete single secondary nid from peer (gni) ========================================================== 10:27:47 (1729607267) [ 229.072444] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 229.090451] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 229.123074] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 22@gni --nid [24-29]@gni [ 229.139356] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 22@gni --nid 26@gni [ 231.050919] Lustre: DEBUG MARKER: == sanity-lnet test 23: Delete all secondary nids from peer (gni) ========================================================== 10:27:50 (1729607270) [ 231.071451] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 231.079623] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 231.099355] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 23@gni --nid [25-29]@gni [ 231.112869] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 23@gni --nid [25-29]@gni [ 233.003743] Lustre: DEBUG MARKER: == sanity-lnet test 24: Delete a secondary nid from peer (tcp, o2ib and gni) ========================================================== 10:27:51 (1729607271) [ 233.032014] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 233.047967] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 233.079076] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 24@gni --nid [13-14/1].[13-15/2].13.13@o2ib,[15-16/3].[17-19/4].[1].[5-20/5]@tcp,[5-12/6]@gni [ 233.095987] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 24@gni --nid 5@gni,13.15.13.13@o2ib,15.17.1.15@tcp [ 235.295479] Lustre: DEBUG MARKER: == sanity-lnet test 25: Delete all secondary nids from peer (tcp, gni and o2ib) ========================================================== 10:27:54 (1729607274) [ 235.330195] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 235.348387] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 235.381358] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 25@gni --nid [26-27].[4-10/3].26.26@tcp,26.26.26.26@o2ib,[30-35]@gni [ 235.400215] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 25@gni --nid [26-27].[4-10/3].26.26@tcp,26.26.26.26@o2ib,[30-35]@gni [ 237.605043] Lustre: DEBUG MARKER: == sanity-lnet test 26: Delete peer with primary nid locked ========================================================== 10:27:56 (1729607276) [ 237.642838] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 237.663322] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 237.686748] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --lock_prim [ 237.711204] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp [ 237.721762] LNetError: 27647:0:(peer.c:2171:lnet_del_peer_ni()) peer 1.1.1.1@tcp created by Lustre. Must preserve primary NID, but will remove other NIDs [ 237.739633] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp --force [ 237.755327] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer show --nid 1.1.1.1@tcp [ 239.860120] Lustre: DEBUG MARKER: == sanity-lnet test 27: Import bad config should fail gracefully ========================================================== 10:27:58 (1729607278) [ 239.895574] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 239.911985] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 239.945339] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.ueKYwTki6v [ 239.976285] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.ueKYwTki6v [ 239.998415] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.ueKYwTki6v [ 242.086470] Lustre: DEBUG MARKER: == sanity-lnet test 28: Test peer_list =================== 10:28:00 (1729607280) [ 242.121303] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 242.131521] LNet: 28945:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 242.135589] LNet: 28945:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 13 previous similar messages [ 242.146029] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 242.169216] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --ni 7.7.7.7@tcp [ 242.184794] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.2@tcp --nid 7.7.7.8@tcp [ 242.204689] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer list [ 244.278090] Lustre: DEBUG MARKER: == sanity-lnet test 99a: Check various invalid inputs to lnetctl peer ========================================================== 10:28:03 (1729607283) [ 244.310169] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 244.326765] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 244.350941] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid foobar [ 244.365919] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid foobar [ 244.380827] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@o2ib [ 244.396257] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --nid 1.1.1.1@tcp [ 244.411281] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --nid 1.1.1.1@tcp [ 244.425082] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add [ 244.436590] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid foobar [ 244.450214] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.1.1.[2-255]@tcp [ 244.478210] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@foo [ 244.493912] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@tcp [ 244.509299] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@o2ib [ 244.525110] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@gni [ 244.541202] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid [2-1]@gni [ 244.557754] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid [a-f/x]@gni [ 244.573933] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 256.256.256.256@tcp [ 244.590018] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.1.1.1.[2-5/f]@tcp [ 244.606247] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.]2[.3.4@o2ib1.[2-4,[5-6],7-8].1.1@tcp [ 244.623281] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid foobar [ 244.638820] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp --gateway 1@gni [ 244.649340] LNetError: 29642:0:(router.c:632:lnet_add_route()) Cannot add route with gateway 1@gni. There is no local interface configured on LNet gni [ 246.668106] Lustre: DEBUG MARKER: == sanity-lnet test 99b: Invalid value for Multi-Rail in yaml import ========================================================== 10:28:05 (1729607285) [ 246.696774] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 246.712806] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 246.746634] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 248.937302] Lustre: DEBUG MARKER: == sanity-lnet test 100: Add route with single gw ======== 10:28:07 (1729607287) [ 249.557754] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_100 Need at least 2 remote nodes found oleg122-server [ 250.159633] Lustre: DEBUG MARKER: == sanity-lnet test 101: Add route with multiple gw ====== 10:28:09 (1729607289) [ 250.191819] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 250.209108] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 250.232239] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 250.243148] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 250.246023] LNet: Accept secure, port 988 [ 250.896202] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp1 --gateway 192.168.201.[23-27]@tcp [ 250.908231] LNet: 31610:0:(router.c:737:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled [ 253.079500] Lustre: DEBUG MARKER: == sanity-lnet test 102: Delete route with single gw ===== 10:28:11 (1729607291) [ 253.702612] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_102 Need at least 2 remote nodes found oleg122-server [ 254.273111] Lustre: DEBUG MARKER: == sanity-lnet test 103: Delete route with multiple gw === 10:28:13 (1729607293) [ 254.296932] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 269.306777] LNetError: 31313:0:(lib-lnet.h:1332:lnet_set_route_aliveness()) route to tcp1 through 192.168.201.23@tcp has gone from up to down [ 269.323309] LNet: Removed LNI 192.168.201.22@tcp [ 269.333389] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 269.358623] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 269.370582] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 269.373670] LNet: Accept secure, port 988 [ 269.610338] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp103 --gateway 192.168.201.[23-28/2]@tcp [ 269.623584] LNet: 302:0:(router.c:737:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled [ 269.629452] LNet: 302:0:(router.c:737:lnet_add_route()) Skipped 4 previous similar messages [ 269.639088] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route del --net tcp103 --gateway 192.168.201.[23-28/2]@tcp [ 271.827738] Lustre: DEBUG MARKER: == sanity-lnet test 104: Set/check response_tracking param ========================================================== 10:28:30 (1729607310) [ 271.853514] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 272.867162] LNet: Removed LNI 192.168.201.22@tcp [ 272.877105] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 272.910819] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking -1 [ 272.933334] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 272.949779] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 272.978081] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 272.999914] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.016515] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.040279] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 0 [ 273.067992] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.084716] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.111423] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 273.138691] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.154528] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.178253] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 1 [ 273.206255] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.222530] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.250718] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 273.278244] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.294398] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.318134] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 2 [ 273.346152] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.362086] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.389690] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 273.416786] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.434032] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.457964] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 3 [ 273.485931] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.502397] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.530181] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 273.557387] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.573971] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.597336] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 4 [ 273.618837] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 273.633200] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 273.659088] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import [ 275.708586] Lustre: DEBUG MARKER: == sanity-lnet test 105: Adding duplicate GW peer should fail ========================================================== 10:28:34 (1729607314) [ 276.279795] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_105 Need at least 2 remote nodes found oleg122-server [ 276.875937] Lustre: DEBUG MARKER: == sanity-lnet test 106: Deleting GW peer should fail ==== 10:28:35 (1729607315) [ 277.500288] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_106 Need at least 2 remote nodes found oleg122-server [ 278.065617] Lustre: DEBUG MARKER: == sanity-lnet test 107: Deleting extra interface doesn't crash node ========================================================== 10:28:36 (1729607316) [ 279.412051] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 279.423439] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 279.424712] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 279.426063] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 279.530097] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 279.537521] alg: No test for adler32 (adler32-zlib) [ 280.332246] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 280.352568] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 280.363437] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 280.366259] LNet: Accept secure, port 988 [ 280.587450] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 280.599191] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 281.201872] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg [ 281.213989] LNet: Removed LNI 10.1.2.3@tcp [ 281.255387] LNet: 3201:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 281.271260] LNet: Removed LNI 192.168.201.22@tcp [ 284.449973] Lustre: DEBUG MARKER: == sanity-lnet test 108: Check Multi-Rail setup ========== 10:28:43 (1729607323) [ 285.634233] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 285.649713] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 285.653631] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 285.657120] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 285.755245] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 285.761116] alg: No test for adler32 (adler32-zlib) [ 286.543874] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 286.560520] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 286.568446] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 286.571481] LNet: Accept secure, port 988 [ 286.799130] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 286.811301] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 287.465603] LNet: 4688:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 287.468928] LNet: Removed LNI 192.168.201.22@tcp [ 287.484180] LNet: Removed LNI 10.1.2.3@tcp [ 290.656702] Lustre: DEBUG MARKER: == sanity-lnet test 109: Add NI using a network interface alias (LU-16859) ========================================================== 10:28:49 (1729607329) [ 291.911397] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 291.925324] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 291.926863] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 291.928315] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 292.014168] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 292.017581] alg: No test for adler32 (adler32-zlib) [ 292.809969] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 292.831806] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg:0 [ 292.842794] LNet: Added LNI 10.1.2.31@tcp [8/256/0/180] [ 292.844269] LNet: Accept secure, port 988 [ 293.374364] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 293.385320] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 293.986703] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg [ 293.996288] LNet: Removed LNI 10.1.2.3@tcp [ 294.002756] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg:0 [ 294.020303] LNet: Removed LNI 10.1.2.31@tcp [ 294.027700] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 294.039210] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 294.269758] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg:0 [ 294.280178] LNet: Added LNI 10.1.2.31@tcp [8/256/0/180] [ 294.571178] LNet: 6596:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 294.575181] LNet: Removed LNI 10.1.2.3@tcp [ 294.587116] LNet: Removed LNI 10.1.2.31@tcp [ 297.933372] Lustre: DEBUG MARKER: == sanity-lnet test 110: Configure NI using lnetctl net add --nid ========================================================== 10:28:56 (1729607336) [ 298.041069] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 298.046858] alg: No test for adler32 (adler32-zlib) [ 298.828867] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 298.843525] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 298.849095] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 298.850296] LNet: Accept secure, port 988 [ 299.075795] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 299.086206] LNet: 7595:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 299.100074] LNet: Removed LNI 192.168.201.22@tcp [ 299.108289] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 299.130783] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --nid 192.168.201.22@tcp [ 299.141487] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 299.144341] LNet: Accept secure, port 988 [ 299.387962] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --nid 192.168.201.22@tcp [ 299.410185] LNet: Removed LNI 192.168.201.22@tcp [ 302.716027] Lustre: DEBUG MARKER: == sanity-lnet test 111: Test many routes ================ 10:29:01 (1729607341) [ 303.228822] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_111 Unsupported on RHEL7 [ 303.806933] Lustre: DEBUG MARKER: == sanity-lnet test 112: multiple net configurations ===== 10:29:02 (1729607342) [ 304.987771] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 304.995826] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 304.997085] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 304.998497] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 305.068048] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 305.071285] alg: No test for adler32 (adler32-zlib) [ 305.862779] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 305.884250] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 305.885831] LNet: Accept secure, port 988 [ 306.118442] LNet: Added LNI 10.1.2.3@tcp2 [8/256/0/180] [ 306.718768] LNet: 9544:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 306.722993] LNet: Removed LNI 192.168.201.22@tcp1 [ 306.738235] LNet: Removed LNI 10.1.2.3@tcp2 [ 310.048781] Lustre: DEBUG MARKER: == sanity-lnet test 199: load lnet w/o module option, configure interface twice ========================================================== 10:29:08 (1729607348) [ 310.161807] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 310.169079] alg: No test for adler32 (adler32-zlib) [ 310.963257] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 310.978392] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 310.987001] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 310.989829] LNet: Accept secure, port 988 [ 311.229054] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --ip2net tcp 192.168.201.22 [ 311.239690] LNet: Removed LNI 192.168.201.22@tcp [ 313.327736] Lustre: DEBUG MARKER: == sanity-lnet test 200: load lnet w/o module option, configure in a non-default namespace ========================================================== 10:29:12 (1729607352) [ 313.356382] LNet: 11175:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 313.373212] LNet: Removed LNI 192.168.201.22@tcp [ 314.684090] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 314.744456] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 314.747353] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 314.750293] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 314.907325] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 314.913363] alg: No test for adler32 (adler32-zlib) [ 315.714230] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 315.716533] LNet: Accept secure, port 988 [ 317.771767] Lustre: DEBUG MARKER: == sanity-lnet test 201: load lnet using networks module options in a non-default namespace ========================================================== 10:29:16 (1729607356) [ 317.809311] LNet: 12095:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 317.829440] LNet: Removed LNI 10.1.2.3@tcp [ 319.142438] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 319.198289] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 319.201215] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 319.204185] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 319.372238] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 319.379384] alg: No test for adler32 (adler32-zlib) [ 320.193728] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 320.196619] LNet: Accept secure, port 988 [ 322.320931] Lustre: DEBUG MARKER: == sanity-lnet test 202: load lnet using ip2nets in a non-default namespace ========================================================== 10:29:21 (1729607361) [ 322.363671] LNet: 13013:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 322.379512] LNet: Removed LNI 10.1.2.3@tcp [ 323.556206] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 323.611270] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 323.612474] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 323.613675] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 323.761902] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 323.767110] alg: No test for adler32 (adler32-zlib) [ 324.560886] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 324.562294] LNet: Accept secure, port 988 [ 326.596575] Lustre: DEBUG MARKER: == sanity-lnet test 203: add a network using an interface in the non-default namespace ========================================================== 10:29:25 (1729607365) [ 326.633310] LNet: 13920:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 326.644356] LNet: Removed LNI 10.1.2.3@tcp [ 327.891156] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 327.943461] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 327.945694] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 327.947625] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 328.096432] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 328.099904] alg: No test for adler32 (adler32-zlib) [ 328.875479] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 328.895191] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 328.896967] LNet: Accept secure, port 988 [ 331.423142] Lustre: DEBUG MARKER: == sanity-lnet test 204: Check no health or resends for single-rail local failures ========================================================== 10:29:30 (1729607370) [ 331.568153] LNet: 15182:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 331.582218] LNet: Removed LNI 10.1.2.3@tcp [ 332.764001] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 332.767339] alg: No test for adler32 (adler32-zlib) [ 333.553402] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 333.565179] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 333.568150] LNet: Accept secure, port 988 [ 336.107704] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 336.235347] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 336.246562] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 336.324156] LNet: 15564:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 336.354504] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 336.370903] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 336.464985] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 336.586237] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 336.602578] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 336.696968] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 336.807293] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 336.824285] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 336.918200] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 336.931911] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 336.937620] LNet: Skipped 2 previous similar messages [ 337.019780] LNet: 15750:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 337.025047] LNet: 15750:0:(api-ni.c:337:recovery_interval_set()) Skipped 2 previous similar messages [ 337.057060] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 337.072698] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 337.168454] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 337.286538] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 337.301340] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 337.389794] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 337.500902] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 337.515446] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 337.607682] LNet: 15906:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 337.619264] LNet: Removed LNI 192.168.201.22@tcp [ 341.751385] Lustre: DEBUG MARKER: == sanity-lnet test 205: Check health and resends for multi-rail local failures ========================================================== 10:29:40 (1729607380) [ 343.164403] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 343.167816] alg: No test for adler32 (adler32-zlib) [ 343.950888] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 343.961612] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 343.963621] LNet: Accept secure, port 988 [ 346.535367] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 349.398340] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 349.415950] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 349.429246] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 349.801017] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 349.810465] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 349.815053] LNet: 1 local NIs in recovery (showing 1): 192.168.201.22@tcp [ 349.892189] LNet: 17373:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 349.921349] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 349.935998] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 350.050327] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 350.152912] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 350.166031] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 350.275018] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 350.390113] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 350.407223] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 350.532840] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 350.546021] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 350.553441] LNet: Skipped 8 previous similar messages [ 350.630692] LNet: 17577:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 350.635225] LNet: 17577:0:(api-ni.c:337:recovery_interval_set()) Skipped 2 previous similar messages [ 350.661436] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 350.676299] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 350.797032] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 350.876624] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 350.884409] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 350.959036] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 351.050247] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 351.066511] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 352.915072] LNet: 17780:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 353.918824] LNet: Removed LNI 192.168.201.22@tcp [ 354.924157] LNet: Removed LNI 192.168.201.22@tcp1 [ 359.044920] Lustre: DEBUG MARKER: == sanity-lnet test 206: Check no health or resends for single-rail remote failures ========================================================== 10:29:57 (1729607397) [ 360.441726] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 360.446456] alg: No test for adler32 (adler32-zlib) [ 361.236204] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 361.247809] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 361.249444] LNet: Accept secure, port 988 [ 363.216433] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 363.282912] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 363.287953] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 363.329775] LNet: 19039:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 363.344667] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 363.352826] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 363.401132] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 363.461249] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 363.469320] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 363.518620] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 363.575726] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 363.583631] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 363.634478] LNet: 19194:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 363.647938] LNet: Removed LNI 192.168.201.22@tcp [ 366.291624] Lustre: DEBUG MARKER: == sanity-lnet test 207: Check health and resends for multi-rail remote errors ========================================================== 10:30:05 (1729607405) [ 367.214685] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 367.218148] alg: No test for adler32 (adler32-zlib) [ 367.993987] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 368.000217] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 368.001538] LNet: Accept secure, port 988 [ 369.879848] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 371.121007] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 371.128732] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 371.134753] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 371.346858] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 371.352240] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 371.354246] LNet: 1 peer NIs in recovery (showing 1): 192.168.201.122@tcp [ 371.398725] LNet: 20654:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 371.413751] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 371.421467] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 371.432685] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 371.496799] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 371.557900] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 371.565504] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 371.576496] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 371.641741] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.122@tcp [ 371.702240] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 371.710160] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 371.721181] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 373.209321] LNet: 20862:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 374.210765] LNet: Removed LNI 192.168.201.22@tcp [ 374.215000] LNet: Removed LNI 192.168.201.22@tcp1 [ 376.939337] Lustre: DEBUG MARKER: == sanity-lnet test 208: Test various kernel ip2nets configurations ========================================================== 10:30:15 (1729607415) [ 377.731191] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 377.738362] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 377.739705] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 377.741064] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 377.817627] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 377.822960] alg: No test for adler32 (adler32-zlib) [ 378.606967] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 378.608439] LNet: Accept secure, port 988 [ 378.618390] LNet: 21963:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 378.630973] LNet: Removed LNI 192.168.201.22@tcp [ 379.522801] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 379.526492] alg: No test for adler32 (adler32-zlib) [ 380.305307] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 380.306514] LNet: Added LNI 10.1.2.3@tcp1 [8/256/0/180] [ 380.307671] LNet: Accept secure, port 988 [ 380.316060] LNet: 22219:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 380.318064] LNet: Removed LNI 192.168.201.22@tcp [ 380.326909] LNet: Removed LNI 10.1.2.3@tcp1 [ 381.194739] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 381.198386] alg: No test for adler32 (adler32-zlib) [ 381.977005] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 381.978187] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 381.979342] LNet: Accept secure, port 988 [ 381.987619] LNet: 22476:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 381.989604] LNet: Removed LNI 192.168.201.22@tcp [ 381.998048] LNet: Removed LNI 10.1.2.3@tcp [ 382.871488] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 382.875094] alg: No test for adler32 (adler32-zlib) [ 383.654345] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 383.655555] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 383.656717] LNet: Accept secure, port 988 [ 383.665090] LNet: 22733:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 383.667146] LNet: Removed LNI 192.168.201.22@tcp [ 383.679957] LNet: Removed LNI 10.1.2.3@tcp [ 384.562296] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 384.565900] alg: No test for adler32 (adler32-zlib) [ 385.345957] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 385.347152] LNetError: 22978:0:(config.c:1558:lnet_inet_select()) ksocklnd: failed to find interface test1pg [ 385.348914] LNetError: Error -100 starting up LNI tcp [ 385.356945] LNet: Removed LNI 192.168.201.22@tcp [ 387.496687] Lustre: DEBUG MARKER: == sanity-lnet test 209: Check health, but not resends, for network timeout ========================================================== 10:30:26 (1729607426) [ 388.399103] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 388.404336] alg: No test for adler32 (adler32-zlib) [ 389.182214] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 389.188988] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 389.190244] LNet: Accept secure, port 988 [ 391.066962] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 391.134722] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 391.139667] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 391.181982] LNet: 24232:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 391.197124] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 391.205270] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 391.251985] LNet: 24262:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 391.263878] LNet: Removed LNI 192.168.201.22@tcp [ 393.464333] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 393.468432] alg: No test for adler32 (adler32-zlib) [ 394.245619] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 394.251772] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 394.253025] LNet: Accept secure, port 988 [ 396.412273] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 397.632819] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 397.640553] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 397.645424] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 397.844075] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 397.851846] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 397.895592] LNet: 25072:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 397.909926] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all [ 397.917710] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all [ 399.377731] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 399.421542] LNet: 25137:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 399.423482] LNet: Removed LNI 192.168.201.22@tcp [ 399.432000] LNet: Removed LNI 192.168.201.22@tcp1 [ 402.843321] Lustre: DEBUG MARKER: == sanity-lnet test 210: Local NI recovery checks ======== 10:30:41 (1729607441) [ 402.959487] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 402.966490] alg: No test for adler32 (adler32-zlib) [ 403.743181] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 403.754552] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 403.759860] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 403.761010] LNet: Accept secure, port 988 [ 403.876001] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 403.880799] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 404.064566] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.22@tcp [ 404.090781] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 10 [ 404.131989] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 0 --nid 192.168.201.22@tcp [ 404.142397] LNetError: 26281:0:(api-ni.c:4065:lnet_ni_set_healthv()) manually adding local NI 192.168.201.22@tcp to recovery [ 404.747855] LNet: 1 local NIs in recovery (showing 1): 192.168.201.22@tcp [ 404.747927] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 406.751341] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 407.280437] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 410.751013] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 411.437859] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 411.451550] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 411.456006] LNet: 26402:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 411.457560] LNet: Removed LNI 192.168.201.22@tcp [ 411.466103] LNet: Removed LNI 192.168.201.22@tcp1 [ 411.471010] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 411.482423] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 411.487372] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 411.488611] LNet: Accept secure, port 988 [ 411.606092] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 411.610851] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 411.761939] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.22@tcp [ 411.776423] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 [ 411.795444] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 4 [ 411.833100] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 0 --nid 192.168.201.22@tcp [ 411.844227] LNetError: 26666:0:(api-ni.c:4065:lnet_ni_set_healthv()) manually adding local NI 192.168.201.22@tcp to recovery [ 414.476558] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 414.480590] LNet: Skipped 1 previous similar message [ 414.978795] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 418.476791] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 423.283084] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 423.305025] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 900 [ 425.451461] Lustre: DEBUG MARKER: == sanity-lnet test 211: Remote NI recovery checks ======= 10:31:04 (1729607464) [ 425.494971] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 425.506068] LNet: 27464:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 426.509872] LNet: Removed LNI 192.168.201.22@tcp [ 426.514971] LNet: Removed LNI 192.168.201.22@tcp1 [ 426.522822] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 426.548869] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 426.559610] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 426.562433] LNet: Accept secure, port 988 [ 426.772501] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 426.780269] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 427.042720] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.22@tcp [ 427.065255] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 10 [ 427.098051] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.201.22@tcp --health 0 [ 427.133549] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 427.537005] LNet: 1 peer NIs in recovery (showing 1): 192.168.201.22@tcp [ 427.537118] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 427.537120] LNet: Skipped 1 previous similar message [ 441.558001] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 441.610907] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 [ 441.624889] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.201.22@tcp --health 500 [ 441.663229] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 447.864588] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 447.886755] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 447.896921] LNet: 27962:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 448.900853] LNet: Removed LNI 192.168.201.22@tcp [ 448.906096] LNet: Removed LNI 192.168.201.22@tcp1 [ 448.915511] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 448.939624] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 448.951020] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 448.953955] LNet: Accept secure, port 988 [ 449.188202] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 449.198386] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 449.465202] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.22@tcp [ 449.482624] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 [ 449.504673] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 4 [ 449.540827] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.201.22@tcp --health 0 [ 450.927155] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 450.932936] LNet: Skipped 3 previous similar messages [ 451.672338] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 460.992663] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 461.005382] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 900 [ 463.145388] Lustre: DEBUG MARKER: == sanity-lnet test 212: Check discovery refcount loss bug (LU-14627) ========================================================== 10:31:41 (1729607501) [ 463.259884] LNet: 29084:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 464.261904] LNet: Removed LNI 192.168.201.22@tcp [ 464.267126] LNet: Removed LNI 192.168.201.22@tcp1 [ 465.633023] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 465.636671] alg: No test for adler32 (adler32-zlib) [ 466.418387] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 466.426190] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 466.427758] LNet: Accept secure, port 988 [ 469.312865] Lustre: DEBUG MARKER: Initial discovery [ 469.323986] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.201.122@tcp [ 469.978992] Lustre: DEBUG MARKER: Fail local discover ping to set LNET_PEER_REDISCOVER flag [ 469.993205] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.201.122@tcp [ 469.998514] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 470.437375] Lustre: DEBUG MARKER: Force oleg122-client.virtnet to discover 192.168.201.122@tcp (in background) [ 470.448849] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.201.122@tcp [ 470.853517] Lustre: DEBUG MARKER: Force oleg122-server to discover 192.168.201.22@tcp [ 471.680392] Lustre: DEBUG MARKER: Wait for 29863 [ 473.463936] LNet: There was an unexpected network error while writing to 192.168.201.122: rc = -22 [ 473.860846] Lustre: DEBUG MARKER: Finished wait on 29863 [ 473.922437] LNet: 30371:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 474.926995] LNet: Removed LNI 192.168.201.22@tcp [ 478.426310] Lustre: DEBUG MARKER: == sanity-lnet test 213: Check LNetDist calculation for multiple local NIDs ========================================================== 10:31:57 (1729607517) [ 479.411957] IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready [ 479.422090] IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready [ 479.423669] IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready [ 479.425048] IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready [ 479.502819] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 479.507034] alg: No test for adler32 (adler32-zlib) [ 480.306871] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 480.327663] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 480.337071] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 480.338931] LNet: Accept secure, port 988 [ 480.579219] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 480.591997] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 483.499912] Lustre: DEBUG MARKER: == sanity-lnet test 214: Check local NI status when link is downed ========================================================== 10:32:02 (1729607522) [ 483.538599] LNet: 32510:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 483.542704] LNet: Removed LNI 192.168.201.22@tcp [ 483.558234] LNet: Removed LNI 10.1.2.3@tcp [ 484.992248] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 484.995815] alg: No test for adler32 (adler32-zlib) [ 485.786096] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 485.803079] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 485.808078] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 485.809238] LNet: Accept secure, port 988 [ 485.978136] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg [ 485.986302] LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] [ 486.261990] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 10.1.2.3@tcp 192.168.201.22@tcp [ 487.274755] LNetError: Unexpected error -22 connecting to 192.168.201.22@tcp at host 192.168.201.22:988 [ 488.362382] Lustre: DEBUG MARKER: == sanity-lnet test 215: Test lnetctl ping --source option ========================================================== 10:32:07 (1729607527) [ 488.387606] LNet: 1250:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 489.391850] LNet: Removed LNI 192.168.201.22@tcp [ 489.398296] LNet: Removed LNI 10.1.2.3@tcp [ 490.843531] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 490.847535] alg: No test for adler32 (adler32-zlib) [ 491.641171] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 491.660057] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 491.669052] LNet: 1516:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 491.676225] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 491.679176] LNet: Accept secure, port 988 [ 491.915080] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp2 --if eth0 [ 491.925989] LNet: Added LNI 192.168.201.22@tcp2 [8/256/0/180] [ 492.186527] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim 192.168.201.22@tcp1 --nid 192.168.201.22@tcp2 [ 493.649808] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.201.22@tcp1 192.168.201.22@tcp2 [ 493.660973] LNetError: 2079:0:(lib-move.c:2228:lnet_handle_find_routed_path()) Unable to send message from 192.168.201.22@tcp1 to 192.168.201.22@tcp2 - Route table may be misconfigured [ 493.676872] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.201.22@tcp2 192.168.201.22@tcp1 [ 495.884028] Lustre: DEBUG MARKER: == sanity-lnet test 216: Failed send to peer NI owned by local host should not trigger peer NI recovery ========================================================== 10:32:14 (1729607534) [ 495.922835] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 495.932905] LNet: 2717:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 496.937799] LNet: Removed LNI 192.168.201.22@tcp1 [ 497.944353] LNet: Removed LNI 192.168.201.22@tcp2 [ 497.955038] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 497.980299] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 497.991272] LNet: 2729:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 497.997761] LNet: 2729:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 1 previous similar message [ 498.005543] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 498.008448] LNet: Accept secure, port 988 [ 498.256198] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 498.266983] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 498.548245] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.22@tcp [ 498.566554] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.201.22@tcp 192.168.201.22@tcp [ 498.584747] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.201.22@tcp1 192.168.201.22@tcp1 [ 498.626281] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 498.636148] LNet: There was an unexpected network error while writing to 192.168.201.22: rc = -22 [ 498.676566] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p [ 498.715412] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l [ 498.967850] LNet: 1 local NIs in recovery (showing 1): 192.168.201.22@tcp [ 500.898723] Lustre: DEBUG MARKER: == sanity-lnet test 217: Don't leak memory when discovering peer with nnis <= 1 ========================================================== 10:32:19 (1729607539) [ 500.934564] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 500.944724] LNet: 3634:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 500.949459] LNet: Removed LNI 192.168.201.22@tcp [ 500.962330] LNet: Removed LNI 192.168.201.22@tcp1 [ 500.971433] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 501.004926] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 0@lo [ 504.474282] Lustre: DEBUG MARKER: == sanity-lnet test 218: Local recovery pings should exercise all available paths ========================================================== 10:32:23 (1729607543) [ 504.589808] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 504.596902] alg: No test for adler32 (adler32-zlib) [ 505.392935] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 505.898783] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_218 Need two LNet interfaces [ 506.492392] Lustre: DEBUG MARKER: == sanity-lnet test 219: Consolidate peer entries ======== 10:32:25 (1729607545) [ 506.528993] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 506.538699] LNet: 4852:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 506.548822] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 506.572698] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 506.584052] LNet: 4860:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 506.588838] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 506.591805] LNet: Accept secure, port 988 [ 506.839970] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 506.850034] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 507.139448] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 507.157046] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp1 [ 507.174368] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.22@tcp1 [ 509.349873] Lustre: DEBUG MARKER: == sanity-lnet test 220: Add routes w/default options - check aliveness ========================================================== 10:32:28 (1729607548) [ 510.003186] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_220 Need at least 2 remote nodes found oleg122-server [ 510.614764] Lustre: DEBUG MARKER: == sanity-lnet test 221: Add routes w/DD disabled - check aliveness ========================================================== 10:32:29 (1729607549) [ 511.237628] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_221 Need at least 2 remote nodes found oleg122-server [ 511.852304] Lustre: DEBUG MARKER: == sanity-lnet test 222: Check avoid_asym_router_failure=1 ========================================================== 10:32:30 (1729607550) [ 512.389347] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_222 Need at least 2 remote nodes found oleg122-server [ 512.869850] Lustre: DEBUG MARKER: == sanity-lnet test 223: Check avoid_asym_router_failure=1 w/DD disabled ========================================================== 10:32:31 (1729607551) [ 513.408479] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_223 Need at least 2 remote nodes found oleg122-server [ 514.014600] Lustre: DEBUG MARKER: == sanity-lnet test 224: Check avoid_asym_router_failure=0 ========================================================== 10:32:32 (1729607552) [ 514.648505] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_224 Need at least 2 remote nodes found oleg122-server [ 515.197353] Lustre: DEBUG MARKER: == sanity-lnet test 225: Check avoid_asym_router_failure=0 w/DD disabled ========================================================== 10:32:34 (1729607554) [ 515.696447] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_225 Need at least 2 remote nodes found oleg122-server [ 516.125720] Lustre: DEBUG MARKER: == sanity-lnet test 226: test missing route for 1 of 2 routers ========================================================== 10:32:35 (1729607555) [ 516.591863] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_226 Need at least 3 remote nodes found oleg122-server [ 516.994013] Lustre: DEBUG MARKER: == sanity-lnet test 227: Check router peer health w/DD disabled ========================================================== 10:32:35 (1729607555) [ 517.508594] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_227 Need at least 3 remote nodes found oleg122-server [ 518.111378] Lustre: DEBUG MARKER: == sanity-lnet test 230: Test setting conns-per-peer ===== 10:32:36 (1729607556) [ 518.150840] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 518.162098] LNet: 8706:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 519.166798] LNet: Removed LNI 192.168.201.22@tcp [ 520.175290] LNet: Removed LNI 192.168.201.22@tcp1 [ 520.185236] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 520.210533] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 520.222121] LNet: 8718:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 520.226657] LNet: 8718:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 1 previous similar message [ 520.231134] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 520.234339] LNet: Accept secure, port 988 [ 520.483578] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 4 [ 520.515207] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 520.584396] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 520.591873] LNet: 8855:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 521.597031] LNet: Removed LNI 192.168.201.22@tcp [ 521.602171] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 521.623301] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 521.636248] LNet: 8863:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 521.642978] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 521.646032] LNet: Accept secure, port 988 [ 521.843137] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 5 [ 521.875216] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 521.950184] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 522.964221] LNet: Removed LNI 192.168.201.22@tcp [ 522.975038] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 523.002319] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 523.014452] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 523.017381] LNet: Accept secure, port 988 [ 523.269485] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 6 [ 523.290795] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 523.344999] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 523.354927] LNet: 9146:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 523.358989] LNet: 9146:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 1 previous similar message [ 524.366164] LNet: Removed LNI 192.168.201.22@tcp [ 524.375984] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 524.402216] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 524.413032] LNet: 9154:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 524.417387] LNet: 9154:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 1 previous similar message [ 524.421790] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 524.424690] LNet: Accept secure, port 988 [ 524.585244] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 7 [ 524.616072] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 524.680590] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 525.689925] LNet: Removed LNI 192.168.201.22@tcp [ 525.695577] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 525.709178] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 525.719558] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 525.722130] LNet: Accept secure, port 988 [ 525.881580] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 8 [ 525.895930] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 525.965027] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 526.975161] LNet: Removed LNI 192.168.201.22@tcp [ 526.986398] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 527.009760] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 527.022126] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 527.024540] LNet: Accept secure, port 988 [ 527.166635] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 9 [ 527.182122] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 527.229244] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 528.239971] LNet: Removed LNI 192.168.201.22@tcp [ 528.245856] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 528.257889] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 528.263024] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 528.264304] LNet: Accept secure, port 988 [ 528.419553] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 10 [ 528.433911] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 528.478900] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 528.484870] LNet: 9726:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 528.486423] LNet: 9726:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 3 previous similar messages [ 529.490992] LNet: Removed LNI 192.168.201.22@tcp [ 529.500363] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 529.524162] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 529.535447] LNet: 9734:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 529.539848] LNet: 9734:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 3 previous similar messages [ 529.544416] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 529.547303] LNet: Accept secure, port 988 [ 529.785716] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 11 [ 529.816116] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 529.915769] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 530.931162] LNet: Removed LNI 192.168.201.22@tcp [ 530.942130] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 530.968746] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 530.982272] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 530.985567] LNet: Accept secure, port 988 [ 531.214109] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 12 [ 531.242296] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 531.312312] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 532.321173] LNet: Removed LNI 192.168.201.22@tcp [ 532.331878] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 532.357596] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 532.371054] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 532.375170] LNet: Accept secure, port 988 [ 532.608406] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 13 [ 532.639072] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 532.747026] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 533.762203] LNet: Removed LNI 192.168.201.22@tcp [ 533.772580] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 533.798052] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 533.811369] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 533.815604] LNet: Accept secure, port 988 [ 534.049559] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 14 [ 534.079517] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 534.190928] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 535.206155] LNet: Removed LNI 192.168.201.22@tcp [ 535.216622] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 535.242127] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 535.255224] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 535.258077] LNet: Accept secure, port 988 [ 535.490081] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 15 [ 535.522771] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.201.22@tcp [ 535.638297] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 536.653128] LNet: Removed LNI 192.168.201.22@tcp [ 536.663243] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 536.688315] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 536.702176] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 536.705249] LNet: Accept secure, port 988 [ 536.940686] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 128 [ 536.963222] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 536.973086] LNet: 10584:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 536.977010] LNet: 10584:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Skipped 5 previous similar messages [ 536.988269] LNet: Removed LNI 192.168.201.22@tcp [ 536.996230] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 537.021363] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 537.032184] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 537.035092] LNet: Accept secure, port 988 [ 537.274930] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer -1 [ 539.425094] Lustre: DEBUG MARKER: == sanity-lnet test 231: Check DLC handling of peer_timeout parameter ========================================================== 10:32:58 (1729607578) [ 539.454060] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 539.480344] LNet: Removed LNI 192.168.201.22@tcp [ 539.488806] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 539.513885] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 [ 539.525892] LNet: 11358:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 539.531732] LNet: 11358:0:(lib-socket.c:558:lnet_inet_enumerate()) Skipped 6 previous similar messages [ 539.536813] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/180] [ 539.539054] LNet: Accept secure, port 988 [ 539.918934] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 539.934191] LNet: Removed LNI 192.168.201.22@tcp231 [ 539.941478] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 539.967538] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 539.976865] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/180] [ 539.980442] LNet: Accept secure, port 988 [ 539.983131] LNet: 11494:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 540.110398] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 540.127152] LNet: Removed LNI 192.168.201.22@tcp231 [ 540.131396] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=-1 [ 540.139038] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/180] [ 540.497223] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 540.517236] LNet: Removed LNI 192.168.201.22@tcp231 [ 540.524995] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 540.551450] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 540.562732] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/0] [ 540.566543] LNet: Accept secure, port 988 [ 540.569728] LNet: 11644:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 540.706752] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 540.725144] LNet: Removed LNI 192.168.201.22@tcp231 [ 540.729603] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=0 [ 540.737511] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/0] [ 541.100212] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 541.123180] LNet: Removed LNI 192.168.201.22@tcp231 [ 541.133103] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 541.160598] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 541.174964] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/60] [ 541.179136] LNet: Accept secure, port 988 [ 541.310553] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 541.327106] LNet: Removed LNI 192.168.201.22@tcp231 [ 541.331384] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=60 [ 541.339320] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/60] [ 541.696671] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 541.719295] LNet: Removed LNI 192.168.201.22@tcp231 [ 541.726752] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 541.752627] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml [ 541.762844] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/180] [ 541.765270] LNet: Accept secure, port 988 [ 541.767238] LNet: 11942:0:(api-ni.c:337:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated [ 541.773219] LNet: 11942:0:(api-ni.c:337:recovery_interval_set()) Skipped 1 previous similar message [ 541.919061] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if eth0 [ 541.936123] LNet: Removed LNI 192.168.201.22@tcp231 [ 541.941595] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if eth0 --peer-timeout=180 [ 541.951703] LNet: Added LNI 192.168.201.22@tcp231 [8/256/0/180] [ 544.409405] Lustre: DEBUG MARKER: == sanity-lnet test 232: Test setting ToS value ========== 10:33:03 (1729607583) [ 544.441095] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 544.460354] LNet: Removed LNI 192.168.201.22@tcp231 [ 544.468886] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 544.499182] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 [ 544.513011] LNet: Added LNI 192.168.201.22@tcp232 [8/256/0/180] [ 544.516011] LNet: Accept secure, port 988 [ 544.751937] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 544.770908] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 544.794226] LNet: Removed LNI 192.168.201.22@tcp232 [ 544.802616] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos -1 [ 544.816736] LNet: Added LNI 192.168.201.22@tcp232 [8/256/0/180] [ 545.050569] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 545.067319] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 545.091244] LNet: Removed LNI 192.168.201.22@tcp232 [ 545.098412] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos 104 [ 545.109946] LNet: Added LNI 192.168.201.22@tcp232 [8/256/0/180] [ 545.341440] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 545.357893] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 545.378182] LNet: Removed LNI 192.168.201.22@tcp232 [ 545.386447] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos 106 [ 545.400069] LNet: Added LNI 192.168.201.22@tcp232 [8/256/0/180] [ 545.631205] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 [ 545.647729] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if eth0 [ 545.671289] LNet: Removed LNI 192.168.201.22@tcp232 [ 545.679551] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if eth0 --tos 300 [ 547.787356] Lustre: DEBUG MARKER: == sanity-lnet test 250: test that linux routes are added ========================================================== 10:33:06 (1729607586) [ 547.821845] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure [ 547.840443] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 547.867810] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if eth0 [ 547.878836] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 547.881118] LNet: Accept secure, port 988 [ 550.212701] Lustre: DEBUG MARKER: == sanity-lnet test 251: Define multiple kfi networks on single interface ========================================================== 10:33:09 (1729607589) [ 550.708611] Lustre: DEBUG MARKER: SKIP: sanity-lnet test_251 Need kfi NETTYPE [ 551.277397] Lustre: DEBUG MARKER: == sanity-lnet test 252: Ping to down peer should unlink quickly ========================================================== 10:33:10 (1729607590) [ 551.435246] LNet: Removed LNI 192.168.201.22@tcp [ 552.820773] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 552.824753] alg: No test for adler32 (adler32-zlib) [ 553.605722] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 553.612950] LNet: 15232:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 553.614906] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 553.616043] LNet: Accept secure, port 988 [ 556.149592] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 558.198581] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --timeout 15 192.168.201.122@tcp [ 558.262993] LNet: 15388:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 558.273952] LNet: Removed LNI 192.168.201.22@tcp [ 561.487359] Lustre: DEBUG MARKER: == sanity-lnet test 253: Message delayed beyond deadline should be dropped (single-rail) ========================================================== 10:33:20 (1729607600) [ 562.774461] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 562.777832] alg: No test for adler32 (adler32-zlib) [ 563.566908] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 563.578987] LNet: 16476:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 563.583614] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 563.586014] LNet: Accept secure, port 988 [ 566.135514] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 566.201776] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set transaction_timeout 10 [ 577.736594] Lustre: DEBUG MARKER: sanity-lnet test_253: @@@@@@ FAIL: Expect 1 dropped GET but found 0 [ 579.464725] Lustre: DEBUG MARKER: == sanity-lnet test 254: Message delayed beyond deadline should be dropped (multi-rail) ========================================================== 10:33:38 (1729607618) [ 579.615034] LNet: 17301:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 580.625242] LNet: Removed LNI 192.168.201.22@tcp [ 582.028880] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 582.032265] alg: No test for adler32 (adler32-zlib) [ 582.826876] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a [ 582.840123] LNet: 17548:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 582.845092] LNet: Added LNI 192.168.201.22@tcp [8/256/0/180] [ 582.847052] LNet: Accept secure, port 988 [ 585.388675] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.201.122@tcp [ 587.495538] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure [ 587.510928] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if eth0 [ 587.521909] LNet: 17717:0:(lib-socket.c:558:lnet_inet_enumerate()) lnet: Ignoring interface test1pg: it's down [ 587.526913] LNet: Added LNI 192.168.201.22@tcp1 [8/256/0/180] [ 587.828884] Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set transaction_timeout 10 [ 599.433970] Lustre: DEBUG MARKER: sanity-lnet test_254: @@@@@@ FAIL: Expect 1 dropped GET but found 0