Oct 10 15:42:25 oleg256-client kernel: Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 Oct 10 15:42:25 oleg256-client kernel: Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Oct 10 15:42:25 oleg256-client kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Oct 10 15:42:25 oleg256-client kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Oct 10 15:42:25 oleg256-client kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Oct 10 15:42:25 oleg256-client kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Oct 10 15:42:25 oleg256-client kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Oct 10 15:42:25 oleg256-client kernel: signal: max sigframe size: 1776 Oct 10 15:42:25 oleg256-client kernel: BIOS-provided physical RAM map: Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Oct 10 15:42:25 oleg256-client kernel: BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable Oct 10 15:42:25 oleg256-client kernel: NX (Execute Disable) protection: active Oct 10 15:42:25 oleg256-client kernel: SMBIOS 2.8 present. Oct 10 15:42:25 oleg256-client kernel: DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 Oct 10 15:42:25 oleg256-client kernel: Hypervisor detected: KVM Oct 10 15:42:25 oleg256-client kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Oct 10 15:42:25 oleg256-client kernel: kvm-clock: using sched offset of 542869532 cycles Oct 10 15:42:25 oleg256-client kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Oct 10 15:42:25 oleg256-client kernel: tsc: Detected 2399.998 MHz processor Oct 10 15:42:25 oleg256-client kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Oct 10 15:42:25 oleg256-client kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Oct 10 15:42:25 oleg256-client kernel: last_pfn = 0x146e00 max_arch_pfn = 0x400000000 Oct 10 15:42:25 oleg256-client kernel: MTRR default type: write-back Oct 10 15:42:25 oleg256-client kernel: MTRR fixed ranges enabled: Oct 10 15:42:25 oleg256-client kernel: 00000-9FFFF write-back Oct 10 15:42:25 oleg256-client kernel: A0000-BFFFF uncachable Oct 10 15:42:25 oleg256-client kernel: C0000-FFFFF write-protect Oct 10 15:42:25 oleg256-client kernel: MTRR variable ranges enabled: Oct 10 15:42:25 oleg256-client kernel: 0 base 0000C0000000 mask 3FFFC0000000 uncachable Oct 10 15:42:25 oleg256-client kernel: 1 disabled Oct 10 15:42:25 oleg256-client kernel: 2 disabled Oct 10 15:42:25 oleg256-client kernel: 3 disabled Oct 10 15:42:25 oleg256-client kernel: 4 disabled Oct 10 15:42:25 oleg256-client kernel: 5 disabled Oct 10 15:42:25 oleg256-client kernel: 6 disabled Oct 10 15:42:25 oleg256-client kernel: 7 disabled Oct 10 15:42:25 oleg256-client kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Oct 10 15:42:25 oleg256-client kernel: last_pfn = 0xbffda max_arch_pfn = 0x400000000 Oct 10 15:42:25 oleg256-client kernel: found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] Oct 10 15:42:25 oleg256-client kernel: BRK [0x53201000, 0x53201fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53202000, 0x53202fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53203000, 0x53203fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53204000, 0x53204fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53205000, 0x53205fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53206000, 0x53206fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53207000, 0x53207fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53208000, 0x53208fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x53209000, 0x53209fff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x5320a000, 0x5320afff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x5320b000, 0x5320bfff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: BRK [0x5320c000, 0x5320cfff] PGTABLE Oct 10 15:42:25 oleg256-client kernel: RAMDISK: [mem 0xbcc64000-0xbffcffff] Oct 10 15:42:25 oleg256-client kernel: ACPI: Early table checksum verification disabled Oct 10 15:42:25 oleg256-client kernel: ACPI: RSDP 0x00000000000F5970 000014 (v00 BOCHS ) Oct 10 15:42:25 oleg256-client kernel: ACPI: RSDT 0x00000000BFFE1BB7 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) Oct 10 15:42:25 oleg256-client kernel: ACPI: FACP 0x00000000BFFE1A53 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) Oct 10 15:42:25 oleg256-client kernel: ACPI: DSDT 0x00000000BFFE0040 001A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) Oct 10 15:42:25 oleg256-client kernel: ACPI: FACS 0x00000000BFFE0000 000040 Oct 10 15:42:25 oleg256-client kernel: ACPI: APIC 0x00000000BFFE1AC7 000090 (v01 BOCHS BXPC 00000001 BXPC 00000001) Oct 10 15:42:25 oleg256-client kernel: ACPI: HPET 0x00000000BFFE1B57 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) Oct 10 15:42:25 oleg256-client kernel: ACPI: WAET 0x00000000BFFE1B8F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) Oct 10 15:42:25 oleg256-client kernel: ACPI: Reserving FACP table memory at [mem 0xbffe1a53-0xbffe1ac6] Oct 10 15:42:25 oleg256-client kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a52] Oct 10 15:42:25 oleg256-client kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] Oct 10 15:42:25 oleg256-client kernel: ACPI: Reserving APIC table memory at [mem 0xbffe1ac7-0xbffe1b56] Oct 10 15:42:25 oleg256-client kernel: ACPI: Reserving HPET table memory at [mem 0xbffe1b57-0xbffe1b8e] Oct 10 15:42:25 oleg256-client kernel: ACPI: Reserving WAET table memory at [mem 0xbffe1b8f-0xbffe1bb6] Oct 10 15:42:25 oleg256-client kernel: ACPI: Local APIC address 0xfee00000 Oct 10 15:42:25 oleg256-client kernel: No NUMA configuration found Oct 10 15:42:59 oleg256-client kdumpctl[1185]: basename: missing operand Oct 10 15:42:59 oleg256-client kdumpctl[1185]: Try 'basename --help' for more information. Oct 10 15:43:00 oleg256-client dbus-daemon[1024]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.7' (uid=0 pid=1042 comm="/usr/libexec/platform-python -Es /usr/sbin/tuned -") Oct 10 15:43:00 oleg256-client systemd[1]: Starting Authorization Manager... Oct 10 15:43:01 oleg256-client polkitd[1365]: Started polkitd version 0.115 Oct 10 15:43:01 oleg256-client systemd[1]: Started Dynamic System Tuning Daemon. Oct 10 15:43:01 oleg256-client systemd[1]: Reached target Multi-User System. Oct 10 15:43:01 oleg256-client systemd[1]: Reached target Graphical Interface. Oct 10 15:43:01 oleg256-client systemd[1]: Starting Update UTMP about System Runlevel Changes... Oct 10 15:43:01 oleg256-client systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Oct 10 15:43:01 oleg256-client systemd[1]: Started Update UTMP about System Runlevel Changes. Oct 10 15:43:01 oleg256-client polkitd[1365]: Loading rules from directory /etc/polkit-1/rules.d Oct 10 15:43:01 oleg256-client polkitd[1365]: Loading rules from directory /usr/share/polkit-1/rules.d Oct 10 15:43:01 oleg256-client polkitd[1365]: Finished loading, compiling and executing 2 rules Oct 10 15:43:01 oleg256-client dbus-daemon[1024]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Oct 10 15:43:01 oleg256-client systemd[1]: Started Authorization Manager. Oct 10 15:43:01 oleg256-client polkitd[1365]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Oct 10 15:43:08 oleg256-client systemd[1]: NetworkManager-dispatcher.service: Succeeded. Oct 10 15:43:13 oleg256-client kdumpctl[1090]: kdump: kexec: loaded kdump kernel Oct 10 15:43:13 oleg256-client kdumpctl[1090]: kdump: Starting kdump: [OK] Oct 10 15:43:13 oleg256-client systemd[1]: Started Crash recovery kernel arming. Oct 10 15:43:13 oleg256-client systemd[1]: Startup finished in 4.006s (kernel) + 15.255s (initrd) + 33.613s (userspace) = 52.875s. Oct 10 15:43:16 oleg256-client sshd[1468]: Accepted publickey for root from 192.168.200.253 port 39746 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Oct 10 15:43:16 oleg256-client systemd[1]: Created slice User Slice of UID 0. Oct 10 15:43:16 oleg256-client systemd[1]: Starting User runtime directory /run/user/0... Oct 10 15:43:16 oleg256-client systemd-logind[1023]: New session 1 of user root. Oct 10 15:43:16 oleg256-client systemd[1]: Started User runtime directory /run/user/0. Oct 10 15:43:16 oleg256-client systemd[1]: Starting User Manager for UID 0... Oct 10 15:43:16 oleg256-client systemd[1483]: pam_unix(systemd-user:session): session opened for user root by (uid=0) Oct 10 15:43:16 oleg256-client systemd[1483]: Reached target Paths. Oct 10 15:43:16 oleg256-client systemd[1483]: Reached target Timers. Oct 10 15:43:16 oleg256-client systemd[1483]: Starting D-Bus User Message Bus Socket. Oct 10 15:43:17 oleg256-client systemd[1483]: Listening on D-Bus User Message Bus Socket. Oct 10 15:43:17 oleg256-client systemd[1483]: Reached target Sockets. Oct 10 15:43:17 oleg256-client systemd[1483]: Reached target Basic System. Oct 10 15:43:17 oleg256-client systemd[1483]: Reached target Default. Oct 10 15:43:17 oleg256-client systemd[1483]: Startup finished in 381ms. Oct 10 15:43:17 oleg256-client systemd[1]: Started User Manager for UID 0. Oct 10 15:43:17 oleg256-client systemd[1]: Started Session 1 of user root. Oct 10 15:43:17 oleg256-client sshd[1468]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:43:17 oleg256-client sshd[1494]: Received disconnect from 192.168.200.253 port 39746:11: disconnected by user Oct 10 15:43:17 oleg256-client sshd[1494]: Disconnected from user root 192.168.200.253 port 39746 Oct 10 15:43:17 oleg256-client sshd[1468]: pam_unix(sshd:session): session closed for user root Oct 10 15:43:18 oleg256-client systemd[1]: session-1.scope: Succeeded. Oct 10 15:43:18 oleg256-client systemd-logind[1023]: Session 1 logged out. Waiting for processes to exit. Oct 10 15:43:18 oleg256-client systemd-logind[1023]: Removed session 1. Oct 10 15:43:18 oleg256-client sshd[1528]: Accepted publickey for root from 192.168.200.253 port 39758 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Oct 10 15:43:18 oleg256-client systemd-logind[1023]: New session 3 of user root. Oct 10 15:43:18 oleg256-client systemd[1]: Started Session 3 of user root. Oct 10 15:43:18 oleg256-client sshd[1528]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:43:25 oleg256-client systemd[1]: systemd-hostnamed.service: Succeeded. Oct 10 15:43:45 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:43:45 oleg256-client systemd-udevd[2270]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:43:45 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:43:45 oleg256-client kernel: libcfs: loading out-of-tree module taints kernel. Oct 10 15:43:46 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:43:46 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:43:46 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:43:46 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:43:47 oleg256-client kernel: Lustre: Lustre: Build Version: 2.16.58_106_g01a4b29 Oct 10 15:43:48 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:43:49 oleg256-client kernel: Key type lgssc registered Oct 10 15:43:50 oleg256-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ Oct 10 15:44:29 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:44:29 oleg256-client systemd-udevd[4213]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:44:29 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:45:20 oleg256-client kernel: Lustre: Mounted lustre-client Oct 10 15:45:22 oleg256-client sshd[5627]: Accepted publickey for root from 192.168.202.56 port 55298 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:22 oleg256-client systemd-logind[1023]: New session 4 of user root. Oct 10 15:45:22 oleg256-client systemd[1]: Started Session 4 of user root. Oct 10 15:45:22 oleg256-client sshd[5627]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:22 oleg256-client sshd[5640]: Received disconnect from 192.168.202.56 port 55298:11: disconnected by user Oct 10 15:45:22 oleg256-client sshd[5640]: Disconnected from user root 192.168.202.56 port 55298 Oct 10 15:45:22 oleg256-client sshd[5627]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:22 oleg256-client systemd[1]: session-4.scope: Succeeded. Oct 10 15:45:22 oleg256-client systemd-logind[1023]: Session 4 logged out. Waiting for processes to exit. Oct 10 15:45:22 oleg256-client systemd-logind[1023]: Removed session 4. Oct 10 15:45:24 oleg256-client sshd[5800]: Accepted publickey for root from 192.168.202.56 port 49958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:24 oleg256-client systemd-logind[1023]: New session 5 of user root. Oct 10 15:45:24 oleg256-client systemd[1]: Started Session 5 of user root. Oct 10 15:45:24 oleg256-client sshd[5800]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:24 oleg256-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Oct 10 15:45:24 oleg256-client sshd[5813]: Received disconnect from 192.168.202.56 port 49958:11: disconnected by user Oct 10 15:45:24 oleg256-client sshd[5813]: Disconnected from user root 192.168.202.56 port 49958 Oct 10 15:45:24 oleg256-client sshd[5800]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:24 oleg256-client systemd[1]: session-5.scope: Succeeded. Oct 10 15:45:24 oleg256-client systemd-logind[1023]: Session 5 logged out. Waiting for processes to exit. Oct 10 15:45:24 oleg256-client systemd-logind[1023]: Removed session 5. Oct 10 15:45:25 oleg256-client sshd[5932]: Accepted publickey for root from 192.168.202.56 port 49972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:25 oleg256-client systemd[1]: Started Session 6 of user root. Oct 10 15:45:25 oleg256-client systemd-logind[1023]: New session 6 of user root. Oct 10 15:45:25 oleg256-client sshd[5932]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:25 oleg256-client sshd[5945]: Received disconnect from 192.168.202.56 port 49972:11: disconnected by user Oct 10 15:45:25 oleg256-client sshd[5945]: Disconnected from user root 192.168.202.56 port 49972 Oct 10 15:45:25 oleg256-client sshd[5932]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:25 oleg256-client systemd[1]: session-6.scope: Succeeded. Oct 10 15:45:25 oleg256-client systemd-logind[1023]: Session 6 logged out. Waiting for processes to exit. Oct 10 15:45:25 oleg256-client systemd-logind[1023]: Removed session 6. Oct 10 15:45:31 oleg256-client systemd-udevd[6105]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Oct 10 15:45:37 oleg256-client sshd[6222]: Accepted publickey for root from 192.168.202.56 port 50384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:37 oleg256-client systemd-logind[1023]: New session 7 of user root. Oct 10 15:45:37 oleg256-client systemd[1]: Started Session 7 of user root. Oct 10 15:45:37 oleg256-client sshd[6222]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:39 oleg256-client kernel: Lustre: DEBUG MARKER: oleg256-client.virtnet: executing check_logdir /tmp/testlogs/ Oct 10 15:45:39 oleg256-client sshd[6235]: Received disconnect from 192.168.202.56 port 50384:11: disconnected by user Oct 10 15:45:39 oleg256-client sshd[6235]: Disconnected from user root 192.168.202.56 port 50384 Oct 10 15:45:39 oleg256-client sshd[6222]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:39 oleg256-client systemd-logind[1023]: Session 7 logged out. Waiting for processes to exit. Oct 10 15:45:39 oleg256-client systemd[1]: session-7.scope: Succeeded. Oct 10 15:45:39 oleg256-client systemd-logind[1023]: Removed session 7. Oct 10 15:45:40 oleg256-client sshd[6484]: Accepted publickey for root from 192.168.202.56 port 50394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:40 oleg256-client systemd-logind[1023]: New session 8 of user root. Oct 10 15:45:40 oleg256-client systemd[1]: Started Session 8 of user root. Oct 10 15:45:40 oleg256-client sshd[6484]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:42 oleg256-client kernel: Lustre: DEBUG MARKER: oleg256-client.virtnet: executing yml_node Oct 10 15:45:43 oleg256-client sshd[6497]: Received disconnect from 192.168.202.56 port 50394:11: disconnected by user Oct 10 15:45:43 oleg256-client sshd[6497]: Disconnected from user root 192.168.202.56 port 50394 Oct 10 15:45:43 oleg256-client sshd[6484]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:43 oleg256-client systemd[1]: session-8.scope: Succeeded. Oct 10 15:45:43 oleg256-client systemd-logind[1023]: Session 8 logged out. Waiting for processes to exit. Oct 10 15:45:43 oleg256-client systemd-logind[1023]: Removed session 8. Oct 10 15:45:46 oleg256-client kernel: Lustre: lustre-OST0000-osc-ffff9a4c033dd800: disconnect after 24s idle Oct 10 15:45:46 oleg256-client sshd[7062]: Accepted publickey for root from 192.168.202.56 port 52788 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:46 oleg256-client systemd-logind[1023]: New session 9 of user root. Oct 10 15:45:46 oleg256-client systemd[1]: Started Session 9 of user root. Oct 10 15:45:46 oleg256-client sshd[7062]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:46 oleg256-client kernel: Lustre: DEBUG MARKER: Client: 2.16.58.106 Oct 10 15:45:46 oleg256-client sshd[7075]: Received disconnect from 192.168.202.56 port 52788:11: disconnected by user Oct 10 15:45:46 oleg256-client sshd[7075]: Disconnected from user root 192.168.202.56 port 52788 Oct 10 15:45:46 oleg256-client sshd[7062]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:46 oleg256-client systemd[1]: session-9.scope: Succeeded. Oct 10 15:45:46 oleg256-client systemd-logind[1023]: Session 9 logged out. Waiting for processes to exit. Oct 10 15:45:46 oleg256-client systemd-logind[1023]: Removed session 9. Oct 10 15:45:48 oleg256-client sshd[7217]: Accepted publickey for root from 192.168.202.56 port 52796 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:48 oleg256-client systemd[1]: Started Session 10 of user root. Oct 10 15:45:48 oleg256-client systemd-logind[1023]: New session 10 of user root. Oct 10 15:45:48 oleg256-client sshd[7217]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:49 oleg256-client kernel: Lustre: DEBUG MARKER: MDS: 2.16.58.106 Oct 10 15:45:49 oleg256-client sshd[7230]: Received disconnect from 192.168.202.56 port 52796:11: disconnected by user Oct 10 15:45:49 oleg256-client sshd[7230]: Disconnected from user root 192.168.202.56 port 52796 Oct 10 15:45:49 oleg256-client sshd[7217]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:49 oleg256-client systemd[1]: session-10.scope: Succeeded. Oct 10 15:45:49 oleg256-client systemd-logind[1023]: Session 10 logged out. Waiting for processes to exit. Oct 10 15:45:49 oleg256-client systemd-logind[1023]: Removed session 10. Oct 10 15:45:50 oleg256-client sshd[7371]: Accepted publickey for root from 192.168.202.56 port 52812 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:50 oleg256-client systemd[1]: Started Session 11 of user root. Oct 10 15:45:50 oleg256-client systemd-logind[1023]: New session 11 of user root. Oct 10 15:45:50 oleg256-client sshd[7371]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:51 oleg256-client kernel: Lustre: DEBUG MARKER: OSS: 2.16.58.106 Oct 10 15:45:51 oleg256-client sshd[7384]: Received disconnect from 192.168.202.56 port 52812:11: disconnected by user Oct 10 15:45:51 oleg256-client sshd[7384]: Disconnected from user root 192.168.202.56 port 52812 Oct 10 15:45:51 oleg256-client sshd[7371]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:51 oleg256-client systemd[1]: session-11.scope: Succeeded. Oct 10 15:45:51 oleg256-client systemd-logind[1023]: Session 11 logged out. Waiting for processes to exit. Oct 10 15:45:51 oleg256-client systemd-logind[1023]: Removed session 11. Oct 10 15:45:52 oleg256-client sshd[7515]: Accepted publickey for root from 192.168.202.56 port 52820 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:45:52 oleg256-client systemd-logind[1023]: New session 12 of user root. Oct 10 15:45:52 oleg256-client systemd[1]: Started Session 12 of user root. Oct 10 15:45:52 oleg256-client sshd[7515]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:45:52 oleg256-client kernel: Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-lnet ============----- Fri Oct 10 15:45:51 EDT 2025 Oct 10 15:45:52 oleg256-client sshd[7528]: Received disconnect from 192.168.202.56 port 52820:11: disconnected by user Oct 10 15:45:52 oleg256-client sshd[7528]: Disconnected from user root 192.168.202.56 port 52820 Oct 10 15:45:52 oleg256-client sshd[7515]: pam_unix(sshd:session): session closed for user root Oct 10 15:45:52 oleg256-client systemd-logind[1023]: Session 12 logged out. Waiting for processes to exit. Oct 10 15:45:52 oleg256-client systemd[1]: session-12.scope: Succeeded. Oct 10 15:45:52 oleg256-client systemd-logind[1023]: Removed session 12. Oct 10 15:46:05 oleg256-client systemd[1]: mnt-lustre.mount: Succeeded. Oct 10 15:46:05 oleg256-client kernel: LustreError: 7917:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9a4c033dd800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Oct 10 15:46:05 oleg256-client kernel: LustreError: 7917:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup Oct 10 15:46:05 oleg256-client kernel: Lustre: Unmounted lustre-client Oct 10 15:46:38 oleg256-client kernel: Key type lgssc unregistered Oct 10 15:46:39 oleg256-client kernel: LNet: 8365:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:46:39 oleg256-client kernel: LNetError: 8365:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:46:40 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:46:40 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:46:40 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:46:41 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:46:41 oleg256-client systemd-udevd[8457]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:46:41 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:46:48 oleg256-client systemd[1]: usr-sbin-mount.lustre.mount: Succeeded. Oct 10 15:46:56 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:46:56 oleg256-client systemd-udevd[8813]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:46:56 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:47:00 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:47:00 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:47:00 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:47:00 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:47:01 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:47:01 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:47:01 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show Oct 10 15:47:03 oleg256-client sshd[9188]: Accepted publickey for root from 192.168.202.56 port 52600 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:03 oleg256-client systemd-logind[1023]: New session 13 of user root. Oct 10 15:47:03 oleg256-client systemd[1]: Started Session 13 of user root. Oct 10 15:47:03 oleg256-client sshd[9188]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:03 oleg256-client kernel: Lustre: DEBUG MARKER: excepting tests: 253 254 410 Oct 10 15:47:03 oleg256-client sshd[9201]: Received disconnect from 192.168.202.56 port 52600:11: disconnected by user Oct 10 15:47:03 oleg256-client sshd[9201]: Disconnected from user root 192.168.202.56 port 52600 Oct 10 15:47:03 oleg256-client sshd[9188]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:04 oleg256-client systemd[1]: session-13.scope: Succeeded. Oct 10 15:47:04 oleg256-client systemd-logind[1023]: Session 13 logged out. Waiting for processes to exit. Oct 10 15:47:04 oleg256-client systemd-logind[1023]: Removed session 13. Oct 10 15:47:04 oleg256-client kernel: LNet: 9238:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:47:04 oleg256-client kernel: LNetError: 9238:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:47:04 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:47:04 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:47:04 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:47:04 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:47:05 oleg256-client systemd-udevd[9337]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:47:05 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:47:08 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:47:08 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:47:09 oleg256-client sshd[9576]: Accepted publickey for root from 192.168.202.56 port 52604 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:09 oleg256-client systemd-logind[1023]: New session 14 of user root. Oct 10 15:47:09 oleg256-client systemd[1]: Started Session 14 of user root. Oct 10 15:47:09 oleg256-client sshd[9576]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:09 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 0: Export empty config, import the config, compare ========================================================== 15:47:08 (1760125628) Oct 10 15:47:09 oleg256-client sshd[9590]: Received disconnect from 192.168.202.56 port 52604:11: disconnected by user Oct 10 15:47:09 oleg256-client sshd[9590]: Disconnected from user root 192.168.202.56 port 52604 Oct 10 15:47:09 oleg256-client sshd[9576]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:09 oleg256-client systemd[1]: session-14.scope: Succeeded. Oct 10 15:47:09 oleg256-client systemd-logind[1023]: Session 14 logged out. Waiting for processes to exit. Oct 10 15:47:09 oleg256-client systemd-logind[1023]: Removed session 14. Oct 10 15:47:09 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 15:47:10 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:47:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:10 oleg256-client kernel: LNet: 9669:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:47:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:47:11 oleg256-client kernel: LNet: 9676:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:47:12 oleg256-client sshd[9766]: Accepted publickey for root from 192.168.202.56 port 52608 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:12 oleg256-client systemd-logind[1023]: New session 15 of user root. Oct 10 15:47:12 oleg256-client systemd[1]: Started Session 15 of user root. Oct 10 15:47:12 oleg256-client sshd[9766]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:12 oleg256-client sshd[9779]: Received disconnect from 192.168.202.56 port 52608:11: disconnected by user Oct 10 15:47:12 oleg256-client sshd[9779]: Disconnected from user root 192.168.202.56 port 52608 Oct 10 15:47:12 oleg256-client sshd[9766]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:12 oleg256-client systemd[1]: session-15.scope: Succeeded. Oct 10 15:47:12 oleg256-client systemd-logind[1023]: Session 15 logged out. Waiting for processes to exit. Oct 10 15:47:12 oleg256-client systemd-logind[1023]: Removed session 15. Oct 10 15:47:13 oleg256-client sshd[9903]: Accepted publickey for root from 192.168.202.56 port 52610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:13 oleg256-client systemd-logind[1023]: New session 16 of user root. Oct 10 15:47:13 oleg256-client systemd[1]: Started Session 16 of user root. Oct 10 15:47:13 oleg256-client sshd[9903]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:13 oleg256-client sshd[9916]: Received disconnect from 192.168.202.56 port 52610:11: disconnected by user Oct 10 15:47:13 oleg256-client sshd[9916]: Disconnected from user root 192.168.202.56 port 52610 Oct 10 15:47:13 oleg256-client sshd[9903]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:13 oleg256-client systemd[1]: session-16.scope: Succeeded. Oct 10 15:47:13 oleg256-client systemd-logind[1023]: Session 16 logged out. Waiting for processes to exit. Oct 10 15:47:13 oleg256-client systemd-logind[1023]: Removed session 16. Oct 10 15:47:14 oleg256-client sshd[10047]: Accepted publickey for root from 192.168.202.56 port 33982 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:14 oleg256-client systemd[1]: Started Session 17 of user root. Oct 10 15:47:14 oleg256-client systemd-logind[1023]: New session 17 of user root. Oct 10 15:47:14 oleg256-client sshd[10047]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:14 oleg256-client sshd[10060]: Received disconnect from 192.168.202.56 port 33982:11: disconnected by user Oct 10 15:47:14 oleg256-client sshd[10060]: Disconnected from user root 192.168.202.56 port 33982 Oct 10 15:47:14 oleg256-client sshd[10047]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:14 oleg256-client systemd-logind[1023]: Session 17 logged out. Waiting for processes to exit. Oct 10 15:47:14 oleg256-client systemd[1]: session-17.scope: Succeeded. Oct 10 15:47:14 oleg256-client systemd-logind[1023]: Removed session 17. Oct 10 15:47:15 oleg256-client sshd[10201]: Accepted publickey for root from 192.168.202.56 port 33992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:15 oleg256-client systemd-logind[1023]: New session 18 of user root. Oct 10 15:47:15 oleg256-client systemd[1]: Started Session 18 of user root. Oct 10 15:47:15 oleg256-client sshd[10201]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:15 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 1: Add peer with single nid (tcp) ==== 15:47:14 (1760125634) Oct 10 15:47:15 oleg256-client sshd[10215]: Received disconnect from 192.168.202.56 port 33992:11: disconnected by user Oct 10 15:47:15 oleg256-client sshd[10215]: Disconnected from user root 192.168.202.56 port 33992 Oct 10 15:47:15 oleg256-client sshd[10201]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:15 oleg256-client kernel: LNet: 10246:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:47:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:16 oleg256-client systemd[1]: session-18.scope: Succeeded. Oct 10 15:47:16 oleg256-client systemd-logind[1023]: Session 18 logged out. Waiting for processes to exit. Oct 10 15:47:16 oleg256-client systemd-logind[1023]: Removed session 18. Oct 10 15:47:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp Oct 10 15:47:16 oleg256-client sshd[10351]: Accepted publickey for root from 192.168.202.56 port 33994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:16 oleg256-client systemd-logind[1023]: New session 19 of user root. Oct 10 15:47:16 oleg256-client systemd[1]: Started Session 19 of user root. Oct 10 15:47:17 oleg256-client sshd[10351]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:17 oleg256-client sshd[10364]: Received disconnect from 192.168.202.56 port 33994:11: disconnected by user Oct 10 15:47:17 oleg256-client sshd[10364]: Disconnected from user root 192.168.202.56 port 33994 Oct 10 15:47:17 oleg256-client sshd[10351]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:17 oleg256-client systemd[1]: session-19.scope: Succeeded. Oct 10 15:47:17 oleg256-client systemd-logind[1023]: Session 19 logged out. Waiting for processes to exit. Oct 10 15:47:17 oleg256-client systemd-logind[1023]: Removed session 19. Oct 10 15:47:18 oleg256-client sshd[10488]: Accepted publickey for root from 192.168.202.56 port 34010 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:18 oleg256-client systemd[1]: Started Session 20 of user root. Oct 10 15:47:18 oleg256-client systemd-logind[1023]: New session 20 of user root. Oct 10 15:47:18 oleg256-client sshd[10488]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:18 oleg256-client sshd[10501]: Received disconnect from 192.168.202.56 port 34010:11: disconnected by user Oct 10 15:47:18 oleg256-client sshd[10501]: Disconnected from user root 192.168.202.56 port 34010 Oct 10 15:47:18 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:47:18 oleg256-client sshd[10488]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:18 oleg256-client systemd-logind[1023]: Session 20 logged out. Waiting for processes to exit. Oct 10 15:47:18 oleg256-client systemd[1]: session-20.scope: Succeeded. Oct 10 15:47:18 oleg256-client systemd-logind[1023]: Removed session 20. Oct 10 15:47:19 oleg256-client sshd[10633]: Accepted publickey for root from 192.168.202.56 port 34020 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:19 oleg256-client systemd-logind[1023]: New session 21 of user root. Oct 10 15:47:19 oleg256-client systemd[1]: Started Session 21 of user root. Oct 10 15:47:19 oleg256-client sshd[10633]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:19 oleg256-client sshd[10646]: Received disconnect from 192.168.202.56 port 34020:11: disconnected by user Oct 10 15:47:19 oleg256-client sshd[10646]: Disconnected from user root 192.168.202.56 port 34020 Oct 10 15:47:19 oleg256-client sshd[10633]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:19 oleg256-client systemd[1]: session-21.scope: Succeeded. Oct 10 15:47:19 oleg256-client systemd-logind[1023]: Session 21 logged out. Waiting for processes to exit. Oct 10 15:47:19 oleg256-client systemd-logind[1023]: Removed session 21. Oct 10 15:47:20 oleg256-client sshd[10786]: Accepted publickey for root from 192.168.202.56 port 34030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:20 oleg256-client systemd-logind[1023]: New session 22 of user root. Oct 10 15:47:20 oleg256-client systemd[1]: Started Session 22 of user root. Oct 10 15:47:20 oleg256-client sshd[10786]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:21 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 2: Add peer with single nid (o2ib) === 15:47:19 (1760125639) Oct 10 15:47:21 oleg256-client sshd[10799]: Received disconnect from 192.168.202.56 port 34030:11: disconnected by user Oct 10 15:47:21 oleg256-client sshd[10799]: Disconnected from user root 192.168.202.56 port 34030 Oct 10 15:47:21 oleg256-client sshd[10786]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:21 oleg256-client systemd[1]: session-22.scope: Succeeded. Oct 10 15:47:21 oleg256-client systemd-logind[1023]: Session 22 logged out. Waiting for processes to exit. Oct 10 15:47:21 oleg256-client systemd-logind[1023]: Removed session 22. Oct 10 15:47:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:21 oleg256-client kernel: LNet: 10837:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:47:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 2.2.2.2@o2ib Oct 10 15:47:22 oleg256-client sshd[10936]: Accepted publickey for root from 192.168.202.56 port 34036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:22 oleg256-client systemd-logind[1023]: New session 23 of user root. Oct 10 15:47:22 oleg256-client systemd[1]: Started Session 23 of user root. Oct 10 15:47:22 oleg256-client sshd[10936]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:22 oleg256-client sshd[10949]: Received disconnect from 192.168.202.56 port 34036:11: disconnected by user Oct 10 15:47:22 oleg256-client sshd[10949]: Disconnected from user root 192.168.202.56 port 34036 Oct 10 15:47:22 oleg256-client sshd[10936]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:22 oleg256-client systemd[1]: session-23.scope: Succeeded. Oct 10 15:47:22 oleg256-client systemd-logind[1023]: Session 23 logged out. Waiting for processes to exit. Oct 10 15:47:22 oleg256-client systemd-logind[1023]: Removed session 23. Oct 10 15:47:23 oleg256-client sshd[11073]: Accepted publickey for root from 192.168.202.56 port 34046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:23 oleg256-client systemd-logind[1023]: New session 24 of user root. Oct 10 15:47:23 oleg256-client systemd[1]: Started Session 24 of user root. Oct 10 15:47:23 oleg256-client sshd[11073]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:23 oleg256-client sshd[11086]: Received disconnect from 192.168.202.56 port 34046:11: disconnected by user Oct 10 15:47:23 oleg256-client sshd[11086]: Disconnected from user root 192.168.202.56 port 34046 Oct 10 15:47:23 oleg256-client sshd[11073]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:23 oleg256-client systemd[1]: session-24.scope: Succeeded. Oct 10 15:47:23 oleg256-client systemd-logind[1023]: Session 24 logged out. Waiting for processes to exit. Oct 10 15:47:23 oleg256-client systemd-logind[1023]: Removed session 24. Oct 10 15:47:24 oleg256-client sshd[11217]: Accepted publickey for root from 192.168.202.56 port 59596 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:24 oleg256-client systemd-logind[1023]: New session 25 of user root. Oct 10 15:47:24 oleg256-client systemd[1]: Started Session 25 of user root. Oct 10 15:47:24 oleg256-client sshd[11217]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:25 oleg256-client sshd[11230]: Received disconnect from 192.168.202.56 port 59596:11: disconnected by user Oct 10 15:47:25 oleg256-client sshd[11230]: Disconnected from user root 192.168.202.56 port 59596 Oct 10 15:47:25 oleg256-client sshd[11217]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:25 oleg256-client systemd[1]: session-25.scope: Succeeded. Oct 10 15:47:25 oleg256-client systemd-logind[1023]: Session 25 logged out. Waiting for processes to exit. Oct 10 15:47:25 oleg256-client systemd-logind[1023]: Removed session 25. Oct 10 15:47:25 oleg256-client sshd[11370]: Accepted publickey for root from 192.168.202.56 port 59598 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:26 oleg256-client systemd-logind[1023]: New session 26 of user root. Oct 10 15:47:26 oleg256-client systemd[1]: Started Session 26 of user root. Oct 10 15:47:26 oleg256-client sshd[11370]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:26 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 3: Add peer with tcp primary o2ib secondary ========================================================== 15:47:25 (1760125645) Oct 10 15:47:26 oleg256-client sshd[11383]: Received disconnect from 192.168.202.56 port 59598:11: disconnected by user Oct 10 15:47:26 oleg256-client sshd[11383]: Disconnected from user root 192.168.202.56 port 59598 Oct 10 15:47:26 oleg256-client sshd[11370]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:26 oleg256-client systemd-logind[1023]: Session 26 logged out. Waiting for processes to exit. Oct 10 15:47:26 oleg256-client systemd[1]: session-26.scope: Succeeded. Oct 10 15:47:26 oleg256-client systemd-logind[1023]: Removed session 26. Oct 10 15:47:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:26 oleg256-client kernel: LNet: 11421:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:47:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 3.3.3.3@tcp --nid 3.3.3.3@o2ib Oct 10 15:47:27 oleg256-client sshd[11520]: Accepted publickey for root from 192.168.202.56 port 59602 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:27 oleg256-client systemd[1]: Started Session 27 of user root. Oct 10 15:47:27 oleg256-client systemd-logind[1023]: New session 27 of user root. Oct 10 15:47:27 oleg256-client sshd[11520]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:27 oleg256-client sshd[11533]: Received disconnect from 192.168.202.56 port 59602:11: disconnected by user Oct 10 15:47:27 oleg256-client sshd[11533]: Disconnected from user root 192.168.202.56 port 59602 Oct 10 15:47:27 oleg256-client sshd[11520]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:27 oleg256-client systemd-logind[1023]: Session 27 logged out. Waiting for processes to exit. Oct 10 15:47:27 oleg256-client systemd[1]: session-27.scope: Succeeded. Oct 10 15:47:28 oleg256-client systemd-logind[1023]: Removed session 27. Oct 10 15:47:28 oleg256-client sshd[11657]: Accepted publickey for root from 192.168.202.56 port 59612 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:28 oleg256-client systemd-logind[1023]: New session 28 of user root. Oct 10 15:47:28 oleg256-client systemd[1]: Started Session 28 of user root. Oct 10 15:47:28 oleg256-client sshd[11657]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:29 oleg256-client sshd[11670]: Received disconnect from 192.168.202.56 port 59612:11: disconnected by user Oct 10 15:47:29 oleg256-client sshd[11670]: Disconnected from user root 192.168.202.56 port 59612 Oct 10 15:47:29 oleg256-client sshd[11657]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:29 oleg256-client systemd[1]: session-28.scope: Succeeded. Oct 10 15:47:29 oleg256-client systemd-logind[1023]: Session 28 logged out. Waiting for processes to exit. Oct 10 15:47:29 oleg256-client systemd-logind[1023]: Removed session 28. Oct 10 15:47:29 oleg256-client sshd[11801]: Accepted publickey for root from 192.168.202.56 port 59624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:29 oleg256-client systemd[1]: Started Session 29 of user root. Oct 10 15:47:29 oleg256-client systemd-logind[1023]: New session 29 of user root. Oct 10 15:47:29 oleg256-client sshd[11801]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:30 oleg256-client sshd[11814]: Received disconnect from 192.168.202.56 port 59624:11: disconnected by user Oct 10 15:47:30 oleg256-client sshd[11814]: Disconnected from user root 192.168.202.56 port 59624 Oct 10 15:47:30 oleg256-client sshd[11801]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:30 oleg256-client systemd[1]: session-29.scope: Succeeded. Oct 10 15:47:30 oleg256-client systemd-logind[1023]: Session 29 logged out. Waiting for processes to exit. Oct 10 15:47:30 oleg256-client systemd-logind[1023]: Removed session 29. Oct 10 15:47:31 oleg256-client sshd[11954]: Accepted publickey for root from 192.168.202.56 port 59632 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:31 oleg256-client systemd[1]: Started Session 30 of user root. Oct 10 15:47:31 oleg256-client systemd-logind[1023]: New session 30 of user root. Oct 10 15:47:31 oleg256-client sshd[11954]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:31 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 4: Add peer with nidrange (tcp) ====== 15:47:30 (1760125650) Oct 10 15:47:31 oleg256-client sshd[11967]: Received disconnect from 192.168.202.56 port 59632:11: disconnected by user Oct 10 15:47:31 oleg256-client sshd[11967]: Disconnected from user root 192.168.202.56 port 59632 Oct 10 15:47:31 oleg256-client sshd[11954]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:31 oleg256-client kernel: LNet: 12002:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:47:31 oleg256-client systemd-logind[1023]: Session 30 logged out. Waiting for processes to exit. Oct 10 15:47:31 oleg256-client systemd[1]: session-30.scope: Succeeded. Oct 10 15:47:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:31 oleg256-client systemd-logind[1023]: Removed session 30. Oct 10 15:47:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 4.4.4.4@tcp --nid 4.4.4.[1-3]@tcp Oct 10 15:47:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 4.4.4.4@tcp --nid 4.4.4.[1-4]@tcp Oct 10 15:47:32 oleg256-client sshd[12110]: Accepted publickey for root from 192.168.202.56 port 59636 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:32 oleg256-client systemd[1]: Started Session 31 of user root. Oct 10 15:47:32 oleg256-client systemd-logind[1023]: New session 31 of user root. Oct 10 15:47:32 oleg256-client sshd[12110]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:33 oleg256-client sshd[12123]: Received disconnect from 192.168.202.56 port 59636:11: disconnected by user Oct 10 15:47:33 oleg256-client sshd[12123]: Disconnected from user root 192.168.202.56 port 59636 Oct 10 15:47:33 oleg256-client sshd[12110]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:33 oleg256-client systemd[1]: session-31.scope: Succeeded. Oct 10 15:47:33 oleg256-client systemd-logind[1023]: Session 31 logged out. Waiting for processes to exit. Oct 10 15:47:33 oleg256-client systemd-logind[1023]: Removed session 31. Oct 10 15:47:34 oleg256-client sshd[12247]: Accepted publickey for root from 192.168.202.56 port 46822 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:34 oleg256-client systemd[1]: Started Session 32 of user root. Oct 10 15:47:34 oleg256-client systemd-logind[1023]: New session 32 of user root. Oct 10 15:47:34 oleg256-client sshd[12247]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:34 oleg256-client sshd[12260]: Received disconnect from 192.168.202.56 port 46822:11: disconnected by user Oct 10 15:47:34 oleg256-client sshd[12260]: Disconnected from user root 192.168.202.56 port 46822 Oct 10 15:47:34 oleg256-client sshd[12247]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:34 oleg256-client systemd-logind[1023]: Session 32 logged out. Waiting for processes to exit. Oct 10 15:47:34 oleg256-client systemd[1]: session-32.scope: Succeeded. Oct 10 15:47:34 oleg256-client systemd-logind[1023]: Removed session 32. Oct 10 15:47:35 oleg256-client sshd[12391]: Accepted publickey for root from 192.168.202.56 port 46828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:35 oleg256-client systemd-logind[1023]: New session 33 of user root. Oct 10 15:47:35 oleg256-client systemd[1]: Started Session 33 of user root. Oct 10 15:47:35 oleg256-client sshd[12391]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:35 oleg256-client sshd[12404]: Received disconnect from 192.168.202.56 port 46828:11: disconnected by user Oct 10 15:47:35 oleg256-client sshd[12404]: Disconnected from user root 192.168.202.56 port 46828 Oct 10 15:47:35 oleg256-client sshd[12391]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:36 oleg256-client systemd[1]: session-33.scope: Succeeded. Oct 10 15:47:36 oleg256-client systemd-logind[1023]: Session 33 logged out. Waiting for processes to exit. Oct 10 15:47:36 oleg256-client systemd-logind[1023]: Removed session 33. Oct 10 15:47:37 oleg256-client sshd[12544]: Accepted publickey for root from 192.168.202.56 port 46840 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:37 oleg256-client systemd[1]: Started Session 34 of user root. Oct 10 15:47:37 oleg256-client systemd-logind[1023]: New session 34 of user root. Oct 10 15:47:37 oleg256-client sshd[12544]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:37 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 5: Add peer with nidrange (o2ib) ===== 15:47:36 (1760125656) Oct 10 15:47:37 oleg256-client sshd[12557]: Received disconnect from 192.168.202.56 port 46840:11: disconnected by user Oct 10 15:47:37 oleg256-client sshd[12557]: Disconnected from user root 192.168.202.56 port 46840 Oct 10 15:47:37 oleg256-client sshd[12544]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:37 oleg256-client systemd[1]: session-34.scope: Succeeded. Oct 10 15:47:37 oleg256-client systemd-logind[1023]: Session 34 logged out. Waiting for processes to exit. Oct 10 15:47:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:37 oleg256-client systemd-logind[1023]: Removed session 34. Oct 10 15:47:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1-4]@o2ib Oct 10 15:47:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1-4]@o2ib Oct 10 15:47:38 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 5.5.5.5@o2ib --nid 5.5.5.[1,2,3-4]@o2ib Oct 10 15:47:39 oleg256-client sshd[12706]: Accepted publickey for root from 192.168.202.56 port 46848 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:39 oleg256-client systemd-logind[1023]: New session 35 of user root. Oct 10 15:47:39 oleg256-client systemd[1]: Started Session 35 of user root. Oct 10 15:47:39 oleg256-client sshd[12706]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:39 oleg256-client sshd[12719]: Received disconnect from 192.168.202.56 port 46848:11: disconnected by user Oct 10 15:47:39 oleg256-client sshd[12719]: Disconnected from user root 192.168.202.56 port 46848 Oct 10 15:47:39 oleg256-client sshd[12706]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:39 oleg256-client systemd[1]: session-35.scope: Succeeded. Oct 10 15:47:39 oleg256-client systemd-logind[1023]: Session 35 logged out. Waiting for processes to exit. Oct 10 15:47:39 oleg256-client systemd-logind[1023]: Removed session 35. Oct 10 15:47:40 oleg256-client sshd[12843]: Accepted publickey for root from 192.168.202.56 port 46854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:40 oleg256-client systemd-logind[1023]: New session 36 of user root. Oct 10 15:47:40 oleg256-client systemd[1]: Started Session 36 of user root. Oct 10 15:47:40 oleg256-client sshd[12843]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:40 oleg256-client sshd[12856]: Received disconnect from 192.168.202.56 port 46854:11: disconnected by user Oct 10 15:47:40 oleg256-client sshd[12856]: Disconnected from user root 192.168.202.56 port 46854 Oct 10 15:47:40 oleg256-client sshd[12843]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:40 oleg256-client systemd[1]: session-36.scope: Succeeded. Oct 10 15:47:40 oleg256-client systemd-logind[1023]: Session 36 logged out. Waiting for processes to exit. Oct 10 15:47:40 oleg256-client systemd-logind[1023]: Removed session 36. Oct 10 15:47:41 oleg256-client sshd[12987]: Accepted publickey for root from 192.168.202.56 port 46864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:41 oleg256-client systemd[1]: Started Session 37 of user root. Oct 10 15:47:41 oleg256-client systemd-logind[1023]: New session 37 of user root. Oct 10 15:47:41 oleg256-client sshd[12987]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:41 oleg256-client sshd[13000]: Received disconnect from 192.168.202.56 port 46864:11: disconnected by user Oct 10 15:47:41 oleg256-client sshd[13000]: Disconnected from user root 192.168.202.56 port 46864 Oct 10 15:47:41 oleg256-client sshd[12987]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:42 oleg256-client systemd[1]: session-37.scope: Succeeded. Oct 10 15:47:42 oleg256-client systemd-logind[1023]: Session 37 logged out. Waiting for processes to exit. Oct 10 15:47:42 oleg256-client systemd-logind[1023]: Removed session 37. Oct 10 15:47:42 oleg256-client sshd[13140]: Accepted publickey for root from 192.168.202.56 port 46872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:42 oleg256-client systemd-logind[1023]: New session 38 of user root. Oct 10 15:47:42 oleg256-client systemd[1]: Started Session 38 of user root. Oct 10 15:47:42 oleg256-client sshd[13140]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:43 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 6: Add peer with multiple nidranges == 15:47:42 (1760125662) Oct 10 15:47:43 oleg256-client sshd[13153]: Received disconnect from 192.168.202.56 port 46872:11: disconnected by user Oct 10 15:47:43 oleg256-client sshd[13153]: Disconnected from user root 192.168.202.56 port 46872 Oct 10 15:47:43 oleg256-client sshd[13140]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:43 oleg256-client kernel: LNet: 13185:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:47:43 oleg256-client kernel: LNet: 13185:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 1 previous similar message Oct 10 15:47:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:43 oleg256-client systemd-logind[1023]: Session 38 logged out. Waiting for processes to exit. Oct 10 15:47:43 oleg256-client systemd[1]: session-38.scope: Succeeded. Oct 10 15:47:43 oleg256-client systemd-logind[1023]: Removed session 38. Oct 10 15:47:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 6.6.6.6@tcp --nid 6.6.[6-7].[0-4/2]@tcp,6.6.[1-4/2].[0-6/3]@o2ib,[6-12/4]@gni,[6-12/4]@kfi,[6-12/4]@bxi3f Oct 10 15:47:44 oleg256-client sshd[13290]: Accepted publickey for root from 192.168.202.56 port 52544 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:44 oleg256-client systemd-logind[1023]: New session 39 of user root. Oct 10 15:47:44 oleg256-client systemd[1]: Started Session 39 of user root. Oct 10 15:47:44 oleg256-client sshd[13290]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:44 oleg256-client sshd[13303]: Received disconnect from 192.168.202.56 port 52544:11: disconnected by user Oct 10 15:47:44 oleg256-client sshd[13303]: Disconnected from user root 192.168.202.56 port 52544 Oct 10 15:47:44 oleg256-client sshd[13290]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:44 oleg256-client systemd[1]: session-39.scope: Succeeded. Oct 10 15:47:44 oleg256-client systemd-logind[1023]: Session 39 logged out. Waiting for processes to exit. Oct 10 15:47:44 oleg256-client systemd-logind[1023]: Removed session 39. Oct 10 15:47:45 oleg256-client sshd[13427]: Accepted publickey for root from 192.168.202.56 port 52558 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:45 oleg256-client systemd-logind[1023]: New session 40 of user root. Oct 10 15:47:45 oleg256-client systemd[1]: Started Session 40 of user root. Oct 10 15:47:45 oleg256-client sshd[13427]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:45 oleg256-client sshd[13440]: Received disconnect from 192.168.202.56 port 52558:11: disconnected by user Oct 10 15:47:45 oleg256-client sshd[13440]: Disconnected from user root 192.168.202.56 port 52558 Oct 10 15:47:45 oleg256-client sshd[13427]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:45 oleg256-client systemd-logind[1023]: Session 40 logged out. Waiting for processes to exit. Oct 10 15:47:45 oleg256-client systemd[1]: session-40.scope: Succeeded. Oct 10 15:47:45 oleg256-client systemd-logind[1023]: Removed session 40. Oct 10 15:47:46 oleg256-client sshd[13571]: Accepted publickey for root from 192.168.202.56 port 52572 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:46 oleg256-client systemd-logind[1023]: New session 41 of user root. Oct 10 15:47:46 oleg256-client systemd[1]: Started Session 41 of user root. Oct 10 15:47:46 oleg256-client sshd[13571]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:46 oleg256-client sshd[13584]: Received disconnect from 192.168.202.56 port 52572:11: disconnected by user Oct 10 15:47:46 oleg256-client sshd[13584]: Disconnected from user root 192.168.202.56 port 52572 Oct 10 15:47:46 oleg256-client sshd[13571]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:46 oleg256-client systemd[1]: session-41.scope: Succeeded. Oct 10 15:47:46 oleg256-client systemd-logind[1023]: Session 41 logged out. Waiting for processes to exit. Oct 10 15:47:46 oleg256-client systemd-logind[1023]: Removed session 41. Oct 10 15:47:47 oleg256-client sshd[13724]: Accepted publickey for root from 192.168.202.56 port 52582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:47 oleg256-client systemd[1]: Started Session 42 of user root. Oct 10 15:47:47 oleg256-client systemd-logind[1023]: New session 42 of user root. Oct 10 15:47:47 oleg256-client sshd[13724]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:47 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 7: Various peer delete tests ========= 15:47:46 (1760125666) Oct 10 15:47:47 oleg256-client sshd[13737]: Received disconnect from 192.168.202.56 port 52582:11: disconnected by user Oct 10 15:47:47 oleg256-client sshd[13737]: Disconnected from user root 192.168.202.56 port 52582 Oct 10 15:47:47 oleg256-client sshd[13724]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:47 oleg256-client systemd[1]: session-42.scope: Succeeded. Oct 10 15:47:47 oleg256-client systemd-logind[1023]: Session 42 logged out. Waiting for processes to exit. Oct 10 15:47:47 oleg256-client systemd-logind[1023]: Removed session 42. Oct 10 15:47:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp Oct 10 15:47:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp Oct 10 15:47:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@o2ib Oct 10 15:47:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@o2ib Oct 10 15:47:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp --nid 7.7.7.[8-12]@tcp Oct 10 15:47:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp Oct 10 15:47:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@o2ib --nid 7.7.7.[8-12]@o2ib Oct 10 15:47:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@o2ib Oct 10 15:47:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7.7.7.7@tcp --nid 7.7.7.[9-12]@tcp,7.7.7.[13-15]@o2ib Oct 10 15:47:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7.7.7.7@tcp Oct 10 15:47:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni Oct 10 15:47:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni Oct 10 15:47:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni --nid [8-12]@gni Oct 10 15:47:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni Oct 10 15:47:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@kfi Oct 10 15:47:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@kfi Oct 10 15:47:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@kfi --nid [8-12]@kfi Oct 10 15:47:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@kfi Oct 10 15:47:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@bxi3f Oct 10 15:47:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@bxi3f Oct 10 15:47:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@bxi3f --nid [8-12]@bxi3f Oct 10 15:47:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@bxi3f Oct 10 15:47:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 7@gni --nid [8-12]@gni,7.7.7.[1-4]@tcp,7.7.7.[5-9]@o2ib,[1-5]@kfi,[3-7]@bxi3f Oct 10 15:47:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 7@gni Oct 10 15:47:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim 1.1.1.1@tcp --nid 1.1.1.1@tcp,2.2.2.2@tcp,3.3.3.3@tcp,4.4.4.4@tcp Oct 10 15:47:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp --nid 1.1.1.1@tcp,2.2.2.2@tcp,3.3.3.3@tcp,4.4.4.4@tcp Oct 10 15:47:52 oleg256-client sshd[13971]: Accepted publickey for root from 192.168.202.56 port 52590 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:52 oleg256-client systemd-logind[1023]: New session 43 of user root. Oct 10 15:47:52 oleg256-client systemd[1]: Started Session 43 of user root. Oct 10 15:47:52 oleg256-client sshd[13971]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:52 oleg256-client sshd[13984]: Received disconnect from 192.168.202.56 port 52590:11: disconnected by user Oct 10 15:47:52 oleg256-client sshd[13984]: Disconnected from user root 192.168.202.56 port 52590 Oct 10 15:47:52 oleg256-client sshd[13971]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:52 oleg256-client systemd[1]: session-43.scope: Succeeded. Oct 10 15:47:52 oleg256-client systemd-logind[1023]: Session 43 logged out. Waiting for processes to exit. Oct 10 15:47:52 oleg256-client systemd-logind[1023]: Removed session 43. Oct 10 15:47:53 oleg256-client sshd[14108]: Accepted publickey for root from 192.168.202.56 port 52598 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:53 oleg256-client systemd[1]: Started Session 44 of user root. Oct 10 15:47:53 oleg256-client systemd-logind[1023]: New session 44 of user root. Oct 10 15:47:53 oleg256-client sshd[14108]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:53 oleg256-client sshd[14121]: Received disconnect from 192.168.202.56 port 52598:11: disconnected by user Oct 10 15:47:53 oleg256-client sshd[14121]: Disconnected from user root 192.168.202.56 port 52598 Oct 10 15:47:53 oleg256-client sshd[14108]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:53 oleg256-client systemd[1]: session-44.scope: Succeeded. Oct 10 15:47:53 oleg256-client systemd-logind[1023]: Session 44 logged out. Waiting for processes to exit. Oct 10 15:47:53 oleg256-client systemd-logind[1023]: Removed session 44. Oct 10 15:47:54 oleg256-client sshd[14252]: Accepted publickey for root from 192.168.202.56 port 50478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:54 oleg256-client systemd[1]: Started Session 45 of user root. Oct 10 15:47:54 oleg256-client systemd-logind[1023]: New session 45 of user root. Oct 10 15:47:54 oleg256-client sshd[14252]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:54 oleg256-client sshd[14265]: Received disconnect from 192.168.202.56 port 50478:11: disconnected by user Oct 10 15:47:54 oleg256-client sshd[14265]: Disconnected from user root 192.168.202.56 port 50478 Oct 10 15:47:54 oleg256-client sshd[14252]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:54 oleg256-client systemd-logind[1023]: Session 45 logged out. Waiting for processes to exit. Oct 10 15:47:54 oleg256-client systemd[1]: session-45.scope: Succeeded. Oct 10 15:47:54 oleg256-client systemd-logind[1023]: Removed session 45. Oct 10 15:47:55 oleg256-client sshd[14405]: Accepted publickey for root from 192.168.202.56 port 50490 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:55 oleg256-client systemd-logind[1023]: New session 46 of user root. Oct 10 15:47:55 oleg256-client systemd[1]: Started Session 46 of user root. Oct 10 15:47:55 oleg256-client sshd[14405]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:55 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 8: Delete single secondary nid from peer (tcp) ========================================================== 15:47:54 (1760125674) Oct 10 15:47:55 oleg256-client sshd[14419]: Received disconnect from 192.168.202.56 port 50490:11: disconnected by user Oct 10 15:47:55 oleg256-client sshd[14419]: Disconnected from user root 192.168.202.56 port 50490 Oct 10 15:47:55 oleg256-client sshd[14405]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:55 oleg256-client systemd[1]: session-46.scope: Succeeded. Oct 10 15:47:55 oleg256-client systemd-logind[1023]: Session 46 logged out. Waiting for processes to exit. Oct 10 15:47:55 oleg256-client systemd-logind[1023]: Removed session 46. Oct 10 15:47:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:47:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:47:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 8.8.8.8@tcp --nid 8.8.8.[10-15]@tcp Oct 10 15:47:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 8.8.8.8@tcp --nid 8.8.8.13@tcp Oct 10 15:47:56 oleg256-client sshd[14557]: Accepted publickey for root from 192.168.202.56 port 50498 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:56 oleg256-client systemd[1]: Started Session 47 of user root. Oct 10 15:47:56 oleg256-client systemd-logind[1023]: New session 47 of user root. Oct 10 15:47:56 oleg256-client sshd[14557]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:57 oleg256-client sshd[14570]: Received disconnect from 192.168.202.56 port 50498:11: disconnected by user Oct 10 15:47:57 oleg256-client sshd[14570]: Disconnected from user root 192.168.202.56 port 50498 Oct 10 15:47:57 oleg256-client sshd[14557]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:57 oleg256-client systemd[1]: session-47.scope: Succeeded. Oct 10 15:47:57 oleg256-client systemd-logind[1023]: Session 47 logged out. Waiting for processes to exit. Oct 10 15:47:57 oleg256-client systemd-logind[1023]: Removed session 47. Oct 10 15:47:57 oleg256-client sshd[14695]: Accepted publickey for root from 192.168.202.56 port 50512 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:57 oleg256-client systemd-logind[1023]: New session 48 of user root. Oct 10 15:47:57 oleg256-client systemd[1]: Started Session 48 of user root. Oct 10 15:47:57 oleg256-client sshd[14695]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:58 oleg256-client sshd[14708]: Received disconnect from 192.168.202.56 port 50512:11: disconnected by user Oct 10 15:47:58 oleg256-client sshd[14708]: Disconnected from user root 192.168.202.56 port 50512 Oct 10 15:47:58 oleg256-client sshd[14695]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:58 oleg256-client systemd[1]: session-48.scope: Succeeded. Oct 10 15:47:58 oleg256-client systemd-logind[1023]: Session 48 logged out. Waiting for processes to exit. Oct 10 15:47:58 oleg256-client systemd-logind[1023]: Removed session 48. Oct 10 15:47:58 oleg256-client sshd[14839]: Accepted publickey for root from 192.168.202.56 port 50514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:58 oleg256-client systemd[1]: Started Session 49 of user root. Oct 10 15:47:58 oleg256-client systemd-logind[1023]: New session 49 of user root. Oct 10 15:47:58 oleg256-client sshd[14839]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:47:59 oleg256-client sshd[14852]: Received disconnect from 192.168.202.56 port 50514:11: disconnected by user Oct 10 15:47:59 oleg256-client sshd[14852]: Disconnected from user root 192.168.202.56 port 50514 Oct 10 15:47:59 oleg256-client sshd[14839]: pam_unix(sshd:session): session closed for user root Oct 10 15:47:59 oleg256-client systemd[1]: session-49.scope: Succeeded. Oct 10 15:47:59 oleg256-client systemd-logind[1023]: Session 49 logged out. Waiting for processes to exit. Oct 10 15:47:59 oleg256-client systemd-logind[1023]: Removed session 49. Oct 10 15:47:59 oleg256-client sshd[14992]: Accepted publickey for root from 192.168.202.56 port 50522 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:47:59 oleg256-client systemd-logind[1023]: New session 50 of user root. Oct 10 15:47:59 oleg256-client systemd[1]: Started Session 50 of user root. Oct 10 15:47:59 oleg256-client sshd[14992]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:00 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 9: Delete all secondary nids from peer (tcp) ========================================================== 15:47:59 (1760125679) Oct 10 15:48:00 oleg256-client sshd[15005]: Received disconnect from 192.168.202.56 port 50522:11: disconnected by user Oct 10 15:48:00 oleg256-client sshd[15005]: Disconnected from user root 192.168.202.56 port 50522 Oct 10 15:48:00 oleg256-client sshd[14992]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:00 oleg256-client systemd[1]: session-50.scope: Succeeded. Oct 10 15:48:00 oleg256-client systemd-logind[1023]: Session 50 logged out. Waiting for processes to exit. Oct 10 15:48:00 oleg256-client systemd-logind[1023]: Removed session 50. Oct 10 15:48:00 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:00 oleg256-client kernel: LNet: 15044:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:48:00 oleg256-client kernel: LNet: 15044:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 2 previous similar messages Oct 10 15:48:00 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:00 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 9.9.9.9@tcp --nid 9.9.9.[11-16]@tcp Oct 10 15:48:00 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 9.9.9.9@tcp --nid 9.9.9.[11-16]@tcp Oct 10 15:48:01 oleg256-client sshd[15144]: Accepted publickey for root from 192.168.202.56 port 50538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:01 oleg256-client systemd-logind[1023]: New session 51 of user root. Oct 10 15:48:01 oleg256-client systemd[1]: Started Session 51 of user root. Oct 10 15:48:01 oleg256-client sshd[15144]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:01 oleg256-client sshd[15157]: Received disconnect from 192.168.202.56 port 50538:11: disconnected by user Oct 10 15:48:01 oleg256-client sshd[15157]: Disconnected from user root 192.168.202.56 port 50538 Oct 10 15:48:01 oleg256-client sshd[15144]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:01 oleg256-client systemd[1]: session-51.scope: Succeeded. Oct 10 15:48:01 oleg256-client systemd-logind[1023]: Session 51 logged out. Waiting for processes to exit. Oct 10 15:48:01 oleg256-client systemd-logind[1023]: Removed session 51. Oct 10 15:48:02 oleg256-client sshd[15282]: Accepted publickey for root from 192.168.202.56 port 50550 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:02 oleg256-client systemd[1]: Started Session 52 of user root. Oct 10 15:48:02 oleg256-client systemd-logind[1023]: New session 52 of user root. Oct 10 15:48:02 oleg256-client sshd[15282]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:02 oleg256-client sshd[15295]: Received disconnect from 192.168.202.56 port 50550:11: disconnected by user Oct 10 15:48:02 oleg256-client sshd[15295]: Disconnected from user root 192.168.202.56 port 50550 Oct 10 15:48:02 oleg256-client sshd[15282]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:02 oleg256-client systemd[1]: session-52.scope: Succeeded. Oct 10 15:48:02 oleg256-client systemd-logind[1023]: Session 52 logged out. Waiting for processes to exit. Oct 10 15:48:02 oleg256-client systemd-logind[1023]: Removed session 52. Oct 10 15:48:03 oleg256-client sshd[15426]: Accepted publickey for root from 192.168.202.56 port 50560 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:03 oleg256-client systemd-logind[1023]: New session 53 of user root. Oct 10 15:48:03 oleg256-client systemd[1]: Started Session 53 of user root. Oct 10 15:48:03 oleg256-client sshd[15426]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:03 oleg256-client sshd[15439]: Received disconnect from 192.168.202.56 port 50560:11: disconnected by user Oct 10 15:48:03 oleg256-client sshd[15439]: Disconnected from user root 192.168.202.56 port 50560 Oct 10 15:48:03 oleg256-client sshd[15426]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:03 oleg256-client systemd[1]: session-53.scope: Succeeded. Oct 10 15:48:03 oleg256-client systemd-logind[1023]: Session 53 logged out. Waiting for processes to exit. Oct 10 15:48:03 oleg256-client systemd-logind[1023]: Removed session 53. Oct 10 15:48:04 oleg256-client sshd[15579]: Accepted publickey for root from 192.168.202.56 port 36886 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:04 oleg256-client systemd[1]: Started Session 54 of user root. Oct 10 15:48:04 oleg256-client systemd-logind[1023]: New session 54 of user root. Oct 10 15:48:04 oleg256-client sshd[15579]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:04 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 10: Delete single secondary nid from peer (o2ib) ========================================================== 15:48:03 (1760125683) Oct 10 15:48:04 oleg256-client sshd[15592]: Received disconnect from 192.168.202.56 port 36886:11: disconnected by user Oct 10 15:48:04 oleg256-client sshd[15592]: Disconnected from user root 192.168.202.56 port 36886 Oct 10 15:48:04 oleg256-client sshd[15579]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:04 oleg256-client systemd[1]: session-54.scope: Succeeded. Oct 10 15:48:04 oleg256-client systemd-logind[1023]: Session 54 logged out. Waiting for processes to exit. Oct 10 15:48:04 oleg256-client systemd-logind[1023]: Removed session 54. Oct 10 15:48:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 10.10.10.10@tcp --nid 10.10.10.[12-16]@tcp Oct 10 15:48:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 10.10.10.10@tcp --nid 10.10.10.14@tcp Oct 10 15:48:05 oleg256-client sshd[15730]: Accepted publickey for root from 192.168.202.56 port 36892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:05 oleg256-client systemd[1]: Started Session 55 of user root. Oct 10 15:48:05 oleg256-client systemd-logind[1023]: New session 55 of user root. Oct 10 15:48:05 oleg256-client sshd[15730]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:05 oleg256-client sshd[15743]: Received disconnect from 192.168.202.56 port 36892:11: disconnected by user Oct 10 15:48:05 oleg256-client sshd[15743]: Disconnected from user root 192.168.202.56 port 36892 Oct 10 15:48:05 oleg256-client sshd[15730]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:06 oleg256-client systemd[1]: session-55.scope: Succeeded. Oct 10 15:48:06 oleg256-client systemd-logind[1023]: Session 55 logged out. Waiting for processes to exit. Oct 10 15:48:06 oleg256-client systemd-logind[1023]: Removed session 55. Oct 10 15:48:06 oleg256-client sshd[15867]: Accepted publickey for root from 192.168.202.56 port 36900 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:06 oleg256-client systemd-logind[1023]: New session 56 of user root. Oct 10 15:48:06 oleg256-client systemd[1]: Started Session 56 of user root. Oct 10 15:48:06 oleg256-client sshd[15867]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:06 oleg256-client sshd[15881]: Received disconnect from 192.168.202.56 port 36900:11: disconnected by user Oct 10 15:48:06 oleg256-client sshd[15881]: Disconnected from user root 192.168.202.56 port 36900 Oct 10 15:48:06 oleg256-client sshd[15867]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:07 oleg256-client systemd[1]: session-56.scope: Succeeded. Oct 10 15:48:07 oleg256-client systemd-logind[1023]: Session 56 logged out. Waiting for processes to exit. Oct 10 15:48:07 oleg256-client systemd-logind[1023]: Removed session 56. Oct 10 15:48:07 oleg256-client sshd[16012]: Accepted publickey for root from 192.168.202.56 port 36902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:07 oleg256-client systemd[1]: Started Session 57 of user root. Oct 10 15:48:07 oleg256-client systemd-logind[1023]: New session 57 of user root. Oct 10 15:48:07 oleg256-client sshd[16012]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:08 oleg256-client sshd[16025]: Received disconnect from 192.168.202.56 port 36902:11: disconnected by user Oct 10 15:48:08 oleg256-client sshd[16025]: Disconnected from user root 192.168.202.56 port 36902 Oct 10 15:48:08 oleg256-client sshd[16012]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:08 oleg256-client systemd-logind[1023]: Session 57 logged out. Waiting for processes to exit. Oct 10 15:48:08 oleg256-client systemd[1]: session-57.scope: Succeeded. Oct 10 15:48:08 oleg256-client systemd-logind[1023]: Removed session 57. Oct 10 15:48:09 oleg256-client sshd[16165]: Accepted publickey for root from 192.168.202.56 port 36912 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:09 oleg256-client systemd-logind[1023]: New session 58 of user root. Oct 10 15:48:09 oleg256-client systemd[1]: Started Session 58 of user root. Oct 10 15:48:09 oleg256-client sshd[16165]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:09 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 11: Delete all secondary nids from peer (o2ib) ========================================================== 15:48:08 (1760125688) Oct 10 15:48:09 oleg256-client sshd[16178]: Received disconnect from 192.168.202.56 port 36912:11: disconnected by user Oct 10 15:48:09 oleg256-client sshd[16178]: Disconnected from user root 192.168.202.56 port 36912 Oct 10 15:48:09 oleg256-client sshd[16165]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:09 oleg256-client systemd[1]: session-58.scope: Succeeded. Oct 10 15:48:09 oleg256-client systemd-logind[1023]: Session 58 logged out. Waiting for processes to exit. Oct 10 15:48:09 oleg256-client systemd-logind[1023]: Removed session 58. Oct 10 15:48:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 11.11.11.11@tcp --nid 11.11.11.[13-17]@tcp Oct 10 15:48:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 11.11.11.11@tcp --nid 11.11.11.[13-17]@tcp Oct 10 15:48:10 oleg256-client sshd[16316]: Accepted publickey for root from 192.168.202.56 port 36924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:10 oleg256-client systemd-logind[1023]: New session 59 of user root. Oct 10 15:48:10 oleg256-client systemd[1]: Started Session 59 of user root. Oct 10 15:48:10 oleg256-client sshd[16316]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:10 oleg256-client sshd[16329]: Received disconnect from 192.168.202.56 port 36924:11: disconnected by user Oct 10 15:48:10 oleg256-client sshd[16329]: Disconnected from user root 192.168.202.56 port 36924 Oct 10 15:48:11 oleg256-client sshd[16316]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:11 oleg256-client systemd[1]: session-59.scope: Succeeded. Oct 10 15:48:11 oleg256-client systemd-logind[1023]: Session 59 logged out. Waiting for processes to exit. Oct 10 15:48:11 oleg256-client systemd-logind[1023]: Removed session 59. Oct 10 15:48:11 oleg256-client sshd[16453]: Accepted publickey for root from 192.168.202.56 port 36932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:11 oleg256-client systemd[1]: Started Session 60 of user root. Oct 10 15:48:11 oleg256-client systemd-logind[1023]: New session 60 of user root. Oct 10 15:48:11 oleg256-client sshd[16453]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:12 oleg256-client sshd[16467]: Received disconnect from 192.168.202.56 port 36932:11: disconnected by user Oct 10 15:48:12 oleg256-client sshd[16467]: Disconnected from user root 192.168.202.56 port 36932 Oct 10 15:48:12 oleg256-client sshd[16453]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:12 oleg256-client systemd[1]: session-60.scope: Succeeded. Oct 10 15:48:12 oleg256-client systemd-logind[1023]: Session 60 logged out. Waiting for processes to exit. Oct 10 15:48:12 oleg256-client systemd-logind[1023]: Removed session 60. Oct 10 15:48:13 oleg256-client sshd[16598]: Accepted publickey for root from 192.168.202.56 port 36936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:13 oleg256-client systemd[1]: Started Session 61 of user root. Oct 10 15:48:13 oleg256-client systemd-logind[1023]: New session 61 of user root. Oct 10 15:48:13 oleg256-client sshd[16598]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:13 oleg256-client sshd[16611]: Received disconnect from 192.168.202.56 port 36936:11: disconnected by user Oct 10 15:48:13 oleg256-client sshd[16611]: Disconnected from user root 192.168.202.56 port 36936 Oct 10 15:48:13 oleg256-client sshd[16598]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:13 oleg256-client systemd[1]: session-61.scope: Succeeded. Oct 10 15:48:13 oleg256-client systemd-logind[1023]: Session 61 logged out. Waiting for processes to exit. Oct 10 15:48:13 oleg256-client systemd-logind[1023]: Removed session 61. Oct 10 15:48:14 oleg256-client sshd[16751]: Accepted publickey for root from 192.168.202.56 port 54386 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:14 oleg256-client systemd-logind[1023]: New session 62 of user root. Oct 10 15:48:14 oleg256-client systemd[1]: Started Session 62 of user root. Oct 10 15:48:14 oleg256-client sshd[16751]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:14 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 12: Delete a secondary nid from peer (tcp and o2ib) ========================================================== 15:48:13 (1760125693) Oct 10 15:48:14 oleg256-client sshd[16764]: Received disconnect from 192.168.202.56 port 54386:11: disconnected by user Oct 10 15:48:14 oleg256-client sshd[16764]: Disconnected from user root 192.168.202.56 port 54386 Oct 10 15:48:14 oleg256-client sshd[16751]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:14 oleg256-client systemd[1]: session-62.scope: Succeeded. Oct 10 15:48:14 oleg256-client systemd-logind[1023]: Session 62 logged out. Waiting for processes to exit. Oct 10 15:48:14 oleg256-client systemd-logind[1023]: Removed session 62. Oct 10 15:48:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 12.12.12.12@o2ib --nid [13-14/1].[13-15/2].13.13@o2ib,[15-16/3].[17-19/4].[1].[5-20/5]@tcp Oct 10 15:48:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 12.12.12.12@o2ib --nid 13.15.13.13@o2ib,15.17.1.15@tcp Oct 10 15:48:15 oleg256-client sshd[16902]: Accepted publickey for root from 192.168.202.56 port 54394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:15 oleg256-client systemd-logind[1023]: New session 63 of user root. Oct 10 15:48:15 oleg256-client systemd[1]: Started Session 63 of user root. Oct 10 15:48:15 oleg256-client sshd[16902]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:16 oleg256-client sshd[16915]: Received disconnect from 192.168.202.56 port 54394:11: disconnected by user Oct 10 15:48:16 oleg256-client sshd[16915]: Disconnected from user root 192.168.202.56 port 54394 Oct 10 15:48:16 oleg256-client sshd[16902]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:16 oleg256-client systemd-logind[1023]: Session 63 logged out. Waiting for processes to exit. Oct 10 15:48:16 oleg256-client systemd[1]: session-63.scope: Succeeded. Oct 10 15:48:16 oleg256-client systemd-logind[1023]: Removed session 63. Oct 10 15:48:16 oleg256-client sshd[17039]: Accepted publickey for root from 192.168.202.56 port 54400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:16 oleg256-client systemd[1]: Started Session 64 of user root. Oct 10 15:48:16 oleg256-client systemd-logind[1023]: New session 64 of user root. Oct 10 15:48:16 oleg256-client sshd[17039]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:17 oleg256-client sshd[17053]: Received disconnect from 192.168.202.56 port 54400:11: disconnected by user Oct 10 15:48:17 oleg256-client sshd[17053]: Disconnected from user root 192.168.202.56 port 54400 Oct 10 15:48:17 oleg256-client sshd[17039]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:17 oleg256-client systemd[1]: session-64.scope: Succeeded. Oct 10 15:48:17 oleg256-client systemd-logind[1023]: Session 64 logged out. Waiting for processes to exit. Oct 10 15:48:17 oleg256-client systemd-logind[1023]: Removed session 64. Oct 10 15:48:17 oleg256-client sshd[17184]: Accepted publickey for root from 192.168.202.56 port 54404 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:18 oleg256-client systemd-logind[1023]: New session 65 of user root. Oct 10 15:48:18 oleg256-client systemd[1]: Started Session 65 of user root. Oct 10 15:48:18 oleg256-client sshd[17184]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:18 oleg256-client sshd[17197]: Received disconnect from 192.168.202.56 port 54404:11: disconnected by user Oct 10 15:48:18 oleg256-client sshd[17197]: Disconnected from user root 192.168.202.56 port 54404 Oct 10 15:48:18 oleg256-client sshd[17184]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:18 oleg256-client systemd[1]: session-65.scope: Succeeded. Oct 10 15:48:18 oleg256-client systemd-logind[1023]: Session 65 logged out. Waiting for processes to exit. Oct 10 15:48:18 oleg256-client systemd-logind[1023]: Removed session 65. Oct 10 15:48:19 oleg256-client sshd[17337]: Accepted publickey for root from 192.168.202.56 port 54406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:19 oleg256-client systemd-logind[1023]: New session 66 of user root. Oct 10 15:48:19 oleg256-client systemd[1]: Started Session 66 of user root. Oct 10 15:48:19 oleg256-client sshd[17337]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:19 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 13: Delete all secondary nids from peer (tcp and o2ib) ========================================================== 15:48:18 (1760125698) Oct 10 15:48:19 oleg256-client sshd[17350]: Received disconnect from 192.168.202.56 port 54406:11: disconnected by user Oct 10 15:48:19 oleg256-client sshd[17350]: Disconnected from user root 192.168.202.56 port 54406 Oct 10 15:48:19 oleg256-client sshd[17337]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:19 oleg256-client systemd[1]: session-66.scope: Succeeded. Oct 10 15:48:19 oleg256-client systemd-logind[1023]: Session 66 logged out. Waiting for processes to exit. Oct 10 15:48:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:19 oleg256-client systemd-logind[1023]: Removed session 66. Oct 10 15:48:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 13.13.13.13@o2ib --nid [14-15].[1-2/1].[1].[100-254/10]@tcp,14.14.[254].14@o2ib Oct 10 15:48:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 13.13.13.13@o2ib --nid [14-15].[1-2/1].[1].[100-254/10]@tcp,14.14.[254].14@o2ib Oct 10 15:48:20 oleg256-client sshd[17488]: Accepted publickey for root from 192.168.202.56 port 54418 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:20 oleg256-client systemd-logind[1023]: New session 67 of user root. Oct 10 15:48:20 oleg256-client systemd[1]: Started Session 67 of user root. Oct 10 15:48:20 oleg256-client sshd[17488]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:21 oleg256-client sshd[17501]: Received disconnect from 192.168.202.56 port 54418:11: disconnected by user Oct 10 15:48:21 oleg256-client sshd[17501]: Disconnected from user root 192.168.202.56 port 54418 Oct 10 15:48:21 oleg256-client sshd[17488]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:21 oleg256-client systemd[1]: session-67.scope: Succeeded. Oct 10 15:48:21 oleg256-client systemd-logind[1023]: Session 67 logged out. Waiting for processes to exit. Oct 10 15:48:21 oleg256-client systemd-logind[1023]: Removed session 67. Oct 10 15:48:21 oleg256-client sshd[17625]: Accepted publickey for root from 192.168.202.56 port 54422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:21 oleg256-client systemd-logind[1023]: New session 68 of user root. Oct 10 15:48:21 oleg256-client systemd[1]: Started Session 68 of user root. Oct 10 15:48:21 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:48:21 oleg256-client sshd[17625]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:21 oleg256-client sshd[17639]: Received disconnect from 192.168.202.56 port 54422:11: disconnected by user Oct 10 15:48:21 oleg256-client sshd[17639]: Disconnected from user root 192.168.202.56 port 54422 Oct 10 15:48:22 oleg256-client sshd[17625]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:22 oleg256-client systemd[1]: session-68.scope: Succeeded. Oct 10 15:48:22 oleg256-client systemd-logind[1023]: Session 68 logged out. Waiting for processes to exit. Oct 10 15:48:22 oleg256-client systemd-logind[1023]: Removed session 68. Oct 10 15:48:22 oleg256-client sshd[17771]: Accepted publickey for root from 192.168.202.56 port 54426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:22 oleg256-client systemd[1]: Started Session 69 of user root. Oct 10 15:48:22 oleg256-client systemd-logind[1023]: New session 69 of user root. Oct 10 15:48:22 oleg256-client sshd[17771]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:23 oleg256-client sshd[17784]: Received disconnect from 192.168.202.56 port 54426:11: disconnected by user Oct 10 15:48:23 oleg256-client sshd[17784]: Disconnected from user root 192.168.202.56 port 54426 Oct 10 15:48:23 oleg256-client sshd[17771]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:23 oleg256-client systemd[1]: session-69.scope: Succeeded. Oct 10 15:48:23 oleg256-client systemd-logind[1023]: Session 69 logged out. Waiting for processes to exit. Oct 10 15:48:23 oleg256-client systemd-logind[1023]: Removed session 69. Oct 10 15:48:24 oleg256-client sshd[17924]: Accepted publickey for root from 192.168.202.56 port 38234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:24 oleg256-client systemd-logind[1023]: New session 70 of user root. Oct 10 15:48:24 oleg256-client systemd[1]: Started Session 70 of user root. Oct 10 15:48:24 oleg256-client sshd[17924]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:24 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 14: import peer create/delete with single nid ========================================================== 15:48:23 (1760125703) Oct 10 15:48:24 oleg256-client sshd[17937]: Received disconnect from 192.168.202.56 port 38234:11: disconnected by user Oct 10 15:48:24 oleg256-client sshd[17937]: Disconnected from user root 192.168.202.56 port 38234 Oct 10 15:48:24 oleg256-client sshd[17924]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:24 oleg256-client systemd[1]: session-70.scope: Succeeded. Oct 10 15:48:24 oleg256-client systemd-logind[1023]: Session 70 logged out. Waiting for processes to exit. Oct 10 15:48:24 oleg256-client systemd-logind[1023]: Removed session 70. Oct 10 15:48:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:48:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del Oct 10 15:48:26 oleg256-client sshd[18084]: Accepted publickey for root from 192.168.202.56 port 38236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:26 oleg256-client systemd-logind[1023]: New session 71 of user root. Oct 10 15:48:26 oleg256-client systemd[1]: Started Session 71 of user root. Oct 10 15:48:26 oleg256-client sshd[18084]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:26 oleg256-client sshd[18097]: Received disconnect from 192.168.202.56 port 38236:11: disconnected by user Oct 10 15:48:26 oleg256-client sshd[18097]: Disconnected from user root 192.168.202.56 port 38236 Oct 10 15:48:26 oleg256-client sshd[18084]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:26 oleg256-client systemd[1]: session-71.scope: Succeeded. Oct 10 15:48:26 oleg256-client systemd-logind[1023]: Session 71 logged out. Waiting for processes to exit. Oct 10 15:48:26 oleg256-client systemd-logind[1023]: Removed session 71. Oct 10 15:48:27 oleg256-client sshd[18221]: Accepted publickey for root from 192.168.202.56 port 38238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:27 oleg256-client systemd[1]: Started Session 72 of user root. Oct 10 15:48:27 oleg256-client systemd-logind[1023]: New session 72 of user root. Oct 10 15:48:27 oleg256-client sshd[18221]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:27 oleg256-client sshd[18235]: Received disconnect from 192.168.202.56 port 38238:11: disconnected by user Oct 10 15:48:27 oleg256-client sshd[18235]: Disconnected from user root 192.168.202.56 port 38238 Oct 10 15:48:27 oleg256-client sshd[18221]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:27 oleg256-client systemd[1]: session-72.scope: Succeeded. Oct 10 15:48:27 oleg256-client systemd-logind[1023]: Session 72 logged out. Waiting for processes to exit. Oct 10 15:48:27 oleg256-client systemd-logind[1023]: Removed session 72. Oct 10 15:48:28 oleg256-client sshd[18366]: Accepted publickey for root from 192.168.202.56 port 38254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:28 oleg256-client systemd-logind[1023]: New session 73 of user root. Oct 10 15:48:28 oleg256-client systemd[1]: Started Session 73 of user root. Oct 10 15:48:28 oleg256-client sshd[18366]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:28 oleg256-client sshd[18379]: Received disconnect from 192.168.202.56 port 38254:11: disconnected by user Oct 10 15:48:28 oleg256-client sshd[18379]: Disconnected from user root 192.168.202.56 port 38254 Oct 10 15:48:28 oleg256-client sshd[18366]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:28 oleg256-client systemd[1]: session-73.scope: Succeeded. Oct 10 15:48:28 oleg256-client systemd-logind[1023]: Session 73 logged out. Waiting for processes to exit. Oct 10 15:48:28 oleg256-client systemd-logind[1023]: Removed session 73. Oct 10 15:48:29 oleg256-client sshd[18519]: Accepted publickey for root from 192.168.202.56 port 38258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:29 oleg256-client systemd-logind[1023]: New session 74 of user root. Oct 10 15:48:29 oleg256-client systemd[1]: Started Session 74 of user root. Oct 10 15:48:29 oleg256-client sshd[18519]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:29 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 15: import multi peer create/delete with single nid per peer ========================================================== 15:48:28 (1760125708) Oct 10 15:48:29 oleg256-client sshd[18532]: Received disconnect from 192.168.202.56 port 38258:11: disconnected by user Oct 10 15:48:29 oleg256-client sshd[18532]: Disconnected from user root 192.168.202.56 port 38258 Oct 10 15:48:29 oleg256-client sshd[18519]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:29 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:29 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:30 oleg256-client systemd-logind[1023]: Session 74 logged out. Waiting for processes to exit. Oct 10 15:48:30 oleg256-client systemd[1]: session-74.scope: Succeeded. Oct 10 15:48:30 oleg256-client systemd-logind[1023]: Removed session 74. Oct 10 15:48:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:48:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del Oct 10 15:48:31 oleg256-client sshd[18704]: Accepted publickey for root from 192.168.202.56 port 38262 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:31 oleg256-client systemd-logind[1023]: New session 75 of user root. Oct 10 15:48:31 oleg256-client systemd[1]: Started Session 75 of user root. Oct 10 15:48:31 oleg256-client sshd[18704]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:31 oleg256-client sshd[18717]: Received disconnect from 192.168.202.56 port 38262:11: disconnected by user Oct 10 15:48:31 oleg256-client sshd[18717]: Disconnected from user root 192.168.202.56 port 38262 Oct 10 15:48:31 oleg256-client sshd[18704]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:31 oleg256-client systemd[1]: session-75.scope: Succeeded. Oct 10 15:48:31 oleg256-client systemd-logind[1023]: Session 75 logged out. Waiting for processes to exit. Oct 10 15:48:31 oleg256-client systemd-logind[1023]: Removed session 75. Oct 10 15:48:32 oleg256-client sshd[18841]: Accepted publickey for root from 192.168.202.56 port 38274 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:32 oleg256-client systemd-logind[1023]: New session 76 of user root. Oct 10 15:48:32 oleg256-client systemd[1]: Started Session 76 of user root. Oct 10 15:48:32 oleg256-client sshd[18841]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:32 oleg256-client sshd[18855]: Received disconnect from 192.168.202.56 port 38274:11: disconnected by user Oct 10 15:48:32 oleg256-client sshd[18855]: Disconnected from user root 192.168.202.56 port 38274 Oct 10 15:48:32 oleg256-client sshd[18841]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:32 oleg256-client systemd[1]: session-76.scope: Succeeded. Oct 10 15:48:32 oleg256-client systemd-logind[1023]: Session 76 logged out. Waiting for processes to exit. Oct 10 15:48:32 oleg256-client systemd-logind[1023]: Removed session 76. Oct 10 15:48:33 oleg256-client sshd[18986]: Accepted publickey for root from 192.168.202.56 port 38282 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:33 oleg256-client systemd-logind[1023]: New session 77 of user root. Oct 10 15:48:33 oleg256-client systemd[1]: Started Session 77 of user root. Oct 10 15:48:33 oleg256-client sshd[18986]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:33 oleg256-client sshd[18999]: Received disconnect from 192.168.202.56 port 38282:11: disconnected by user Oct 10 15:48:33 oleg256-client sshd[18999]: Disconnected from user root 192.168.202.56 port 38282 Oct 10 15:48:33 oleg256-client sshd[18986]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:33 oleg256-client systemd[1]: session-77.scope: Succeeded. Oct 10 15:48:33 oleg256-client systemd-logind[1023]: Session 77 logged out. Waiting for processes to exit. Oct 10 15:48:33 oleg256-client systemd-logind[1023]: Removed session 77. Oct 10 15:48:34 oleg256-client sshd[19139]: Accepted publickey for root from 192.168.202.56 port 55038 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:34 oleg256-client systemd-logind[1023]: New session 78 of user root. Oct 10 15:48:34 oleg256-client systemd[1]: Started Session 78 of user root. Oct 10 15:48:34 oleg256-client sshd[19139]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:34 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 16: import peer create/delete with multiple nids ========================================================== 15:48:33 (1760125713) Oct 10 15:48:34 oleg256-client sshd[19152]: Received disconnect from 192.168.202.56 port 55038:11: disconnected by user Oct 10 15:48:34 oleg256-client sshd[19152]: Disconnected from user root 192.168.202.56 port 55038 Oct 10 15:48:34 oleg256-client sshd[19139]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:34 oleg256-client kernel: LNet: 19184:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:48:34 oleg256-client kernel: LNet: 19184:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 6 previous similar messages Oct 10 15:48:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:34 oleg256-client systemd-logind[1023]: Session 78 logged out. Waiting for processes to exit. Oct 10 15:48:34 oleg256-client systemd[1]: session-78.scope: Succeeded. Oct 10 15:48:34 oleg256-client systemd-logind[1023]: Removed session 78. Oct 10 15:48:35 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:48:35 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del Oct 10 15:48:36 oleg256-client sshd[19317]: Accepted publickey for root from 192.168.202.56 port 55042 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:36 oleg256-client systemd[1]: Started Session 79 of user root. Oct 10 15:48:36 oleg256-client systemd-logind[1023]: New session 79 of user root. Oct 10 15:48:36 oleg256-client sshd[19317]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:36 oleg256-client sshd[19330]: Received disconnect from 192.168.202.56 port 55042:11: disconnected by user Oct 10 15:48:36 oleg256-client sshd[19330]: Disconnected from user root 192.168.202.56 port 55042 Oct 10 15:48:36 oleg256-client sshd[19317]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:36 oleg256-client systemd[1]: session-79.scope: Succeeded. Oct 10 15:48:36 oleg256-client systemd-logind[1023]: Session 79 logged out. Waiting for processes to exit. Oct 10 15:48:36 oleg256-client systemd-logind[1023]: Removed session 79. Oct 10 15:48:37 oleg256-client sshd[19454]: Accepted publickey for root from 192.168.202.56 port 55050 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:37 oleg256-client systemd-logind[1023]: New session 80 of user root. Oct 10 15:48:37 oleg256-client systemd[1]: Started Session 80 of user root. Oct 10 15:48:37 oleg256-client sshd[19454]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:37 oleg256-client sshd[19467]: Received disconnect from 192.168.202.56 port 55050:11: disconnected by user Oct 10 15:48:37 oleg256-client sshd[19467]: Disconnected from user root 192.168.202.56 port 55050 Oct 10 15:48:37 oleg256-client sshd[19454]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:37 oleg256-client systemd[1]: session-80.scope: Succeeded. Oct 10 15:48:37 oleg256-client systemd-logind[1023]: Session 80 logged out. Waiting for processes to exit. Oct 10 15:48:37 oleg256-client systemd-logind[1023]: Removed session 80. Oct 10 15:48:38 oleg256-client sshd[19599]: Accepted publickey for root from 192.168.202.56 port 55052 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:38 oleg256-client systemd-logind[1023]: New session 81 of user root. Oct 10 15:48:38 oleg256-client systemd[1]: Started Session 81 of user root. Oct 10 15:48:38 oleg256-client sshd[19599]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:38 oleg256-client sshd[19612]: Received disconnect from 192.168.202.56 port 55052:11: disconnected by user Oct 10 15:48:38 oleg256-client sshd[19612]: Disconnected from user root 192.168.202.56 port 55052 Oct 10 15:48:38 oleg256-client sshd[19599]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:38 oleg256-client systemd-logind[1023]: Session 81 logged out. Waiting for processes to exit. Oct 10 15:48:38 oleg256-client systemd[1]: session-81.scope: Succeeded. Oct 10 15:48:38 oleg256-client systemd-logind[1023]: Removed session 81. Oct 10 15:48:39 oleg256-client sshd[19752]: Accepted publickey for root from 192.168.202.56 port 55068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:39 oleg256-client systemd[1]: Started Session 82 of user root. Oct 10 15:48:39 oleg256-client systemd-logind[1023]: New session 82 of user root. Oct 10 15:48:39 oleg256-client sshd[19752]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:39 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 17: import multi peer create/delete with multiple nids ========================================================== 15:48:38 (1760125718) Oct 10 15:48:39 oleg256-client sshd[19765]: Received disconnect from 192.168.202.56 port 55068:11: disconnected by user Oct 10 15:48:39 oleg256-client sshd[19765]: Disconnected from user root 192.168.202.56 port 55068 Oct 10 15:48:39 oleg256-client sshd[19752]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:40 oleg256-client systemd[1]: session-82.scope: Succeeded. Oct 10 15:48:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:40 oleg256-client systemd-logind[1023]: Session 82 logged out. Waiting for processes to exit. Oct 10 15:48:40 oleg256-client systemd-logind[1023]: Removed session 82. Oct 10 15:48:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:48:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del Oct 10 15:48:41 oleg256-client sshd[19972]: Accepted publickey for root from 192.168.202.56 port 55084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:41 oleg256-client systemd-logind[1023]: New session 83 of user root. Oct 10 15:48:41 oleg256-client systemd[1]: Started Session 83 of user root. Oct 10 15:48:41 oleg256-client sshd[19972]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:41 oleg256-client sshd[19985]: Received disconnect from 192.168.202.56 port 55084:11: disconnected by user Oct 10 15:48:41 oleg256-client sshd[19985]: Disconnected from user root 192.168.202.56 port 55084 Oct 10 15:48:41 oleg256-client sshd[19972]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:41 oleg256-client systemd-logind[1023]: Session 83 logged out. Waiting for processes to exit. Oct 10 15:48:41 oleg256-client systemd[1]: session-83.scope: Succeeded. Oct 10 15:48:41 oleg256-client systemd-logind[1023]: Removed session 83. Oct 10 15:48:42 oleg256-client sshd[20109]: Accepted publickey for root from 192.168.202.56 port 55088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:42 oleg256-client systemd-logind[1023]: New session 84 of user root. Oct 10 15:48:42 oleg256-client systemd[1]: Started Session 84 of user root. Oct 10 15:48:42 oleg256-client sshd[20109]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:42 oleg256-client sshd[20122]: Received disconnect from 192.168.202.56 port 55088:11: disconnected by user Oct 10 15:48:42 oleg256-client sshd[20122]: Disconnected from user root 192.168.202.56 port 55088 Oct 10 15:48:42 oleg256-client sshd[20109]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:42 oleg256-client systemd-logind[1023]: Session 84 logged out. Waiting for processes to exit. Oct 10 15:48:42 oleg256-client systemd[1]: session-84.scope: Succeeded. Oct 10 15:48:42 oleg256-client systemd-logind[1023]: Removed session 84. Oct 10 15:48:43 oleg256-client sshd[20254]: Accepted publickey for root from 192.168.202.56 port 55104 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:43 oleg256-client systemd-logind[1023]: New session 85 of user root. Oct 10 15:48:43 oleg256-client systemd[1]: Started Session 85 of user root. Oct 10 15:48:43 oleg256-client sshd[20254]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:43 oleg256-client sshd[20267]: Received disconnect from 192.168.202.56 port 55104:11: disconnected by user Oct 10 15:48:43 oleg256-client sshd[20267]: Disconnected from user root 192.168.202.56 port 55104 Oct 10 15:48:43 oleg256-client sshd[20254]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:43 oleg256-client systemd-logind[1023]: Session 85 logged out. Waiting for processes to exit. Oct 10 15:48:43 oleg256-client systemd[1]: session-85.scope: Succeeded. Oct 10 15:48:43 oleg256-client systemd-logind[1023]: Removed session 85. Oct 10 15:48:44 oleg256-client sshd[20407]: Accepted publickey for root from 192.168.202.56 port 55370 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:44 oleg256-client systemd-logind[1023]: New session 86 of user root. Oct 10 15:48:44 oleg256-client systemd[1]: Started Session 86 of user root. Oct 10 15:48:44 oleg256-client sshd[20407]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:44 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 18a: Delete a subset of nids from a single peer using import --del ========================================================== 15:48:43 (1760125723) Oct 10 15:48:44 oleg256-client sshd[20420]: Received disconnect from 192.168.202.56 port 55370:11: disconnected by user Oct 10 15:48:44 oleg256-client sshd[20420]: Disconnected from user root 192.168.202.56 port 55370 Oct 10 15:48:44 oleg256-client sshd[20407]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:44 oleg256-client systemd[1]: session-86.scope: Succeeded. Oct 10 15:48:44 oleg256-client systemd-logind[1023]: Session 86 logged out. Waiting for processes to exit. Oct 10 15:48:44 oleg256-client systemd-logind[1023]: Removed session 86. Oct 10 15:48:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:48:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del Oct 10 15:48:45 oleg256-client sshd[20562]: Accepted publickey for root from 192.168.202.56 port 55384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:45 oleg256-client systemd-logind[1023]: New session 87 of user root. Oct 10 15:48:45 oleg256-client systemd[1]: Started Session 87 of user root. Oct 10 15:48:45 oleg256-client sshd[20562]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:45 oleg256-client sshd[20575]: Received disconnect from 192.168.202.56 port 55384:11: disconnected by user Oct 10 15:48:45 oleg256-client sshd[20575]: Disconnected from user root 192.168.202.56 port 55384 Oct 10 15:48:45 oleg256-client sshd[20562]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:45 oleg256-client systemd[1]: session-87.scope: Succeeded. Oct 10 15:48:45 oleg256-client systemd-logind[1023]: Session 87 logged out. Waiting for processes to exit. Oct 10 15:48:45 oleg256-client systemd-logind[1023]: Removed session 87. Oct 10 15:48:46 oleg256-client sshd[20699]: Accepted publickey for root from 192.168.202.56 port 55400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:46 oleg256-client systemd-logind[1023]: New session 88 of user root. Oct 10 15:48:46 oleg256-client systemd[1]: Started Session 88 of user root. Oct 10 15:48:46 oleg256-client sshd[20699]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:46 oleg256-client sshd[20712]: Received disconnect from 192.168.202.56 port 55400:11: disconnected by user Oct 10 15:48:46 oleg256-client sshd[20712]: Disconnected from user root 192.168.202.56 port 55400 Oct 10 15:48:46 oleg256-client sshd[20699]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:46 oleg256-client systemd[1]: session-88.scope: Succeeded. Oct 10 15:48:46 oleg256-client systemd-logind[1023]: Session 88 logged out. Waiting for processes to exit. Oct 10 15:48:46 oleg256-client systemd-logind[1023]: Removed session 88. Oct 10 15:48:47 oleg256-client sshd[20843]: Accepted publickey for root from 192.168.202.56 port 55408 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:47 oleg256-client systemd-logind[1023]: New session 89 of user root. Oct 10 15:48:47 oleg256-client systemd[1]: Started Session 89 of user root. Oct 10 15:48:47 oleg256-client sshd[20843]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:47 oleg256-client sshd[20856]: Received disconnect from 192.168.202.56 port 55408:11: disconnected by user Oct 10 15:48:47 oleg256-client sshd[20856]: Disconnected from user root 192.168.202.56 port 55408 Oct 10 15:48:47 oleg256-client sshd[20843]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:47 oleg256-client systemd[1]: session-89.scope: Succeeded. Oct 10 15:48:47 oleg256-client systemd-logind[1023]: Session 89 logged out. Waiting for processes to exit. Oct 10 15:48:47 oleg256-client systemd-logind[1023]: Removed session 89. Oct 10 15:48:48 oleg256-client sshd[20997]: Accepted publickey for root from 192.168.202.56 port 55412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:48 oleg256-client systemd-logind[1023]: New session 90 of user root. Oct 10 15:48:48 oleg256-client systemd[1]: Started Session 90 of user root. Oct 10 15:48:48 oleg256-client sshd[20997]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:48 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 18b: Delete multiple nids from multiple peers using import --del ========================================================== 15:48:47 (1760125727) Oct 10 15:48:48 oleg256-client sshd[21010]: Received disconnect from 192.168.202.56 port 55412:11: disconnected by user Oct 10 15:48:48 oleg256-client sshd[21010]: Disconnected from user root 192.168.202.56 port 55412 Oct 10 15:48:48 oleg256-client sshd[20997]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:48 oleg256-client systemd[1]: session-90.scope: Succeeded. Oct 10 15:48:48 oleg256-client systemd-logind[1023]: Session 90 logged out. Waiting for processes to exit. Oct 10 15:48:48 oleg256-client systemd-logind[1023]: Removed session 90. Oct 10 15:48:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:48:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import --del Oct 10 15:48:49 oleg256-client sshd[21170]: Accepted publickey for root from 192.168.202.56 port 55426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:49 oleg256-client systemd-logind[1023]: New session 91 of user root. Oct 10 15:48:49 oleg256-client systemd[1]: Started Session 91 of user root. Oct 10 15:48:49 oleg256-client sshd[21170]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:50 oleg256-client sshd[21183]: Received disconnect from 192.168.202.56 port 55426:11: disconnected by user Oct 10 15:48:50 oleg256-client sshd[21183]: Disconnected from user root 192.168.202.56 port 55426 Oct 10 15:48:50 oleg256-client sshd[21170]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:50 oleg256-client systemd[1]: session-91.scope: Succeeded. Oct 10 15:48:50 oleg256-client systemd-logind[1023]: Session 91 logged out. Waiting for processes to exit. Oct 10 15:48:50 oleg256-client systemd-logind[1023]: Removed session 91. Oct 10 15:48:50 oleg256-client sshd[21307]: Accepted publickey for root from 192.168.202.56 port 55434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:50 oleg256-client systemd-logind[1023]: New session 92 of user root. Oct 10 15:48:50 oleg256-client systemd[1]: Started Session 92 of user root. Oct 10 15:48:50 oleg256-client sshd[21307]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:50 oleg256-client sshd[21320]: Received disconnect from 192.168.202.56 port 55434:11: disconnected by user Oct 10 15:48:50 oleg256-client sshd[21320]: Disconnected from user root 192.168.202.56 port 55434 Oct 10 15:48:50 oleg256-client sshd[21307]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:51 oleg256-client systemd[1]: session-92.scope: Succeeded. Oct 10 15:48:51 oleg256-client systemd-logind[1023]: Session 92 logged out. Waiting for processes to exit. Oct 10 15:48:51 oleg256-client systemd-logind[1023]: Removed session 92. Oct 10 15:48:51 oleg256-client sshd[21452]: Accepted publickey for root from 192.168.202.56 port 55448 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:51 oleg256-client systemd[1]: Started Session 93 of user root. Oct 10 15:48:51 oleg256-client sshd[21452]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:51 oleg256-client systemd-logind[1023]: New session 93 of user root. Oct 10 15:48:51 oleg256-client sshd[21465]: Received disconnect from 192.168.202.56 port 55448:11: disconnected by user Oct 10 15:48:51 oleg256-client sshd[21465]: Disconnected from user root 192.168.202.56 port 55448 Oct 10 15:48:51 oleg256-client sshd[21452]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:52 oleg256-client systemd[1]: session-93.scope: Succeeded. Oct 10 15:48:52 oleg256-client systemd-logind[1023]: Session 93 logged out. Waiting for processes to exit. Oct 10 15:48:52 oleg256-client systemd-logind[1023]: Removed session 93. Oct 10 15:48:52 oleg256-client sshd[21605]: Accepted publickey for root from 192.168.202.56 port 55460 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:52 oleg256-client systemd-logind[1023]: New session 94 of user root. Oct 10 15:48:52 oleg256-client systemd[1]: Started Session 94 of user root. Oct 10 15:48:52 oleg256-client sshd[21605]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:53 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 19: Add peer with single nid (gni) === 15:48:52 (1760125732) Oct 10 15:48:53 oleg256-client sshd[21618]: Received disconnect from 192.168.202.56 port 55460:11: disconnected by user Oct 10 15:48:53 oleg256-client sshd[21618]: Disconnected from user root 192.168.202.56 port 55460 Oct 10 15:48:53 oleg256-client sshd[21605]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:53 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:53 oleg256-client systemd-logind[1023]: Session 94 logged out. Waiting for processes to exit. Oct 10 15:48:53 oleg256-client systemd[1]: session-94.scope: Succeeded. Oct 10 15:48:53 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:53 oleg256-client systemd-logind[1023]: Removed session 94. Oct 10 15:48:53 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 19@gni Oct 10 15:48:54 oleg256-client sshd[21754]: Accepted publickey for root from 192.168.202.56 port 37024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:54 oleg256-client systemd[1]: Started Session 95 of user root. Oct 10 15:48:54 oleg256-client systemd-logind[1023]: New session 95 of user root. Oct 10 15:48:54 oleg256-client sshd[21754]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:54 oleg256-client sshd[21767]: Received disconnect from 192.168.202.56 port 37024:11: disconnected by user Oct 10 15:48:54 oleg256-client sshd[21767]: Disconnected from user root 192.168.202.56 port 37024 Oct 10 15:48:54 oleg256-client sshd[21754]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:54 oleg256-client systemd[1]: session-95.scope: Succeeded. Oct 10 15:48:54 oleg256-client systemd-logind[1023]: Session 95 logged out. Waiting for processes to exit. Oct 10 15:48:54 oleg256-client systemd-logind[1023]: Removed session 95. Oct 10 15:48:55 oleg256-client sshd[21892]: Accepted publickey for root from 192.168.202.56 port 37036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:55 oleg256-client systemd-logind[1023]: New session 96 of user root. Oct 10 15:48:55 oleg256-client systemd[1]: Started Session 96 of user root. Oct 10 15:48:55 oleg256-client sshd[21892]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:55 oleg256-client sshd[21905]: Received disconnect from 192.168.202.56 port 37036:11: disconnected by user Oct 10 15:48:55 oleg256-client sshd[21905]: Disconnected from user root 192.168.202.56 port 37036 Oct 10 15:48:55 oleg256-client sshd[21892]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:55 oleg256-client systemd[1]: session-96.scope: Succeeded. Oct 10 15:48:55 oleg256-client systemd-logind[1023]: Session 96 logged out. Waiting for processes to exit. Oct 10 15:48:55 oleg256-client systemd-logind[1023]: Removed session 96. Oct 10 15:48:55 oleg256-client sshd[22036]: Accepted publickey for root from 192.168.202.56 port 37048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:56 oleg256-client systemd-logind[1023]: New session 97 of user root. Oct 10 15:48:56 oleg256-client systemd[1]: Started Session 97 of user root. Oct 10 15:48:56 oleg256-client sshd[22036]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:56 oleg256-client sshd[22049]: Received disconnect from 192.168.202.56 port 37048:11: disconnected by user Oct 10 15:48:56 oleg256-client sshd[22049]: Disconnected from user root 192.168.202.56 port 37048 Oct 10 15:48:56 oleg256-client sshd[22036]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:56 oleg256-client systemd[1]: session-97.scope: Succeeded. Oct 10 15:48:56 oleg256-client systemd-logind[1023]: Session 97 logged out. Waiting for processes to exit. Oct 10 15:48:56 oleg256-client systemd-logind[1023]: Removed session 97. Oct 10 15:48:57 oleg256-client sshd[22189]: Accepted publickey for root from 192.168.202.56 port 37060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:57 oleg256-client systemd-logind[1023]: New session 98 of user root. Oct 10 15:48:57 oleg256-client systemd[1]: Started Session 98 of user root. Oct 10 15:48:57 oleg256-client sshd[22189]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:57 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 20: Add peer with gni primary and tcp, o2ib secondary ========================================================== 15:48:56 (1760125736) Oct 10 15:48:57 oleg256-client sshd[22202]: Received disconnect from 192.168.202.56 port 37060:11: disconnected by user Oct 10 15:48:57 oleg256-client sshd[22202]: Disconnected from user root 192.168.202.56 port 37060 Oct 10 15:48:57 oleg256-client sshd[22189]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:57 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:48:57 oleg256-client systemd[1]: session-98.scope: Succeeded. Oct 10 15:48:57 oleg256-client systemd-logind[1023]: Session 98 logged out. Waiting for processes to exit. Oct 10 15:48:57 oleg256-client systemd-logind[1023]: Removed session 98. Oct 10 15:48:57 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:48:57 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 20@gni --nid 20.20.20.20@tcp,20.20.20.20@o2ib Oct 10 15:48:58 oleg256-client sshd[22338]: Accepted publickey for root from 192.168.202.56 port 37066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:58 oleg256-client systemd[1]: Started Session 99 of user root. Oct 10 15:48:58 oleg256-client systemd-logind[1023]: New session 99 of user root. Oct 10 15:48:58 oleg256-client sshd[22338]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:58 oleg256-client sshd[22351]: Received disconnect from 192.168.202.56 port 37066:11: disconnected by user Oct 10 15:48:58 oleg256-client sshd[22351]: Disconnected from user root 192.168.202.56 port 37066 Oct 10 15:48:58 oleg256-client sshd[22338]: pam_unix(sshd:session): session closed for user root Oct 10 15:48:58 oleg256-client systemd[1]: session-99.scope: Succeeded. Oct 10 15:48:58 oleg256-client systemd-logind[1023]: Session 99 logged out. Waiting for processes to exit. Oct 10 15:48:58 oleg256-client systemd-logind[1023]: Removed session 99. Oct 10 15:48:59 oleg256-client sshd[22475]: Accepted publickey for root from 192.168.202.56 port 37078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:48:59 oleg256-client systemd-logind[1023]: New session 100 of user root. Oct 10 15:48:59 oleg256-client systemd[1]: Started Session 100 of user root. Oct 10 15:48:59 oleg256-client sshd[22475]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:48:59 oleg256-client sshd[22488]: Received disconnect from 192.168.202.56 port 37078:11: disconnected by user Oct 10 15:48:59 oleg256-client sshd[22488]: Disconnected from user root 192.168.202.56 port 37078 Oct 10 15:48:59 oleg256-client sshd[22475]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:00 oleg256-client systemd[1]: session-100.scope: Succeeded. Oct 10 15:49:00 oleg256-client systemd-logind[1023]: Session 100 logged out. Waiting for processes to exit. Oct 10 15:49:00 oleg256-client systemd-logind[1023]: Removed session 100. Oct 10 15:49:00 oleg256-client sshd[22620]: Accepted publickey for root from 192.168.202.56 port 37080 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:00 oleg256-client systemd-logind[1023]: New session 101 of user root. Oct 10 15:49:00 oleg256-client systemd[1]: Started Session 101 of user root. Oct 10 15:49:00 oleg256-client sshd[22620]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:00 oleg256-client sshd[22633]: Received disconnect from 192.168.202.56 port 37080:11: disconnected by user Oct 10 15:49:00 oleg256-client sshd[22633]: Disconnected from user root 192.168.202.56 port 37080 Oct 10 15:49:00 oleg256-client sshd[22620]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:00 oleg256-client systemd[1]: session-101.scope: Succeeded. Oct 10 15:49:00 oleg256-client systemd-logind[1023]: Session 101 logged out. Waiting for processes to exit. Oct 10 15:49:01 oleg256-client systemd-logind[1023]: Removed session 101. Oct 10 15:49:01 oleg256-client sshd[22773]: Accepted publickey for root from 192.168.202.56 port 37090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:01 oleg256-client systemd-logind[1023]: New session 102 of user root. Oct 10 15:49:01 oleg256-client systemd[1]: Started Session 102 of user root. Oct 10 15:49:01 oleg256-client sshd[22773]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:02 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 21: Add peer with nidrange (gni) ===== 15:49:01 (1760125741) Oct 10 15:49:02 oleg256-client sshd[22786]: Received disconnect from 192.168.202.56 port 37090:11: disconnected by user Oct 10 15:49:02 oleg256-client sshd[22786]: Disconnected from user root 192.168.202.56 port 37090 Oct 10 15:49:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:02 oleg256-client sshd[22773]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:02 oleg256-client systemd[1]: session-102.scope: Succeeded. Oct 10 15:49:02 oleg256-client systemd-logind[1023]: Session 102 logged out. Waiting for processes to exit. Oct 10 15:49:02 oleg256-client systemd-logind[1023]: Removed session 102. Oct 10 15:49:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 21@gni --nid [22-25]@gni Oct 10 15:49:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 21@gni --nid [21-25]@gni Oct 10 15:49:03 oleg256-client sshd[22928]: Accepted publickey for root from 192.168.202.56 port 37102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:03 oleg256-client systemd[1]: Started Session 103 of user root. Oct 10 15:49:03 oleg256-client systemd-logind[1023]: New session 103 of user root. Oct 10 15:49:03 oleg256-client sshd[22928]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:03 oleg256-client sshd[22941]: Received disconnect from 192.168.202.56 port 37102:11: disconnected by user Oct 10 15:49:03 oleg256-client sshd[22941]: Disconnected from user root 192.168.202.56 port 37102 Oct 10 15:49:03 oleg256-client sshd[22928]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:03 oleg256-client systemd[1]: session-103.scope: Succeeded. Oct 10 15:49:03 oleg256-client systemd-logind[1023]: Session 103 logged out. Waiting for processes to exit. Oct 10 15:49:03 oleg256-client systemd-logind[1023]: Removed session 103. Oct 10 15:49:04 oleg256-client sshd[23065]: Accepted publickey for root from 192.168.202.56 port 52804 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:04 oleg256-client systemd-logind[1023]: New session 104 of user root. Oct 10 15:49:04 oleg256-client systemd[1]: Started Session 104 of user root. Oct 10 15:49:04 oleg256-client sshd[23065]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:04 oleg256-client sshd[23078]: Received disconnect from 192.168.202.56 port 52804:11: disconnected by user Oct 10 15:49:04 oleg256-client sshd[23078]: Disconnected from user root 192.168.202.56 port 52804 Oct 10 15:49:04 oleg256-client sshd[23065]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:04 oleg256-client systemd-logind[1023]: Session 104 logged out. Waiting for processes to exit. Oct 10 15:49:04 oleg256-client systemd[1]: session-104.scope: Succeeded. Oct 10 15:49:04 oleg256-client systemd-logind[1023]: Removed session 104. Oct 10 15:49:05 oleg256-client sshd[23209]: Accepted publickey for root from 192.168.202.56 port 52814 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:05 oleg256-client systemd-logind[1023]: New session 105 of user root. Oct 10 15:49:05 oleg256-client systemd[1]: Started Session 105 of user root. Oct 10 15:49:05 oleg256-client sshd[23209]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:05 oleg256-client sshd[23222]: Received disconnect from 192.168.202.56 port 52814:11: disconnected by user Oct 10 15:49:05 oleg256-client sshd[23222]: Disconnected from user root 192.168.202.56 port 52814 Oct 10 15:49:05 oleg256-client sshd[23209]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:06 oleg256-client systemd[1]: session-105.scope: Succeeded. Oct 10 15:49:06 oleg256-client systemd-logind[1023]: Session 105 logged out. Waiting for processes to exit. Oct 10 15:49:06 oleg256-client systemd-logind[1023]: Removed session 105. Oct 10 15:49:06 oleg256-client sshd[23362]: Accepted publickey for root from 192.168.202.56 port 52816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:06 oleg256-client systemd[1]: Started Session 106 of user root. Oct 10 15:49:06 oleg256-client systemd-logind[1023]: New session 106 of user root. Oct 10 15:49:06 oleg256-client sshd[23362]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:07 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 22: Delete single secondary nid from peer (gni) ========================================================== 15:49:06 (1760125746) Oct 10 15:49:07 oleg256-client sshd[23375]: Received disconnect from 192.168.202.56 port 52816:11: disconnected by user Oct 10 15:49:07 oleg256-client sshd[23375]: Disconnected from user root 192.168.202.56 port 52816 Oct 10 15:49:07 oleg256-client sshd[23362]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:07 oleg256-client systemd[1]: session-106.scope: Succeeded. Oct 10 15:49:07 oleg256-client systemd-logind[1023]: Session 106 logged out. Waiting for processes to exit. Oct 10 15:49:07 oleg256-client systemd-logind[1023]: Removed session 106. Oct 10 15:49:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 22@gni --nid [24-29]@gni Oct 10 15:49:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 22@gni --nid 26@gni Oct 10 15:49:08 oleg256-client sshd[23514]: Accepted publickey for root from 192.168.202.56 port 52830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:08 oleg256-client systemd-logind[1023]: New session 107 of user root. Oct 10 15:49:08 oleg256-client systemd[1]: Started Session 107 of user root. Oct 10 15:49:08 oleg256-client sshd[23514]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:08 oleg256-client sshd[23527]: Received disconnect from 192.168.202.56 port 52830:11: disconnected by user Oct 10 15:49:08 oleg256-client sshd[23527]: Disconnected from user root 192.168.202.56 port 52830 Oct 10 15:49:08 oleg256-client sshd[23514]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:08 oleg256-client systemd[1]: session-107.scope: Succeeded. Oct 10 15:49:08 oleg256-client systemd-logind[1023]: Session 107 logged out. Waiting for processes to exit. Oct 10 15:49:08 oleg256-client systemd-logind[1023]: Removed session 107. Oct 10 15:49:09 oleg256-client sshd[23651]: Accepted publickey for root from 192.168.202.56 port 52844 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:09 oleg256-client systemd-logind[1023]: New session 108 of user root. Oct 10 15:49:09 oleg256-client systemd[1]: Started Session 108 of user root. Oct 10 15:49:09 oleg256-client sshd[23651]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:09 oleg256-client sshd[23664]: Received disconnect from 192.168.202.56 port 52844:11: disconnected by user Oct 10 15:49:09 oleg256-client sshd[23664]: Disconnected from user root 192.168.202.56 port 52844 Oct 10 15:49:09 oleg256-client sshd[23651]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:09 oleg256-client systemd-logind[1023]: Session 108 logged out. Waiting for processes to exit. Oct 10 15:49:09 oleg256-client systemd[1]: session-108.scope: Succeeded. Oct 10 15:49:09 oleg256-client systemd-logind[1023]: Removed session 108. Oct 10 15:49:10 oleg256-client sshd[23795]: Accepted publickey for root from 192.168.202.56 port 52850 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:10 oleg256-client systemd-logind[1023]: New session 109 of user root. Oct 10 15:49:10 oleg256-client systemd[1]: Started Session 109 of user root. Oct 10 15:49:10 oleg256-client sshd[23795]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:10 oleg256-client sshd[23808]: Received disconnect from 192.168.202.56 port 52850:11: disconnected by user Oct 10 15:49:10 oleg256-client sshd[23808]: Disconnected from user root 192.168.202.56 port 52850 Oct 10 15:49:10 oleg256-client sshd[23795]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:10 oleg256-client systemd[1]: session-109.scope: Succeeded. Oct 10 15:49:10 oleg256-client systemd-logind[1023]: Session 109 logged out. Waiting for processes to exit. Oct 10 15:49:10 oleg256-client systemd-logind[1023]: Removed session 109. Oct 10 15:49:11 oleg256-client sshd[23948]: Accepted publickey for root from 192.168.202.56 port 52864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:11 oleg256-client systemd-logind[1023]: New session 110 of user root. Oct 10 15:49:11 oleg256-client systemd[1]: Started Session 110 of user root. Oct 10 15:49:11 oleg256-client sshd[23948]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:11 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 23: Delete all secondary nids from peer (gni) ========================================================== 15:49:10 (1760125750) Oct 10 15:49:11 oleg256-client sshd[23961]: Received disconnect from 192.168.202.56 port 52864:11: disconnected by user Oct 10 15:49:11 oleg256-client sshd[23961]: Disconnected from user root 192.168.202.56 port 52864 Oct 10 15:49:11 oleg256-client sshd[23948]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:11 oleg256-client systemd[1]: session-110.scope: Succeeded. Oct 10 15:49:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:11 oleg256-client systemd-logind[1023]: Session 110 logged out. Waiting for processes to exit. Oct 10 15:49:11 oleg256-client systemd-logind[1023]: Removed session 110. Oct 10 15:49:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 23@gni --nid [25-29]@gni Oct 10 15:49:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 23@gni --nid [25-29]@gni Oct 10 15:49:12 oleg256-client sshd[24099]: Accepted publickey for root from 192.168.202.56 port 52876 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:12 oleg256-client systemd-logind[1023]: New session 111 of user root. Oct 10 15:49:12 oleg256-client systemd[1]: Started Session 111 of user root. Oct 10 15:49:12 oleg256-client sshd[24099]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:12 oleg256-client sshd[24112]: Received disconnect from 192.168.202.56 port 52876:11: disconnected by user Oct 10 15:49:12 oleg256-client sshd[24112]: Disconnected from user root 192.168.202.56 port 52876 Oct 10 15:49:12 oleg256-client sshd[24099]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:12 oleg256-client systemd[1]: session-111.scope: Succeeded. Oct 10 15:49:12 oleg256-client systemd-logind[1023]: Session 111 logged out. Waiting for processes to exit. Oct 10 15:49:12 oleg256-client systemd-logind[1023]: Removed session 111. Oct 10 15:49:13 oleg256-client sshd[24237]: Accepted publickey for root from 192.168.202.56 port 52892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:13 oleg256-client systemd-logind[1023]: New session 112 of user root. Oct 10 15:49:13 oleg256-client systemd[1]: Started Session 112 of user root. Oct 10 15:49:13 oleg256-client sshd[24237]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:13 oleg256-client sshd[24250]: Received disconnect from 192.168.202.56 port 52892:11: disconnected by user Oct 10 15:49:13 oleg256-client sshd[24250]: Disconnected from user root 192.168.202.56 port 52892 Oct 10 15:49:13 oleg256-client sshd[24237]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:13 oleg256-client systemd[1]: session-112.scope: Succeeded. Oct 10 15:49:13 oleg256-client systemd-logind[1023]: Session 112 logged out. Waiting for processes to exit. Oct 10 15:49:13 oleg256-client systemd-logind[1023]: Removed session 112. Oct 10 15:49:14 oleg256-client sshd[24381]: Accepted publickey for root from 192.168.202.56 port 60864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:14 oleg256-client systemd-logind[1023]: New session 113 of user root. Oct 10 15:49:14 oleg256-client systemd[1]: Started Session 113 of user root. Oct 10 15:49:14 oleg256-client sshd[24381]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:14 oleg256-client sshd[24394]: Received disconnect from 192.168.202.56 port 60864:11: disconnected by user Oct 10 15:49:14 oleg256-client sshd[24394]: Disconnected from user root 192.168.202.56 port 60864 Oct 10 15:49:14 oleg256-client sshd[24381]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:14 oleg256-client systemd[1]: session-113.scope: Succeeded. Oct 10 15:49:14 oleg256-client systemd-logind[1023]: Session 113 logged out. Waiting for processes to exit. Oct 10 15:49:14 oleg256-client systemd-logind[1023]: Removed session 113. Oct 10 15:49:15 oleg256-client sshd[24534]: Accepted publickey for root from 192.168.202.56 port 60868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:15 oleg256-client systemd[1]: Started Session 114 of user root. Oct 10 15:49:15 oleg256-client systemd-logind[1023]: New session 114 of user root. Oct 10 15:49:15 oleg256-client sshd[24534]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:15 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 24: Delete a secondary nid from peer (tcp, o2ib and gni) ========================================================== 15:49:14 (1760125754) Oct 10 15:49:15 oleg256-client sshd[24547]: Received disconnect from 192.168.202.56 port 60868:11: disconnected by user Oct 10 15:49:15 oleg256-client sshd[24547]: Disconnected from user root 192.168.202.56 port 60868 Oct 10 15:49:15 oleg256-client sshd[24534]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:15 oleg256-client systemd[1]: session-114.scope: Succeeded. Oct 10 15:49:15 oleg256-client systemd-logind[1023]: Session 114 logged out. Waiting for processes to exit. Oct 10 15:49:15 oleg256-client systemd-logind[1023]: Removed session 114. Oct 10 15:49:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 24@gni --nid [13-14/1].[13-15/2].13.13@o2ib,[15-16/3].[17-19/4].[1].[5-20/5]@tcp,[5-12/6]@gni Oct 10 15:49:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 24@gni --nid 5@gni,13.15.13.13@o2ib,15.17.1.15@tcp Oct 10 15:49:16 oleg256-client sshd[24685]: Accepted publickey for root from 192.168.202.56 port 60878 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:16 oleg256-client systemd-logind[1023]: New session 115 of user root. Oct 10 15:49:16 oleg256-client systemd[1]: Started Session 115 of user root. Oct 10 15:49:16 oleg256-client sshd[24685]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:16 oleg256-client sshd[24698]: Received disconnect from 192.168.202.56 port 60878:11: disconnected by user Oct 10 15:49:16 oleg256-client sshd[24698]: Disconnected from user root 192.168.202.56 port 60878 Oct 10 15:49:16 oleg256-client sshd[24685]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:16 oleg256-client systemd[1]: session-115.scope: Succeeded. Oct 10 15:49:16 oleg256-client systemd-logind[1023]: Session 115 logged out. Waiting for processes to exit. Oct 10 15:49:16 oleg256-client systemd-logind[1023]: Removed session 115. Oct 10 15:49:17 oleg256-client sshd[24822]: Accepted publickey for root from 192.168.202.56 port 60890 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:17 oleg256-client systemd-logind[1023]: New session 116 of user root. Oct 10 15:49:17 oleg256-client systemd[1]: Started Session 116 of user root. Oct 10 15:49:17 oleg256-client sshd[24822]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:17 oleg256-client sshd[24835]: Received disconnect from 192.168.202.56 port 60890:11: disconnected by user Oct 10 15:49:17 oleg256-client sshd[24835]: Disconnected from user root 192.168.202.56 port 60890 Oct 10 15:49:17 oleg256-client sshd[24822]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:17 oleg256-client systemd-logind[1023]: Session 116 logged out. Waiting for processes to exit. Oct 10 15:49:17 oleg256-client systemd[1]: session-116.scope: Succeeded. Oct 10 15:49:17 oleg256-client systemd-logind[1023]: Removed session 116. Oct 10 15:49:18 oleg256-client sshd[24966]: Accepted publickey for root from 192.168.202.56 port 60906 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:18 oleg256-client systemd-logind[1023]: New session 117 of user root. Oct 10 15:49:18 oleg256-client systemd[1]: Started Session 117 of user root. Oct 10 15:49:18 oleg256-client sshd[24966]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:18 oleg256-client sshd[24980]: Received disconnect from 192.168.202.56 port 60906:11: disconnected by user Oct 10 15:49:18 oleg256-client sshd[24980]: Disconnected from user root 192.168.202.56 port 60906 Oct 10 15:49:18 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:49:18 oleg256-client sshd[24966]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:18 oleg256-client systemd[1]: session-117.scope: Succeeded. Oct 10 15:49:18 oleg256-client systemd-logind[1023]: Session 117 logged out. Waiting for processes to exit. Oct 10 15:49:18 oleg256-client systemd-logind[1023]: Removed session 117. Oct 10 15:49:19 oleg256-client sshd[25121]: Accepted publickey for root from 192.168.202.56 port 60922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:19 oleg256-client systemd-logind[1023]: New session 118 of user root. Oct 10 15:49:19 oleg256-client systemd[1]: Started Session 118 of user root. Oct 10 15:49:19 oleg256-client sshd[25121]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:19 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 25: Delete all secondary nids from peer (tcp, gni and o2ib) ========================================================== 15:49:18 (1760125758) Oct 10 15:49:19 oleg256-client sshd[25134]: Received disconnect from 192.168.202.56 port 60922:11: disconnected by user Oct 10 15:49:19 oleg256-client sshd[25134]: Disconnected from user root 192.168.202.56 port 60922 Oct 10 15:49:19 oleg256-client sshd[25121]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:19 oleg256-client systemd[1]: session-118.scope: Succeeded. Oct 10 15:49:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:19 oleg256-client systemd-logind[1023]: Session 118 logged out. Waiting for processes to exit. Oct 10 15:49:19 oleg256-client systemd-logind[1023]: Removed session 118. Oct 10 15:49:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 25@gni --nid [26-27].[4-10/3].26.26@tcp,26.26.26.26@o2ib,[30-35]@gni Oct 10 15:49:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 25@gni --nid [26-27].[4-10/3].26.26@tcp,26.26.26.26@o2ib,[30-35]@gni Oct 10 15:49:20 oleg256-client sshd[25272]: Accepted publickey for root from 192.168.202.56 port 60928 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:20 oleg256-client systemd-logind[1023]: New session 119 of user root. Oct 10 15:49:20 oleg256-client systemd[1]: Started Session 119 of user root. Oct 10 15:49:20 oleg256-client sshd[25272]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:20 oleg256-client sshd[25286]: Received disconnect from 192.168.202.56 port 60928:11: disconnected by user Oct 10 15:49:20 oleg256-client sshd[25286]: Disconnected from user root 192.168.202.56 port 60928 Oct 10 15:49:20 oleg256-client sshd[25272]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:20 oleg256-client systemd[1]: session-119.scope: Succeeded. Oct 10 15:49:20 oleg256-client systemd-logind[1023]: Session 119 logged out. Waiting for processes to exit. Oct 10 15:49:20 oleg256-client systemd-logind[1023]: Removed session 119. Oct 10 15:49:21 oleg256-client sshd[25410]: Accepted publickey for root from 192.168.202.56 port 60940 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:21 oleg256-client systemd-logind[1023]: New session 120 of user root. Oct 10 15:49:21 oleg256-client systemd[1]: Started Session 120 of user root. Oct 10 15:49:21 oleg256-client sshd[25410]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:21 oleg256-client sshd[25423]: Received disconnect from 192.168.202.56 port 60940:11: disconnected by user Oct 10 15:49:21 oleg256-client sshd[25423]: Disconnected from user root 192.168.202.56 port 60940 Oct 10 15:49:21 oleg256-client sshd[25410]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:21 oleg256-client systemd[1]: session-120.scope: Succeeded. Oct 10 15:49:21 oleg256-client systemd-logind[1023]: Session 120 logged out. Waiting for processes to exit. Oct 10 15:49:21 oleg256-client systemd-logind[1023]: Removed session 120. Oct 10 15:49:22 oleg256-client sshd[25554]: Accepted publickey for root from 192.168.202.56 port 60952 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:22 oleg256-client systemd[1]: Started Session 121 of user root. Oct 10 15:49:22 oleg256-client systemd-logind[1023]: New session 121 of user root. Oct 10 15:49:22 oleg256-client sshd[25554]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:22 oleg256-client sshd[25567]: Received disconnect from 192.168.202.56 port 60952:11: disconnected by user Oct 10 15:49:22 oleg256-client sshd[25567]: Disconnected from user root 192.168.202.56 port 60952 Oct 10 15:49:22 oleg256-client sshd[25554]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:22 oleg256-client systemd[1]: session-121.scope: Succeeded. Oct 10 15:49:22 oleg256-client systemd-logind[1023]: Session 121 logged out. Waiting for processes to exit. Oct 10 15:49:22 oleg256-client systemd-logind[1023]: Removed session 121. Oct 10 15:49:23 oleg256-client sshd[25707]: Accepted publickey for root from 192.168.202.56 port 60960 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:23 oleg256-client systemd-logind[1023]: New session 122 of user root. Oct 10 15:49:23 oleg256-client systemd[1]: Started Session 122 of user root. Oct 10 15:49:23 oleg256-client sshd[25707]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:23 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 26: Delete peer with primary nid locked ========================================================== 15:49:22 (1760125762) Oct 10 15:49:23 oleg256-client sshd[25720]: Received disconnect from 192.168.202.56 port 60960:11: disconnected by user Oct 10 15:49:23 oleg256-client sshd[25720]: Disconnected from user root 192.168.202.56 port 60960 Oct 10 15:49:23 oleg256-client sshd[25707]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:23 oleg256-client systemd[1]: session-122.scope: Succeeded. Oct 10 15:49:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --lock_prim Oct 10 15:49:23 oleg256-client systemd-logind[1023]: Session 122 logged out. Waiting for processes to exit. Oct 10 15:49:23 oleg256-client systemd-logind[1023]: Removed session 122. Oct 10 15:49:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp Oct 10 15:49:23 oleg256-client kernel: LNetError: 25771:0:(peer.c:2216:lnet_del_peer_ni()) peer 1.1.1.1@tcp created by Lustre. Must preserve primary NID, but will remove other NIDs Oct 10 15:49:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@tcp --force Oct 10 15:49:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer show --nid 1.1.1.1@tcp Oct 10 15:49:24 oleg256-client sshd[25862]: Accepted publickey for root from 192.168.202.56 port 41220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:24 oleg256-client systemd-logind[1023]: New session 123 of user root. Oct 10 15:49:24 oleg256-client systemd[1]: Started Session 123 of user root. Oct 10 15:49:24 oleg256-client sshd[25862]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:24 oleg256-client sshd[25875]: Received disconnect from 192.168.202.56 port 41220:11: disconnected by user Oct 10 15:49:24 oleg256-client sshd[25875]: Disconnected from user root 192.168.202.56 port 41220 Oct 10 15:49:24 oleg256-client sshd[25862]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:24 oleg256-client systemd[1]: session-123.scope: Succeeded. Oct 10 15:49:24 oleg256-client systemd-logind[1023]: Session 123 logged out. Waiting for processes to exit. Oct 10 15:49:24 oleg256-client systemd-logind[1023]: Removed session 123. Oct 10 15:49:25 oleg256-client sshd[25999]: Accepted publickey for root from 192.168.202.56 port 41224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:25 oleg256-client systemd-logind[1023]: New session 124 of user root. Oct 10 15:49:25 oleg256-client systemd[1]: Started Session 124 of user root. Oct 10 15:49:25 oleg256-client sshd[25999]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:25 oleg256-client sshd[26012]: Received disconnect from 192.168.202.56 port 41224:11: disconnected by user Oct 10 15:49:25 oleg256-client sshd[26012]: Disconnected from user root 192.168.202.56 port 41224 Oct 10 15:49:25 oleg256-client sshd[25999]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:25 oleg256-client systemd-logind[1023]: Session 124 logged out. Waiting for processes to exit. Oct 10 15:49:25 oleg256-client systemd[1]: session-124.scope: Succeeded. Oct 10 15:49:25 oleg256-client systemd-logind[1023]: Removed session 124. Oct 10 15:49:25 oleg256-client sshd[26143]: Accepted publickey for root from 192.168.202.56 port 41236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:25 oleg256-client systemd-logind[1023]: New session 125 of user root. Oct 10 15:49:25 oleg256-client systemd[1]: Started Session 125 of user root. Oct 10 15:49:25 oleg256-client sshd[26143]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:26 oleg256-client sshd[26156]: Received disconnect from 192.168.202.56 port 41236:11: disconnected by user Oct 10 15:49:26 oleg256-client sshd[26156]: Disconnected from user root 192.168.202.56 port 41236 Oct 10 15:49:26 oleg256-client sshd[26143]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:26 oleg256-client systemd[1]: session-125.scope: Succeeded. Oct 10 15:49:26 oleg256-client systemd-logind[1023]: Session 125 logged out. Waiting for processes to exit. Oct 10 15:49:26 oleg256-client systemd-logind[1023]: Removed session 125. Oct 10 15:49:26 oleg256-client sshd[26296]: Accepted publickey for root from 192.168.202.56 port 41242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:26 oleg256-client systemd-logind[1023]: New session 126 of user root. Oct 10 15:49:26 oleg256-client systemd[1]: Started Session 126 of user root. Oct 10 15:49:26 oleg256-client sshd[26296]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:27 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 27: Import bad config should fail gracefully ========================================================== 15:49:26 (1760125766) Oct 10 15:49:27 oleg256-client sshd[26309]: Received disconnect from 192.168.202.56 port 41242:11: disconnected by user Oct 10 15:49:27 oleg256-client sshd[26309]: Disconnected from user root 192.168.202.56 port 41242 Oct 10 15:49:27 oleg256-client sshd[26296]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:27 oleg256-client systemd-logind[1023]: Session 126 logged out. Waiting for processes to exit. Oct 10 15:49:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:27 oleg256-client systemd[1]: session-126.scope: Succeeded. Oct 10 15:49:27 oleg256-client systemd-logind[1023]: Removed session 126. Oct 10 15:49:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.HOltNRljjX Oct 10 15:49:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.HOltNRljjX Oct 10 15:49:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/tmp.HOltNRljjX Oct 10 15:49:27 oleg256-client sshd[26455]: Accepted publickey for root from 192.168.202.56 port 41248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:27 oleg256-client systemd-logind[1023]: New session 127 of user root. Oct 10 15:49:27 oleg256-client systemd[1]: Started Session 127 of user root. Oct 10 15:49:27 oleg256-client sshd[26455]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:28 oleg256-client sshd[26468]: Received disconnect from 192.168.202.56 port 41248:11: disconnected by user Oct 10 15:49:28 oleg256-client sshd[26468]: Disconnected from user root 192.168.202.56 port 41248 Oct 10 15:49:28 oleg256-client sshd[26455]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:28 oleg256-client systemd[1]: session-127.scope: Succeeded. Oct 10 15:49:28 oleg256-client systemd-logind[1023]: Session 127 logged out. Waiting for processes to exit. Oct 10 15:49:28 oleg256-client systemd-logind[1023]: Removed session 127. Oct 10 15:49:28 oleg256-client sshd[26592]: Accepted publickey for root from 192.168.202.56 port 41264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:28 oleg256-client systemd-logind[1023]: New session 128 of user root. Oct 10 15:49:28 oleg256-client systemd[1]: Started Session 128 of user root. Oct 10 15:49:28 oleg256-client sshd[26592]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:28 oleg256-client sshd[26605]: Received disconnect from 192.168.202.56 port 41264:11: disconnected by user Oct 10 15:49:28 oleg256-client sshd[26605]: Disconnected from user root 192.168.202.56 port 41264 Oct 10 15:49:28 oleg256-client sshd[26592]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:29 oleg256-client systemd[1]: session-128.scope: Succeeded. Oct 10 15:49:29 oleg256-client systemd-logind[1023]: Session 128 logged out. Waiting for processes to exit. Oct 10 15:49:29 oleg256-client systemd-logind[1023]: Removed session 128. Oct 10 15:49:29 oleg256-client sshd[26736]: Accepted publickey for root from 192.168.202.56 port 41270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:29 oleg256-client systemd[1]: Started Session 129 of user root. Oct 10 15:49:29 oleg256-client systemd-logind[1023]: New session 129 of user root. Oct 10 15:49:29 oleg256-client sshd[26736]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:29 oleg256-client sshd[26749]: Received disconnect from 192.168.202.56 port 41270:11: disconnected by user Oct 10 15:49:29 oleg256-client sshd[26749]: Disconnected from user root 192.168.202.56 port 41270 Oct 10 15:49:29 oleg256-client sshd[26736]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:29 oleg256-client systemd[1]: session-129.scope: Succeeded. Oct 10 15:49:29 oleg256-client systemd-logind[1023]: Session 129 logged out. Waiting for processes to exit. Oct 10 15:49:29 oleg256-client systemd-logind[1023]: Removed session 129. Oct 10 15:49:30 oleg256-client sshd[26890]: Accepted publickey for root from 192.168.202.56 port 41276 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:30 oleg256-client systemd-logind[1023]: New session 130 of user root. Oct 10 15:49:30 oleg256-client systemd[1]: Started Session 130 of user root. Oct 10 15:49:30 oleg256-client sshd[26890]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:30 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 28: Test peer_list =================== 15:49:29 (1760125769) Oct 10 15:49:30 oleg256-client sshd[26903]: Received disconnect from 192.168.202.56 port 41276:11: disconnected by user Oct 10 15:49:30 oleg256-client sshd[26903]: Disconnected from user root 192.168.202.56 port 41276 Oct 10 15:49:30 oleg256-client sshd[26890]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:30 oleg256-client systemd[1]: session-130.scope: Succeeded. Oct 10 15:49:30 oleg256-client systemd-logind[1023]: Session 130 logged out. Waiting for processes to exit. Oct 10 15:49:30 oleg256-client systemd-logind[1023]: Removed session 130. Oct 10 15:49:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --ni 7.7.7.7@tcp Oct 10 15:49:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.2@tcp --nid 7.7.7.8@tcp Oct 10 15:49:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer list Oct 10 15:49:31 oleg256-client sshd[27041]: Accepted publickey for root from 192.168.202.56 port 41288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:31 oleg256-client systemd-logind[1023]: New session 131 of user root. Oct 10 15:49:31 oleg256-client systemd[1]: Started Session 131 of user root. Oct 10 15:49:31 oleg256-client sshd[27041]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:31 oleg256-client sshd[27054]: Received disconnect from 192.168.202.56 port 41288:11: disconnected by user Oct 10 15:49:31 oleg256-client sshd[27054]: Disconnected from user root 192.168.202.56 port 41288 Oct 10 15:49:31 oleg256-client sshd[27041]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:31 oleg256-client systemd[1]: session-131.scope: Succeeded. Oct 10 15:49:31 oleg256-client systemd-logind[1023]: Session 131 logged out. Waiting for processes to exit. Oct 10 15:49:31 oleg256-client systemd-logind[1023]: Removed session 131. Oct 10 15:49:32 oleg256-client sshd[27178]: Accepted publickey for root from 192.168.202.56 port 41292 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:32 oleg256-client systemd-logind[1023]: New session 132 of user root. Oct 10 15:49:32 oleg256-client systemd[1]: Started Session 132 of user root. Oct 10 15:49:32 oleg256-client sshd[27178]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:32 oleg256-client sshd[27191]: Received disconnect from 192.168.202.56 port 41292:11: disconnected by user Oct 10 15:49:32 oleg256-client sshd[27191]: Disconnected from user root 192.168.202.56 port 41292 Oct 10 15:49:32 oleg256-client sshd[27178]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:32 oleg256-client systemd-logind[1023]: Session 132 logged out. Waiting for processes to exit. Oct 10 15:49:32 oleg256-client systemd[1]: session-132.scope: Succeeded. Oct 10 15:49:32 oleg256-client systemd-logind[1023]: Removed session 132. Oct 10 15:49:32 oleg256-client sshd[27322]: Accepted publickey for root from 192.168.202.56 port 41294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:33 oleg256-client systemd[1]: Started Session 133 of user root. Oct 10 15:49:33 oleg256-client systemd-logind[1023]: New session 133 of user root. Oct 10 15:49:33 oleg256-client sshd[27322]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:33 oleg256-client sshd[27335]: Received disconnect from 192.168.202.56 port 41294:11: disconnected by user Oct 10 15:49:33 oleg256-client sshd[27335]: Disconnected from user root 192.168.202.56 port 41294 Oct 10 15:49:33 oleg256-client sshd[27322]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:33 oleg256-client systemd[1]: session-133.scope: Succeeded. Oct 10 15:49:33 oleg256-client systemd-logind[1023]: Session 133 logged out. Waiting for processes to exit. Oct 10 15:49:33 oleg256-client systemd-logind[1023]: Removed session 133. Oct 10 15:49:33 oleg256-client sshd[27475]: Accepted publickey for root from 192.168.202.56 port 43336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:34 oleg256-client systemd-logind[1023]: New session 134 of user root. Oct 10 15:49:34 oleg256-client systemd[1]: Started Session 134 of user root. Oct 10 15:49:34 oleg256-client sshd[27475]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:34 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 50: Enable/disable routing via yaml import ========================================================== 15:49:33 (1760125773) Oct 10 15:49:34 oleg256-client sshd[27488]: Received disconnect from 192.168.202.56 port 43336:11: disconnected by user Oct 10 15:49:34 oleg256-client sshd[27488]: Disconnected from user root 192.168.202.56 port 43336 Oct 10 15:49:34 oleg256-client sshd[27475]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:34 oleg256-client systemd[1]: session-134.scope: Succeeded. Oct 10 15:49:34 oleg256-client systemd-logind[1023]: Session 134 logged out. Waiting for processes to exit. Oct 10 15:49:34 oleg256-client systemd-logind[1023]: Removed session 134. Oct 10 15:49:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-50.yaml Oct 10 15:49:35 oleg256-client kernel: LNet: Message forwarding will be enabled in 2s Oct 10 15:49:39 oleg256-client kernel: LNet: Message forwarding enabled Oct 10 15:49:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-50.yaml Oct 10 15:49:40 oleg256-client kernel: LNet: Message forwarding will stop in 2s to 6s Oct 10 15:49:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-50.yaml Oct 10 15:49:44 oleg256-client kernel: LNet: Message forwarding disabled Oct 10 15:49:45 oleg256-client kernel: LNet: Message forwarding will be enabled in 2s Oct 10 15:49:46 oleg256-client sshd[27737]: Accepted publickey for root from 192.168.202.56 port 56710 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:46 oleg256-client systemd-logind[1023]: New session 135 of user root. Oct 10 15:49:46 oleg256-client systemd[1]: Started Session 135 of user root. Oct 10 15:49:46 oleg256-client sshd[27737]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:46 oleg256-client sshd[27750]: Received disconnect from 192.168.202.56 port 56710:11: disconnected by user Oct 10 15:49:46 oleg256-client sshd[27750]: Disconnected from user root 192.168.202.56 port 56710 Oct 10 15:49:46 oleg256-client sshd[27737]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:46 oleg256-client systemd[1]: session-135.scope: Succeeded. Oct 10 15:49:46 oleg256-client systemd-logind[1023]: Session 135 logged out. Waiting for processes to exit. Oct 10 15:49:46 oleg256-client systemd-logind[1023]: Removed session 135. Oct 10 15:49:48 oleg256-client sshd[27875]: Accepted publickey for root from 192.168.202.56 port 56712 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:48 oleg256-client systemd-logind[1023]: New session 136 of user root. Oct 10 15:49:48 oleg256-client systemd[1]: Started Session 136 of user root. Oct 10 15:49:48 oleg256-client sshd[27875]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:48 oleg256-client sshd[27888]: Received disconnect from 192.168.202.56 port 56712:11: disconnected by user Oct 10 15:49:48 oleg256-client sshd[27888]: Disconnected from user root 192.168.202.56 port 56712 Oct 10 15:49:48 oleg256-client sshd[27875]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:48 oleg256-client systemd[1]: session-136.scope: Succeeded. Oct 10 15:49:48 oleg256-client systemd-logind[1023]: Session 136 logged out. Waiting for processes to exit. Oct 10 15:49:48 oleg256-client systemd-logind[1023]: Removed session 136. Oct 10 15:49:48 oleg256-client sshd[28019]: Accepted publickey for root from 192.168.202.56 port 56724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:48 oleg256-client systemd-logind[1023]: New session 137 of user root. Oct 10 15:49:48 oleg256-client systemd[1]: Started Session 137 of user root. Oct 10 15:49:48 oleg256-client sshd[28019]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:48 oleg256-client kernel: LNet: Message forwarding enabled Oct 10 15:49:49 oleg256-client sshd[28032]: Received disconnect from 192.168.202.56 port 56724:11: disconnected by user Oct 10 15:49:49 oleg256-client sshd[28032]: Disconnected from user root 192.168.202.56 port 56724 Oct 10 15:49:49 oleg256-client sshd[28019]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:49 oleg256-client systemd[1]: session-137.scope: Succeeded. Oct 10 15:49:49 oleg256-client systemd-logind[1023]: Session 137 logged out. Waiting for processes to exit. Oct 10 15:49:49 oleg256-client systemd-logind[1023]: Removed session 137. Oct 10 15:49:49 oleg256-client sshd[28172]: Accepted publickey for root from 192.168.202.56 port 56732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:50 oleg256-client systemd-logind[1023]: New session 138 of user root. Oct 10 15:49:50 oleg256-client systemd[1]: Started Session 138 of user root. Oct 10 15:49:50 oleg256-client sshd[28172]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:50 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 51: Set numa range via yaml import === 15:49:49 (1760125789) Oct 10 15:49:50 oleg256-client sshd[28185]: Received disconnect from 192.168.202.56 port 56732:11: disconnected by user Oct 10 15:49:50 oleg256-client sshd[28185]: Disconnected from user root 192.168.202.56 port 56732 Oct 10 15:49:50 oleg256-client sshd[28172]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:50 oleg256-client kernel: LNet: 28221:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:49:50 oleg256-client kernel: LNet: 28221:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 14 previous similar messages Oct 10 15:49:50 oleg256-client systemd[1]: session-138.scope: Succeeded. Oct 10 15:49:50 oleg256-client systemd-logind[1023]: Session 138 logged out. Waiting for processes to exit. Oct 10 15:49:50 oleg256-client systemd-logind[1023]: Removed session 138. Oct 10 15:49:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-51.yaml Oct 10 15:49:51 oleg256-client sshd[28318]: Accepted publickey for root from 192.168.202.56 port 56744 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:51 oleg256-client systemd-logind[1023]: New session 139 of user root. Oct 10 15:49:51 oleg256-client systemd[1]: Started Session 139 of user root. Oct 10 15:49:51 oleg256-client sshd[28318]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:51 oleg256-client sshd[28331]: Received disconnect from 192.168.202.56 port 56744:11: disconnected by user Oct 10 15:49:52 oleg256-client sshd[28331]: Disconnected from user root 192.168.202.56 port 56744 Oct 10 15:49:52 oleg256-client sshd[28318]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:52 oleg256-client systemd-logind[1023]: Session 139 logged out. Waiting for processes to exit. Oct 10 15:49:52 oleg256-client systemd[1]: session-139.scope: Succeeded. Oct 10 15:49:52 oleg256-client systemd-logind[1023]: Removed session 139. Oct 10 15:49:52 oleg256-client sshd[28455]: Accepted publickey for root from 192.168.202.56 port 56760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:52 oleg256-client systemd-logind[1023]: New session 140 of user root. Oct 10 15:49:52 oleg256-client sshd[28455]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:52 oleg256-client systemd[1]: Started Session 140 of user root. Oct 10 15:49:52 oleg256-client sshd[28468]: Received disconnect from 192.168.202.56 port 56760:11: disconnected by user Oct 10 15:49:52 oleg256-client sshd[28468]: Disconnected from user root 192.168.202.56 port 56760 Oct 10 15:49:52 oleg256-client sshd[28455]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:52 oleg256-client systemd[1]: session-140.scope: Succeeded. Oct 10 15:49:52 oleg256-client systemd-logind[1023]: Session 140 logged out. Waiting for processes to exit. Oct 10 15:49:52 oleg256-client systemd-logind[1023]: Removed session 140. Oct 10 15:49:53 oleg256-client sshd[28600]: Accepted publickey for root from 192.168.202.56 port 48050 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:53 oleg256-client systemd-logind[1023]: New session 141 of user root. Oct 10 15:49:53 oleg256-client systemd[1]: Started Session 141 of user root. Oct 10 15:49:53 oleg256-client sshd[28600]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:53 oleg256-client sshd[28613]: Received disconnect from 192.168.202.56 port 48050:11: disconnected by user Oct 10 15:49:53 oleg256-client sshd[28613]: Disconnected from user root 192.168.202.56 port 48050 Oct 10 15:49:53 oleg256-client sshd[28600]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:53 oleg256-client systemd[1]: session-141.scope: Succeeded. Oct 10 15:49:53 oleg256-client systemd-logind[1023]: Session 141 logged out. Waiting for processes to exit. Oct 10 15:49:53 oleg256-client systemd-logind[1023]: Removed session 141. Oct 10 15:49:54 oleg256-client sshd[28753]: Accepted publickey for root from 192.168.202.56 port 48052 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:54 oleg256-client systemd-logind[1023]: New session 142 of user root. Oct 10 15:49:54 oleg256-client systemd[1]: Started Session 142 of user root. Oct 10 15:49:54 oleg256-client sshd[28753]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:54 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 99a: Check various invalid inputs to lnetctl peer ========================================================== 15:49:53 (1760125793) Oct 10 15:49:54 oleg256-client sshd[28766]: Received disconnect from 192.168.202.56 port 48052:11: disconnected by user Oct 10 15:49:54 oleg256-client sshd[28766]: Disconnected from user root 192.168.202.56 port 48052 Oct 10 15:49:54 oleg256-client sshd[28753]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:54 oleg256-client systemd[1]: session-142.scope: Succeeded. Oct 10 15:49:54 oleg256-client systemd-logind[1023]: Session 142 logged out. Waiting for processes to exit. Oct 10 15:49:54 oleg256-client systemd-logind[1023]: Removed session 142. Oct 10 15:49:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid foobar Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid foobar Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --prim_nid 1.1.1.1@o2ib Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer del --nid 1.1.1.1@tcp Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --nid 1.1.1.1@tcp Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid foobar Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.1.1.[2-255]@tcp Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@foo Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@tcp Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1@o2ib Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@gni Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid [2-1]@gni Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid [a-f/x]@gni Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 256.256.256.256@tcp Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.1.1.1.[2-5/f]@tcp Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid 1.]2[.3.4@o2ib1.[2-4,[5-6],7-8].1.1@tcp Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 1.1.1.1@tcp --nid foobar Oct 10 15:49:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp --gateway 1@gni Oct 10 15:49:55 oleg256-client kernel: LNetError: 28847:0:(router.c:629:lnet_add_route()) Cannot add route with gateway 1@gni. There is no local interface configured on LNet gni Oct 10 15:49:55 oleg256-client sshd[28932]: Accepted publickey for root from 192.168.202.56 port 48068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:56 oleg256-client systemd-logind[1023]: New session 143 of user root. Oct 10 15:49:56 oleg256-client systemd[1]: Started Session 143 of user root. Oct 10 15:49:56 oleg256-client sshd[28932]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:56 oleg256-client sshd[28945]: Received disconnect from 192.168.202.56 port 48068:11: disconnected by user Oct 10 15:49:56 oleg256-client sshd[28945]: Disconnected from user root 192.168.202.56 port 48068 Oct 10 15:49:56 oleg256-client sshd[28932]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:56 oleg256-client systemd[1]: session-143.scope: Succeeded. Oct 10 15:49:56 oleg256-client systemd-logind[1023]: Session 143 logged out. Waiting for processes to exit. Oct 10 15:49:56 oleg256-client systemd-logind[1023]: Removed session 143. Oct 10 15:49:56 oleg256-client sshd[29069]: Accepted publickey for root from 192.168.202.56 port 48074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:56 oleg256-client systemd-logind[1023]: New session 144 of user root. Oct 10 15:49:56 oleg256-client systemd[1]: Started Session 144 of user root. Oct 10 15:49:56 oleg256-client sshd[29069]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:57 oleg256-client sshd[29082]: Received disconnect from 192.168.202.56 port 48074:11: disconnected by user Oct 10 15:49:57 oleg256-client sshd[29082]: Disconnected from user root 192.168.202.56 port 48074 Oct 10 15:49:57 oleg256-client sshd[29069]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:57 oleg256-client systemd[1]: session-144.scope: Succeeded. Oct 10 15:49:57 oleg256-client systemd-logind[1023]: Session 144 logged out. Waiting for processes to exit. Oct 10 15:49:57 oleg256-client systemd-logind[1023]: Removed session 144. Oct 10 15:49:57 oleg256-client sshd[29213]: Accepted publickey for root from 192.168.202.56 port 48090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:57 oleg256-client systemd-logind[1023]: New session 145 of user root. Oct 10 15:49:57 oleg256-client systemd[1]: Started Session 145 of user root. Oct 10 15:49:57 oleg256-client sshd[29213]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:57 oleg256-client sshd[29226]: Received disconnect from 192.168.202.56 port 48090:11: disconnected by user Oct 10 15:49:57 oleg256-client sshd[29226]: Disconnected from user root 192.168.202.56 port 48090 Oct 10 15:49:58 oleg256-client sshd[29213]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:58 oleg256-client systemd[1]: session-145.scope: Succeeded. Oct 10 15:49:58 oleg256-client systemd-logind[1023]: Session 145 logged out. Waiting for processes to exit. Oct 10 15:49:58 oleg256-client systemd-logind[1023]: Removed session 145. Oct 10 15:49:58 oleg256-client sshd[29367]: Accepted publickey for root from 192.168.202.56 port 48102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:49:58 oleg256-client systemd-logind[1023]: New session 146 of user root. Oct 10 15:49:58 oleg256-client systemd[1]: Started Session 146 of user root. Oct 10 15:49:58 oleg256-client sshd[29367]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:49:59 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 99b: Invalid value for Multi-Rail in yaml import ========================================================== 15:49:58 (1760125798) Oct 10 15:49:59 oleg256-client sshd[29380]: Received disconnect from 192.168.202.56 port 48102:11: disconnected by user Oct 10 15:49:59 oleg256-client sshd[29380]: Disconnected from user root 192.168.202.56 port 48102 Oct 10 15:49:59 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:49:59 oleg256-client sshd[29367]: pam_unix(sshd:session): session closed for user root Oct 10 15:49:59 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:49:59 oleg256-client systemd[1]: session-146.scope: Succeeded. Oct 10 15:49:59 oleg256-client systemd-logind[1023]: Session 146 logged out. Waiting for processes to exit. Oct 10 15:49:59 oleg256-client systemd-logind[1023]: Removed session 146. Oct 10 15:49:59 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:50:00 oleg256-client sshd[29516]: Accepted publickey for root from 192.168.202.56 port 48112 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:00 oleg256-client systemd-logind[1023]: New session 147 of user root. Oct 10 15:50:00 oleg256-client systemd[1]: Started Session 147 of user root. Oct 10 15:50:00 oleg256-client sshd[29516]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:00 oleg256-client sshd[29529]: Received disconnect from 192.168.202.56 port 48112:11: disconnected by user Oct 10 15:50:00 oleg256-client sshd[29529]: Disconnected from user root 192.168.202.56 port 48112 Oct 10 15:50:00 oleg256-client sshd[29516]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:00 oleg256-client systemd[1]: session-147.scope: Succeeded. Oct 10 15:50:00 oleg256-client systemd-logind[1023]: Session 147 logged out. Waiting for processes to exit. Oct 10 15:50:00 oleg256-client systemd-logind[1023]: Removed session 147. Oct 10 15:50:00 oleg256-client sshd[29653]: Accepted publickey for root from 192.168.202.56 port 48114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:01 oleg256-client systemd[1]: Started Session 148 of user root. Oct 10 15:50:01 oleg256-client systemd-logind[1023]: New session 148 of user root. Oct 10 15:50:01 oleg256-client sshd[29653]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:01 oleg256-client sshd[29666]: Received disconnect from 192.168.202.56 port 48114:11: disconnected by user Oct 10 15:50:01 oleg256-client sshd[29666]: Disconnected from user root 192.168.202.56 port 48114 Oct 10 15:50:01 oleg256-client sshd[29653]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:01 oleg256-client systemd[1]: session-148.scope: Succeeded. Oct 10 15:50:01 oleg256-client systemd-logind[1023]: Session 148 logged out. Waiting for processes to exit. Oct 10 15:50:01 oleg256-client systemd-logind[1023]: Removed session 148. Oct 10 15:50:01 oleg256-client sshd[29797]: Accepted publickey for root from 192.168.202.56 port 48120 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:01 oleg256-client systemd-logind[1023]: New session 149 of user root. Oct 10 15:50:01 oleg256-client systemd[1]: Started Session 149 of user root. Oct 10 15:50:01 oleg256-client sshd[29797]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:02 oleg256-client sshd[29810]: Received disconnect from 192.168.202.56 port 48120:11: disconnected by user Oct 10 15:50:02 oleg256-client sshd[29810]: Disconnected from user root 192.168.202.56 port 48120 Oct 10 15:50:02 oleg256-client sshd[29797]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:02 oleg256-client systemd-logind[1023]: Session 149 logged out. Waiting for processes to exit. Oct 10 15:50:02 oleg256-client systemd[1]: session-149.scope: Succeeded. Oct 10 15:50:02 oleg256-client systemd-logind[1023]: Removed session 149. Oct 10 15:50:02 oleg256-client sshd[29950]: Accepted publickey for root from 192.168.202.56 port 48132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:02 oleg256-client systemd-logind[1023]: New session 150 of user root. Oct 10 15:50:02 oleg256-client systemd[1]: Started Session 150 of user root. Oct 10 15:50:02 oleg256-client sshd[29950]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:03 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 100: Add route with single gw ======== 15:50:02 (1760125802) Oct 10 15:50:03 oleg256-client sshd[29963]: Received disconnect from 192.168.202.56 port 48132:11: disconnected by user Oct 10 15:50:03 oleg256-client sshd[29963]: Disconnected from user root 192.168.202.56 port 48132 Oct 10 15:50:03 oleg256-client sshd[29950]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:03 oleg256-client systemd[1]: session-150.scope: Succeeded. Oct 10 15:50:03 oleg256-client systemd-logind[1023]: Session 150 logged out. Waiting for processes to exit. Oct 10 15:50:03 oleg256-client systemd-logind[1023]: Removed session 150. Oct 10 15:50:03 oleg256-client sshd[30136]: Accepted publickey for root from 192.168.202.56 port 40144 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:03 oleg256-client systemd-logind[1023]: New session 151 of user root. Oct 10 15:50:03 oleg256-client systemd[1]: Started Session 151 of user root. Oct 10 15:50:03 oleg256-client sshd[30136]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:04 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_100 Need at least 2 remote nodes found oleg256-server Oct 10 15:50:04 oleg256-client sshd[30149]: Received disconnect from 192.168.202.56 port 40144:11: disconnected by user Oct 10 15:50:04 oleg256-client sshd[30149]: Disconnected from user root 192.168.202.56 port 40144 Oct 10 15:50:04 oleg256-client sshd[30136]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:04 oleg256-client systemd[1]: session-151.scope: Succeeded. Oct 10 15:50:04 oleg256-client systemd-logind[1023]: Session 151 logged out. Waiting for processes to exit. Oct 10 15:50:04 oleg256-client systemd-logind[1023]: Removed session 151. Oct 10 15:50:04 oleg256-client sshd[30296]: Accepted publickey for root from 192.168.202.56 port 40158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:04 oleg256-client systemd-logind[1023]: New session 152 of user root. Oct 10 15:50:04 oleg256-client systemd[1]: Started Session 152 of user root. Oct 10 15:50:04 oleg256-client sshd[30296]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:05 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 101: Add route with multiple gw ====== 15:50:04 (1760125804) Oct 10 15:50:05 oleg256-client sshd[30310]: Received disconnect from 192.168.202.56 port 40158:11: disconnected by user Oct 10 15:50:05 oleg256-client sshd[30310]: Disconnected from user root 192.168.202.56 port 40158 Oct 10 15:50:05 oleg256-client sshd[30296]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:05 oleg256-client systemd-logind[1023]: Session 152 logged out. Waiting for processes to exit. Oct 10 15:50:05 oleg256-client systemd[1]: session-152.scope: Succeeded. Oct 10 15:50:05 oleg256-client systemd-logind[1023]: Removed session 152. Oct 10 15:50:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:50:05 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:50:05 oleg256-client root[30384]: ksocklnd-config: /sbin/ip route flush table ens2 Oct 10 15:50:06 oleg256-client root[30537]: ksocklnd-config: /sbin/ip route add default via 192.168.202.254 dev ens2 table ens2 /sbin/ip route add 192.168.202.0/24 dev ens2 proto kernel scope link src 192.168.202.56 table ens2 Oct 10 15:50:06 oleg256-client root[30538]: ksocklnd-config: /sbin/ip rule del from 192.168.202.56 table ens2 Oct 10 15:50:06 oleg256-client root[30539]: ksocklnd-config: /sbin/ip rule add from 192.168.202.56 table ens2 Oct 10 15:50:06 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp1 --gateway 192.168.202.[57-61]@tcp Oct 10 15:50:06 oleg256-client kernel: LNet: 30559:0:(router.c:733:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled Oct 10 15:50:06 oleg256-client kernel: LNetError: 30352:0:(router.c:398:lnet_router_discovery_ping_reply()) Peer 192.168.202.58@tcp is being used as a gateway but routing feature is not turned on Oct 10 15:50:06 oleg256-client kernel: LNetError: 30352:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) route to tcp1 through 192.168.202.58@tcp has gone from up to down Oct 10 15:50:06 oleg256-client sshd[30669]: Accepted publickey for root from 192.168.202.56 port 40168 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:06 oleg256-client systemd[1]: Started Session 153 of user root. Oct 10 15:50:06 oleg256-client systemd-logind[1023]: New session 153 of user root. Oct 10 15:50:06 oleg256-client sshd[30669]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:07 oleg256-client sshd[30682]: Received disconnect from 192.168.202.56 port 40168:11: disconnected by user Oct 10 15:50:07 oleg256-client sshd[30682]: Disconnected from user root 192.168.202.56 port 40168 Oct 10 15:50:07 oleg256-client sshd[30669]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:07 oleg256-client systemd[1]: session-153.scope: Succeeded. Oct 10 15:50:07 oleg256-client systemd-logind[1023]: Session 153 logged out. Waiting for processes to exit. Oct 10 15:50:07 oleg256-client systemd-logind[1023]: Removed session 153. Oct 10 15:50:07 oleg256-client kernel: LNetError: 30352:0:(router.c:398:lnet_router_discovery_ping_reply()) Peer 192.168.202.60@tcp is being used as a gateway but routing feature is not turned on Oct 10 15:50:07 oleg256-client kernel: LNetError: 30352:0:(router.c:398:lnet_router_discovery_ping_reply()) Skipped 5 previous similar messages Oct 10 15:50:07 oleg256-client sshd[30806]: Accepted publickey for root from 192.168.202.56 port 40178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:07 oleg256-client systemd-logind[1023]: New session 154 of user root. Oct 10 15:50:07 oleg256-client systemd[1]: Started Session 154 of user root. Oct 10 15:50:07 oleg256-client sshd[30806]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:07 oleg256-client sshd[30819]: Received disconnect from 192.168.202.56 port 40178:11: disconnected by user Oct 10 15:50:07 oleg256-client sshd[30819]: Disconnected from user root 192.168.202.56 port 40178 Oct 10 15:50:07 oleg256-client sshd[30806]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:08 oleg256-client systemd-logind[1023]: Session 154 logged out. Waiting for processes to exit. Oct 10 15:50:08 oleg256-client systemd[1]: session-154.scope: Succeeded. Oct 10 15:50:08 oleg256-client systemd-logind[1023]: Removed session 154. Oct 10 15:50:08 oleg256-client kernel: LNetError: 30352:0:(router.c:398:lnet_router_discovery_ping_reply()) Peer 192.168.202.57@tcp is being used as a gateway but routing feature is not turned on Oct 10 15:50:08 oleg256-client kernel: LNetError: 30352:0:(router.c:398:lnet_router_discovery_ping_reply()) Skipped 2 previous similar messages Oct 10 15:50:08 oleg256-client sshd[30950]: Accepted publickey for root from 192.168.202.56 port 40180 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:08 oleg256-client systemd-logind[1023]: New session 155 of user root. Oct 10 15:50:08 oleg256-client systemd[1]: Started Session 155 of user root. Oct 10 15:50:08 oleg256-client sshd[30950]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:08 oleg256-client sshd[30963]: Received disconnect from 192.168.202.56 port 40180:11: disconnected by user Oct 10 15:50:08 oleg256-client sshd[30963]: Disconnected from user root 192.168.202.56 port 40180 Oct 10 15:50:08 oleg256-client sshd[30950]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:08 oleg256-client systemd-logind[1023]: Session 155 logged out. Waiting for processes to exit. Oct 10 15:50:08 oleg256-client systemd[1]: session-155.scope: Succeeded. Oct 10 15:50:08 oleg256-client systemd-logind[1023]: Removed session 155. Oct 10 15:50:09 oleg256-client kernel: LNetError: 30358:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) route to tcp1 through 192.168.202.59@tcp has gone from up to down Oct 10 15:50:09 oleg256-client kernel: LNetError: 30358:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) Skipped 2 previous similar messages Oct 10 15:50:09 oleg256-client sshd[31103]: Accepted publickey for root from 192.168.202.56 port 40184 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:09 oleg256-client systemd-logind[1023]: New session 156 of user root. Oct 10 15:50:09 oleg256-client systemd[1]: Started Session 156 of user root. Oct 10 15:50:09 oleg256-client sshd[31103]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:09 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 102: Delete route with single gw ===== 15:50:08 (1760125808) Oct 10 15:50:09 oleg256-client sshd[31116]: Received disconnect from 192.168.202.56 port 40184:11: disconnected by user Oct 10 15:50:09 oleg256-client sshd[31116]: Disconnected from user root 192.168.202.56 port 40184 Oct 10 15:50:09 oleg256-client sshd[31103]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:09 oleg256-client systemd[1]: session-156.scope: Succeeded. Oct 10 15:50:09 oleg256-client systemd-logind[1023]: Session 156 logged out. Waiting for processes to exit. Oct 10 15:50:09 oleg256-client systemd-logind[1023]: Removed session 156. Oct 10 15:50:10 oleg256-client kernel: LNetError: 30352:0:(router.c:398:lnet_router_discovery_ping_reply()) Peer 192.168.202.57@tcp is being used as a gateway but routing feature is not turned on Oct 10 15:50:10 oleg256-client kernel: LNetError: 30352:0:(router.c:398:lnet_router_discovery_ping_reply()) Skipped 5 previous similar messages Oct 10 15:50:10 oleg256-client sshd[31289]: Accepted publickey for root from 192.168.202.56 port 40200 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:10 oleg256-client systemd-logind[1023]: New session 157 of user root. Oct 10 15:50:10 oleg256-client systemd[1]: Started Session 157 of user root. Oct 10 15:50:10 oleg256-client sshd[31289]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:10 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_102 Need at least 2 remote nodes found oleg256-server Oct 10 15:50:10 oleg256-client sshd[31302]: Received disconnect from 192.168.202.56 port 40200:11: disconnected by user Oct 10 15:50:10 oleg256-client sshd[31302]: Disconnected from user root 192.168.202.56 port 40200 Oct 10 15:50:10 oleg256-client sshd[31289]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:10 oleg256-client systemd[1]: session-157.scope: Succeeded. Oct 10 15:50:10 oleg256-client systemd-logind[1023]: Session 157 logged out. Waiting for processes to exit. Oct 10 15:50:10 oleg256-client systemd-logind[1023]: Removed session 157. Oct 10 15:50:11 oleg256-client sshd[31442]: Accepted publickey for root from 192.168.202.56 port 40206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:11 oleg256-client systemd-logind[1023]: New session 158 of user root. Oct 10 15:50:11 oleg256-client systemd[1]: Started Session 158 of user root. Oct 10 15:50:11 oleg256-client sshd[31442]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:11 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 103: Delete route with multiple gw === 15:50:10 (1760125810) Oct 10 15:50:11 oleg256-client sshd[31455]: Received disconnect from 192.168.202.56 port 40206:11: disconnected by user Oct 10 15:50:11 oleg256-client sshd[31455]: Disconnected from user root 192.168.202.56 port 40206 Oct 10 15:50:11 oleg256-client sshd[31442]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:11 oleg256-client systemd[1]: session-158.scope: Succeeded. Oct 10 15:50:11 oleg256-client systemd-logind[1023]: Session 158 logged out. Waiting for processes to exit. Oct 10 15:50:11 oleg256-client systemd-logind[1023]: Removed session 158. Oct 10 15:50:12 oleg256-client kernel: LNetError: 30351:0:(router.c:1267:lnet_check_routers()) Failed to discover router 192.168.202.57@tcp Oct 10 15:50:12 oleg256-client kernel: LNetError: 31491:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:50:12 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:50:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:50:12 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:50:12 oleg256-client root[31526]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:50:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route add --net tcp103 --gateway 192.168.202.[57-62/2]@tcp Oct 10 15:50:13 oleg256-client kernel: LNet: 31607:0:(router.c:733:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled Oct 10 15:50:13 oleg256-client kernel: LNet: 31607:0:(router.c:733:lnet_add_route()) Skipped 4 previous similar messages Oct 10 15:50:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl route del --net tcp103 --gateway 192.168.202.[57-62/2]@tcp Oct 10 15:50:13 oleg256-client kernel: LNetError: 31497:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) route to tcp103 through 192.168.202.57@tcp has gone from up to down Oct 10 15:50:13 oleg256-client kernel: LNetError: 31497:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) Skipped 1 previous similar message Oct 10 15:50:13 oleg256-client sshd[31713]: Accepted publickey for root from 192.168.202.56 port 46238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:13 oleg256-client systemd-logind[1023]: New session 159 of user root. Oct 10 15:50:13 oleg256-client systemd[1]: Started Session 159 of user root. Oct 10 15:50:13 oleg256-client sshd[31713]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:14 oleg256-client sshd[31726]: Received disconnect from 192.168.202.56 port 46238:11: disconnected by user Oct 10 15:50:14 oleg256-client sshd[31726]: Disconnected from user root 192.168.202.56 port 46238 Oct 10 15:50:14 oleg256-client sshd[31713]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:14 oleg256-client systemd[1]: session-159.scope: Succeeded. Oct 10 15:50:14 oleg256-client systemd-logind[1023]: Session 159 logged out. Waiting for processes to exit. Oct 10 15:50:14 oleg256-client systemd-logind[1023]: Removed session 159. Oct 10 15:50:14 oleg256-client sshd[31850]: Accepted publickey for root from 192.168.202.56 port 46248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:14 oleg256-client systemd-logind[1023]: New session 160 of user root. Oct 10 15:50:14 oleg256-client systemd[1]: Started Session 160 of user root. Oct 10 15:50:14 oleg256-client sshd[31850]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:14 oleg256-client sshd[31863]: Received disconnect from 192.168.202.56 port 46248:11: disconnected by user Oct 10 15:50:14 oleg256-client sshd[31863]: Disconnected from user root 192.168.202.56 port 46248 Oct 10 15:50:14 oleg256-client sshd[31850]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:15 oleg256-client systemd[1]: session-160.scope: Succeeded. Oct 10 15:50:15 oleg256-client systemd-logind[1023]: Session 160 logged out. Waiting for processes to exit. Oct 10 15:50:15 oleg256-client systemd-logind[1023]: Removed session 160. Oct 10 15:50:15 oleg256-client sshd[31994]: Accepted publickey for root from 192.168.202.56 port 46264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:15 oleg256-client systemd[1]: Started Session 161 of user root. Oct 10 15:50:15 oleg256-client systemd-logind[1023]: New session 161 of user root. Oct 10 15:50:15 oleg256-client sshd[31994]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:15 oleg256-client sshd[32007]: Received disconnect from 192.168.202.56 port 46264:11: disconnected by user Oct 10 15:50:15 oleg256-client sshd[32007]: Disconnected from user root 192.168.202.56 port 46264 Oct 10 15:50:15 oleg256-client sshd[31994]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:15 oleg256-client systemd-logind[1023]: Session 161 logged out. Waiting for processes to exit. Oct 10 15:50:15 oleg256-client systemd[1]: session-161.scope: Succeeded. Oct 10 15:50:15 oleg256-client systemd-logind[1023]: Removed session 161. Oct 10 15:50:16 oleg256-client sshd[32147]: Accepted publickey for root from 192.168.202.56 port 46280 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:16 oleg256-client systemd-logind[1023]: New session 162 of user root. Oct 10 15:50:16 oleg256-client systemd[1]: Started Session 162 of user root. Oct 10 15:50:16 oleg256-client sshd[32147]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 104: Set/check response_tracking param ========================================================== 15:50:15 (1760125815) Oct 10 15:50:16 oleg256-client sshd[32160]: Received disconnect from 192.168.202.56 port 46280:11: disconnected by user Oct 10 15:50:16 oleg256-client sshd[32160]: Disconnected from user root 192.168.202.56 port 46280 Oct 10 15:50:16 oleg256-client sshd[32147]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:16 oleg256-client kernel: LNetError: 32195:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:50:16 oleg256-client systemd[1]: session-162.scope: Succeeded. Oct 10 15:50:16 oleg256-client systemd-logind[1023]: Session 162 logged out. Waiting for processes to exit. Oct 10 15:50:16 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:50:16 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:50:16 oleg256-client systemd-logind[1023]: Removed session 162. Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking -1 Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 0 Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 1 Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 2 Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 3 Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set response_tracking 4 Oct 10 15:50:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:50:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 15:50:18 oleg256-client sshd[32438]: Accepted publickey for root from 192.168.202.56 port 46282 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:18 oleg256-client systemd-logind[1023]: New session 163 of user root. Oct 10 15:50:18 oleg256-client systemd[1]: Started Session 163 of user root. Oct 10 15:50:18 oleg256-client sshd[32438]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:18 oleg256-client sshd[32451]: Received disconnect from 192.168.202.56 port 46282:11: disconnected by user Oct 10 15:50:18 oleg256-client sshd[32451]: Disconnected from user root 192.168.202.56 port 46282 Oct 10 15:50:18 oleg256-client sshd[32438]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:19 oleg256-client systemd[1]: session-163.scope: Succeeded. Oct 10 15:50:19 oleg256-client systemd-logind[1023]: Session 163 logged out. Waiting for processes to exit. Oct 10 15:50:19 oleg256-client systemd-logind[1023]: Removed session 163. Oct 10 15:50:19 oleg256-client sshd[32575]: Accepted publickey for root from 192.168.202.56 port 46284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:19 oleg256-client systemd-logind[1023]: New session 164 of user root. Oct 10 15:50:19 oleg256-client systemd[1]: Started Session 164 of user root. Oct 10 15:50:19 oleg256-client sshd[32575]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:19 oleg256-client sshd[32588]: Received disconnect from 192.168.202.56 port 46284:11: disconnected by user Oct 10 15:50:19 oleg256-client sshd[32588]: Disconnected from user root 192.168.202.56 port 46284 Oct 10 15:50:19 oleg256-client sshd[32575]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:20 oleg256-client systemd-logind[1023]: Session 164 logged out. Waiting for processes to exit. Oct 10 15:50:20 oleg256-client systemd[1]: session-164.scope: Succeeded. Oct 10 15:50:20 oleg256-client systemd-logind[1023]: Removed session 164. Oct 10 15:50:20 oleg256-client sshd[32719]: Accepted publickey for root from 192.168.202.56 port 46294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:20 oleg256-client systemd-logind[1023]: New session 165 of user root. Oct 10 15:50:20 oleg256-client systemd[1]: Started Session 165 of user root. Oct 10 15:50:20 oleg256-client sshd[32719]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:20 oleg256-client sshd[32732]: Received disconnect from 192.168.202.56 port 46294:11: disconnected by user Oct 10 15:50:20 oleg256-client sshd[32732]: Disconnected from user root 192.168.202.56 port 46294 Oct 10 15:50:20 oleg256-client sshd[32719]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:21 oleg256-client systemd[1]: session-165.scope: Succeeded. Oct 10 15:50:21 oleg256-client systemd-logind[1023]: Session 165 logged out. Waiting for processes to exit. Oct 10 15:50:21 oleg256-client systemd-logind[1023]: Removed session 165. Oct 10 15:50:21 oleg256-client sshd[32872]: Accepted publickey for root from 192.168.202.56 port 46298 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:21 oleg256-client systemd-logind[1023]: New session 166 of user root. Oct 10 15:50:21 oleg256-client systemd[1]: Started Session 166 of user root. Oct 10 15:50:21 oleg256-client sshd[32872]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:21 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 105: Adding duplicate GW peer should fail ========================================================== 15:50:21 (1760125821) Oct 10 15:50:21 oleg256-client sshd[32885]: Received disconnect from 192.168.202.56 port 46298:11: disconnected by user Oct 10 15:50:22 oleg256-client sshd[32885]: Disconnected from user root 192.168.202.56 port 46298 Oct 10 15:50:22 oleg256-client sshd[32872]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:22 oleg256-client systemd[1]: session-166.scope: Succeeded. Oct 10 15:50:22 oleg256-client systemd-logind[1023]: Session 166 logged out. Waiting for processes to exit. Oct 10 15:50:22 oleg256-client systemd-logind[1023]: Removed session 166. Oct 10 15:50:22 oleg256-client sshd[33058]: Accepted publickey for root from 192.168.202.56 port 46304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:22 oleg256-client systemd-logind[1023]: New session 167 of user root. Oct 10 15:50:22 oleg256-client systemd[1]: Started Session 167 of user root. Oct 10 15:50:22 oleg256-client sshd[33058]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:23 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_105 Need at least 2 remote nodes found oleg256-server Oct 10 15:50:23 oleg256-client sshd[33071]: Received disconnect from 192.168.202.56 port 46304:11: disconnected by user Oct 10 15:50:23 oleg256-client sshd[33071]: Disconnected from user root 192.168.202.56 port 46304 Oct 10 15:50:23 oleg256-client sshd[33058]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:23 oleg256-client systemd[1]: session-167.scope: Succeeded. Oct 10 15:50:23 oleg256-client systemd-logind[1023]: Session 167 logged out. Waiting for processes to exit. Oct 10 15:50:23 oleg256-client systemd-logind[1023]: Removed session 167. Oct 10 15:50:23 oleg256-client sshd[33210]: Accepted publickey for root from 192.168.202.56 port 50390 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:23 oleg256-client systemd-logind[1023]: New session 168 of user root. Oct 10 15:50:23 oleg256-client systemd[1]: Started Session 168 of user root. Oct 10 15:50:23 oleg256-client sshd[33210]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:24 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 106: Deleting GW peer should fail ==== 15:50:23 (1760125823) Oct 10 15:50:24 oleg256-client sshd[33224]: Received disconnect from 192.168.202.56 port 50390:11: disconnected by user Oct 10 15:50:24 oleg256-client sshd[33224]: Disconnected from user root 192.168.202.56 port 50390 Oct 10 15:50:24 oleg256-client sshd[33210]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:24 oleg256-client systemd-logind[1023]: Session 168 logged out. Waiting for processes to exit. Oct 10 15:50:24 oleg256-client systemd[1]: session-168.scope: Succeeded. Oct 10 15:50:24 oleg256-client systemd-logind[1023]: Removed session 168. Oct 10 15:50:24 oleg256-client sshd[33397]: Accepted publickey for root from 192.168.202.56 port 50400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:25 oleg256-client systemd[1]: Started Session 169 of user root. Oct 10 15:50:25 oleg256-client systemd-logind[1023]: New session 169 of user root. Oct 10 15:50:25 oleg256-client sshd[33397]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:25 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_106 Need at least 2 remote nodes found oleg256-server Oct 10 15:50:25 oleg256-client sshd[33410]: Received disconnect from 192.168.202.56 port 50400:11: disconnected by user Oct 10 15:50:25 oleg256-client sshd[33410]: Disconnected from user root 192.168.202.56 port 50400 Oct 10 15:50:25 oleg256-client sshd[33397]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:25 oleg256-client systemd[1]: session-169.scope: Succeeded. Oct 10 15:50:25 oleg256-client systemd-logind[1023]: Session 169 logged out. Waiting for processes to exit. Oct 10 15:50:25 oleg256-client systemd-logind[1023]: Removed session 169. Oct 10 15:50:26 oleg256-client sshd[33549]: Accepted publickey for root from 192.168.202.56 port 50406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:26 oleg256-client systemd-logind[1023]: New session 170 of user root. Oct 10 15:50:26 oleg256-client systemd[1]: Started Session 170 of user root. Oct 10 15:50:26 oleg256-client sshd[33549]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:26 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 107: Deleting extra interface doesn't crash node ========================================================== 15:50:25 (1760125825) Oct 10 15:50:26 oleg256-client sshd[33562]: Received disconnect from 192.168.202.56 port 50406:11: disconnected by user Oct 10 15:50:26 oleg256-client sshd[33562]: Disconnected from user root 192.168.202.56 port 50406 Oct 10 15:50:26 oleg256-client sshd[33549]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:26 oleg256-client systemd-logind[1023]: Session 170 logged out. Waiting for processes to exit. Oct 10 15:50:26 oleg256-client systemd[1]: session-170.scope: Succeeded. Oct 10 15:50:26 oleg256-client systemd-logind[1023]: Removed session 170. Oct 10 15:50:26 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:50:26 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:50:27 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:50:27 oleg256-client systemd-udevd[33675]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:50:27 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:50:29 oleg256-client NetworkManager[1026]: [1760125829.8957] manager: (test1pg): new Veth device (/org/freedesktop/NetworkManager/Devices/3) Oct 10 15:50:29 oleg256-client NetworkManager[1026]: [1760125829.9001] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/4) Oct 10 15:50:29 oleg256-client systemd-udevd[33805]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:50:29 oleg256-client systemd-udevd[33805]: Could not generate persistent MAC address for test1pg: No such file or directory Oct 10 15:50:29 oleg256-client systemd-udevd[33804]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:50:29 oleg256-client systemd-udevd[33804]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:50:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:50:29 oleg256-client NetworkManager[1026]: [1760125829.9868] device (test1pg): carrier: link connected Oct 10 15:50:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:50:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:50:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:50:30 oleg256-client NetworkManager[1026]: [1760125830.0026] device (test1pl): carrier: link connected Oct 10 15:50:32 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:50:32 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:50:32 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:50:32 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:50:33 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:33 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:50:33 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:50:33 oleg256-client root[33936]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:50:33 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 15:50:33 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:50:33 oleg256-client root[34033]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:50:33 oleg256-client root[34047]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 15:50:34 oleg256-client root[34178]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 15:50:34 oleg256-client root[34179]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 15:50:34 oleg256-client root[34180]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 15:50:34 oleg256-client root[34295]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 15:50:34 oleg256-client root[34296]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 15:50:34 oleg256-client root[34297]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 15:50:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg Oct 10 15:50:34 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:50:34 oleg256-client kernel: LNet: 34308:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:50:34 oleg256-client kernel: LNetError: 34308:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:50:34 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:50:35 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:50:35 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:50:35 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:50:35 oleg256-client systemd-udevd[34378]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:50:35 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:50:38 oleg256-client sshd[34596]: Accepted publickey for root from 192.168.202.56 port 35620 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:38 oleg256-client systemd-logind[1023]: New session 171 of user root. Oct 10 15:50:38 oleg256-client systemd[1]: Started Session 171 of user root. Oct 10 15:50:38 oleg256-client sshd[34596]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:38 oleg256-client sshd[34609]: Received disconnect from 192.168.202.56 port 35620:11: disconnected by user Oct 10 15:50:38 oleg256-client sshd[34609]: Disconnected from user root 192.168.202.56 port 35620 Oct 10 15:50:38 oleg256-client sshd[34596]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:38 oleg256-client systemd-logind[1023]: Session 171 logged out. Waiting for processes to exit. Oct 10 15:50:38 oleg256-client systemd[1]: session-171.scope: Succeeded. Oct 10 15:50:38 oleg256-client systemd-logind[1023]: Removed session 171. Oct 10 15:50:39 oleg256-client sshd[34733]: Accepted publickey for root from 192.168.202.56 port 35636 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:39 oleg256-client systemd-logind[1023]: New session 172 of user root. Oct 10 15:50:39 oleg256-client systemd[1]: Started Session 172 of user root. Oct 10 15:50:39 oleg256-client sshd[34733]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:39 oleg256-client sshd[34746]: Received disconnect from 192.168.202.56 port 35636:11: disconnected by user Oct 10 15:50:39 oleg256-client sshd[34746]: Disconnected from user root 192.168.202.56 port 35636 Oct 10 15:50:39 oleg256-client sshd[34733]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:39 oleg256-client systemd-logind[1023]: Session 172 logged out. Waiting for processes to exit. Oct 10 15:50:39 oleg256-client systemd[1]: session-172.scope: Succeeded. Oct 10 15:50:39 oleg256-client systemd-logind[1023]: Removed session 172. Oct 10 15:50:40 oleg256-client sshd[34877]: Accepted publickey for root from 192.168.202.56 port 35650 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:40 oleg256-client systemd-logind[1023]: New session 173 of user root. Oct 10 15:50:40 oleg256-client systemd[1]: Started Session 173 of user root. Oct 10 15:50:40 oleg256-client sshd[34877]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:40 oleg256-client sshd[34891]: Received disconnect from 192.168.202.56 port 35650:11: disconnected by user Oct 10 15:50:40 oleg256-client sshd[34891]: Disconnected from user root 192.168.202.56 port 35650 Oct 10 15:50:40 oleg256-client sshd[34877]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:40 oleg256-client systemd-logind[1023]: Session 173 logged out. Waiting for processes to exit. Oct 10 15:50:40 oleg256-client systemd[1]: session-173.scope: Succeeded. Oct 10 15:50:40 oleg256-client systemd-logind[1023]: Removed session 173. Oct 10 15:50:40 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:50:40 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:50:41 oleg256-client sshd[35040]: Accepted publickey for root from 192.168.202.56 port 35654 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:41 oleg256-client systemd-logind[1023]: New session 174 of user root. Oct 10 15:50:41 oleg256-client systemd[1]: Started Session 174 of user root. Oct 10 15:50:41 oleg256-client sshd[35040]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:41 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 108: Check Multi-Rail setup ========== 15:50:40 (1760125840) Oct 10 15:50:41 oleg256-client sshd[35053]: Received disconnect from 192.168.202.56 port 35654:11: disconnected by user Oct 10 15:50:41 oleg256-client sshd[35053]: Disconnected from user root 192.168.202.56 port 35654 Oct 10 15:50:41 oleg256-client sshd[35040]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:41 oleg256-client systemd[1]: session-174.scope: Succeeded. Oct 10 15:50:41 oleg256-client systemd-logind[1023]: Session 174 logged out. Waiting for processes to exit. Oct 10 15:50:41 oleg256-client systemd-logind[1023]: Removed session 174. Oct 10 15:50:41 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:50:41 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:50:42 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:50:42 oleg256-client systemd-udevd[35148]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:50:42 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:50:44 oleg256-client NetworkManager[1026]: [1760125844.7956] manager: (test1pg): new Veth device (/org/freedesktop/NetworkManager/Devices/5) Oct 10 15:50:44 oleg256-client systemd-udevd[35268]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:50:44 oleg256-client systemd-udevd[35268]: Could not generate persistent MAC address for test1pg: No such file or directory Oct 10 15:50:44 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:50:44 oleg256-client NetworkManager[1026]: [1760125844.8071] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/6) Oct 10 15:50:44 oleg256-client systemd-udevd[35271]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:50:44 oleg256-client systemd-udevd[35271]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:50:44 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:50:44 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:50:44 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:50:44 oleg256-client NetworkManager[1026]: [1760125844.8606] device (test1pg): carrier: link connected Oct 10 15:50:44 oleg256-client NetworkManager[1026]: [1760125844.8688] device (test1pl): carrier: link connected Oct 10 15:50:47 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:50:47 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:50:47 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:50:47 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:50:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:50:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:50:48 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:50:48 oleg256-client root[35398]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:50:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 15:50:48 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:50:48 oleg256-client root[35502]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:50:48 oleg256-client root[35516]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 15:50:49 oleg256-client root[35653]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 15:50:49 oleg256-client root[35654]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 15:50:49 oleg256-client root[35655]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 15:50:49 oleg256-client root[35770]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 15:50:49 oleg256-client root[35771]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 15:50:49 oleg256-client root[35772]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 15:50:50 oleg256-client kernel: LNet: 35786:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:50:50 oleg256-client kernel: LNetError: 35786:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:50:50 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:50:50 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:50:50 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:50:50 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:50:50 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:50:51 oleg256-client systemd-udevd[35859]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:50:51 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:50:53 oleg256-client sshd[36074]: Accepted publickey for root from 192.168.202.56 port 43894 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:53 oleg256-client systemd-logind[1023]: New session 175 of user root. Oct 10 15:50:53 oleg256-client systemd[1]: Started Session 175 of user root. Oct 10 15:50:53 oleg256-client sshd[36074]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:54 oleg256-client sshd[36087]: Received disconnect from 192.168.202.56 port 43894:11: disconnected by user Oct 10 15:50:54 oleg256-client sshd[36087]: Disconnected from user root 192.168.202.56 port 43894 Oct 10 15:50:54 oleg256-client sshd[36074]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:54 oleg256-client systemd[1]: session-175.scope: Succeeded. Oct 10 15:50:54 oleg256-client systemd-logind[1023]: Session 175 logged out. Waiting for processes to exit. Oct 10 15:50:54 oleg256-client systemd-logind[1023]: Removed session 175. Oct 10 15:50:54 oleg256-client sshd[36211]: Accepted publickey for root from 192.168.202.56 port 43896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:54 oleg256-client systemd[1]: Started Session 176 of user root. Oct 10 15:50:54 oleg256-client systemd-logind[1023]: New session 176 of user root. Oct 10 15:50:54 oleg256-client sshd[36211]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:54 oleg256-client sshd[36224]: Received disconnect from 192.168.202.56 port 43896:11: disconnected by user Oct 10 15:50:54 oleg256-client sshd[36224]: Disconnected from user root 192.168.202.56 port 43896 Oct 10 15:50:54 oleg256-client sshd[36211]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:54 oleg256-client systemd-logind[1023]: Session 176 logged out. Waiting for processes to exit. Oct 10 15:50:54 oleg256-client systemd[1]: session-176.scope: Succeeded. Oct 10 15:50:55 oleg256-client systemd-logind[1023]: Removed session 176. Oct 10 15:50:55 oleg256-client sshd[36355]: Accepted publickey for root from 192.168.202.56 port 43902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:55 oleg256-client systemd-logind[1023]: New session 177 of user root. Oct 10 15:50:55 oleg256-client systemd[1]: Started Session 177 of user root. Oct 10 15:50:55 oleg256-client sshd[36355]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:55 oleg256-client sshd[36369]: Received disconnect from 192.168.202.56 port 43902:11: disconnected by user Oct 10 15:50:55 oleg256-client sshd[36369]: Disconnected from user root 192.168.202.56 port 43902 Oct 10 15:50:55 oleg256-client sshd[36355]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:55 oleg256-client systemd[1]: session-177.scope: Succeeded. Oct 10 15:50:55 oleg256-client systemd-logind[1023]: Session 177 logged out. Waiting for processes to exit. Oct 10 15:50:55 oleg256-client systemd-logind[1023]: Removed session 177. Oct 10 15:50:56 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:50:56 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:50:56 oleg256-client sshd[36518]: Accepted publickey for root from 192.168.202.56 port 43904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:50:56 oleg256-client systemd-logind[1023]: New session 178 of user root. Oct 10 15:50:56 oleg256-client systemd[1]: Started Session 178 of user root. Oct 10 15:50:56 oleg256-client sshd[36518]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:50:56 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 109: Add NI using a network interface alias (LU-16859) ========================================================== 15:50:56 (1760125856) Oct 10 15:50:56 oleg256-client sshd[36531]: Received disconnect from 192.168.202.56 port 43904:11: disconnected by user Oct 10 15:50:56 oleg256-client sshd[36531]: Disconnected from user root 192.168.202.56 port 43904 Oct 10 15:50:56 oleg256-client sshd[36518]: pam_unix(sshd:session): session closed for user root Oct 10 15:50:57 oleg256-client systemd[1]: session-178.scope: Succeeded. Oct 10 15:50:57 oleg256-client systemd-logind[1023]: Session 178 logged out. Waiting for processes to exit. Oct 10 15:50:57 oleg256-client systemd-logind[1023]: Removed session 178. Oct 10 15:50:57 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:50:57 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:50:57 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:50:57 oleg256-client systemd-udevd[36627]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:50:57 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:51:00 oleg256-client NetworkManager[1026]: [1760125860.2558] manager: (test1pg): new Veth device (/org/freedesktop/NetworkManager/Devices/7) Oct 10 15:51:00 oleg256-client systemd-udevd[36746]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:51:00 oleg256-client systemd-udevd[36746]: Could not generate persistent MAC address for test1pg: No such file or directory Oct 10 15:51:00 oleg256-client NetworkManager[1026]: [1760125860.2644] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/8) Oct 10 15:51:00 oleg256-client systemd-udevd[36747]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:51:00 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:51:00 oleg256-client systemd-udevd[36747]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:51:00 oleg256-client NetworkManager[1026]: [1760125860.3592] device (test1pg): carrier: link connected Oct 10 15:51:00 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:51:00 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:51:00 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:51:00 oleg256-client NetworkManager[1026]: [1760125860.3730] device (test1pl): carrier: link connected Oct 10 15:51:02 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:51:02 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:51:02 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:51:02 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:51:03 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:51:03 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg:0 Oct 10 15:51:03 oleg256-client kernel: LNet: Added LNI 10.1.2.31@tcp [8/256/0/180] Oct 10 15:51:03 oleg256-client root[36880]: ksocklnd-config: /sbin/ip route flush table test1pg:0 Oct 10 15:51:04 oleg256-client root[37017]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg:0 proto kernel scope link src 10.1.2.3 table test1pg:0 Oct 10 15:51:04 oleg256-client root[37018]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg:0 Oct 10 15:51:04 oleg256-client root[37019]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg:0 Oct 10 15:51:04 oleg256-client root[37134]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg:0 proto kernel scope link src 2001:db8:0:f101::1 table test1pg:0 Oct 10 15:51:04 oleg256-client root[37135]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg:0 Oct 10 15:51:04 oleg256-client root[37136]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg:0 Oct 10 15:51:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 15:51:04 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:51:05 oleg256-client root[37156]: ksocklnd-config: skip setting up route for test1pg:0: IPv4 route exists Oct 10 15:51:05 oleg256-client root[37170]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 15:51:05 oleg256-client root[37313]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 15:51:05 oleg256-client root[37314]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 15:51:05 oleg256-client root[37315]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 15:51:06 oleg256-client root[37431]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 15:51:06 oleg256-client root[37432]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 15:51:06 oleg256-client root[37433]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 15:51:06 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg Oct 10 15:51:06 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:51:06 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if test1pg:0 Oct 10 15:51:06 oleg256-client kernel: LNet: Removed LNI 10.1.2.31@tcp Oct 10 15:51:06 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 15:51:06 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:51:06 oleg256-client root[37466]: ksocklnd-config: skip setting up route for test1pg: IPv4 route exists Oct 10 15:51:06 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg:0 Oct 10 15:51:06 oleg256-client kernel: LNet: Added LNI 10.1.2.31@tcp [8/256/0/180] Oct 10 15:51:06 oleg256-client root[37575]: ksocklnd-config: skip setting up route for test1pg: IPv4 route exists Oct 10 15:51:06 oleg256-client root[37586]: ksocklnd-config: skip setting up route for test1pg:0: IPv4 route exists Oct 10 15:51:07 oleg256-client kernel: LNet: 37686:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:51:07 oleg256-client kernel: LNetError: 37686:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface test1pg not found Oct 10 15:51:07 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:51:07 oleg256-client kernel: LNet: Removed LNI 10.1.2.31@tcp Oct 10 15:51:07 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:51:07 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:51:07 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:51:07 oleg256-client systemd-udevd[37771]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:51:07 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:51:10 oleg256-client sshd[37973]: Accepted publickey for root from 192.168.202.56 port 59078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:10 oleg256-client systemd[1]: Started Session 179 of user root. Oct 10 15:51:10 oleg256-client systemd-logind[1023]: New session 179 of user root. Oct 10 15:51:10 oleg256-client sshd[37973]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:10 oleg256-client sshd[37986]: Received disconnect from 192.168.202.56 port 59078:11: disconnected by user Oct 10 15:51:10 oleg256-client sshd[37986]: Disconnected from user root 192.168.202.56 port 59078 Oct 10 15:51:10 oleg256-client sshd[37973]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:10 oleg256-client systemd[1]: session-179.scope: Succeeded. Oct 10 15:51:10 oleg256-client systemd-logind[1023]: Session 179 logged out. Waiting for processes to exit. Oct 10 15:51:10 oleg256-client systemd-logind[1023]: Removed session 179. Oct 10 15:51:11 oleg256-client sshd[38111]: Accepted publickey for root from 192.168.202.56 port 59080 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:11 oleg256-client systemd[1]: Started Session 180 of user root. Oct 10 15:51:11 oleg256-client systemd-logind[1023]: New session 180 of user root. Oct 10 15:51:11 oleg256-client sshd[38111]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:11 oleg256-client sshd[38124]: Received disconnect from 192.168.202.56 port 59080:11: disconnected by user Oct 10 15:51:11 oleg256-client sshd[38124]: Disconnected from user root 192.168.202.56 port 59080 Oct 10 15:51:11 oleg256-client sshd[38111]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:11 oleg256-client systemd[1]: session-180.scope: Succeeded. Oct 10 15:51:11 oleg256-client systemd-logind[1023]: Session 180 logged out. Waiting for processes to exit. Oct 10 15:51:11 oleg256-client systemd-logind[1023]: Removed session 180. Oct 10 15:51:12 oleg256-client sshd[38255]: Accepted publickey for root from 192.168.202.56 port 59086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:12 oleg256-client systemd[1]: Started Session 181 of user root. Oct 10 15:51:12 oleg256-client systemd-logind[1023]: New session 181 of user root. Oct 10 15:51:12 oleg256-client sshd[38255]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:12 oleg256-client sshd[38268]: Received disconnect from 192.168.202.56 port 59086:11: disconnected by user Oct 10 15:51:12 oleg256-client sshd[38268]: Disconnected from user root 192.168.202.56 port 59086 Oct 10 15:51:12 oleg256-client sshd[38255]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:12 oleg256-client systemd-logind[1023]: Session 181 logged out. Waiting for processes to exit. Oct 10 15:51:12 oleg256-client systemd[1]: session-181.scope: Succeeded. Oct 10 15:51:12 oleg256-client systemd-logind[1023]: Removed session 181. Oct 10 15:51:12 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:51:12 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:51:13 oleg256-client sshd[38417]: Accepted publickey for root from 192.168.202.56 port 59094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:13 oleg256-client systemd[1]: Started Session 182 of user root. Oct 10 15:51:13 oleg256-client systemd-logind[1023]: New session 182 of user root. Oct 10 15:51:13 oleg256-client sshd[38417]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:13 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 110: Configure NI using lnetctl net add --nid ========================================================== 15:51:12 (1760125872) Oct 10 15:51:13 oleg256-client sshd[38430]: Received disconnect from 192.168.202.56 port 59094:11: disconnected by user Oct 10 15:51:13 oleg256-client sshd[38430]: Disconnected from user root 192.168.202.56 port 59094 Oct 10 15:51:13 oleg256-client sshd[38417]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:13 oleg256-client systemd[1]: session-182.scope: Succeeded. Oct 10 15:51:13 oleg256-client systemd-logind[1023]: Session 182 logged out. Waiting for processes to exit. Oct 10 15:51:13 oleg256-client systemd-logind[1023]: Removed session 182. Oct 10 15:51:13 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 15:51:13 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:51:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:51:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:51:14 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:51:14 oleg256-client root[38535]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:51:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:51:15 oleg256-client kernel: LNet: 38630:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:51:15 oleg256-client kernel: LNetError: 38630:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:51:15 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:51:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:51:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --nid 192.168.202.56@tcp Oct 10 15:51:15 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:51:15 oleg256-client root[38663]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:51:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --nid 192.168.202.56@tcp Oct 10 15:51:15 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:51:15 oleg256-client kernel: LNet: 38762:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:51:16 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:51:16 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:51:16 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:51:16 oleg256-client systemd-udevd[38846]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:51:16 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:51:19 oleg256-client sshd[39050]: Accepted publickey for root from 192.168.202.56 port 44988 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:19 oleg256-client systemd[1]: Started Session 183 of user root. Oct 10 15:51:19 oleg256-client systemd-logind[1023]: New session 183 of user root. Oct 10 15:51:19 oleg256-client sshd[39050]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:19 oleg256-client sshd[39063]: Received disconnect from 192.168.202.56 port 44988:11: disconnected by user Oct 10 15:51:20 oleg256-client sshd[39063]: Disconnected from user root 192.168.202.56 port 44988 Oct 10 15:51:20 oleg256-client sshd[39050]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:20 oleg256-client systemd-logind[1023]: Session 183 logged out. Waiting for processes to exit. Oct 10 15:51:20 oleg256-client systemd[1]: session-183.scope: Succeeded. Oct 10 15:51:20 oleg256-client systemd-logind[1023]: Removed session 183. Oct 10 15:51:20 oleg256-client sshd[39187]: Accepted publickey for root from 192.168.202.56 port 44992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:20 oleg256-client systemd[1]: Started Session 184 of user root. Oct 10 15:51:20 oleg256-client systemd-logind[1023]: New session 184 of user root. Oct 10 15:51:20 oleg256-client sshd[39187]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:20 oleg256-client sshd[39200]: Received disconnect from 192.168.202.56 port 44992:11: disconnected by user Oct 10 15:51:20 oleg256-client sshd[39200]: Disconnected from user root 192.168.202.56 port 44992 Oct 10 15:51:20 oleg256-client sshd[39187]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:20 oleg256-client systemd[1]: session-184.scope: Succeeded. Oct 10 15:51:20 oleg256-client systemd-logind[1023]: Session 184 logged out. Waiting for processes to exit. Oct 10 15:51:20 oleg256-client systemd-logind[1023]: Removed session 184. Oct 10 15:51:21 oleg256-client sshd[39332]: Accepted publickey for root from 192.168.202.56 port 45004 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:21 oleg256-client systemd-logind[1023]: New session 185 of user root. Oct 10 15:51:21 oleg256-client systemd[1]: Started Session 185 of user root. Oct 10 15:51:21 oleg256-client sshd[39332]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:21 oleg256-client sshd[39345]: Received disconnect from 192.168.202.56 port 45004:11: disconnected by user Oct 10 15:51:21 oleg256-client sshd[39345]: Disconnected from user root 192.168.202.56 port 45004 Oct 10 15:51:21 oleg256-client sshd[39332]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:21 oleg256-client systemd[1]: session-185.scope: Succeeded. Oct 10 15:51:21 oleg256-client systemd-logind[1023]: Session 185 logged out. Waiting for processes to exit. Oct 10 15:51:21 oleg256-client systemd-logind[1023]: Removed session 185. Oct 10 15:51:21 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:51:21 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:51:22 oleg256-client sshd[39494]: Accepted publickey for root from 192.168.202.56 port 45012 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:22 oleg256-client systemd-logind[1023]: New session 186 of user root. Oct 10 15:51:22 oleg256-client systemd[1]: Started Session 186 of user root. Oct 10 15:51:22 oleg256-client sshd[39494]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:22 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 111: Test many routes ================ 15:51:21 (1760125881) Oct 10 15:51:22 oleg256-client sshd[39507]: Received disconnect from 192.168.202.56 port 45012:11: disconnected by user Oct 10 15:51:22 oleg256-client sshd[39507]: Disconnected from user root 192.168.202.56 port 45012 Oct 10 15:51:22 oleg256-client sshd[39494]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:22 oleg256-client systemd[1]: session-186.scope: Succeeded. Oct 10 15:51:22 oleg256-client systemd-logind[1023]: Session 186 logged out. Waiting for processes to exit. Oct 10 15:51:22 oleg256-client systemd-logind[1023]: Removed session 186. Oct 10 15:51:23 oleg256-client sshd[39682]: Accepted publickey for root from 192.168.202.56 port 40166 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:23 oleg256-client systemd-logind[1023]: New session 187 of user root. Oct 10 15:51:23 oleg256-client systemd[1]: Started Session 187 of user root. Oct 10 15:51:23 oleg256-client sshd[39682]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:23 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_111 Need at least 2 remote nodes found oleg256-server Oct 10 15:51:23 oleg256-client sshd[39695]: Received disconnect from 192.168.202.56 port 40166:11: disconnected by user Oct 10 15:51:23 oleg256-client sshd[39695]: Disconnected from user root 192.168.202.56 port 40166 Oct 10 15:51:23 oleg256-client sshd[39682]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:23 oleg256-client systemd-logind[1023]: Session 187 logged out. Waiting for processes to exit. Oct 10 15:51:23 oleg256-client systemd[1]: session-187.scope: Succeeded. Oct 10 15:51:23 oleg256-client systemd-logind[1023]: Removed session 187. Oct 10 15:51:24 oleg256-client sshd[39834]: Accepted publickey for root from 192.168.202.56 port 40170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:24 oleg256-client systemd-logind[1023]: New session 188 of user root. Oct 10 15:51:24 oleg256-client systemd[1]: Started Session 188 of user root. Oct 10 15:51:24 oleg256-client sshd[39834]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:24 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 112: multiple net configurations ===== 15:51:23 (1760125883) Oct 10 15:51:24 oleg256-client sshd[39847]: Received disconnect from 192.168.202.56 port 40170:11: disconnected by user Oct 10 15:51:24 oleg256-client sshd[39847]: Disconnected from user root 192.168.202.56 port 40170 Oct 10 15:51:24 oleg256-client sshd[39834]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:24 oleg256-client systemd-logind[1023]: Session 188 logged out. Waiting for processes to exit. Oct 10 15:51:24 oleg256-client systemd[1]: session-188.scope: Succeeded. Oct 10 15:51:24 oleg256-client systemd-logind[1023]: Removed session 188. Oct 10 15:51:24 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:51:24 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:51:24 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:51:25 oleg256-client systemd-udevd[39933]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:51:25 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:51:27 oleg256-client systemd-udevd[40063]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:51:27 oleg256-client systemd-udevd[40063]: Could not generate persistent MAC address for test1pg: No such file or directory Oct 10 15:51:27 oleg256-client systemd-udevd[40064]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:51:27 oleg256-client NetworkManager[1026]: [1760125887.4682] manager: (test1pg): new Veth device (/org/freedesktop/NetworkManager/Devices/9) Oct 10 15:51:27 oleg256-client systemd-udevd[40064]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:51:27 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:51:27 oleg256-client NetworkManager[1026]: [1760125887.4875] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/10) Oct 10 15:51:27 oleg256-client NetworkManager[1026]: [1760125887.5446] device (test1pg): carrier: link connected Oct 10 15:51:27 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:51:27 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:51:27 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:51:27 oleg256-client NetworkManager[1026]: [1760125887.5537] device (test1pl): carrier: link connected Oct 10 15:51:29 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:51:29 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:51:29 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:51:29 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:51:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:51:30 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:51:30 oleg256-client root[40193]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:51:31 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp2 [8/256/0/180] Oct 10 15:51:31 oleg256-client root[40301]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:51:31 oleg256-client root[40316]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 15:51:32 oleg256-client root[40459]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 15:51:32 oleg256-client root[40460]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 15:51:32 oleg256-client root[40461]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 15:51:32 oleg256-client root[40576]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 15:51:32 oleg256-client root[40577]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 15:51:32 oleg256-client root[40578]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 15:51:32 oleg256-client kernel: LNet: 40585:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:51:32 oleg256-client kernel: LNetError: 40585:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:51:32 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:51:32 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp2 Oct 10 15:51:33 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:51:33 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:51:33 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:51:33 oleg256-client systemd-udevd[40655]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:51:33 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:51:36 oleg256-client sshd[40883]: Accepted publickey for root from 192.168.202.56 port 33582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:36 oleg256-client systemd-logind[1023]: New session 189 of user root. Oct 10 15:51:36 oleg256-client systemd[1]: Started Session 189 of user root. Oct 10 15:51:36 oleg256-client sshd[40883]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:36 oleg256-client sshd[40897]: Received disconnect from 192.168.202.56 port 33582:11: disconnected by user Oct 10 15:51:36 oleg256-client sshd[40897]: Disconnected from user root 192.168.202.56 port 33582 Oct 10 15:51:36 oleg256-client sshd[40883]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:37 oleg256-client systemd[1]: session-189.scope: Succeeded. Oct 10 15:51:37 oleg256-client systemd-logind[1023]: Session 189 logged out. Waiting for processes to exit. Oct 10 15:51:37 oleg256-client systemd-logind[1023]: Removed session 189. Oct 10 15:51:37 oleg256-client sshd[41021]: Accepted publickey for root from 192.168.202.56 port 33590 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:37 oleg256-client systemd-logind[1023]: New session 190 of user root. Oct 10 15:51:37 oleg256-client systemd[1]: Started Session 190 of user root. Oct 10 15:51:37 oleg256-client sshd[41021]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:37 oleg256-client sshd[41034]: Received disconnect from 192.168.202.56 port 33590:11: disconnected by user Oct 10 15:51:37 oleg256-client sshd[41034]: Disconnected from user root 192.168.202.56 port 33590 Oct 10 15:51:37 oleg256-client sshd[41021]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:37 oleg256-client systemd[1]: session-190.scope: Succeeded. Oct 10 15:51:37 oleg256-client systemd-logind[1023]: Session 190 logged out. Waiting for processes to exit. Oct 10 15:51:37 oleg256-client systemd-logind[1023]: Removed session 190. Oct 10 15:51:38 oleg256-client sshd[41165]: Accepted publickey for root from 192.168.202.56 port 33592 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:38 oleg256-client systemd[1]: Started Session 191 of user root. Oct 10 15:51:38 oleg256-client systemd-logind[1023]: New session 191 of user root. Oct 10 15:51:38 oleg256-client sshd[41165]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:38 oleg256-client sshd[41178]: Received disconnect from 192.168.202.56 port 33592:11: disconnected by user Oct 10 15:51:38 oleg256-client sshd[41178]: Disconnected from user root 192.168.202.56 port 33592 Oct 10 15:51:38 oleg256-client sshd[41165]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:38 oleg256-client systemd-logind[1023]: Session 191 logged out. Waiting for processes to exit. Oct 10 15:51:38 oleg256-client systemd[1]: session-191.scope: Succeeded. Oct 10 15:51:38 oleg256-client systemd-logind[1023]: Removed session 191. Oct 10 15:51:39 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:51:39 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:51:39 oleg256-client sshd[41327]: Accepted publickey for root from 192.168.202.56 port 33596 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:39 oleg256-client systemd[1]: Started Session 192 of user root. Oct 10 15:51:39 oleg256-client systemd-logind[1023]: New session 192 of user root. Oct 10 15:51:39 oleg256-client sshd[41327]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:39 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 150: Check import of ip2nets yaml sequence ========================================================== 15:51:38 (1760125898) Oct 10 15:51:39 oleg256-client sshd[41340]: Received disconnect from 192.168.202.56 port 33596:11: disconnected by user Oct 10 15:51:39 oleg256-client sshd[41340]: Disconnected from user root 192.168.202.56 port 33596 Oct 10 15:51:39 oleg256-client sshd[41327]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:39 oleg256-client systemd[1]: session-192.scope: Succeeded. Oct 10 15:51:39 oleg256-client systemd-logind[1023]: Session 192 logged out. Waiting for processes to exit. Oct 10 15:51:39 oleg256-client systemd-logind[1023]: Removed session 192. Oct 10 15:51:40 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 15:51:40 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:51:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:51:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:51:40 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:51:41 oleg256-client root[41445]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:51:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:51:41 oleg256-client kernel: LNet: 41541:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:51:41 oleg256-client kernel: LNetError: 41541:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:51:41 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:51:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:51:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet.yaml Oct 10 15:51:41 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:51:42 oleg256-client sshd[41652]: Accepted publickey for root from 192.168.202.56 port 33608 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:42 oleg256-client systemd-logind[1023]: New session 193 of user root. Oct 10 15:51:42 oleg256-client systemd[1]: Started Session 193 of user root. Oct 10 15:51:42 oleg256-client sshd[41652]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:42 oleg256-client sshd[41665]: Received disconnect from 192.168.202.56 port 33608:11: disconnected by user Oct 10 15:51:42 oleg256-client sshd[41665]: Disconnected from user root 192.168.202.56 port 33608 Oct 10 15:51:42 oleg256-client sshd[41652]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:42 oleg256-client systemd-logind[1023]: Session 193 logged out. Waiting for processes to exit. Oct 10 15:51:42 oleg256-client systemd[1]: session-193.scope: Succeeded. Oct 10 15:51:42 oleg256-client systemd-logind[1023]: Removed session 193. Oct 10 15:51:43 oleg256-client sshd[41789]: Accepted publickey for root from 192.168.202.56 port 33614 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:43 oleg256-client systemd[1]: Started Session 194 of user root. Oct 10 15:51:43 oleg256-client systemd-logind[1023]: New session 194 of user root. Oct 10 15:51:43 oleg256-client sshd[41789]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:43 oleg256-client sshd[41802]: Received disconnect from 192.168.202.56 port 33614:11: disconnected by user Oct 10 15:51:43 oleg256-client sshd[41802]: Disconnected from user root 192.168.202.56 port 33614 Oct 10 15:51:43 oleg256-client sshd[41789]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:43 oleg256-client systemd-logind[1023]: Session 194 logged out. Waiting for processes to exit. Oct 10 15:51:43 oleg256-client systemd[1]: session-194.scope: Succeeded. Oct 10 15:51:43 oleg256-client systemd-logind[1023]: Removed session 194. Oct 10 15:51:44 oleg256-client sshd[41933]: Accepted publickey for root from 192.168.202.56 port 59212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:44 oleg256-client systemd-logind[1023]: New session 195 of user root. Oct 10 15:51:44 oleg256-client systemd[1]: Started Session 195 of user root. Oct 10 15:51:44 oleg256-client sshd[41933]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:44 oleg256-client sshd[41946]: Received disconnect from 192.168.202.56 port 59212:11: disconnected by user Oct 10 15:51:44 oleg256-client sshd[41946]: Disconnected from user root 192.168.202.56 port 59212 Oct 10 15:51:44 oleg256-client sshd[41933]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:44 oleg256-client systemd-logind[1023]: Session 195 logged out. Waiting for processes to exit. Oct 10 15:51:44 oleg256-client systemd[1]: session-195.scope: Succeeded. Oct 10 15:51:44 oleg256-client systemd-logind[1023]: Removed session 195. Oct 10 15:51:45 oleg256-client sshd[42086]: Accepted publickey for root from 192.168.202.56 port 59214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:45 oleg256-client systemd-logind[1023]: New session 196 of user root. Oct 10 15:51:45 oleg256-client systemd[1]: Started Session 196 of user root. Oct 10 15:51:45 oleg256-client sshd[42086]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:45 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 199: load lnet w/o module option, configure interface twice ========================================================== 15:51:44 (1760125904) Oct 10 15:51:45 oleg256-client sshd[42099]: Received disconnect from 192.168.202.56 port 59214:11: disconnected by user Oct 10 15:51:45 oleg256-client sshd[42099]: Disconnected from user root 192.168.202.56 port 59214 Oct 10 15:51:45 oleg256-client sshd[42086]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:51:45 oleg256-client kernel: LNet: 42132:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:51:45 oleg256-client kernel: LNetError: 42132:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:51:45 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:51:45 oleg256-client systemd[1]: session-196.scope: Succeeded. Oct 10 15:51:45 oleg256-client systemd-logind[1023]: Session 196 logged out. Waiting for processes to exit. Oct 10 15:51:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:51:45 oleg256-client systemd-logind[1023]: Removed session 196. Oct 10 15:51:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:51:45 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:51:45 oleg256-client root[42170]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:51:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --ip2net tcp 192.168.202.56 Oct 10 15:51:46 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:51:46 oleg256-client sshd[42351]: Accepted publickey for root from 192.168.202.56 port 59228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:46 oleg256-client systemd[1]: Started Session 197 of user root. Oct 10 15:51:46 oleg256-client systemd-logind[1023]: New session 197 of user root. Oct 10 15:51:46 oleg256-client sshd[42351]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:47 oleg256-client sshd[42365]: Received disconnect from 192.168.202.56 port 59228:11: disconnected by user Oct 10 15:51:47 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:51:47 oleg256-client sshd[42365]: Disconnected from user root 192.168.202.56 port 59228 Oct 10 15:51:47 oleg256-client sshd[42351]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:47 oleg256-client systemd[1]: session-197.scope: Succeeded. Oct 10 15:51:47 oleg256-client systemd-logind[1023]: Session 197 logged out. Waiting for processes to exit. Oct 10 15:51:47 oleg256-client systemd-logind[1023]: Removed session 197. Oct 10 15:51:47 oleg256-client sshd[42490]: Accepted publickey for root from 192.168.202.56 port 59244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:47 oleg256-client systemd[1]: Started Session 198 of user root. Oct 10 15:51:47 oleg256-client systemd-logind[1023]: New session 198 of user root. Oct 10 15:51:47 oleg256-client sshd[42490]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:47 oleg256-client sshd[42503]: Received disconnect from 192.168.202.56 port 59244:11: disconnected by user Oct 10 15:51:47 oleg256-client sshd[42503]: Disconnected from user root 192.168.202.56 port 59244 Oct 10 15:51:47 oleg256-client sshd[42490]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:48 oleg256-client systemd[1]: session-198.scope: Succeeded. Oct 10 15:51:48 oleg256-client systemd-logind[1023]: Session 198 logged out. Waiting for processes to exit. Oct 10 15:51:48 oleg256-client systemd-logind[1023]: Removed session 198. Oct 10 15:51:48 oleg256-client sshd[42634]: Accepted publickey for root from 192.168.202.56 port 59256 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:48 oleg256-client systemd-logind[1023]: New session 199 of user root. Oct 10 15:51:48 oleg256-client systemd[1]: Started Session 199 of user root. Oct 10 15:51:48 oleg256-client sshd[42634]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:48 oleg256-client sshd[42647]: Received disconnect from 192.168.202.56 port 59256:11: disconnected by user Oct 10 15:51:48 oleg256-client sshd[42647]: Disconnected from user root 192.168.202.56 port 59256 Oct 10 15:51:48 oleg256-client sshd[42634]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:48 oleg256-client systemd[1]: session-199.scope: Succeeded. Oct 10 15:51:48 oleg256-client systemd-logind[1023]: Session 199 logged out. Waiting for processes to exit. Oct 10 15:51:48 oleg256-client systemd-logind[1023]: Removed session 199. Oct 10 15:51:49 oleg256-client sshd[42787]: Accepted publickey for root from 192.168.202.56 port 59264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:49 oleg256-client systemd[1]: Started Session 200 of user root. Oct 10 15:51:49 oleg256-client systemd-logind[1023]: New session 200 of user root. Oct 10 15:51:49 oleg256-client sshd[42787]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:49 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 200: load lnet w/o module option, configure in a non-default namespace ========================================================== 15:51:48 (1760125908) Oct 10 15:51:49 oleg256-client sshd[42800]: Received disconnect from 192.168.202.56 port 59264:11: disconnected by user Oct 10 15:51:49 oleg256-client sshd[42800]: Disconnected from user root 192.168.202.56 port 59264 Oct 10 15:51:49 oleg256-client sshd[42787]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:49 oleg256-client kernel: LNet: 42834:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:51:49 oleg256-client kernel: LNetError: 42834:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:51:49 oleg256-client systemd-logind[1023]: Session 200 logged out. Waiting for processes to exit. Oct 10 15:51:49 oleg256-client systemd[1]: session-200.scope: Succeeded. Oct 10 15:51:49 oleg256-client systemd-logind[1023]: Removed session 200. Oct 10 15:51:49 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:51:50 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:51:50 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:51:50 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:51:50 oleg256-client systemd-udevd[42912]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:51:50 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:51:53 oleg256-client NetworkManager[1026]: [1760125913.4210] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/11) Oct 10 15:51:53 oleg256-client systemd-udevd[43048]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:51:53 oleg256-client systemd-udevd[43048]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:51:53 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:51:53 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:51:53 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:51:53 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:51:53 oleg256-client NetworkManager[1026]: [1760125913.6300] device (test1pl): carrier: link connected Oct 10 15:51:55 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:51:55 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:51:55 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:51:55 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:51:56 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:51:56 oleg256-client systemd[1]: run-netns-test_ns.mount: Succeeded. Oct 10 15:51:56 oleg256-client sshd[43243]: Accepted publickey for root from 192.168.202.56 port 42830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:56 oleg256-client systemd-logind[1023]: New session 201 of user root. Oct 10 15:51:56 oleg256-client systemd[1]: Started Session 201 of user root. Oct 10 15:51:56 oleg256-client sshd[43243]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:57 oleg256-client sshd[43256]: Received disconnect from 192.168.202.56 port 42830:11: disconnected by user Oct 10 15:51:57 oleg256-client sshd[43256]: Disconnected from user root 192.168.202.56 port 42830 Oct 10 15:51:57 oleg256-client sshd[43243]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:57 oleg256-client systemd[1]: session-201.scope: Succeeded. Oct 10 15:51:57 oleg256-client systemd-logind[1023]: Session 201 logged out. Waiting for processes to exit. Oct 10 15:51:57 oleg256-client systemd-logind[1023]: Removed session 201. Oct 10 15:51:57 oleg256-client sshd[43381]: Accepted publickey for root from 192.168.202.56 port 42844 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:57 oleg256-client systemd-logind[1023]: New session 202 of user root. Oct 10 15:51:57 oleg256-client systemd[1]: Started Session 202 of user root. Oct 10 15:51:57 oleg256-client sshd[43381]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:58 oleg256-client sshd[43394]: Received disconnect from 192.168.202.56 port 42844:11: disconnected by user Oct 10 15:51:58 oleg256-client sshd[43394]: Disconnected from user root 192.168.202.56 port 42844 Oct 10 15:51:58 oleg256-client sshd[43381]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:58 oleg256-client systemd[1]: session-202.scope: Succeeded. Oct 10 15:51:58 oleg256-client systemd-logind[1023]: Session 202 logged out. Waiting for processes to exit. Oct 10 15:51:58 oleg256-client systemd-logind[1023]: Removed session 202. Oct 10 15:51:58 oleg256-client sshd[43525]: Accepted publickey for root from 192.168.202.56 port 42856 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:58 oleg256-client systemd-logind[1023]: New session 203 of user root. Oct 10 15:51:58 oleg256-client systemd[1]: Started Session 203 of user root. Oct 10 15:51:58 oleg256-client sshd[43525]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:58 oleg256-client sshd[43538]: Received disconnect from 192.168.202.56 port 42856:11: disconnected by user Oct 10 15:51:59 oleg256-client sshd[43538]: Disconnected from user root 192.168.202.56 port 42856 Oct 10 15:51:59 oleg256-client sshd[43525]: pam_unix(sshd:session): session closed for user root Oct 10 15:51:59 oleg256-client systemd[1]: session-203.scope: Succeeded. Oct 10 15:51:59 oleg256-client systemd-logind[1023]: Session 203 logged out. Waiting for processes to exit. Oct 10 15:51:59 oleg256-client systemd-logind[1023]: Removed session 203. Oct 10 15:51:59 oleg256-client sshd[43678]: Accepted publickey for root from 192.168.202.56 port 42858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:51:59 oleg256-client systemd[1]: Started Session 204 of user root. Oct 10 15:51:59 oleg256-client systemd-logind[1023]: New session 204 of user root. Oct 10 15:51:59 oleg256-client sshd[43678]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:51:59 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 201: load lnet using networks module options in a non-default namespace ========================================================== 15:51:59 (1760125919) Oct 10 15:51:59 oleg256-client sshd[43691]: Received disconnect from 192.168.202.56 port 42858:11: disconnected by user Oct 10 15:51:59 oleg256-client sshd[43691]: Disconnected from user root 192.168.202.56 port 42858 Oct 10 15:52:00 oleg256-client sshd[43678]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:00 oleg256-client kernel: LNet: 43724:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:52:00 oleg256-client kernel: LNetError: 43724:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface test1pg not found Oct 10 15:52:00 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:52:00 oleg256-client systemd[1]: session-204.scope: Succeeded. Oct 10 15:52:00 oleg256-client systemd-logind[1023]: Session 204 logged out. Waiting for processes to exit. Oct 10 15:52:00 oleg256-client systemd-logind[1023]: Removed session 204. Oct 10 15:52:00 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:52:00 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:52:00 oleg256-client systemd-udevd[43807]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:52:00 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:52:00 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:52:03 oleg256-client NetworkManager[1026]: [1760125923.4577] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/12) Oct 10 15:52:03 oleg256-client systemd-udevd[43940]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:52:03 oleg256-client systemd-udevd[43940]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:52:03 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:52:03 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:52:03 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:52:03 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:52:03 oleg256-client NetworkManager[1026]: [1760125923.6376] device (test1pl): carrier: link connected Oct 10 15:52:06 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:52:06 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:52:06 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:52:06 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:52:07 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:52:07 oleg256-client systemd[1]: run-netns-test_ns.mount: Succeeded. Oct 10 15:52:07 oleg256-client sshd[44132]: Accepted publickey for root from 192.168.202.56 port 59726 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:07 oleg256-client systemd[1]: Started Session 205 of user root. Oct 10 15:52:07 oleg256-client systemd-logind[1023]: New session 205 of user root. Oct 10 15:52:07 oleg256-client sshd[44132]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:08 oleg256-client sshd[44145]: Received disconnect from 192.168.202.56 port 59726:11: disconnected by user Oct 10 15:52:08 oleg256-client sshd[44145]: Disconnected from user root 192.168.202.56 port 59726 Oct 10 15:52:08 oleg256-client sshd[44132]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:08 oleg256-client systemd[1]: session-205.scope: Succeeded. Oct 10 15:52:08 oleg256-client systemd-logind[1023]: Session 205 logged out. Waiting for processes to exit. Oct 10 15:52:08 oleg256-client systemd-logind[1023]: Removed session 205. Oct 10 15:52:08 oleg256-client sshd[44269]: Accepted publickey for root from 192.168.202.56 port 59742 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:08 oleg256-client systemd-logind[1023]: New session 206 of user root. Oct 10 15:52:08 oleg256-client systemd[1]: Started Session 206 of user root. Oct 10 15:52:08 oleg256-client sshd[44269]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:08 oleg256-client sshd[44282]: Received disconnect from 192.168.202.56 port 59742:11: disconnected by user Oct 10 15:52:08 oleg256-client sshd[44282]: Disconnected from user root 192.168.202.56 port 59742 Oct 10 15:52:08 oleg256-client sshd[44269]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:08 oleg256-client systemd-logind[1023]: Session 206 logged out. Waiting for processes to exit. Oct 10 15:52:08 oleg256-client systemd[1]: session-206.scope: Succeeded. Oct 10 15:52:08 oleg256-client systemd-logind[1023]: Removed session 206. Oct 10 15:52:09 oleg256-client sshd[44413]: Accepted publickey for root from 192.168.202.56 port 59756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:09 oleg256-client systemd[1]: Started Session 207 of user root. Oct 10 15:52:09 oleg256-client systemd-logind[1023]: New session 207 of user root. Oct 10 15:52:09 oleg256-client sshd[44413]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:09 oleg256-client sshd[44426]: Received disconnect from 192.168.202.56 port 59756:11: disconnected by user Oct 10 15:52:09 oleg256-client sshd[44426]: Disconnected from user root 192.168.202.56 port 59756 Oct 10 15:52:09 oleg256-client sshd[44413]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:09 oleg256-client systemd-logind[1023]: Session 207 logged out. Waiting for processes to exit. Oct 10 15:52:09 oleg256-client systemd[1]: session-207.scope: Succeeded. Oct 10 15:52:09 oleg256-client systemd-logind[1023]: Removed session 207. Oct 10 15:52:10 oleg256-client sshd[44566]: Accepted publickey for root from 192.168.202.56 port 59758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:10 oleg256-client systemd-logind[1023]: New session 208 of user root. Oct 10 15:52:10 oleg256-client systemd[1]: Started Session 208 of user root. Oct 10 15:52:10 oleg256-client sshd[44566]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:10 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 202: load lnet using ip2nets in a non-default namespace ========================================================== 15:52:09 (1760125929) Oct 10 15:52:10 oleg256-client sshd[44579]: Received disconnect from 192.168.202.56 port 59758:11: disconnected by user Oct 10 15:52:10 oleg256-client sshd[44579]: Disconnected from user root 192.168.202.56 port 59758 Oct 10 15:52:10 oleg256-client sshd[44566]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:10 oleg256-client kernel: LNet: 44607:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:52:10 oleg256-client kernel: LNetError: 44607:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface test1pg not found Oct 10 15:52:10 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:52:10 oleg256-client systemd[1]: session-208.scope: Succeeded. Oct 10 15:52:10 oleg256-client systemd-logind[1023]: Session 208 logged out. Waiting for processes to exit. Oct 10 15:52:10 oleg256-client systemd-logind[1023]: Removed session 208. Oct 10 15:52:11 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:52:11 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:52:11 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:52:11 oleg256-client systemd-udevd[44691]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:52:11 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:52:14 oleg256-client systemd-udevd[44828]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:52:14 oleg256-client systemd-udevd[44828]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:52:14 oleg256-client NetworkManager[1026]: [1760125934.7819] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/13) Oct 10 15:52:14 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:52:15 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:52:15 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:52:15 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:52:15 oleg256-client NetworkManager[1026]: [1760125935.0130] device (test1pl): carrier: link connected Oct 10 15:52:17 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:52:17 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:52:17 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:52:17 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:52:18 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:52:18 oleg256-client systemd[1]: run-netns-test_ns.mount: Succeeded. Oct 10 15:52:19 oleg256-client sshd[45020]: Accepted publickey for root from 192.168.202.56 port 57452 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:19 oleg256-client systemd[1]: Started Session 209 of user root. Oct 10 15:52:19 oleg256-client systemd-logind[1023]: New session 209 of user root. Oct 10 15:52:19 oleg256-client sshd[45020]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:19 oleg256-client sshd[45033]: Received disconnect from 192.168.202.56 port 57452:11: disconnected by user Oct 10 15:52:19 oleg256-client sshd[45033]: Disconnected from user root 192.168.202.56 port 57452 Oct 10 15:52:19 oleg256-client sshd[45020]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:19 oleg256-client systemd-logind[1023]: Session 209 logged out. Waiting for processes to exit. Oct 10 15:52:19 oleg256-client systemd[1]: session-209.scope: Succeeded. Oct 10 15:52:19 oleg256-client systemd-logind[1023]: Removed session 209. Oct 10 15:52:20 oleg256-client sshd[45157]: Accepted publickey for root from 192.168.202.56 port 57466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:20 oleg256-client systemd[1]: Started Session 210 of user root. Oct 10 15:52:20 oleg256-client systemd-logind[1023]: New session 210 of user root. Oct 10 15:52:20 oleg256-client sshd[45157]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:20 oleg256-client sshd[45170]: Received disconnect from 192.168.202.56 port 57466:11: disconnected by user Oct 10 15:52:20 oleg256-client sshd[45170]: Disconnected from user root 192.168.202.56 port 57466 Oct 10 15:52:20 oleg256-client sshd[45157]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:20 oleg256-client systemd[1]: session-210.scope: Succeeded. Oct 10 15:52:20 oleg256-client systemd-logind[1023]: Session 210 logged out. Waiting for processes to exit. Oct 10 15:52:20 oleg256-client systemd-logind[1023]: Removed session 210. Oct 10 15:52:21 oleg256-client sshd[45301]: Accepted publickey for root from 192.168.202.56 port 57468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:21 oleg256-client systemd-logind[1023]: New session 211 of user root. Oct 10 15:52:21 oleg256-client systemd[1]: Started Session 211 of user root. Oct 10 15:52:21 oleg256-client sshd[45301]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:21 oleg256-client sshd[45314]: Received disconnect from 192.168.202.56 port 57468:11: disconnected by user Oct 10 15:52:21 oleg256-client sshd[45314]: Disconnected from user root 192.168.202.56 port 57468 Oct 10 15:52:21 oleg256-client sshd[45301]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:21 oleg256-client systemd[1]: session-211.scope: Succeeded. Oct 10 15:52:21 oleg256-client systemd-logind[1023]: Session 211 logged out. Waiting for processes to exit. Oct 10 15:52:21 oleg256-client systemd-logind[1023]: Removed session 211. Oct 10 15:52:22 oleg256-client sshd[45454]: Accepted publickey for root from 192.168.202.56 port 57484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:22 oleg256-client systemd-logind[1023]: New session 212 of user root. Oct 10 15:52:22 oleg256-client systemd[1]: Started Session 212 of user root. Oct 10 15:52:22 oleg256-client sshd[45454]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:22 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 203: add a network using an interface in the non-default namespace ========================================================== 15:52:21 (1760125941) Oct 10 15:52:22 oleg256-client sshd[45468]: Received disconnect from 192.168.202.56 port 57484:11: disconnected by user Oct 10 15:52:22 oleg256-client sshd[45468]: Disconnected from user root 192.168.202.56 port 57484 Oct 10 15:52:23 oleg256-client sshd[45454]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:23 oleg256-client kernel: LNet: 45500:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:52:23 oleg256-client kernel: LNetError: 45500:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface test1pg not found Oct 10 15:52:23 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:52:23 oleg256-client systemd[1]: session-212.scope: Succeeded. Oct 10 15:52:23 oleg256-client systemd-logind[1023]: Session 212 logged out. Waiting for processes to exit. Oct 10 15:52:23 oleg256-client systemd-logind[1023]: Removed session 212. Oct 10 15:52:23 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:52:23 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:52:23 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:52:23 oleg256-client systemd-udevd[45580]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:52:23 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:52:26 oleg256-client NetworkManager[1026]: [1760125946.9524] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/14) Oct 10 15:52:26 oleg256-client systemd-udevd[45716]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:52:26 oleg256-client systemd-udevd[45716]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:52:26 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:52:27 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:52:27 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:52:27 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:52:27 oleg256-client NetworkManager[1026]: [1760125947.1797] device (test1pl): carrier: link connected Oct 10 15:52:29 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:52:29 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:52:29 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:52:29 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:52:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:52:30 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:52:30 oleg256-client root[45838]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 15:52:31 oleg256-client root[45981]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 15:52:31 oleg256-client root[45982]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 15:52:31 oleg256-client root[45983]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 15:52:31 oleg256-client root[46098]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 15:52:31 oleg256-client root[46099]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 15:52:31 oleg256-client root[46100]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 15:52:31 oleg256-client systemd[1]: run-netns-test_ns.mount: Succeeded. Oct 10 15:52:32 oleg256-client sshd[46196]: Accepted publickey for root from 192.168.202.56 port 50102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:32 oleg256-client systemd-logind[1023]: New session 213 of user root. Oct 10 15:52:32 oleg256-client systemd[1]: Started Session 213 of user root. Oct 10 15:52:32 oleg256-client sshd[46196]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:32 oleg256-client sshd[46209]: Received disconnect from 192.168.202.56 port 50102:11: disconnected by user Oct 10 15:52:32 oleg256-client sshd[46209]: Disconnected from user root 192.168.202.56 port 50102 Oct 10 15:52:32 oleg256-client sshd[46196]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:32 oleg256-client systemd-logind[1023]: Session 213 logged out. Waiting for processes to exit. Oct 10 15:52:32 oleg256-client systemd[1]: session-213.scope: Succeeded. Oct 10 15:52:32 oleg256-client systemd-logind[1023]: Removed session 213. Oct 10 15:52:33 oleg256-client sshd[46333]: Accepted publickey for root from 192.168.202.56 port 50106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:33 oleg256-client systemd-logind[1023]: New session 214 of user root. Oct 10 15:52:33 oleg256-client systemd[1]: Started Session 214 of user root. Oct 10 15:52:33 oleg256-client sshd[46333]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:33 oleg256-client sshd[46346]: Received disconnect from 192.168.202.56 port 50106:11: disconnected by user Oct 10 15:52:33 oleg256-client sshd[46346]: Disconnected from user root 192.168.202.56 port 50106 Oct 10 15:52:33 oleg256-client sshd[46333]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:33 oleg256-client systemd[1]: session-214.scope: Succeeded. Oct 10 15:52:33 oleg256-client systemd-logind[1023]: Session 214 logged out. Waiting for processes to exit. Oct 10 15:52:33 oleg256-client systemd-logind[1023]: Removed session 214. Oct 10 15:52:34 oleg256-client sshd[46477]: Accepted publickey for root from 192.168.202.56 port 55328 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:34 oleg256-client systemd-logind[1023]: New session 215 of user root. Oct 10 15:52:34 oleg256-client systemd[1]: Started Session 215 of user root. Oct 10 15:52:34 oleg256-client sshd[46477]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:34 oleg256-client sshd[46490]: Received disconnect from 192.168.202.56 port 55328:11: disconnected by user Oct 10 15:52:34 oleg256-client sshd[46490]: Disconnected from user root 192.168.202.56 port 55328 Oct 10 15:52:34 oleg256-client sshd[46477]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:34 oleg256-client systemd[1]: session-215.scope: Succeeded. Oct 10 15:52:34 oleg256-client systemd-logind[1023]: Session 215 logged out. Waiting for processes to exit. Oct 10 15:52:34 oleg256-client systemd-logind[1023]: Removed session 215. Oct 10 15:52:35 oleg256-client sshd[46630]: Accepted publickey for root from 192.168.202.56 port 55332 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:35 oleg256-client systemd-logind[1023]: New session 216 of user root. Oct 10 15:52:35 oleg256-client systemd[1]: Started Session 216 of user root. Oct 10 15:52:35 oleg256-client sshd[46630]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:35 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 204: Check no health or resends for single-rail local failures ========================================================== 15:52:34 (1760125954) Oct 10 15:52:35 oleg256-client sshd[46643]: Received disconnect from 192.168.202.56 port 55332:11: disconnected by user Oct 10 15:52:35 oleg256-client sshd[46643]: Disconnected from user root 192.168.202.56 port 55332 Oct 10 15:52:35 oleg256-client sshd[46630]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:35 oleg256-client systemd-logind[1023]: Session 216 logged out. Waiting for processes to exit. Oct 10 15:52:35 oleg256-client systemd[1]: session-216.scope: Succeeded. Oct 10 15:52:35 oleg256-client systemd-logind[1023]: Removed session 216. Oct 10 15:52:35 oleg256-client kernel: LNet: 46724:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:52:35 oleg256-client kernel: LNetError: 46724:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface test1pg not found Oct 10 15:52:35 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:52:35 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:52:35 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:52:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:52:36 oleg256-client systemd-udevd[46795]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:52:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:52:38 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:52:38 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:52:38 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:52:38 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:52:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:52:39 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:52:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_interrupt -r 1 Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_interrupt -r 1 Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:52:44 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:52:44 oleg256-client kernel: LNet: 47149:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_dropped -r 1 Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_dropped -r 1 Oct 10 15:52:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:52:44 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:52:45 oleg256-client kernel: LNet: 47246:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_aborted -r 1 Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_aborted -r 1 Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:52:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_no_route -r 1 Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_no_route -r 1 Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:52:46 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:52:46 oleg256-client kernel: LNet: Skipped 1 previous similar message Oct 10 15:52:46 oleg256-client kernel: LNet: 47440:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:52:46 oleg256-client kernel: LNet: 47440:0:(api-ni.c:339:recovery_interval_set()) Skipped 1 previous similar message Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_timeout -r 1 Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_timeout -r 1 Oct 10 15:52:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_error -r 1 Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_error -r 1 Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:52:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:52:48 oleg256-client kernel: LNet: 47671:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:52:48 oleg256-client kernel: LNetError: 47671:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:52:48 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:52:48 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:52:48 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:52:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:52:48 oleg256-client systemd-udevd[47736]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:52:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:52:55 oleg256-client sshd[47967]: Accepted publickey for root from 192.168.202.56 port 50846 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:55 oleg256-client systemd-logind[1023]: New session 217 of user root. Oct 10 15:52:55 oleg256-client systemd[1]: Started Session 217 of user root. Oct 10 15:52:55 oleg256-client sshd[47967]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:55 oleg256-client sshd[47980]: Received disconnect from 192.168.202.56 port 50846:11: disconnected by user Oct 10 15:52:55 oleg256-client sshd[47980]: Disconnected from user root 192.168.202.56 port 50846 Oct 10 15:52:55 oleg256-client sshd[47967]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:55 oleg256-client systemd-logind[1023]: Session 217 logged out. Waiting for processes to exit. Oct 10 15:52:55 oleg256-client systemd[1]: session-217.scope: Succeeded. Oct 10 15:52:55 oleg256-client systemd-logind[1023]: Removed session 217. Oct 10 15:52:56 oleg256-client sshd[48104]: Accepted publickey for root from 192.168.202.56 port 50852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:56 oleg256-client systemd[1]: Started Session 218 of user root. Oct 10 15:52:56 oleg256-client systemd-logind[1023]: New session 218 of user root. Oct 10 15:52:56 oleg256-client sshd[48104]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:56 oleg256-client sshd[48117]: Received disconnect from 192.168.202.56 port 50852:11: disconnected by user Oct 10 15:52:56 oleg256-client sshd[48117]: Disconnected from user root 192.168.202.56 port 50852 Oct 10 15:52:56 oleg256-client sshd[48104]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:56 oleg256-client systemd[1]: session-218.scope: Succeeded. Oct 10 15:52:56 oleg256-client systemd-logind[1023]: Session 218 logged out. Waiting for processes to exit. Oct 10 15:52:56 oleg256-client systemd-logind[1023]: Removed session 218. Oct 10 15:52:57 oleg256-client sshd[48248]: Accepted publickey for root from 192.168.202.56 port 50862 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:57 oleg256-client systemd-logind[1023]: New session 219 of user root. Oct 10 15:52:57 oleg256-client systemd[1]: Started Session 219 of user root. Oct 10 15:52:57 oleg256-client sshd[48248]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:57 oleg256-client sshd[48262]: Received disconnect from 192.168.202.56 port 50862:11: disconnected by user Oct 10 15:52:57 oleg256-client sshd[48262]: Disconnected from user root 192.168.202.56 port 50862 Oct 10 15:52:57 oleg256-client sshd[48248]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:57 oleg256-client systemd[1]: session-219.scope: Succeeded. Oct 10 15:52:57 oleg256-client systemd-logind[1023]: Session 219 logged out. Waiting for processes to exit. Oct 10 15:52:57 oleg256-client systemd-logind[1023]: Removed session 219. Oct 10 15:52:58 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:52:58 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:52:58 oleg256-client sshd[48411]: Accepted publickey for root from 192.168.202.56 port 50864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:52:58 oleg256-client systemd[1]: Started Session 220 of user root. Oct 10 15:52:58 oleg256-client systemd-logind[1023]: New session 220 of user root. Oct 10 15:52:58 oleg256-client sshd[48411]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:52:59 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 205: Check health and resends for multi-rail local failures ========================================================== 15:52:58 (1760125978) Oct 10 15:52:59 oleg256-client sshd[48424]: Received disconnect from 192.168.202.56 port 50864:11: disconnected by user Oct 10 15:52:59 oleg256-client sshd[48424]: Disconnected from user root 192.168.202.56 port 50864 Oct 10 15:52:59 oleg256-client sshd[48411]: pam_unix(sshd:session): session closed for user root Oct 10 15:52:59 oleg256-client systemd[1]: session-220.scope: Succeeded. Oct 10 15:52:59 oleg256-client systemd-logind[1023]: Session 220 logged out. Waiting for processes to exit. Oct 10 15:52:59 oleg256-client systemd-logind[1023]: Removed session 220. Oct 10 15:52:59 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:52:59 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:52:59 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:53:00 oleg256-client systemd-udevd[48557]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:53:00 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:53:03 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:53:03 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:53:03 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:53:03 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:53:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:53:04 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:53:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:53:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:53:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:53:15 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:53:15 oleg256-client root[48927]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:53:15 oleg256-client root[48938]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_interrupt -r 1 Oct 10 15:53:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:16 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:53:16 oleg256-client kernel: LNet: 1 local NIs in recovery (showing 1): 192.168.202.56@tcp Oct 10 15:53:17 oleg256-client kernel: LNet: 49131:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_dropped -r 1 Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:17 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:53:17 oleg256-client kernel: LNet: Skipped 2 previous similar messages Oct 10 15:53:17 oleg256-client kernel: LNet: 49241:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:53:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_aborted -r 1 Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_no_route -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:19 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:53:19 oleg256-client kernel: LNet: Skipped 7 previous similar messages Oct 10 15:53:19 oleg256-client kernel: LNet: 49459:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:53:19 oleg256-client kernel: LNet: 49459:0:(api-ni.c:339:recovery_interval_set()) Skipped 1 previous similar message Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_timeout -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_timeout -r 1 Oct 10 15:53:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_timeout -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_timeout -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_timeout -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_timeout -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_timeout -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_timeout -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_error -r 1 Oct 10 15:53:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:53:23 oleg256-client kernel: LNet: 49748:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:53:23 oleg256-client kernel: LNetError: 49748:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:53:23 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:53:24 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:53:25 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:53:25 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:53:25 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:53:25 oleg256-client systemd-udevd[49797]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:53:25 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:53:31 oleg256-client sshd[50044]: Accepted publickey for root from 192.168.202.56 port 54002 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:31 oleg256-client systemd-logind[1023]: New session 221 of user root. Oct 10 15:53:31 oleg256-client systemd[1]: Started Session 221 of user root. Oct 10 15:53:31 oleg256-client sshd[50044]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:31 oleg256-client sshd[50057]: Received disconnect from 192.168.202.56 port 54002:11: disconnected by user Oct 10 15:53:31 oleg256-client sshd[50057]: Disconnected from user root 192.168.202.56 port 54002 Oct 10 15:53:31 oleg256-client sshd[50044]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:32 oleg256-client systemd[1]: session-221.scope: Succeeded. Oct 10 15:53:32 oleg256-client systemd-logind[1023]: Session 221 logged out. Waiting for processes to exit. Oct 10 15:53:32 oleg256-client systemd-logind[1023]: Removed session 221. Oct 10 15:53:32 oleg256-client sshd[50182]: Accepted publickey for root from 192.168.202.56 port 54014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:32 oleg256-client systemd-logind[1023]: New session 222 of user root. Oct 10 15:53:32 oleg256-client systemd[1]: Started Session 222 of user root. Oct 10 15:53:32 oleg256-client sshd[50182]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:32 oleg256-client sshd[50195]: Received disconnect from 192.168.202.56 port 54014:11: disconnected by user Oct 10 15:53:32 oleg256-client sshd[50195]: Disconnected from user root 192.168.202.56 port 54014 Oct 10 15:53:32 oleg256-client sshd[50182]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:32 oleg256-client systemd[1]: session-222.scope: Succeeded. Oct 10 15:53:32 oleg256-client systemd-logind[1023]: Session 222 logged out. Waiting for processes to exit. Oct 10 15:53:32 oleg256-client systemd-logind[1023]: Removed session 222. Oct 10 15:53:33 oleg256-client sshd[50327]: Accepted publickey for root from 192.168.202.56 port 42566 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:33 oleg256-client systemd[1]: Started Session 223 of user root. Oct 10 15:53:33 oleg256-client systemd-logind[1023]: New session 223 of user root. Oct 10 15:53:33 oleg256-client sshd[50327]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:33 oleg256-client sshd[50340]: Received disconnect from 192.168.202.56 port 42566:11: disconnected by user Oct 10 15:53:33 oleg256-client sshd[50340]: Disconnected from user root 192.168.202.56 port 42566 Oct 10 15:53:34 oleg256-client sshd[50327]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:34 oleg256-client systemd[1]: session-223.scope: Succeeded. Oct 10 15:53:34 oleg256-client systemd-logind[1023]: Session 223 logged out. Waiting for processes to exit. Oct 10 15:53:34 oleg256-client systemd-logind[1023]: Removed session 223. Oct 10 15:53:34 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:53:34 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:53:34 oleg256-client sshd[50489]: Accepted publickey for root from 192.168.202.56 port 42578 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:34 oleg256-client systemd-logind[1023]: New session 224 of user root. Oct 10 15:53:34 oleg256-client systemd[1]: Started Session 224 of user root. Oct 10 15:53:34 oleg256-client sshd[50489]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:35 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 206: Check no health or resends for single-rail remote failures ========================================================== 15:53:34 (1760126014) Oct 10 15:53:35 oleg256-client sshd[50502]: Received disconnect from 192.168.202.56 port 42578:11: disconnected by user Oct 10 15:53:35 oleg256-client sshd[50502]: Disconnected from user root 192.168.202.56 port 42578 Oct 10 15:53:35 oleg256-client sshd[50489]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:35 oleg256-client systemd[1]: session-224.scope: Succeeded. Oct 10 15:53:35 oleg256-client systemd-logind[1023]: Session 224 logged out. Waiting for processes to exit. Oct 10 15:53:35 oleg256-client systemd-logind[1023]: Removed session 224. Oct 10 15:53:35 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:53:35 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:53:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:53:36 oleg256-client systemd-udevd[50626]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:53:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:53:39 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:53:39 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:53:39 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:53:39 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:53:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:53:40 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:53:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:53:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e remote_dropped -r 1 Oct 10 15:53:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e remote_dropped -r 1 Oct 10 15:53:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:45 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:53:45 oleg256-client kernel: LNet: 50982:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e remote_error -r 1 Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e remote_error -r 1 Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:46 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:53:46 oleg256-client kernel: LNet: 51079:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:53:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e remote_timeout -r 1 Oct 10 15:53:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e remote_timeout -r 1 Oct 10 15:53:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:53:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:53:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:53:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:53:47 oleg256-client kernel: LNet: 51212:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:53:47 oleg256-client kernel: LNetError: 51212:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:53:47 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:53:48 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:53:48 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:53:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:53:48 oleg256-client systemd-udevd[51255]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:53:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:53:54 oleg256-client sshd[51509]: Accepted publickey for root from 192.168.202.56 port 47010 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:54 oleg256-client systemd-logind[1023]: New session 225 of user root. Oct 10 15:53:54 oleg256-client systemd[1]: Started Session 225 of user root. Oct 10 15:53:54 oleg256-client sshd[51509]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:54 oleg256-client sshd[51522]: Received disconnect from 192.168.202.56 port 47010:11: disconnected by user Oct 10 15:53:54 oleg256-client sshd[51522]: Disconnected from user root 192.168.202.56 port 47010 Oct 10 15:53:54 oleg256-client sshd[51509]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:54 oleg256-client systemd[1]: session-225.scope: Succeeded. Oct 10 15:53:54 oleg256-client systemd-logind[1023]: Session 225 logged out. Waiting for processes to exit. Oct 10 15:53:54 oleg256-client systemd-logind[1023]: Removed session 225. Oct 10 15:53:55 oleg256-client sshd[51647]: Accepted publickey for root from 192.168.202.56 port 47024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:55 oleg256-client systemd-logind[1023]: New session 226 of user root. Oct 10 15:53:55 oleg256-client systemd[1]: Started Session 226 of user root. Oct 10 15:53:55 oleg256-client sshd[51647]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:55 oleg256-client sshd[51660]: Received disconnect from 192.168.202.56 port 47024:11: disconnected by user Oct 10 15:53:55 oleg256-client sshd[51660]: Disconnected from user root 192.168.202.56 port 47024 Oct 10 15:53:55 oleg256-client sshd[51647]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:55 oleg256-client systemd-logind[1023]: Session 226 logged out. Waiting for processes to exit. Oct 10 15:53:55 oleg256-client systemd[1]: session-226.scope: Succeeded. Oct 10 15:53:55 oleg256-client systemd-logind[1023]: Removed session 226. Oct 10 15:53:56 oleg256-client sshd[51791]: Accepted publickey for root from 192.168.202.56 port 47036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:56 oleg256-client systemd-logind[1023]: New session 227 of user root. Oct 10 15:53:56 oleg256-client systemd[1]: Started Session 227 of user root. Oct 10 15:53:56 oleg256-client sshd[51791]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:56 oleg256-client sshd[51804]: Received disconnect from 192.168.202.56 port 47036:11: disconnected by user Oct 10 15:53:56 oleg256-client sshd[51804]: Disconnected from user root 192.168.202.56 port 47036 Oct 10 15:53:56 oleg256-client sshd[51791]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:57 oleg256-client systemd[1]: session-227.scope: Succeeded. Oct 10 15:53:57 oleg256-client systemd-logind[1023]: Session 227 logged out. Waiting for processes to exit. Oct 10 15:53:57 oleg256-client systemd-logind[1023]: Removed session 227. Oct 10 15:53:57 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:53:57 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:53:57 oleg256-client sshd[51953]: Accepted publickey for root from 192.168.202.56 port 47042 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:53:57 oleg256-client systemd-logind[1023]: New session 228 of user root. Oct 10 15:53:57 oleg256-client systemd[1]: Started Session 228 of user root. Oct 10 15:53:57 oleg256-client sshd[51953]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:53:57 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 207: Check health and resends for multi-rail remote errors ========================================================== 15:53:57 (1760126037) Oct 10 15:53:57 oleg256-client sshd[51966]: Received disconnect from 192.168.202.56 port 47042:11: disconnected by user Oct 10 15:53:57 oleg256-client sshd[51966]: Disconnected from user root 192.168.202.56 port 47042 Oct 10 15:53:57 oleg256-client sshd[51953]: pam_unix(sshd:session): session closed for user root Oct 10 15:53:58 oleg256-client systemd[1]: session-228.scope: Succeeded. Oct 10 15:53:58 oleg256-client systemd-logind[1023]: Session 228 logged out. Waiting for processes to exit. Oct 10 15:53:58 oleg256-client systemd-logind[1023]: Removed session 228. Oct 10 15:53:58 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:53:58 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:53:58 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:53:58 oleg256-client systemd-udevd[52100]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:53:58 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:01 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:01 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:54:02 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:54:02 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:54:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:54:02 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:54:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:54:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:54:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:54:11 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:54:11 oleg256-client root[52457]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:54:11 oleg256-client root[52468]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e remote_dropped -r 1 Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:54:12 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:54:12 oleg256-client kernel: LNet: 1 peer NIs in recovery (showing 1): 192.168.202.156@tcp Oct 10 15:54:12 oleg256-client kernel: LNet: 52661:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:54:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e remote_error -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:54:13 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:54:13 oleg256-client kernel: LNet: Skipped 2 previous similar messages Oct 10 15:54:13 oleg256-client kernel: LNet: 52772:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e remote_timeout -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e remote_timeout -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e remote_timeout -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e remote_timeout -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e remote_timeout -r 1 Oct 10 15:54:13 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e remote_timeout -r 1 Oct 10 15:54:13 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e remote_timeout -r 1 Oct 10 15:54:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e remote_timeout -r 1 Oct 10 15:54:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.156@tcp Oct 10 15:54:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:54:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:54:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:54:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:54:17 oleg256-client kernel: LNet: 52957:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:54:17 oleg256-client kernel: LNetError: 52957:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:54:17 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:54:17 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:54:17 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:54:17 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:54:18 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:54:18 oleg256-client systemd-udevd[53002]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:54:18 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:23 oleg256-client sshd[53253]: Accepted publickey for root from 192.168.202.56 port 56704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:54:23 oleg256-client systemd-logind[1023]: New session 229 of user root. Oct 10 15:54:23 oleg256-client systemd[1]: Started Session 229 of user root. Oct 10 15:54:23 oleg256-client sshd[53253]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:54:24 oleg256-client sshd[53266]: Received disconnect from 192.168.202.56 port 56704:11: disconnected by user Oct 10 15:54:24 oleg256-client sshd[53266]: Disconnected from user root 192.168.202.56 port 56704 Oct 10 15:54:24 oleg256-client sshd[53253]: pam_unix(sshd:session): session closed for user root Oct 10 15:54:24 oleg256-client systemd[1]: session-229.scope: Succeeded. Oct 10 15:54:24 oleg256-client systemd-logind[1023]: Session 229 logged out. Waiting for processes to exit. Oct 10 15:54:24 oleg256-client systemd-logind[1023]: Removed session 229. Oct 10 15:54:24 oleg256-client sshd[53390]: Accepted publickey for root from 192.168.202.56 port 56714 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:54:24 oleg256-client systemd-logind[1023]: New session 230 of user root. Oct 10 15:54:24 oleg256-client systemd[1]: Started Session 230 of user root. Oct 10 15:54:24 oleg256-client sshd[53390]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:54:24 oleg256-client sshd[53404]: Received disconnect from 192.168.202.56 port 56714:11: disconnected by user Oct 10 15:54:24 oleg256-client sshd[53404]: Disconnected from user root 192.168.202.56 port 56714 Oct 10 15:54:24 oleg256-client sshd[53390]: pam_unix(sshd:session): session closed for user root Oct 10 15:54:24 oleg256-client systemd-logind[1023]: Session 230 logged out. Waiting for processes to exit. Oct 10 15:54:24 oleg256-client systemd[1]: session-230.scope: Succeeded. Oct 10 15:54:24 oleg256-client systemd-logind[1023]: Removed session 230. Oct 10 15:54:25 oleg256-client sshd[53535]: Accepted publickey for root from 192.168.202.56 port 56726 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:54:25 oleg256-client systemd[1]: Started Session 231 of user root. Oct 10 15:54:25 oleg256-client systemd-logind[1023]: New session 231 of user root. Oct 10 15:54:25 oleg256-client sshd[53535]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:54:25 oleg256-client sshd[53548]: Received disconnect from 192.168.202.56 port 56726:11: disconnected by user Oct 10 15:54:25 oleg256-client sshd[53548]: Disconnected from user root 192.168.202.56 port 56726 Oct 10 15:54:25 oleg256-client sshd[53535]: pam_unix(sshd:session): session closed for user root Oct 10 15:54:25 oleg256-client systemd[1]: session-231.scope: Succeeded. Oct 10 15:54:25 oleg256-client systemd-logind[1023]: Session 231 logged out. Waiting for processes to exit. Oct 10 15:54:25 oleg256-client systemd-logind[1023]: Removed session 231. Oct 10 15:54:25 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:25 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:54:26 oleg256-client sshd[53697]: Accepted publickey for root from 192.168.202.56 port 56728 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:54:26 oleg256-client systemd[1]: Started Session 232 of user root. Oct 10 15:54:26 oleg256-client systemd-logind[1023]: New session 232 of user root. Oct 10 15:54:26 oleg256-client sshd[53697]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:54:26 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 208: Test various kernel ip2nets configurations ========================================================== 15:54:25 (1760126065) Oct 10 15:54:26 oleg256-client sshd[53710]: Received disconnect from 192.168.202.56 port 56728:11: disconnected by user Oct 10 15:54:26 oleg256-client sshd[53710]: Disconnected from user root 192.168.202.56 port 56728 Oct 10 15:54:26 oleg256-client sshd[53697]: pam_unix(sshd:session): session closed for user root Oct 10 15:54:26 oleg256-client systemd-logind[1023]: Session 232 logged out. Waiting for processes to exit. Oct 10 15:54:26 oleg256-client systemd[1]: session-232.scope: Succeeded. Oct 10 15:54:26 oleg256-client systemd-logind[1023]: Removed session 232. Oct 10 15:54:26 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:54:26 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:54:27 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:54:27 oleg256-client systemd-udevd[53790]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:54:27 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:29 oleg256-client NetworkManager[1026]: [1760126069.6452] manager: (test1pg): new Veth device (/org/freedesktop/NetworkManager/Devices/15) Oct 10 15:54:29 oleg256-client systemd-udevd[53926]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:54:29 oleg256-client systemd-udevd[53926]: Could not generate persistent MAC address for test1pg: No such file or directory Oct 10 15:54:29 oleg256-client systemd-udevd[53928]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:54:29 oleg256-client systemd-udevd[53928]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:54:29 oleg256-client NetworkManager[1026]: [1760126069.6556] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/16) Oct 10 15:54:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:54:29 oleg256-client NetworkManager[1026]: [1760126069.7748] device (test1pg): carrier: link connected Oct 10 15:54:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:54:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:54:29 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:54:29 oleg256-client NetworkManager[1026]: [1760126069.7857] device (test1pl): carrier: link connected Oct 10 15:54:32 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:32 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:54:32 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:54:32 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:54:32 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:54:33 oleg256-client kernel: LNet: 54041:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:54:33 oleg256-client kernel: LNetError: 54041:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:54:33 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:54:33 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:54:33 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:54:33 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:54:33 oleg256-client systemd-udevd[54114]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:54:33 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:36 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:36 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:54:36 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:54:36 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:54:37 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:54:37 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp1 [8/256/0/180] Oct 10 15:54:37 oleg256-client kernel: LNet: 54310:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:54:37 oleg256-client kernel: LNetError: 54310:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:54:37 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:54:37 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp1 Oct 10 15:54:37 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:54:37 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:54:37 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:54:37 oleg256-client systemd-udevd[54386]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:54:37 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:40 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:40 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:54:40 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:54:40 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:54:41 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:54:41 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:54:41 oleg256-client kernel: LNet: 54579:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:54:41 oleg256-client kernel: LNetError: 54579:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:54:41 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:54:41 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:54:42 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:54:42 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:54:42 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:54:42 oleg256-client systemd-udevd[54657]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:54:42 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:45 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:45 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:54:46 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:54:46 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:54:46 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:54:46 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:54:46 oleg256-client kernel: LNet: 54849:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:54:46 oleg256-client kernel: LNetError: 54849:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:54:46 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:54:46 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:54:47 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:54:47 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:54:47 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:54:47 oleg256-client systemd-udevd[54935]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:54:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:51 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:51 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:54:51 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:54:51 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:54:52 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:54:52 oleg256-client kernel: LNetError: 55109:0:(config.c:1557:lnet_inet_select()) ksocklnd: failed to find UP interface test1pg Oct 10 15:54:52 oleg256-client kernel: LNetError: Error -100 starting up LNI tcp Oct 10 15:54:52 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:54:52 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:54:52 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:54:52 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:54:53 oleg256-client systemd-udevd[55192]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:54:53 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:54:56 oleg256-client sshd[55409]: Accepted publickey for root from 192.168.202.56 port 59686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:54:56 oleg256-client systemd-logind[1023]: New session 233 of user root. Oct 10 15:54:56 oleg256-client systemd[1]: Started Session 233 of user root. Oct 10 15:54:56 oleg256-client sshd[55409]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:54:57 oleg256-client sshd[55422]: Received disconnect from 192.168.202.56 port 59686:11: disconnected by user Oct 10 15:54:57 oleg256-client sshd[55422]: Disconnected from user root 192.168.202.56 port 59686 Oct 10 15:54:57 oleg256-client sshd[55409]: pam_unix(sshd:session): session closed for user root Oct 10 15:54:57 oleg256-client systemd-logind[1023]: Session 233 logged out. Waiting for processes to exit. Oct 10 15:54:57 oleg256-client systemd[1]: session-233.scope: Succeeded. Oct 10 15:54:57 oleg256-client systemd-logind[1023]: Removed session 233. Oct 10 15:54:57 oleg256-client sshd[55546]: Accepted publickey for root from 192.168.202.56 port 59694 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:54:57 oleg256-client systemd-logind[1023]: New session 234 of user root. Oct 10 15:54:57 oleg256-client systemd[1]: Started Session 234 of user root. Oct 10 15:54:57 oleg256-client sshd[55546]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:54:58 oleg256-client sshd[55559]: Received disconnect from 192.168.202.56 port 59694:11: disconnected by user Oct 10 15:54:58 oleg256-client sshd[55559]: Disconnected from user root 192.168.202.56 port 59694 Oct 10 15:54:58 oleg256-client sshd[55546]: pam_unix(sshd:session): session closed for user root Oct 10 15:54:58 oleg256-client systemd[1]: session-234.scope: Succeeded. Oct 10 15:54:58 oleg256-client systemd-logind[1023]: Session 234 logged out. Waiting for processes to exit. Oct 10 15:54:58 oleg256-client systemd-logind[1023]: Removed session 234. Oct 10 15:54:58 oleg256-client sshd[55690]: Accepted publickey for root from 192.168.202.56 port 59706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:54:58 oleg256-client systemd-logind[1023]: New session 235 of user root. Oct 10 15:54:58 oleg256-client systemd[1]: Started Session 235 of user root. Oct 10 15:54:58 oleg256-client sshd[55690]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:54:59 oleg256-client sshd[55703]: Received disconnect from 192.168.202.56 port 59706:11: disconnected by user Oct 10 15:54:59 oleg256-client sshd[55703]: Disconnected from user root 192.168.202.56 port 59706 Oct 10 15:54:59 oleg256-client sshd[55690]: pam_unix(sshd:session): session closed for user root Oct 10 15:54:59 oleg256-client systemd[1]: session-235.scope: Succeeded. Oct 10 15:54:59 oleg256-client systemd-logind[1023]: Session 235 logged out. Waiting for processes to exit. Oct 10 15:54:59 oleg256-client systemd-logind[1023]: Removed session 235. Oct 10 15:54:59 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:54:59 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:55:00 oleg256-client sshd[55852]: Accepted publickey for root from 192.168.202.56 port 59710 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:55:00 oleg256-client systemd-logind[1023]: New session 236 of user root. Oct 10 15:55:00 oleg256-client systemd[1]: Started Session 236 of user root. Oct 10 15:55:00 oleg256-client sshd[55852]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:55:00 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 209: Check health, but not resends, for network timeout ========================================================== 15:54:59 (1760126099) Oct 10 15:55:00 oleg256-client sshd[55865]: Received disconnect from 192.168.202.56 port 59710:11: disconnected by user Oct 10 15:55:00 oleg256-client sshd[55865]: Disconnected from user root 192.168.202.56 port 59710 Oct 10 15:55:00 oleg256-client sshd[55852]: pam_unix(sshd:session): session closed for user root Oct 10 15:55:00 oleg256-client systemd-logind[1023]: Session 236 logged out. Waiting for processes to exit. Oct 10 15:55:00 oleg256-client systemd[1]: session-236.scope: Succeeded. Oct 10 15:55:00 oleg256-client systemd-logind[1023]: Removed session 236. Oct 10 15:55:00 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:55:00 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:55:01 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:55:01 oleg256-client systemd-udevd[56000]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:55:01 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:55:04 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:55:04 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:55:04 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:55:04 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:55:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:55:05 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:55:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:55:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e network_timeout -r 1 Oct 10 15:55:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e network_timeout -r 1 Oct 10 15:55:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:55:10 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:55:10 oleg256-client kernel: LNet: 56348:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:55:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:55:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:55:10 oleg256-client kernel: LNet: 56382:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:55:10 oleg256-client kernel: LNetError: 56382:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:55:10 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:55:10 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:55:10 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:55:11 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:55:11 oleg256-client systemd-udevd[56427]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:55:11 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:55:17 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:55:17 oleg256-client systemd-udevd[56685]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:55:17 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:55:20 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:55:20 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:55:20 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:55:20 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:55:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:55:21 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:55:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:55:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:55:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:55:31 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:55:31 oleg256-client root[57038]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:31 oleg256-client root[57049]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e network_timeout -r 1 Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:55:32 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:55:32 oleg256-client kernel: LNet: 57243:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:55:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:55:35 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:55:35 oleg256-client kernel: LNet: 1 local NIs in recovery (showing 1): 192.168.202.56@tcp Oct 10 15:55:35 oleg256-client kernel: LNet: 57311:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:55:35 oleg256-client kernel: LNetError: 57311:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:55:35 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:55:35 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:55:36 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:55:36 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:55:36 oleg256-client systemd-udevd[57368]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:55:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:55:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:55:42 oleg256-client sshd[57606]: Accepted publickey for root from 192.168.202.56 port 41530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:55:42 oleg256-client systemd-logind[1023]: New session 237 of user root. Oct 10 15:55:42 oleg256-client systemd[1]: Started Session 237 of user root. Oct 10 15:55:42 oleg256-client sshd[57606]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:55:42 oleg256-client sshd[57620]: Received disconnect from 192.168.202.56 port 41530:11: disconnected by user Oct 10 15:55:42 oleg256-client sshd[57620]: Disconnected from user root 192.168.202.56 port 41530 Oct 10 15:55:42 oleg256-client sshd[57606]: pam_unix(sshd:session): session closed for user root Oct 10 15:55:42 oleg256-client systemd[1]: session-237.scope: Succeeded. Oct 10 15:55:42 oleg256-client systemd-logind[1023]: Session 237 logged out. Waiting for processes to exit. Oct 10 15:55:42 oleg256-client systemd-logind[1023]: Removed session 237. Oct 10 15:55:43 oleg256-client sshd[57744]: Accepted publickey for root from 192.168.202.56 port 41538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:55:43 oleg256-client systemd-logind[1023]: New session 238 of user root. Oct 10 15:55:43 oleg256-client systemd[1]: Started Session 238 of user root. Oct 10 15:55:43 oleg256-client sshd[57744]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:55:43 oleg256-client sshd[57757]: Received disconnect from 192.168.202.56 port 41538:11: disconnected by user Oct 10 15:55:43 oleg256-client sshd[57757]: Disconnected from user root 192.168.202.56 port 41538 Oct 10 15:55:43 oleg256-client sshd[57744]: pam_unix(sshd:session): session closed for user root Oct 10 15:55:43 oleg256-client systemd[1]: session-238.scope: Succeeded. Oct 10 15:55:43 oleg256-client systemd-logind[1023]: Session 238 logged out. Waiting for processes to exit. Oct 10 15:55:43 oleg256-client systemd-logind[1023]: Removed session 238. Oct 10 15:55:44 oleg256-client sshd[57888]: Accepted publickey for root from 192.168.202.56 port 51606 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:55:44 oleg256-client systemd-logind[1023]: New session 239 of user root. Oct 10 15:55:44 oleg256-client systemd[1]: Started Session 239 of user root. Oct 10 15:55:44 oleg256-client sshd[57888]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:55:44 oleg256-client sshd[57901]: Received disconnect from 192.168.202.56 port 51606:11: disconnected by user Oct 10 15:55:44 oleg256-client sshd[57901]: Disconnected from user root 192.168.202.56 port 51606 Oct 10 15:55:44 oleg256-client sshd[57888]: pam_unix(sshd:session): session closed for user root Oct 10 15:55:44 oleg256-client systemd[1]: session-239.scope: Succeeded. Oct 10 15:55:44 oleg256-client systemd-logind[1023]: Session 239 logged out. Waiting for processes to exit. Oct 10 15:55:44 oleg256-client systemd-logind[1023]: Removed session 239. Oct 10 15:55:44 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:55:44 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:55:45 oleg256-client sshd[58050]: Accepted publickey for root from 192.168.202.56 port 51614 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:55:45 oleg256-client systemd-logind[1023]: New session 240 of user root. Oct 10 15:55:45 oleg256-client systemd[1]: Started Session 240 of user root. Oct 10 15:55:45 oleg256-client sshd[58050]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:55:45 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 210: Local NI recovery checks ======== 15:55:44 (1760126144) Oct 10 15:55:45 oleg256-client sshd[58063]: Received disconnect from 192.168.202.56 port 51614:11: disconnected by user Oct 10 15:55:45 oleg256-client sshd[58063]: Disconnected from user root 192.168.202.56 port 51614 Oct 10 15:55:45 oleg256-client sshd[58050]: pam_unix(sshd:session): session closed for user root Oct 10 15:55:45 oleg256-client systemd[1]: session-240.scope: Succeeded. Oct 10 15:55:45 oleg256-client systemd-logind[1023]: Session 240 logged out. Waiting for processes to exit. Oct 10 15:55:45 oleg256-client systemd-logind[1023]: Removed session 240. Oct 10 15:55:45 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 15:55:45 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:55:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:55:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:55:46 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:55:46 oleg256-client root[58168]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:55:46 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:55:46 oleg256-client root[58277]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:46 oleg256-client root[58288]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 15:55:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 10 Oct 10 15:55:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp -d *@tcp -m GET -r 1 -e local_error Oct 10 15:55:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp1 -d *@tcp1 -m GET -r 1 -e local_error Oct 10 15:55:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp -d *@tcp -r 1 Oct 10 15:55:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp1 -d *@tcp1 -r 1 Oct 10 15:55:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 0 --nid 192.168.202.56@tcp Oct 10 15:55:47 oleg256-client kernel: LNetError: 58399:0:(api-ni.c:4316:lnet_ni_set_healthv()) manually adding local NI 192.168.202.56@tcp to recovery Oct 10 15:55:47 oleg256-client kernel: LNet: 1 local NIs in recovery (showing 1): 192.168.202.56@tcp Oct 10 15:55:47 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:55:49 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:55:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l Oct 10 15:55:52 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:55:52 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l Oct 10 15:55:52 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:55:52 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:55:52 oleg256-client kernel: LNet: 58497:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:55:52 oleg256-client kernel: LNetError: 58497:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:55:52 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:55:52 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:55:52 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:55:52 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:55:52 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:55:53 oleg256-client root[58530]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:53 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:55:53 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:55:53 oleg256-client root[58639]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:53 oleg256-client root[58650]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:55:53 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 15:55:53 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 Oct 10 15:55:53 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 4 Oct 10 15:55:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp -d *@tcp -m GET -r 1 -e local_error Oct 10 15:55:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp1 -d *@tcp1 -m GET -r 1 -e local_error Oct 10 15:55:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp -d *@tcp -r 1 Oct 10 15:55:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp1 -d *@tcp1 -r 1 Oct 10 15:55:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 0 --nid 192.168.202.56@tcp Oct 10 15:55:54 oleg256-client kernel: LNetError: 58763:0:(api-ni.c:4316:lnet_ni_set_healthv()) manually adding local NI 192.168.202.56@tcp to recovery Oct 10 15:55:55 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:55:57 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l Oct 10 15:56:01 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:56:01 oleg256-client kernel: LNet: Skipped 1 previous similar message Oct 10 15:56:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l Oct 10 15:56:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:56:06 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 900 Oct 10 15:56:06 oleg256-client sshd[59004]: Accepted publickey for root from 192.168.202.56 port 60242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:06 oleg256-client systemd[1]: Started Session 241 of user root. Oct 10 15:56:06 oleg256-client systemd-logind[1023]: New session 241 of user root. Oct 10 15:56:06 oleg256-client sshd[59004]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:06 oleg256-client sshd[59017]: Received disconnect from 192.168.202.56 port 60242:11: disconnected by user Oct 10 15:56:06 oleg256-client sshd[59017]: Disconnected from user root 192.168.202.56 port 60242 Oct 10 15:56:06 oleg256-client sshd[59004]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:06 oleg256-client systemd[1]: session-241.scope: Succeeded. Oct 10 15:56:06 oleg256-client systemd-logind[1023]: Session 241 logged out. Waiting for processes to exit. Oct 10 15:56:06 oleg256-client systemd-logind[1023]: Removed session 241. Oct 10 15:56:07 oleg256-client sshd[59141]: Accepted publickey for root from 192.168.202.56 port 60256 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:07 oleg256-client systemd-logind[1023]: New session 242 of user root. Oct 10 15:56:07 oleg256-client systemd[1]: Started Session 242 of user root. Oct 10 15:56:07 oleg256-client sshd[59141]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:07 oleg256-client sshd[59154]: Received disconnect from 192.168.202.56 port 60256:11: disconnected by user Oct 10 15:56:07 oleg256-client sshd[59154]: Disconnected from user root 192.168.202.56 port 60256 Oct 10 15:56:07 oleg256-client sshd[59141]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:07 oleg256-client systemd[1]: session-242.scope: Succeeded. Oct 10 15:56:07 oleg256-client systemd-logind[1023]: Session 242 logged out. Waiting for processes to exit. Oct 10 15:56:07 oleg256-client systemd-logind[1023]: Removed session 242. Oct 10 15:56:08 oleg256-client sshd[59286]: Accepted publickey for root from 192.168.202.56 port 60262 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:08 oleg256-client systemd-logind[1023]: New session 243 of user root. Oct 10 15:56:08 oleg256-client systemd[1]: Started Session 243 of user root. Oct 10 15:56:08 oleg256-client sshd[59286]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:08 oleg256-client sshd[59299]: Received disconnect from 192.168.202.56 port 60262:11: disconnected by user Oct 10 15:56:08 oleg256-client sshd[59299]: Disconnected from user root 192.168.202.56 port 60262 Oct 10 15:56:08 oleg256-client sshd[59286]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:08 oleg256-client systemd[1]: session-243.scope: Succeeded. Oct 10 15:56:08 oleg256-client systemd-logind[1023]: Session 243 logged out. Waiting for processes to exit. Oct 10 15:56:08 oleg256-client systemd-logind[1023]: Removed session 243. Oct 10 15:56:09 oleg256-client sshd[59439]: Accepted publickey for root from 192.168.202.56 port 60276 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:09 oleg256-client systemd-logind[1023]: New session 244 of user root. Oct 10 15:56:09 oleg256-client systemd[1]: Started Session 244 of user root. Oct 10 15:56:09 oleg256-client sshd[59439]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:09 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 211: Remote NI recovery checks ======= 15:56:08 (1760126168) Oct 10 15:56:09 oleg256-client sshd[59452]: Received disconnect from 192.168.202.56 port 60276:11: disconnected by user Oct 10 15:56:09 oleg256-client sshd[59452]: Disconnected from user root 192.168.202.56 port 60276 Oct 10 15:56:09 oleg256-client sshd[59439]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:56:09 oleg256-client kernel: LNet: 59483:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:56:09 oleg256-client kernel: LNetError: 59483:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:56:09 oleg256-client kernel: LNetError: 59483:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Skipped 1 previous similar message Oct 10 15:56:09 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:56:09 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:56:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:56:09 oleg256-client systemd-logind[1023]: Session 244 logged out. Waiting for processes to exit. Oct 10 15:56:09 oleg256-client systemd[1]: session-244.scope: Succeeded. Oct 10 15:56:09 oleg256-client systemd-logind[1023]: Removed session 244. Oct 10 15:56:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:56:09 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:56:09 oleg256-client root[59523]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:56:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:56:09 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:56:09 oleg256-client root[59632]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:56:10 oleg256-client root[59643]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 10 Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp -d *@tcp -m GET -r 1 -e remote_error Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp1 -d *@tcp1 -m GET -r 1 -e remote_error Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp -d *@tcp -r 1 Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp1 -d *@tcp1 -r 1 Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.202.56@tcp --health 0 Oct 10 15:56:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p Oct 10 15:56:11 oleg256-client kernel: LNet: 1 peer NIs in recovery (showing 1): 192.168.202.56@tcp Oct 10 15:56:11 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:56:11 oleg256-client kernel: LNet: Skipped 1 previous similar message Oct 10 15:56:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p Oct 10 15:56:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:56:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 Oct 10 15:56:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.202.56@tcp --health 500 Oct 10 15:56:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p Oct 10 15:56:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p Oct 10 15:56:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:56:31 oleg256-client kernel: LNet: 59975:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:56:31 oleg256-client kernel: LNetError: 59975:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:56:31 oleg256-client kernel: LNetError: 59975:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Skipped 1 previous similar message Oct 10 15:56:31 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:56:31 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:56:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:56:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:56:31 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:56:32 oleg256-client root[60008]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:56:32 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:56:32 oleg256-client root[60117]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:56:32 oleg256-client root[60128]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set recovery_limit 0 Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 4 Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp -d *@tcp -m GET -r 1 -e remote_error Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp1 -d *@tcp1 -m GET -r 1 -e remote_error Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp -d *@tcp -r 1 Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp1 -d *@tcp1 -r 1 Oct 10 15:56:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 192.168.202.56@tcp --health 0 Oct 10 15:56:34 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:56:34 oleg256-client kernel: LNet: Skipped 3 previous similar messages Oct 10 15:56:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p Oct 10 15:56:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p Oct 10 15:56:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:56:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl set max_recovery_ping_interval 900 Oct 10 15:56:45 oleg256-client sshd[60496]: Accepted publickey for root from 192.168.202.56 port 34922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:45 oleg256-client systemd-logind[1023]: New session 245 of user root. Oct 10 15:56:45 oleg256-client systemd[1]: Started Session 245 of user root. Oct 10 15:56:45 oleg256-client sshd[60496]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:45 oleg256-client sshd[60509]: Received disconnect from 192.168.202.56 port 34922:11: disconnected by user Oct 10 15:56:45 oleg256-client sshd[60509]: Disconnected from user root 192.168.202.56 port 34922 Oct 10 15:56:45 oleg256-client sshd[60496]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:45 oleg256-client systemd-logind[1023]: Session 245 logged out. Waiting for processes to exit. Oct 10 15:56:45 oleg256-client systemd[1]: session-245.scope: Succeeded. Oct 10 15:56:45 oleg256-client systemd-logind[1023]: Removed session 245. Oct 10 15:56:45 oleg256-client sshd[60634]: Accepted publickey for root from 192.168.202.56 port 34930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:45 oleg256-client systemd-logind[1023]: New session 246 of user root. Oct 10 15:56:45 oleg256-client systemd[1]: Started Session 246 of user root. Oct 10 15:56:45 oleg256-client sshd[60634]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:46 oleg256-client sshd[60647]: Received disconnect from 192.168.202.56 port 34930:11: disconnected by user Oct 10 15:56:46 oleg256-client sshd[60647]: Disconnected from user root 192.168.202.56 port 34930 Oct 10 15:56:46 oleg256-client sshd[60634]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:46 oleg256-client systemd-logind[1023]: Session 246 logged out. Waiting for processes to exit. Oct 10 15:56:46 oleg256-client systemd[1]: session-246.scope: Succeeded. Oct 10 15:56:46 oleg256-client systemd-logind[1023]: Removed session 246. Oct 10 15:56:46 oleg256-client sshd[60778]: Accepted publickey for root from 192.168.202.56 port 34946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:46 oleg256-client systemd-logind[1023]: New session 247 of user root. Oct 10 15:56:46 oleg256-client systemd[1]: Started Session 247 of user root. Oct 10 15:56:46 oleg256-client sshd[60778]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:46 oleg256-client sshd[60791]: Received disconnect from 192.168.202.56 port 34946:11: disconnected by user Oct 10 15:56:46 oleg256-client sshd[60791]: Disconnected from user root 192.168.202.56 port 34946 Oct 10 15:56:46 oleg256-client sshd[60778]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:46 oleg256-client systemd[1]: session-247.scope: Succeeded. Oct 10 15:56:46 oleg256-client systemd-logind[1023]: Session 247 logged out. Waiting for processes to exit. Oct 10 15:56:46 oleg256-client systemd-logind[1023]: Removed session 247. Oct 10 15:56:47 oleg256-client sshd[60931]: Accepted publickey for root from 192.168.202.56 port 34958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:47 oleg256-client systemd-logind[1023]: New session 248 of user root. Oct 10 15:56:47 oleg256-client systemd[1]: Started Session 248 of user root. Oct 10 15:56:47 oleg256-client sshd[60931]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:47 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 212: Check discovery refcount loss bug (LU-14627) ========================================================== 15:56:46 (1760126206) Oct 10 15:56:47 oleg256-client sshd[60944]: Received disconnect from 192.168.202.56 port 34958:11: disconnected by user Oct 10 15:56:47 oleg256-client sshd[60944]: Disconnected from user root 192.168.202.56 port 34958 Oct 10 15:56:47 oleg256-client sshd[60931]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:47 oleg256-client systemd[1]: session-248.scope: Succeeded. Oct 10 15:56:47 oleg256-client systemd-logind[1023]: Session 248 logged out. Waiting for processes to exit. Oct 10 15:56:47 oleg256-client systemd-logind[1023]: Removed session 248. Oct 10 15:56:47 oleg256-client kernel: LNet: 61025:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:56:47 oleg256-client kernel: LNetError: 61025:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:56:47 oleg256-client kernel: LNetError: 61025:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Skipped 1 previous similar message Oct 10 15:56:47 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:56:47 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:56:48 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:56:48 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:56:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:56:48 oleg256-client systemd-udevd[61099]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:56:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:56:50 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:56:50 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:56:50 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:56:50 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:56:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:56:51 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:56:55 oleg256-client sshd[61442]: Accepted publickey for root from 192.168.202.56 port 46216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:55 oleg256-client systemd-logind[1023]: New session 249 of user root. Oct 10 15:56:55 oleg256-client systemd[1]: Started Session 249 of user root. Oct 10 15:56:55 oleg256-client sshd[61442]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:55 oleg256-client kernel: Lustre: DEBUG MARKER: Initial discovery Oct 10 15:56:55 oleg256-client sshd[61455]: Received disconnect from 192.168.202.56 port 46216:11: disconnected by user Oct 10 15:56:55 oleg256-client sshd[61455]: Disconnected from user root 192.168.202.56 port 46216 Oct 10 15:56:55 oleg256-client sshd[61442]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.202.156@tcp Oct 10 15:56:55 oleg256-client systemd[1]: session-249.scope: Succeeded. Oct 10 15:56:55 oleg256-client systemd-logind[1023]: Session 249 logged out. Waiting for processes to exit. Oct 10 15:56:55 oleg256-client systemd-logind[1023]: Removed session 249. Oct 10 15:56:56 oleg256-client sshd[61586]: Accepted publickey for root from 192.168.202.56 port 46222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:56 oleg256-client systemd[1]: Started Session 250 of user root. Oct 10 15:56:56 oleg256-client systemd-logind[1023]: New session 250 of user root. Oct 10 15:56:56 oleg256-client sshd[61586]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:56 oleg256-client kernel: Lustre: DEBUG MARKER: Fail local discover ping to set LNET_PEER_REDISCOVER flag Oct 10 15:56:56 oleg256-client sshd[61599]: Received disconnect from 192.168.202.56 port 46222:11: disconnected by user Oct 10 15:56:56 oleg256-client sshd[61599]: Disconnected from user root 192.168.202.56 port 46222 Oct 10 15:56:56 oleg256-client sshd[61586]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp -d *@tcp -r 1 -e local_error Oct 10 15:56:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.202.156@tcp Oct 10 15:56:56 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:56:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:56:56 oleg256-client systemd[1]: session-250.scope: Succeeded. Oct 10 15:56:56 oleg256-client systemd-logind[1023]: Session 250 logged out. Waiting for processes to exit. Oct 10 15:56:56 oleg256-client systemd-logind[1023]: Removed session 250. Oct 10 15:56:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault delay add -s *@tcp -d 192.168.202.156@tcp -r 1 -m GET -l 3 Oct 10 15:56:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp -d 192.168.202.156@tcp -r 1 -m GET -e local_error Oct 10 15:56:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault delay add -s *@tcp -d 192.168.202.156@tcp -r 1 -m PUT -l 6 Oct 10 15:56:56 oleg256-client sshd[61735]: Accepted publickey for root from 192.168.202.56 port 46234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:56 oleg256-client systemd-logind[1023]: New session 251 of user root. Oct 10 15:56:56 oleg256-client systemd[1]: Started Session 251 of user root. Oct 10 15:56:56 oleg256-client sshd[61735]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:57 oleg256-client kernel: Lustre: DEBUG MARKER: Force oleg256-client.virtnet to discover 192.168.202.156@tcp (in background) Oct 10 15:56:57 oleg256-client sshd[61748]: Received disconnect from 192.168.202.56 port 46234:11: disconnected by user Oct 10 15:56:57 oleg256-client sshd[61748]: Disconnected from user root 192.168.202.56 port 46234 Oct 10 15:56:57 oleg256-client sshd[61735]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:57 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover --force 192.168.202.156@tcp Oct 10 15:56:57 oleg256-client systemd-logind[1023]: Session 251 logged out. Waiting for processes to exit. Oct 10 15:56:57 oleg256-client systemd[1]: session-251.scope: Succeeded. Oct 10 15:56:57 oleg256-client systemd-logind[1023]: Removed session 251. Oct 10 15:56:57 oleg256-client sshd[61874]: Accepted publickey for root from 192.168.202.56 port 46250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:57 oleg256-client systemd-logind[1023]: New session 252 of user root. Oct 10 15:56:57 oleg256-client systemd[1]: Started Session 252 of user root. Oct 10 15:56:57 oleg256-client sshd[61874]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:57 oleg256-client kernel: Lustre: DEBUG MARKER: Force oleg256-server to discover 192.168.202.56@tcp Oct 10 15:56:57 oleg256-client sshd[61887]: Received disconnect from 192.168.202.56 port 46250:11: disconnected by user Oct 10 15:56:57 oleg256-client sshd[61887]: Disconnected from user root 192.168.202.56 port 46250 Oct 10 15:56:57 oleg256-client sshd[61874]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:57 oleg256-client systemd-logind[1023]: Session 252 logged out. Waiting for processes to exit. Oct 10 15:56:57 oleg256-client systemd[1]: session-252.scope: Succeeded. Oct 10 15:56:57 oleg256-client systemd-logind[1023]: Removed session 252. Oct 10 15:56:58 oleg256-client sshd[62016]: Accepted publickey for root from 192.168.202.56 port 46260 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:56:58 oleg256-client systemd-logind[1023]: New session 253 of user root. Oct 10 15:56:58 oleg256-client systemd[1]: Started Session 253 of user root. Oct 10 15:56:58 oleg256-client sshd[62016]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:56:58 oleg256-client kernel: Lustre: DEBUG MARKER: Wait for 61774 Oct 10 15:56:58 oleg256-client sshd[62029]: Received disconnect from 192.168.202.56 port 46260:11: disconnected by user Oct 10 15:56:58 oleg256-client sshd[62029]: Disconnected from user root 192.168.202.56 port 46260 Oct 10 15:56:58 oleg256-client sshd[62016]: pam_unix(sshd:session): session closed for user root Oct 10 15:56:58 oleg256-client systemd[1]: session-253.scope: Succeeded. Oct 10 15:56:58 oleg256-client systemd-logind[1023]: Session 253 logged out. Waiting for processes to exit. Oct 10 15:56:58 oleg256-client systemd-logind[1023]: Removed session 253. Oct 10 15:57:00 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:57:00 oleg256-client sshd[62153]: Accepted publickey for root from 192.168.202.56 port 46274 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:00 oleg256-client systemd-logind[1023]: New session 254 of user root. Oct 10 15:57:00 oleg256-client systemd[1]: Started Session 254 of user root. Oct 10 15:57:00 oleg256-client sshd[62153]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:00 oleg256-client kernel: Lustre: DEBUG MARKER: Finished wait on 61774 Oct 10 15:57:00 oleg256-client sshd[62166]: Received disconnect from 192.168.202.56 port 46274:11: disconnected by user Oct 10 15:57:00 oleg256-client sshd[62166]: Disconnected from user root 192.168.202.56 port 46274 Oct 10 15:57:00 oleg256-client sshd[62153]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:00 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault delay del -a Oct 10 15:57:00 oleg256-client systemd-logind[1023]: Session 254 logged out. Waiting for processes to exit. Oct 10 15:57:00 oleg256-client systemd[1]: session-254.scope: Succeeded. Oct 10 15:57:00 oleg256-client systemd-logind[1023]: Removed session 254. Oct 10 15:57:00 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop del -a Oct 10 15:57:00 oleg256-client kernel: LNet: 62230:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:57:00 oleg256-client kernel: LNetError: 62230:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:57:00 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:57:01 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:57:01 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:57:01 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:57:01 oleg256-client systemd-udevd[62279]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:57:01 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:57:06 oleg256-client sshd[62526]: Accepted publickey for root from 192.168.202.56 port 44284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:06 oleg256-client systemd-logind[1023]: New session 255 of user root. Oct 10 15:57:06 oleg256-client systemd[1]: Started Session 255 of user root. Oct 10 15:57:06 oleg256-client sshd[62526]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:06 oleg256-client sshd[62539]: Received disconnect from 192.168.202.56 port 44284:11: disconnected by user Oct 10 15:57:06 oleg256-client sshd[62539]: Disconnected from user root 192.168.202.56 port 44284 Oct 10 15:57:06 oleg256-client sshd[62526]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:06 oleg256-client systemd[1]: session-255.scope: Succeeded. Oct 10 15:57:06 oleg256-client systemd-logind[1023]: Session 255 logged out. Waiting for processes to exit. Oct 10 15:57:06 oleg256-client systemd-logind[1023]: Removed session 255. Oct 10 15:57:06 oleg256-client sshd[62663]: Accepted publickey for root from 192.168.202.56 port 44290 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:06 oleg256-client systemd-logind[1023]: New session 256 of user root. Oct 10 15:57:06 oleg256-client systemd[1]: Started Session 256 of user root. Oct 10 15:57:06 oleg256-client sshd[62663]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:07 oleg256-client sshd[62676]: Received disconnect from 192.168.202.56 port 44290:11: disconnected by user Oct 10 15:57:07 oleg256-client sshd[62676]: Disconnected from user root 192.168.202.56 port 44290 Oct 10 15:57:07 oleg256-client sshd[62663]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:07 oleg256-client systemd-logind[1023]: Session 256 logged out. Waiting for processes to exit. Oct 10 15:57:07 oleg256-client systemd[1]: session-256.scope: Succeeded. Oct 10 15:57:07 oleg256-client systemd-logind[1023]: Removed session 256. Oct 10 15:57:07 oleg256-client sshd[62807]: Accepted publickey for root from 192.168.202.56 port 44302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:07 oleg256-client systemd-logind[1023]: New session 257 of user root. Oct 10 15:57:07 oleg256-client systemd[1]: Started Session 257 of user root. Oct 10 15:57:07 oleg256-client sshd[62807]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:07 oleg256-client sshd[62820]: Received disconnect from 192.168.202.56 port 44302:11: disconnected by user Oct 10 15:57:07 oleg256-client sshd[62820]: Disconnected from user root 192.168.202.56 port 44302 Oct 10 15:57:07 oleg256-client sshd[62807]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:07 oleg256-client systemd[1]: session-257.scope: Succeeded. Oct 10 15:57:07 oleg256-client systemd-logind[1023]: Session 257 logged out. Waiting for processes to exit. Oct 10 15:57:07 oleg256-client systemd-logind[1023]: Removed session 257. Oct 10 15:57:07 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:57:07 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:57:08 oleg256-client sshd[62969]: Accepted publickey for root from 192.168.202.56 port 44312 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:08 oleg256-client systemd-logind[1023]: New session 258 of user root. Oct 10 15:57:08 oleg256-client systemd[1]: Started Session 258 of user root. Oct 10 15:57:08 oleg256-client sshd[62969]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:08 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 213: Check LNetDist calculation for multiple local NIDs ========================================================== 15:57:07 (1760126227) Oct 10 15:57:08 oleg256-client sshd[62982]: Received disconnect from 192.168.202.56 port 44312:11: disconnected by user Oct 10 15:57:08 oleg256-client sshd[62982]: Disconnected from user root 192.168.202.56 port 44312 Oct 10 15:57:08 oleg256-client sshd[62969]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:08 oleg256-client systemd[1]: session-258.scope: Succeeded. Oct 10 15:57:08 oleg256-client systemd-logind[1023]: Session 258 logged out. Waiting for processes to exit. Oct 10 15:57:08 oleg256-client systemd-logind[1023]: Removed session 258. Oct 10 15:57:08 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:57:08 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:57:09 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:57:09 oleg256-client systemd-udevd[63071]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:57:09 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:57:11 oleg256-client systemd-udevd[63201]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:57:11 oleg256-client systemd-udevd[63201]: Could not generate persistent MAC address for test1pg: No such file or directory Oct 10 15:57:11 oleg256-client NetworkManager[1026]: [1760126231.0503] manager: (test1pg): new Veth device (/org/freedesktop/NetworkManager/Devices/17) Oct 10 15:57:11 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 15:57:11 oleg256-client systemd-udevd[63204]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 15:57:11 oleg256-client NetworkManager[1026]: [1760126231.0679] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/18) Oct 10 15:57:11 oleg256-client systemd-udevd[63204]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 15:57:11 oleg256-client NetworkManager[1026]: [1760126231.1085] device (test1pg): carrier: link connected Oct 10 15:57:11 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 15:57:11 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 15:57:11 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 15:57:11 oleg256-client NetworkManager[1026]: [1760126231.1300] device (test1pl): carrier: link connected Oct 10 15:57:13 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:57:13 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:57:13 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:57:13 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:57:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:57:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:57:14 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:57:14 oleg256-client root[63325]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 15:57:14 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:57:14 oleg256-client root[63434]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:14 oleg256-client root[63448]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 15:57:15 oleg256-client root[63592]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 15:57:15 oleg256-client root[63593]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 15:57:15 oleg256-client root[63594]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 15:57:15 oleg256-client root[63709]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 15:57:15 oleg256-client root[63710]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 15:57:15 oleg256-client root[63711]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 15:57:15 oleg256-client sshd[63805]: Accepted publickey for root from 192.168.202.56 port 46630 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:16 oleg256-client systemd[1]: Started Session 259 of user root. Oct 10 15:57:16 oleg256-client systemd-logind[1023]: New session 259 of user root. Oct 10 15:57:16 oleg256-client sshd[63805]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:16 oleg256-client sshd[63818]: Received disconnect from 192.168.202.56 port 46630:11: disconnected by user Oct 10 15:57:16 oleg256-client sshd[63818]: Disconnected from user root 192.168.202.56 port 46630 Oct 10 15:57:16 oleg256-client sshd[63805]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:16 oleg256-client systemd[1]: session-259.scope: Succeeded. Oct 10 15:57:16 oleg256-client systemd-logind[1023]: Session 259 logged out. Waiting for processes to exit. Oct 10 15:57:16 oleg256-client systemd-logind[1023]: Removed session 259. Oct 10 15:57:16 oleg256-client sshd[63942]: Accepted publickey for root from 192.168.202.56 port 46634 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:16 oleg256-client systemd[1]: Started Session 260 of user root. Oct 10 15:57:16 oleg256-client systemd-logind[1023]: New session 260 of user root. Oct 10 15:57:16 oleg256-client sshd[63942]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:16 oleg256-client sshd[63955]: Received disconnect from 192.168.202.56 port 46634:11: disconnected by user Oct 10 15:57:16 oleg256-client sshd[63955]: Disconnected from user root 192.168.202.56 port 46634 Oct 10 15:57:16 oleg256-client sshd[63942]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:16 oleg256-client systemd-logind[1023]: Session 260 logged out. Waiting for processes to exit. Oct 10 15:57:16 oleg256-client systemd[1]: session-260.scope: Succeeded. Oct 10 15:57:16 oleg256-client systemd-logind[1023]: Removed session 260. Oct 10 15:57:17 oleg256-client sshd[64086]: Accepted publickey for root from 192.168.202.56 port 46640 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:17 oleg256-client systemd-logind[1023]: New session 261 of user root. Oct 10 15:57:17 oleg256-client systemd[1]: Started Session 261 of user root. Oct 10 15:57:17 oleg256-client sshd[64086]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:17 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:57:17 oleg256-client sshd[64100]: Received disconnect from 192.168.202.56 port 46640:11: disconnected by user Oct 10 15:57:17 oleg256-client sshd[64100]: Disconnected from user root 192.168.202.56 port 46640 Oct 10 15:57:17 oleg256-client sshd[64086]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:17 oleg256-client systemd[1]: session-261.scope: Succeeded. Oct 10 15:57:17 oleg256-client systemd-logind[1023]: Session 261 logged out. Waiting for processes to exit. Oct 10 15:57:17 oleg256-client systemd-logind[1023]: Removed session 261. Oct 10 15:57:18 oleg256-client sshd[64240]: Accepted publickey for root from 192.168.202.56 port 46646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:18 oleg256-client systemd-logind[1023]: New session 262 of user root. Oct 10 15:57:18 oleg256-client systemd[1]: Started Session 262 of user root. Oct 10 15:57:18 oleg256-client sshd[64240]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:18 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 214: Check local NI status when link is downed ========================================================== 15:57:17 (1760126237) Oct 10 15:57:18 oleg256-client sshd[64253]: Received disconnect from 192.168.202.56 port 46646:11: disconnected by user Oct 10 15:57:18 oleg256-client sshd[64253]: Disconnected from user root 192.168.202.56 port 46646 Oct 10 15:57:18 oleg256-client sshd[64240]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:18 oleg256-client systemd[1]: session-262.scope: Succeeded. Oct 10 15:57:18 oleg256-client systemd-logind[1023]: Session 262 logged out. Waiting for processes to exit. Oct 10 15:57:18 oleg256-client kernel: LNet: 64290:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:57:18 oleg256-client kernel: LNetError: 64290:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:57:18 oleg256-client systemd-logind[1023]: Removed session 262. Oct 10 15:57:18 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:57:18 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:57:18 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:57:18 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:57:19 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:57:19 oleg256-client systemd-udevd[64378]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:57:19 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:57:21 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:57:21 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:57:21 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:57:21 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:57:22 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:57:22 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:57:22 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:57:22 oleg256-client root[64598]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 15:57:23 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 15:57:23 oleg256-client root[64707]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:23 oleg256-client root[64718]: ksocklnd-config: skip setting up route for test1pg: IPv4 route exists Oct 10 15:57:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 10.1.2.3@tcp 192.168.202.56@tcp Oct 10 15:57:24 oleg256-client systemd[1]: Starting Cleanup of Temporary Directories... Oct 10 15:57:24 oleg256-client sshd[64926]: Accepted publickey for root from 192.168.202.56 port 51054 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:24 oleg256-client systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Oct 10 15:57:24 oleg256-client systemd[1]: Started Cleanup of Temporary Directories. Oct 10 15:57:24 oleg256-client systemd-logind[1023]: New session 263 of user root. Oct 10 15:57:24 oleg256-client systemd[1]: Started Session 263 of user root. Oct 10 15:57:24 oleg256-client sshd[64926]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:24 oleg256-client sshd[64941]: Received disconnect from 192.168.202.56 port 51054:11: disconnected by user Oct 10 15:57:24 oleg256-client sshd[64941]: Disconnected from user root 192.168.202.56 port 51054 Oct 10 15:57:24 oleg256-client sshd[64926]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:24 oleg256-client systemd[1]: session-263.scope: Succeeded. Oct 10 15:57:24 oleg256-client systemd-logind[1023]: Session 263 logged out. Waiting for processes to exit. Oct 10 15:57:24 oleg256-client systemd-logind[1023]: Removed session 263. Oct 10 15:57:24 oleg256-client kernel: LNetError: Unexpected error -22 connecting to 192.168.202.56@tcp at host 192.168.202.56:988 Oct 10 15:57:25 oleg256-client sshd[65065]: Accepted publickey for root from 192.168.202.56 port 51066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:25 oleg256-client systemd-logind[1023]: New session 264 of user root. Oct 10 15:57:25 oleg256-client systemd[1]: Started Session 264 of user root. Oct 10 15:57:25 oleg256-client sshd[65065]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:25 oleg256-client sshd[65078]: Received disconnect from 192.168.202.56 port 51066:11: disconnected by user Oct 10 15:57:25 oleg256-client sshd[65078]: Disconnected from user root 192.168.202.56 port 51066 Oct 10 15:57:25 oleg256-client sshd[65065]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:25 oleg256-client systemd[1]: session-264.scope: Succeeded. Oct 10 15:57:25 oleg256-client systemd-logind[1023]: Session 264 logged out. Waiting for processes to exit. Oct 10 15:57:25 oleg256-client systemd-logind[1023]: Removed session 264. Oct 10 15:57:25 oleg256-client sshd[65209]: Accepted publickey for root from 192.168.202.56 port 51070 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:25 oleg256-client systemd[1]: Started Session 265 of user root. Oct 10 15:57:25 oleg256-client systemd-logind[1023]: New session 265 of user root. Oct 10 15:57:25 oleg256-client sshd[65209]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:26 oleg256-client sshd[65222]: Received disconnect from 192.168.202.56 port 51070:11: disconnected by user Oct 10 15:57:26 oleg256-client sshd[65222]: Disconnected from user root 192.168.202.56 port 51070 Oct 10 15:57:26 oleg256-client sshd[65209]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:26 oleg256-client systemd-logind[1023]: Session 265 logged out. Waiting for processes to exit. Oct 10 15:57:26 oleg256-client systemd[1]: session-265.scope: Succeeded. Oct 10 15:57:26 oleg256-client systemd-logind[1023]: Removed session 265. Oct 10 15:57:26 oleg256-client sshd[65362]: Accepted publickey for root from 192.168.202.56 port 51074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:26 oleg256-client systemd-logind[1023]: New session 266 of user root. Oct 10 15:57:26 oleg256-client systemd[1]: Started Session 266 of user root. Oct 10 15:57:26 oleg256-client sshd[65362]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:27 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 215: Test lnetctl ping --source option ========================================================== 15:57:26 (1760126246) Oct 10 15:57:27 oleg256-client sshd[65375]: Received disconnect from 192.168.202.56 port 51074:11: disconnected by user Oct 10 15:57:27 oleg256-client sshd[65375]: Disconnected from user root 192.168.202.56 port 51074 Oct 10 15:57:27 oleg256-client sshd[65362]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:27 oleg256-client kernel: LNet: 65410:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:57:27 oleg256-client systemd[1]: session-266.scope: Succeeded. Oct 10 15:57:27 oleg256-client kernel: LNetError: 65410:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:57:27 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:57:27 oleg256-client systemd-logind[1023]: Session 266 logged out. Waiting for processes to exit. Oct 10 15:57:27 oleg256-client systemd-logind[1023]: Removed session 266. Oct 10 15:57:27 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 15:57:27 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:57:27 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:57:27 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:57:27 oleg256-client systemd-udevd[65484]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:57:27 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:57:30 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:57:30 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:57:30 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:57:30 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:57:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:57:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:57:31 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:57:31 oleg256-client root[65702]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp2 --if ens2 Oct 10 15:57:31 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp2 [8/256/0/180] Oct 10 15:57:31 oleg256-client root[65811]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:31 oleg256-client root[65822]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim 192.168.202.56@tcp1 --nid 192.168.202.56@tcp2 Oct 10 15:57:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp1 192.168.202.56@tcp2 Oct 10 15:57:34 oleg256-client kernel: LNetError: 66237:0:(lib-move.c:2264:lnet_handle_find_routed_path()) Unable to send message from 192.168.202.56@tcp1 to 192.168.202.56@tcp2 - Route table may be misconfigured Oct 10 15:57:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp2 192.168.202.56@tcp1 Oct 10 15:57:35 oleg256-client sshd[66324]: Accepted publickey for root from 192.168.202.56 port 37210 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:35 oleg256-client systemd-logind[1023]: New session 267 of user root. Oct 10 15:57:35 oleg256-client systemd[1]: Started Session 267 of user root. Oct 10 15:57:35 oleg256-client sshd[66324]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:35 oleg256-client sshd[66337]: Received disconnect from 192.168.202.56 port 37210:11: disconnected by user Oct 10 15:57:35 oleg256-client sshd[66337]: Disconnected from user root 192.168.202.56 port 37210 Oct 10 15:57:35 oleg256-client sshd[66324]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:35 oleg256-client systemd[1]: session-267.scope: Succeeded. Oct 10 15:57:35 oleg256-client systemd-logind[1023]: Session 267 logged out. Waiting for processes to exit. Oct 10 15:57:35 oleg256-client systemd-logind[1023]: Removed session 267. Oct 10 15:57:35 oleg256-client sshd[66461]: Accepted publickey for root from 192.168.202.56 port 37226 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:35 oleg256-client systemd-logind[1023]: New session 268 of user root. Oct 10 15:57:35 oleg256-client systemd[1]: Started Session 268 of user root. Oct 10 15:57:35 oleg256-client sshd[66461]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:36 oleg256-client sshd[66474]: Received disconnect from 192.168.202.56 port 37226:11: disconnected by user Oct 10 15:57:36 oleg256-client sshd[66474]: Disconnected from user root 192.168.202.56 port 37226 Oct 10 15:57:36 oleg256-client sshd[66461]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:36 oleg256-client systemd-logind[1023]: Session 268 logged out. Waiting for processes to exit. Oct 10 15:57:36 oleg256-client systemd[1]: session-268.scope: Succeeded. Oct 10 15:57:36 oleg256-client systemd-logind[1023]: Removed session 268. Oct 10 15:57:36 oleg256-client sshd[66605]: Accepted publickey for root from 192.168.202.56 port 37228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:36 oleg256-client systemd[1]: Started Session 269 of user root. Oct 10 15:57:36 oleg256-client systemd-logind[1023]: New session 269 of user root. Oct 10 15:57:36 oleg256-client sshd[66605]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:36 oleg256-client sshd[66618]: Received disconnect from 192.168.202.56 port 37228:11: disconnected by user Oct 10 15:57:36 oleg256-client sshd[66618]: Disconnected from user root 192.168.202.56 port 37228 Oct 10 15:57:36 oleg256-client sshd[66605]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:37 oleg256-client systemd[1]: session-269.scope: Succeeded. Oct 10 15:57:37 oleg256-client systemd-logind[1023]: Session 269 logged out. Waiting for processes to exit. Oct 10 15:57:37 oleg256-client systemd-logind[1023]: Removed session 269. Oct 10 15:57:37 oleg256-client sshd[66758]: Accepted publickey for root from 192.168.202.56 port 37242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:37 oleg256-client systemd-logind[1023]: New session 270 of user root. Oct 10 15:57:37 oleg256-client systemd[1]: Started Session 270 of user root. Oct 10 15:57:37 oleg256-client sshd[66758]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:37 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 216: Failed send to peer NI owned by local host should not trigger peer NI recovery ========================================================== 15:57:37 (1760126257) Oct 10 15:57:37 oleg256-client sshd[66771]: Received disconnect from 192.168.202.56 port 37242:11: disconnected by user Oct 10 15:57:37 oleg256-client sshd[66771]: Disconnected from user root 192.168.202.56 port 37242 Oct 10 15:57:37 oleg256-client sshd[66758]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:57:37 oleg256-client kernel: LNet: 66804:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:57:37 oleg256-client kernel: LNetError: 66804:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:57:37 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:57:37 oleg256-client systemd-logind[1023]: Session 270 logged out. Waiting for processes to exit. Oct 10 15:57:37 oleg256-client systemd[1]: session-270.scope: Succeeded. Oct 10 15:57:37 oleg256-client systemd-logind[1023]: Removed session 270. Oct 10 15:57:38 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp2 Oct 10 15:57:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:57:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:57:39 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:57:39 oleg256-client root[66843]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:57:39 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:57:39 oleg256-client root[66952]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:39 oleg256-client root[66963]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 15:57:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp 192.168.202.56@tcp Oct 10 15:57:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp1 192.168.202.56@tcp1 Oct 10 15:57:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -r 1 -s 192.168.202.56@tcp -d 192.168.202.56@tcp -e network_timeout Oct 10 15:57:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -r 1 -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -e network_timeout Oct 10 15:57:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -r 1 -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -e network_timeout Oct 10 15:57:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -r 1 -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -e network_timeout Oct 10 15:57:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:57:40 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.56: rc = -22 Oct 10 15:57:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop del -a Oct 10 15:57:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -p Oct 10 15:57:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug recovery -l Oct 10 15:57:40 oleg256-client sshd[67178]: Accepted publickey for root from 192.168.202.56 port 37258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:40 oleg256-client systemd-logind[1023]: New session 271 of user root. Oct 10 15:57:40 oleg256-client systemd[1]: Started Session 271 of user root. Oct 10 15:57:40 oleg256-client sshd[67178]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:40 oleg256-client sshd[67191]: Received disconnect from 192.168.202.56 port 37258:11: disconnected by user Oct 10 15:57:40 oleg256-client sshd[67191]: Disconnected from user root 192.168.202.56 port 37258 Oct 10 15:57:40 oleg256-client sshd[67178]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:41 oleg256-client systemd[1]: session-271.scope: Succeeded. Oct 10 15:57:41 oleg256-client systemd-logind[1023]: Session 271 logged out. Waiting for processes to exit. Oct 10 15:57:41 oleg256-client systemd-logind[1023]: Removed session 271. Oct 10 15:57:41 oleg256-client kernel: LNet: 1 local NIs in recovery (showing 1): 192.168.202.56@tcp Oct 10 15:57:41 oleg256-client sshd[67316]: Accepted publickey for root from 192.168.202.56 port 37268 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:41 oleg256-client systemd-logind[1023]: New session 272 of user root. Oct 10 15:57:41 oleg256-client systemd[1]: Started Session 272 of user root. Oct 10 15:57:41 oleg256-client sshd[67316]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:41 oleg256-client sshd[67329]: Received disconnect from 192.168.202.56 port 37268:11: disconnected by user Oct 10 15:57:41 oleg256-client sshd[67329]: Disconnected from user root 192.168.202.56 port 37268 Oct 10 15:57:41 oleg256-client sshd[67316]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:41 oleg256-client systemd-logind[1023]: Session 272 logged out. Waiting for processes to exit. Oct 10 15:57:41 oleg256-client systemd[1]: session-272.scope: Succeeded. Oct 10 15:57:41 oleg256-client systemd-logind[1023]: Removed session 272. Oct 10 15:57:42 oleg256-client sshd[67460]: Accepted publickey for root from 192.168.202.56 port 37272 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:42 oleg256-client systemd-logind[1023]: New session 273 of user root. Oct 10 15:57:42 oleg256-client systemd[1]: Started Session 273 of user root. Oct 10 15:57:42 oleg256-client sshd[67460]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:42 oleg256-client sshd[67473]: Received disconnect from 192.168.202.56 port 37272:11: disconnected by user Oct 10 15:57:42 oleg256-client sshd[67473]: Disconnected from user root 192.168.202.56 port 37272 Oct 10 15:57:42 oleg256-client sshd[67460]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:42 oleg256-client systemd[1]: session-273.scope: Succeeded. Oct 10 15:57:42 oleg256-client systemd-logind[1023]: Session 273 logged out. Waiting for processes to exit. Oct 10 15:57:42 oleg256-client systemd-logind[1023]: Removed session 273. Oct 10 15:57:43 oleg256-client sshd[67613]: Accepted publickey for root from 192.168.202.56 port 37278 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:43 oleg256-client systemd-logind[1023]: New session 274 of user root. Oct 10 15:57:43 oleg256-client systemd[1]: Started Session 274 of user root. Oct 10 15:57:43 oleg256-client sshd[67613]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:43 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 217: Don't leak memory when discovering peer with nnis <= 1 ========================================================== 15:57:42 (1760126262) Oct 10 15:57:43 oleg256-client sshd[67626]: Received disconnect from 192.168.202.56 port 37278:11: disconnected by user Oct 10 15:57:43 oleg256-client sshd[67626]: Disconnected from user root 192.168.202.56 port 37278 Oct 10 15:57:43 oleg256-client sshd[67613]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:57:43 oleg256-client kernel: LNet: 67660:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:57:43 oleg256-client kernel: LNetError: 67660:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:57:43 oleg256-client kernel: LNetError: 67660:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Skipped 1 previous similar message Oct 10 15:57:43 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:57:43 oleg256-client systemd[1]: session-274.scope: Succeeded. Oct 10 15:57:43 oleg256-client systemd-logind[1023]: Session 274 logged out. Waiting for processes to exit. Oct 10 15:57:43 oleg256-client systemd-logind[1023]: Removed session 274. Oct 10 15:57:44 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:57:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:57:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 0@lo Oct 10 15:57:44 oleg256-client kernel: LNet: 67700:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:57:45 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:57:45 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:57:45 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:57:45 oleg256-client systemd-udevd[67754]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:57:45 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:57:48 oleg256-client sshd[67968]: Accepted publickey for root from 192.168.202.56 port 44064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:48 oleg256-client systemd-logind[1023]: New session 275 of user root. Oct 10 15:57:48 oleg256-client systemd[1]: Started Session 275 of user root. Oct 10 15:57:48 oleg256-client sshd[67968]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:49 oleg256-client sshd[67981]: Received disconnect from 192.168.202.56 port 44064:11: disconnected by user Oct 10 15:57:49 oleg256-client sshd[67981]: Disconnected from user root 192.168.202.56 port 44064 Oct 10 15:57:49 oleg256-client sshd[67968]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:49 oleg256-client systemd-logind[1023]: Session 275 logged out. Waiting for processes to exit. Oct 10 15:57:49 oleg256-client systemd[1]: session-275.scope: Succeeded. Oct 10 15:57:49 oleg256-client systemd-logind[1023]: Removed session 275. Oct 10 15:57:49 oleg256-client sshd[68105]: Accepted publickey for root from 192.168.202.56 port 44072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:49 oleg256-client systemd[1]: Started Session 276 of user root. Oct 10 15:57:49 oleg256-client systemd-logind[1023]: New session 276 of user root. Oct 10 15:57:49 oleg256-client sshd[68105]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:49 oleg256-client sshd[68118]: Received disconnect from 192.168.202.56 port 44072:11: disconnected by user Oct 10 15:57:49 oleg256-client sshd[68118]: Disconnected from user root 192.168.202.56 port 44072 Oct 10 15:57:49 oleg256-client sshd[68105]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:50 oleg256-client systemd[1]: session-276.scope: Succeeded. Oct 10 15:57:50 oleg256-client systemd-logind[1023]: Session 276 logged out. Waiting for processes to exit. Oct 10 15:57:50 oleg256-client systemd-logind[1023]: Removed session 276. Oct 10 15:57:50 oleg256-client sshd[68249]: Accepted publickey for root from 192.168.202.56 port 44082 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:50 oleg256-client systemd[1]: Started Session 277 of user root. Oct 10 15:57:50 oleg256-client systemd-logind[1023]: New session 277 of user root. Oct 10 15:57:50 oleg256-client sshd[68249]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:50 oleg256-client sshd[68262]: Received disconnect from 192.168.202.56 port 44082:11: disconnected by user Oct 10 15:57:50 oleg256-client sshd[68262]: Disconnected from user root 192.168.202.56 port 44082 Oct 10 15:57:50 oleg256-client sshd[68249]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:50 oleg256-client systemd[1]: session-277.scope: Succeeded. Oct 10 15:57:50 oleg256-client systemd-logind[1023]: Session 277 logged out. Waiting for processes to exit. Oct 10 15:57:50 oleg256-client systemd-logind[1023]: Removed session 277. Oct 10 15:57:51 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:57:51 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:57:51 oleg256-client sshd[68411]: Accepted publickey for root from 192.168.202.56 port 44088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:51 oleg256-client systemd-logind[1023]: New session 278 of user root. Oct 10 15:57:51 oleg256-client systemd[1]: Started Session 278 of user root. Oct 10 15:57:51 oleg256-client sshd[68411]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:51 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 218: Local recovery pings should exercise all available paths ========================================================== 15:57:51 (1760126271) Oct 10 15:57:51 oleg256-client sshd[68424]: Received disconnect from 192.168.202.56 port 44088:11: disconnected by user Oct 10 15:57:51 oleg256-client sshd[68424]: Disconnected from user root 192.168.202.56 port 44088 Oct 10 15:57:51 oleg256-client sshd[68411]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:51 oleg256-client systemd[1]: session-278.scope: Succeeded. Oct 10 15:57:51 oleg256-client systemd-logind[1023]: Session 278 logged out. Waiting for processes to exit. Oct 10 15:57:52 oleg256-client systemd-logind[1023]: Removed session 278. Oct 10 15:57:52 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 15:57:52 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:57:52 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:57:53 oleg256-client sshd[68590]: Accepted publickey for root from 192.168.202.56 port 36270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:53 oleg256-client systemd-logind[1023]: New session 279 of user root. Oct 10 15:57:53 oleg256-client systemd[1]: Started Session 279 of user root. Oct 10 15:57:53 oleg256-client sshd[68590]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:53 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_218 Need two LNet interfaces Oct 10 15:57:53 oleg256-client sshd[68603]: Received disconnect from 192.168.202.56 port 36270:11: disconnected by user Oct 10 15:57:53 oleg256-client sshd[68603]: Disconnected from user root 192.168.202.56 port 36270 Oct 10 15:57:53 oleg256-client sshd[68590]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:53 oleg256-client systemd[1]: session-279.scope: Succeeded. Oct 10 15:57:53 oleg256-client systemd-logind[1023]: Session 279 logged out. Waiting for processes to exit. Oct 10 15:57:53 oleg256-client systemd-logind[1023]: Removed session 279. Oct 10 15:57:54 oleg256-client sshd[68742]: Accepted publickey for root from 192.168.202.56 port 36274 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:54 oleg256-client systemd-logind[1023]: New session 280 of user root. Oct 10 15:57:54 oleg256-client systemd[1]: Started Session 280 of user root. Oct 10 15:57:54 oleg256-client sshd[68742]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:54 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 219: Consolidate peer entries ======== 15:57:54 (1760126274) Oct 10 15:57:54 oleg256-client sshd[68755]: Received disconnect from 192.168.202.56 port 36274:11: disconnected by user Oct 10 15:57:54 oleg256-client sshd[68755]: Disconnected from user root 192.168.202.56 port 36274 Oct 10 15:57:54 oleg256-client sshd[68742]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:57:54 oleg256-client kernel: LNet: 68789:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:57:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:57:54 oleg256-client systemd[1]: session-280.scope: Succeeded. Oct 10 15:57:54 oleg256-client systemd-logind[1023]: Session 280 logged out. Waiting for processes to exit. Oct 10 15:57:54 oleg256-client systemd-logind[1023]: Removed session 280. Oct 10 15:57:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:57:54 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:57:54 oleg256-client root[68826]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:57:55 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:57:55 oleg256-client root[68935]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:55 oleg256-client root[68947]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:57:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:57:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp1 Oct 10 15:57:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp1 Oct 10 15:57:56 oleg256-client sshd[69136]: Accepted publickey for root from 192.168.202.56 port 36278 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:56 oleg256-client systemd-logind[1023]: New session 281 of user root. Oct 10 15:57:56 oleg256-client systemd[1]: Started Session 281 of user root. Oct 10 15:57:56 oleg256-client sshd[69136]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:56 oleg256-client sshd[69149]: Received disconnect from 192.168.202.56 port 36278:11: disconnected by user Oct 10 15:57:56 oleg256-client sshd[69149]: Disconnected from user root 192.168.202.56 port 36278 Oct 10 15:57:56 oleg256-client sshd[69136]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:56 oleg256-client systemd[1]: session-281.scope: Succeeded. Oct 10 15:57:56 oleg256-client systemd-logind[1023]: Session 281 logged out. Waiting for processes to exit. Oct 10 15:57:56 oleg256-client systemd-logind[1023]: Removed session 281. Oct 10 15:57:56 oleg256-client sshd[69273]: Accepted publickey for root from 192.168.202.56 port 36292 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:57 oleg256-client systemd-logind[1023]: New session 282 of user root. Oct 10 15:57:57 oleg256-client systemd[1]: Started Session 282 of user root. Oct 10 15:57:57 oleg256-client sshd[69273]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:57 oleg256-client sshd[69286]: Received disconnect from 192.168.202.56 port 36292:11: disconnected by user Oct 10 15:57:57 oleg256-client sshd[69286]: Disconnected from user root 192.168.202.56 port 36292 Oct 10 15:57:57 oleg256-client sshd[69273]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:57 oleg256-client systemd[1]: session-282.scope: Succeeded. Oct 10 15:57:57 oleg256-client systemd-logind[1023]: Session 282 logged out. Waiting for processes to exit. Oct 10 15:57:57 oleg256-client systemd-logind[1023]: Removed session 282. Oct 10 15:57:57 oleg256-client sshd[69417]: Accepted publickey for root from 192.168.202.56 port 36306 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:57 oleg256-client systemd-logind[1023]: New session 283 of user root. Oct 10 15:57:57 oleg256-client systemd[1]: Started Session 283 of user root. Oct 10 15:57:57 oleg256-client sshd[69417]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:57 oleg256-client sshd[69430]: Received disconnect from 192.168.202.56 port 36306:11: disconnected by user Oct 10 15:57:57 oleg256-client sshd[69430]: Disconnected from user root 192.168.202.56 port 36306 Oct 10 15:57:57 oleg256-client sshd[69417]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:57 oleg256-client systemd[1]: session-283.scope: Succeeded. Oct 10 15:57:57 oleg256-client systemd-logind[1023]: Session 283 logged out. Waiting for processes to exit. Oct 10 15:57:57 oleg256-client systemd-logind[1023]: Removed session 283. Oct 10 15:57:58 oleg256-client sshd[69570]: Accepted publickey for root from 192.168.202.56 port 36318 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:58 oleg256-client systemd[1]: Started Session 284 of user root. Oct 10 15:57:58 oleg256-client systemd-logind[1023]: New session 284 of user root. Oct 10 15:57:58 oleg256-client sshd[69570]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:58 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 220: Add routes w/default options - check aliveness ========================================================== 15:57:58 (1760126278) Oct 10 15:57:58 oleg256-client sshd[69583]: Received disconnect from 192.168.202.56 port 36318:11: disconnected by user Oct 10 15:57:58 oleg256-client sshd[69583]: Disconnected from user root 192.168.202.56 port 36318 Oct 10 15:57:58 oleg256-client sshd[69570]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:58 oleg256-client systemd-logind[1023]: Session 284 logged out. Waiting for processes to exit. Oct 10 15:57:58 oleg256-client systemd[1]: session-284.scope: Succeeded. Oct 10 15:57:58 oleg256-client systemd-logind[1023]: Removed session 284. Oct 10 15:57:59 oleg256-client sshd[69755]: Accepted publickey for root from 192.168.202.56 port 36326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:57:59 oleg256-client systemd-logind[1023]: New session 285 of user root. Oct 10 15:57:59 oleg256-client systemd[1]: Started Session 285 of user root. Oct 10 15:57:59 oleg256-client sshd[69755]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:57:59 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_220 Need at least 2 remote nodes found oleg256-server Oct 10 15:57:59 oleg256-client sshd[69768]: Received disconnect from 192.168.202.56 port 36326:11: disconnected by user Oct 10 15:57:59 oleg256-client sshd[69768]: Disconnected from user root 192.168.202.56 port 36326 Oct 10 15:57:59 oleg256-client sshd[69755]: pam_unix(sshd:session): session closed for user root Oct 10 15:57:59 oleg256-client systemd-logind[1023]: Session 285 logged out. Waiting for processes to exit. Oct 10 15:57:59 oleg256-client systemd[1]: session-285.scope: Succeeded. Oct 10 15:57:59 oleg256-client systemd-logind[1023]: Removed session 285. Oct 10 15:58:00 oleg256-client sshd[69907]: Accepted publickey for root from 192.168.202.56 port 36334 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:00 oleg256-client systemd-logind[1023]: New session 286 of user root. Oct 10 15:58:00 oleg256-client systemd[1]: Started Session 286 of user root. Oct 10 15:58:00 oleg256-client sshd[69907]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:00 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 221: Add routes w/DD disabled - check aliveness ========================================================== 15:57:59 (1760126279) Oct 10 15:58:00 oleg256-client sshd[69920]: Received disconnect from 192.168.202.56 port 36334:11: disconnected by user Oct 10 15:58:00 oleg256-client sshd[69920]: Disconnected from user root 192.168.202.56 port 36334 Oct 10 15:58:00 oleg256-client sshd[69907]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:00 oleg256-client systemd-logind[1023]: Session 286 logged out. Waiting for processes to exit. Oct 10 15:58:00 oleg256-client systemd[1]: session-286.scope: Succeeded. Oct 10 15:58:00 oleg256-client systemd-logind[1023]: Removed session 286. Oct 10 15:58:01 oleg256-client sshd[70092]: Accepted publickey for root from 192.168.202.56 port 36350 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:01 oleg256-client systemd-logind[1023]: New session 287 of user root. Oct 10 15:58:01 oleg256-client systemd[1]: Started Session 287 of user root. Oct 10 15:58:01 oleg256-client sshd[70092]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:01 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_221 Need at least 2 remote nodes found oleg256-server Oct 10 15:58:01 oleg256-client sshd[70106]: Received disconnect from 192.168.202.56 port 36350:11: disconnected by user Oct 10 15:58:01 oleg256-client sshd[70106]: Disconnected from user root 192.168.202.56 port 36350 Oct 10 15:58:01 oleg256-client sshd[70092]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:01 oleg256-client systemd[1]: session-287.scope: Succeeded. Oct 10 15:58:01 oleg256-client systemd-logind[1023]: Session 287 logged out. Waiting for processes to exit. Oct 10 15:58:01 oleg256-client systemd-logind[1023]: Removed session 287. Oct 10 15:58:02 oleg256-client sshd[70245]: Accepted publickey for root from 192.168.202.56 port 36354 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:02 oleg256-client systemd-logind[1023]: New session 288 of user root. Oct 10 15:58:02 oleg256-client systemd[1]: Started Session 288 of user root. Oct 10 15:58:02 oleg256-client sshd[70245]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:02 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 222: Check avoid_asym_router_failure=1 ========================================================== 15:58:01 (1760126281) Oct 10 15:58:02 oleg256-client sshd[70258]: Received disconnect from 192.168.202.56 port 36354:11: disconnected by user Oct 10 15:58:02 oleg256-client sshd[70258]: Disconnected from user root 192.168.202.56 port 36354 Oct 10 15:58:02 oleg256-client sshd[70245]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:02 oleg256-client systemd[1]: session-288.scope: Succeeded. Oct 10 15:58:02 oleg256-client systemd-logind[1023]: Session 288 logged out. Waiting for processes to exit. Oct 10 15:58:02 oleg256-client systemd-logind[1023]: Removed session 288. Oct 10 15:58:02 oleg256-client sshd[70430]: Accepted publickey for root from 192.168.202.56 port 36356 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:02 oleg256-client systemd-logind[1023]: New session 289 of user root. Oct 10 15:58:02 oleg256-client systemd[1]: Started Session 289 of user root. Oct 10 15:58:03 oleg256-client sshd[70430]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:03 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_222 Need at least 2 remote nodes found oleg256-server Oct 10 15:58:03 oleg256-client sshd[70443]: Received disconnect from 192.168.202.56 port 36356:11: disconnected by user Oct 10 15:58:03 oleg256-client sshd[70443]: Disconnected from user root 192.168.202.56 port 36356 Oct 10 15:58:03 oleg256-client sshd[70430]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:03 oleg256-client systemd-logind[1023]: Session 289 logged out. Waiting for processes to exit. Oct 10 15:58:03 oleg256-client systemd[1]: session-289.scope: Succeeded. Oct 10 15:58:03 oleg256-client systemd-logind[1023]: Removed session 289. Oct 10 15:58:03 oleg256-client sshd[70582]: Accepted publickey for root from 192.168.202.56 port 38886 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:03 oleg256-client systemd-logind[1023]: New session 290 of user root. Oct 10 15:58:03 oleg256-client systemd[1]: Started Session 290 of user root. Oct 10 15:58:03 oleg256-client sshd[70582]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:03 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 223: Check avoid_asym_router_failure=1 w/DD disabled ========================================================== 15:58:03 (1760126283) Oct 10 15:58:03 oleg256-client sshd[70595]: Received disconnect from 192.168.202.56 port 38886:11: disconnected by user Oct 10 15:58:03 oleg256-client sshd[70595]: Disconnected from user root 192.168.202.56 port 38886 Oct 10 15:58:03 oleg256-client sshd[70582]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:04 oleg256-client systemd[1]: session-290.scope: Succeeded. Oct 10 15:58:04 oleg256-client systemd-logind[1023]: Session 290 logged out. Waiting for processes to exit. Oct 10 15:58:04 oleg256-client systemd-logind[1023]: Removed session 290. Oct 10 15:58:04 oleg256-client sshd[70767]: Accepted publickey for root from 192.168.202.56 port 38892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:04 oleg256-client systemd-logind[1023]: New session 291 of user root. Oct 10 15:58:04 oleg256-client systemd[1]: Started Session 291 of user root. Oct 10 15:58:04 oleg256-client sshd[70767]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:04 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_223 Need at least 2 remote nodes found oleg256-server Oct 10 15:58:04 oleg256-client sshd[70780]: Received disconnect from 192.168.202.56 port 38892:11: disconnected by user Oct 10 15:58:04 oleg256-client sshd[70780]: Disconnected from user root 192.168.202.56 port 38892 Oct 10 15:58:04 oleg256-client sshd[70767]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:04 oleg256-client systemd[1]: session-291.scope: Succeeded. Oct 10 15:58:04 oleg256-client systemd-logind[1023]: Session 291 logged out. Waiting for processes to exit. Oct 10 15:58:04 oleg256-client systemd-logind[1023]: Removed session 291. Oct 10 15:58:05 oleg256-client sshd[70919]: Accepted publickey for root from 192.168.202.56 port 38894 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:05 oleg256-client systemd-logind[1023]: New session 292 of user root. Oct 10 15:58:05 oleg256-client systemd[1]: Started Session 292 of user root. Oct 10 15:58:05 oleg256-client sshd[70919]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:05 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 224: Check avoid_asym_router_failure=0 ========================================================== 15:58:04 (1760126284) Oct 10 15:58:05 oleg256-client sshd[70932]: Received disconnect from 192.168.202.56 port 38894:11: disconnected by user Oct 10 15:58:05 oleg256-client sshd[70932]: Disconnected from user root 192.168.202.56 port 38894 Oct 10 15:58:05 oleg256-client sshd[70919]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:05 oleg256-client systemd-logind[1023]: Session 292 logged out. Waiting for processes to exit. Oct 10 15:58:05 oleg256-client systemd[1]: session-292.scope: Succeeded. Oct 10 15:58:05 oleg256-client systemd-logind[1023]: Removed session 292. Oct 10 15:58:06 oleg256-client sshd[71104]: Accepted publickey for root from 192.168.202.56 port 38910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:06 oleg256-client systemd-logind[1023]: New session 293 of user root. Oct 10 15:58:06 oleg256-client systemd[1]: Started Session 293 of user root. Oct 10 15:58:06 oleg256-client sshd[71104]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:06 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_224 Need at least 2 remote nodes found oleg256-server Oct 10 15:58:06 oleg256-client sshd[71117]: Received disconnect from 192.168.202.56 port 38910:11: disconnected by user Oct 10 15:58:06 oleg256-client sshd[71117]: Disconnected from user root 192.168.202.56 port 38910 Oct 10 15:58:06 oleg256-client sshd[71104]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:06 oleg256-client systemd[1]: session-293.scope: Succeeded. Oct 10 15:58:06 oleg256-client systemd-logind[1023]: Session 293 logged out. Waiting for processes to exit. Oct 10 15:58:06 oleg256-client systemd-logind[1023]: Removed session 293. Oct 10 15:58:07 oleg256-client sshd[71257]: Accepted publickey for root from 192.168.202.56 port 38916 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:07 oleg256-client systemd-logind[1023]: New session 294 of user root. Oct 10 15:58:07 oleg256-client systemd[1]: Started Session 294 of user root. Oct 10 15:58:07 oleg256-client sshd[71257]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:07 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 225: Check avoid_asym_router_failure=0 w/DD disabled ========================================================== 15:58:06 (1760126286) Oct 10 15:58:07 oleg256-client sshd[71270]: Received disconnect from 192.168.202.56 port 38916:11: disconnected by user Oct 10 15:58:07 oleg256-client sshd[71270]: Disconnected from user root 192.168.202.56 port 38916 Oct 10 15:58:07 oleg256-client sshd[71257]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:07 oleg256-client systemd[1]: session-294.scope: Succeeded. Oct 10 15:58:07 oleg256-client systemd-logind[1023]: Session 294 logged out. Waiting for processes to exit. Oct 10 15:58:07 oleg256-client systemd-logind[1023]: Removed session 294. Oct 10 15:58:08 oleg256-client sshd[71442]: Accepted publickey for root from 192.168.202.56 port 38924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:08 oleg256-client systemd-logind[1023]: New session 295 of user root. Oct 10 15:58:08 oleg256-client systemd[1]: Started Session 295 of user root. Oct 10 15:58:08 oleg256-client sshd[71442]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:08 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_225 Need at least 2 remote nodes found oleg256-server Oct 10 15:58:08 oleg256-client sshd[71455]: Received disconnect from 192.168.202.56 port 38924:11: disconnected by user Oct 10 15:58:08 oleg256-client sshd[71455]: Disconnected from user root 192.168.202.56 port 38924 Oct 10 15:58:08 oleg256-client sshd[71442]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:08 oleg256-client systemd[1]: session-295.scope: Succeeded. Oct 10 15:58:08 oleg256-client systemd-logind[1023]: Session 295 logged out. Waiting for processes to exit. Oct 10 15:58:08 oleg256-client systemd-logind[1023]: Removed session 295. Oct 10 15:58:08 oleg256-client sshd[71594]: Accepted publickey for root from 192.168.202.56 port 38928 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:08 oleg256-client systemd-logind[1023]: New session 296 of user root. Oct 10 15:58:08 oleg256-client systemd[1]: Started Session 296 of user root. Oct 10 15:58:08 oleg256-client sshd[71594]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:09 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 226: test missing route for 1 of 2 routers ========================================================== 15:58:08 (1760126288) Oct 10 15:58:09 oleg256-client sshd[71607]: Received disconnect from 192.168.202.56 port 38928:11: disconnected by user Oct 10 15:58:09 oleg256-client sshd[71607]: Disconnected from user root 192.168.202.56 port 38928 Oct 10 15:58:09 oleg256-client sshd[71594]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:09 oleg256-client systemd[1]: session-296.scope: Succeeded. Oct 10 15:58:09 oleg256-client systemd-logind[1023]: Session 296 logged out. Waiting for processes to exit. Oct 10 15:58:09 oleg256-client systemd-logind[1023]: Removed session 296. Oct 10 15:58:09 oleg256-client sshd[71782]: Accepted publickey for root from 192.168.202.56 port 38936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:09 oleg256-client systemd-logind[1023]: New session 297 of user root. Oct 10 15:58:09 oleg256-client systemd[1]: Started Session 297 of user root. Oct 10 15:58:09 oleg256-client sshd[71782]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:10 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_226 Need at least 3 remote nodes found oleg256-server Oct 10 15:58:10 oleg256-client sshd[71795]: Received disconnect from 192.168.202.56 port 38936:11: disconnected by user Oct 10 15:58:10 oleg256-client sshd[71795]: Disconnected from user root 192.168.202.56 port 38936 Oct 10 15:58:10 oleg256-client sshd[71782]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:10 oleg256-client systemd-logind[1023]: Session 297 logged out. Waiting for processes to exit. Oct 10 15:58:10 oleg256-client systemd[1]: session-297.scope: Succeeded. Oct 10 15:58:10 oleg256-client systemd-logind[1023]: Removed session 297. Oct 10 15:58:10 oleg256-client sshd[71934]: Accepted publickey for root from 192.168.202.56 port 38946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:10 oleg256-client systemd-logind[1023]: New session 298 of user root. Oct 10 15:58:10 oleg256-client systemd[1]: Started Session 298 of user root. Oct 10 15:58:10 oleg256-client sshd[71934]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:10 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 227: Check router peer health w/DD disabled ========================================================== 15:58:10 (1760126290) Oct 10 15:58:10 oleg256-client sshd[71947]: Received disconnect from 192.168.202.56 port 38946:11: disconnected by user Oct 10 15:58:10 oleg256-client sshd[71947]: Disconnected from user root 192.168.202.56 port 38946 Oct 10 15:58:10 oleg256-client sshd[71934]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:11 oleg256-client systemd[1]: session-298.scope: Succeeded. Oct 10 15:58:11 oleg256-client systemd-logind[1023]: Session 298 logged out. Waiting for processes to exit. Oct 10 15:58:11 oleg256-client systemd-logind[1023]: Removed session 298. Oct 10 15:58:11 oleg256-client sshd[72119]: Accepted publickey for root from 192.168.202.56 port 38950 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:11 oleg256-client systemd-logind[1023]: New session 299 of user root. Oct 10 15:58:11 oleg256-client systemd[1]: Started Session 299 of user root. Oct 10 15:58:11 oleg256-client sshd[72119]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:11 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_227 Need at least 3 remote nodes found oleg256-server Oct 10 15:58:11 oleg256-client sshd[72132]: Received disconnect from 192.168.202.56 port 38950:11: disconnected by user Oct 10 15:58:11 oleg256-client sshd[72132]: Disconnected from user root 192.168.202.56 port 38950 Oct 10 15:58:11 oleg256-client sshd[72119]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:11 oleg256-client systemd[1]: session-299.scope: Succeeded. Oct 10 15:58:11 oleg256-client systemd-logind[1023]: Session 299 logged out. Waiting for processes to exit. Oct 10 15:58:11 oleg256-client systemd-logind[1023]: Removed session 299. Oct 10 15:58:12 oleg256-client sshd[72271]: Accepted publickey for root from 192.168.202.56 port 38958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:12 oleg256-client systemd-logind[1023]: New session 300 of user root. Oct 10 15:58:12 oleg256-client systemd[1]: Started Session 300 of user root. Oct 10 15:58:12 oleg256-client sshd[72271]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:12 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 228: Routes should stay up when health is decremented ========================================================== 15:58:12 (1760126292) Oct 10 15:58:12 oleg256-client sshd[72284]: Received disconnect from 192.168.202.56 port 38958:11: disconnected by user Oct 10 15:58:12 oleg256-client sshd[72284]: Disconnected from user root 192.168.202.56 port 38958 Oct 10 15:58:12 oleg256-client sshd[72271]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:12 oleg256-client systemd-logind[1023]: Session 300 logged out. Waiting for processes to exit. Oct 10 15:58:12 oleg256-client systemd[1]: session-300.scope: Succeeded. Oct 10 15:58:12 oleg256-client systemd-logind[1023]: Removed session 300. Oct 10 15:58:13 oleg256-client sshd[72456]: Accepted publickey for root from 192.168.202.56 port 44038 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:13 oleg256-client systemd[1]: Started Session 301 of user root. Oct 10 15:58:13 oleg256-client systemd-logind[1023]: New session 301 of user root. Oct 10 15:58:13 oleg256-client sshd[72456]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:13 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_228 Need at least 3 remote nodes found oleg256-server Oct 10 15:58:13 oleg256-client sshd[72470]: Received disconnect from 192.168.202.56 port 44038:11: disconnected by user Oct 10 15:58:13 oleg256-client sshd[72470]: Disconnected from user root 192.168.202.56 port 44038 Oct 10 15:58:13 oleg256-client sshd[72456]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:13 oleg256-client systemd[1]: session-301.scope: Succeeded. Oct 10 15:58:13 oleg256-client systemd-logind[1023]: Session 301 logged out. Waiting for processes to exit. Oct 10 15:58:13 oleg256-client systemd-logind[1023]: Removed session 301. Oct 10 15:58:14 oleg256-client sshd[72609]: Accepted publickey for root from 192.168.202.56 port 44052 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:14 oleg256-client systemd[1]: Started Session 302 of user root. Oct 10 15:58:14 oleg256-client systemd-logind[1023]: New session 302 of user root. Oct 10 15:58:14 oleg256-client sshd[72609]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:14 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 230: Test setting conns-per-peer ===== 15:58:13 (1760126293) Oct 10 15:58:14 oleg256-client sshd[72622]: Received disconnect from 192.168.202.56 port 44052:11: disconnected by user Oct 10 15:58:14 oleg256-client sshd[72622]: Disconnected from user root 192.168.202.56 port 44052 Oct 10 15:58:14 oleg256-client sshd[72609]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:14 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:14 oleg256-client kernel: LNet: 72659:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:58:14 oleg256-client kernel: LNetError: 72659:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:58:14 oleg256-client systemd-logind[1023]: Session 302 logged out. Waiting for processes to exit. Oct 10 15:58:14 oleg256-client systemd[1]: session-302.scope: Succeeded. Oct 10 15:58:14 oleg256-client systemd-logind[1023]: Removed session 302. Oct 10 15:58:15 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:15 oleg256-client kernel: LNetError: 72659:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:58:15 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:58:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:15 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:15 oleg256-client root[72693]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 4 Oct 10 15:58:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:17 oleg256-client kernel: LNet: 72813:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:58:17 oleg256-client kernel: LNetError: 72813:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:58:17 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 --conns-per-peer 5 Oct 10 15:58:17 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:17 oleg256-client root[72846]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:18 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:18 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:18 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:18 oleg256-client root[72988]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 6 Oct 10 15:58:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:19 oleg256-client kernel: LNet: 73100:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:58:19 oleg256-client kernel: LNet: 73100:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 1 previous similar message Oct 10 15:58:19 oleg256-client kernel: LNetError: 73100:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:58:19 oleg256-client kernel: LNetError: 73100:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Skipped 1 previous similar message Oct 10 15:58:19 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 --conns-per-peer 7 Oct 10 15:58:19 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:19 oleg256-client root[73133]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:19 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:21 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:21 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:21 oleg256-client root[73275]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 8 Oct 10 15:58:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:22 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:22 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:22 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:58:22 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 --conns-per-peer 9 Oct 10 15:58:22 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:22 oleg256-client root[73420]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:24 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:24 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:24 oleg256-client root[73562]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 10 Oct 10 15:58:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:26 oleg256-client kernel: LNet: 73683:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:58:26 oleg256-client kernel: LNet: 73683:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 3 previous similar messages Oct 10 15:58:26 oleg256-client kernel: LNetError: 73683:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:58:26 oleg256-client kernel: LNetError: 73683:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Skipped 3 previous similar messages Oct 10 15:58:26 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 --conns-per-peer 11 Oct 10 15:58:26 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:26 oleg256-client root[73716]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:26 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:28 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:28 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:28 oleg256-client root[73858]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 12 Oct 10 15:58:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:29 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:31 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 --conns-per-peer 13 Oct 10 15:58:31 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:31 oleg256-client root[74012]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:31 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:32 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:34 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:34 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:34 oleg256-client root[74163]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 14 Oct 10 15:58:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:34 oleg256-client kernel: LNet: 74274:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:58:34 oleg256-client kernel: LNet: 74274:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 3 previous similar messages Oct 10 15:58:34 oleg256-client kernel: LNetError: 74274:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:58:34 oleg256-client kernel: LNetError: 74274:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Skipped 3 previous similar messages Oct 10 15:58:34 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 --conns-per-peer 15 Oct 10 15:58:34 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:35 oleg256-client root[74307]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:35 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 15:58:35 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:36 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:36 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:36 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:36 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:36 oleg256-client root[74450]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer 128 Oct 10 15:58:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:37 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:58:37 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:58:37 oleg256-client root[74579]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --all --conns-per-peer -1 Oct 10 15:58:38 oleg256-client sshd[74761]: Accepted publickey for root from 192.168.202.56 port 44594 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:38 oleg256-client systemd-logind[1023]: New session 303 of user root. Oct 10 15:58:38 oleg256-client systemd[1]: Started Session 303 of user root. Oct 10 15:58:38 oleg256-client sshd[74761]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:38 oleg256-client sshd[74774]: Received disconnect from 192.168.202.56 port 44594:11: disconnected by user Oct 10 15:58:38 oleg256-client sshd[74774]: Disconnected from user root 192.168.202.56 port 44594 Oct 10 15:58:38 oleg256-client sshd[74761]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:38 oleg256-client systemd-logind[1023]: Session 303 logged out. Waiting for processes to exit. Oct 10 15:58:38 oleg256-client systemd[1]: session-303.scope: Succeeded. Oct 10 15:58:38 oleg256-client systemd-logind[1023]: Removed session 303. Oct 10 15:58:39 oleg256-client sshd[74899]: Accepted publickey for root from 192.168.202.56 port 44606 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:39 oleg256-client systemd[1]: Started Session 304 of user root. Oct 10 15:58:39 oleg256-client systemd-logind[1023]: New session 304 of user root. Oct 10 15:58:39 oleg256-client sshd[74899]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:39 oleg256-client sshd[74912]: Received disconnect from 192.168.202.56 port 44606:11: disconnected by user Oct 10 15:58:39 oleg256-client sshd[74912]: Disconnected from user root 192.168.202.56 port 44606 Oct 10 15:58:39 oleg256-client sshd[74899]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:39 oleg256-client systemd[1]: session-304.scope: Succeeded. Oct 10 15:58:39 oleg256-client systemd-logind[1023]: Session 304 logged out. Waiting for processes to exit. Oct 10 15:58:39 oleg256-client systemd-logind[1023]: Removed session 304. Oct 10 15:58:40 oleg256-client sshd[75043]: Accepted publickey for root from 192.168.202.56 port 44614 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:40 oleg256-client systemd-logind[1023]: New session 305 of user root. Oct 10 15:58:40 oleg256-client systemd[1]: Started Session 305 of user root. Oct 10 15:58:40 oleg256-client sshd[75043]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:40 oleg256-client sshd[75056]: Received disconnect from 192.168.202.56 port 44614:11: disconnected by user Oct 10 15:58:40 oleg256-client sshd[75056]: Disconnected from user root 192.168.202.56 port 44614 Oct 10 15:58:40 oleg256-client sshd[75043]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:40 oleg256-client systemd[1]: session-305.scope: Succeeded. Oct 10 15:58:40 oleg256-client systemd-logind[1023]: Session 305 logged out. Waiting for processes to exit. Oct 10 15:58:40 oleg256-client systemd-logind[1023]: Removed session 305. Oct 10 15:58:41 oleg256-client sshd[75197]: Accepted publickey for root from 192.168.202.56 port 44628 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:41 oleg256-client systemd-logind[1023]: New session 306 of user root. Oct 10 15:58:41 oleg256-client systemd[1]: Started Session 306 of user root. Oct 10 15:58:41 oleg256-client sshd[75197]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:41 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 231: Check DLC handling of peer_timeout parameter ========================================================== 15:58:40 (1760126320) Oct 10 15:58:41 oleg256-client sshd[75210]: Received disconnect from 192.168.202.56 port 44628:11: disconnected by user Oct 10 15:58:41 oleg256-client sshd[75210]: Disconnected from user root 192.168.202.56 port 44628 Oct 10 15:58:41 oleg256-client sshd[75197]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:41 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:58:41 oleg256-client systemd[1]: session-306.scope: Succeeded. Oct 10 15:58:41 oleg256-client systemd-logind[1023]: Session 306 logged out. Waiting for processes to exit. Oct 10 15:58:41 oleg256-client systemd-logind[1023]: Removed session 306. Oct 10 15:58:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if ens2 Oct 10 15:58:41 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/180] Oct 10 15:58:41 oleg256-client root[75282]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:42 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:42 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:42 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:42 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml Oct 10 15:58:42 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/180] Oct 10 15:58:42 oleg256-client kernel: LNet: 75392:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:58:42 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if ens2 Oct 10 15:58:42 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:42 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if ens2 --peer-timeout=-1 Oct 10 15:58:42 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/180] Oct 10 15:58:42 oleg256-client root[75435]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:43 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml Oct 10 15:58:43 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/0] Oct 10 15:58:43 oleg256-client kernel: LNet: 75541:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:58:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if ens2 Oct 10 15:58:43 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if ens2 --peer-timeout=0 Oct 10 15:58:43 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/0] Oct 10 15:58:43 oleg256-client root[75583]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:43 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml Oct 10 15:58:44 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/60] Oct 10 15:58:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if ens2 Oct 10 15:58:44 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if ens2 --peer-timeout=60 Oct 10 15:58:44 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/60] Oct 10 15:58:44 oleg256-client root[75731]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:44 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:44 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-231-expected.yaml Oct 10 15:58:44 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/180] Oct 10 15:58:44 oleg256-client kernel: LNet: 75837:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:58:44 oleg256-client kernel: LNet: 75837:0:(api-ni.c:339:recovery_interval_set()) Skipped 1 previous similar message Oct 10 15:58:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp231 --if ens2 Oct 10 15:58:45 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp231 --if ens2 --peer-timeout=180 Oct 10 15:58:45 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp231 [8/256/0/180] Oct 10 15:58:45 oleg256-client root[75879]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:46 oleg256-client sshd[76059]: Accepted publickey for root from 192.168.202.56 port 60856 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:46 oleg256-client systemd-logind[1023]: New session 307 of user root. Oct 10 15:58:46 oleg256-client systemd[1]: Started Session 307 of user root. Oct 10 15:58:46 oleg256-client sshd[76059]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:46 oleg256-client sshd[76072]: Received disconnect from 192.168.202.56 port 60856:11: disconnected by user Oct 10 15:58:46 oleg256-client sshd[76072]: Disconnected from user root 192.168.202.56 port 60856 Oct 10 15:58:46 oleg256-client sshd[76059]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:46 oleg256-client systemd-logind[1023]: Session 307 logged out. Waiting for processes to exit. Oct 10 15:58:46 oleg256-client systemd[1]: session-307.scope: Succeeded. Oct 10 15:58:46 oleg256-client systemd-logind[1023]: Removed session 307. Oct 10 15:58:46 oleg256-client sshd[76196]: Accepted publickey for root from 192.168.202.56 port 60868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:46 oleg256-client systemd-logind[1023]: New session 308 of user root. Oct 10 15:58:46 oleg256-client systemd[1]: Started Session 308 of user root. Oct 10 15:58:46 oleg256-client sshd[76196]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:47 oleg256-client sshd[76209]: Received disconnect from 192.168.202.56 port 60868:11: disconnected by user Oct 10 15:58:47 oleg256-client sshd[76209]: Disconnected from user root 192.168.202.56 port 60868 Oct 10 15:58:47 oleg256-client sshd[76196]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:47 oleg256-client systemd-logind[1023]: Session 308 logged out. Waiting for processes to exit. Oct 10 15:58:47 oleg256-client systemd[1]: session-308.scope: Succeeded. Oct 10 15:58:47 oleg256-client systemd-logind[1023]: Removed session 308. Oct 10 15:58:47 oleg256-client sshd[76340]: Accepted publickey for root from 192.168.202.56 port 60882 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:47 oleg256-client systemd-logind[1023]: New session 309 of user root. Oct 10 15:58:47 oleg256-client systemd[1]: Started Session 309 of user root. Oct 10 15:58:47 oleg256-client sshd[76340]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:47 oleg256-client sshd[76353]: Received disconnect from 192.168.202.56 port 60882:11: disconnected by user Oct 10 15:58:47 oleg256-client sshd[76353]: Disconnected from user root 192.168.202.56 port 60882 Oct 10 15:58:47 oleg256-client sshd[76340]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:47 oleg256-client systemd[1]: session-309.scope: Succeeded. Oct 10 15:58:47 oleg256-client systemd-logind[1023]: Session 309 logged out. Waiting for processes to exit. Oct 10 15:58:47 oleg256-client systemd-logind[1023]: Removed session 309. Oct 10 15:58:48 oleg256-client sshd[76493]: Accepted publickey for root from 192.168.202.56 port 60886 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:48 oleg256-client systemd[1]: Started Session 310 of user root. Oct 10 15:58:48 oleg256-client systemd-logind[1023]: New session 310 of user root. Oct 10 15:58:48 oleg256-client sshd[76493]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:48 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 232: Test setting ToS value ========== 15:58:47 (1760126327) Oct 10 15:58:48 oleg256-client sshd[76506]: Received disconnect from 192.168.202.56 port 60886:11: disconnected by user Oct 10 15:58:48 oleg256-client sshd[76506]: Disconnected from user root 192.168.202.56 port 60886 Oct 10 15:58:48 oleg256-client sshd[76493]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:58:48 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp231 Oct 10 15:58:48 oleg256-client systemd[1]: session-310.scope: Succeeded. Oct 10 15:58:48 oleg256-client systemd-logind[1023]: Session 310 logged out. Waiting for processes to exit. Oct 10 15:58:48 oleg256-client systemd-logind[1023]: Removed session 310. Oct 10 15:58:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:58:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if ens2 Oct 10 15:58:48 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp232 [8/256/0/180] Oct 10 15:58:48 oleg256-client root[76578]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 Oct 10 15:58:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if ens2 Oct 10 15:58:49 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp232 Oct 10 15:58:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if ens2 --tos -1 Oct 10 15:58:49 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp232 [8/256/0/180] Oct 10 15:58:49 oleg256-client root[76701]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 Oct 10 15:58:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if ens2 Oct 10 15:58:49 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp232 Oct 10 15:58:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if ens2 --tos 104 Oct 10 15:58:49 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp232 [8/256/0/180] Oct 10 15:58:49 oleg256-client root[76824]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 Oct 10 15:58:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if ens2 Oct 10 15:58:50 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp232 Oct 10 15:58:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if ens2 --tos 106 Oct 10 15:58:50 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp232 [8/256/0/180] Oct 10 15:58:50 oleg256-client root[76947]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:58:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show --net tcp232 -v 1 Oct 10 15:58:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp232 --if ens2 Oct 10 15:58:50 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp232 Oct 10 15:58:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp232 --if ens2 --tos 300 Oct 10 15:58:51 oleg256-client sshd[77131]: Accepted publickey for root from 192.168.202.56 port 60898 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:51 oleg256-client systemd-logind[1023]: New session 311 of user root. Oct 10 15:58:51 oleg256-client systemd[1]: Started Session 311 of user root. Oct 10 15:58:51 oleg256-client sshd[77131]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:51 oleg256-client sshd[77144]: Received disconnect from 192.168.202.56 port 60898:11: disconnected by user Oct 10 15:58:51 oleg256-client sshd[77144]: Disconnected from user root 192.168.202.56 port 60898 Oct 10 15:58:51 oleg256-client sshd[77131]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:51 oleg256-client systemd[1]: session-311.scope: Succeeded. Oct 10 15:58:51 oleg256-client systemd-logind[1023]: Session 311 logged out. Waiting for processes to exit. Oct 10 15:58:51 oleg256-client systemd-logind[1023]: Removed session 311. Oct 10 15:58:52 oleg256-client sshd[77268]: Accepted publickey for root from 192.168.202.56 port 60910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:52 oleg256-client systemd-logind[1023]: New session 312 of user root. Oct 10 15:58:52 oleg256-client systemd[1]: Started Session 312 of user root. Oct 10 15:58:52 oleg256-client sshd[77268]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:52 oleg256-client sshd[77281]: Received disconnect from 192.168.202.56 port 60910:11: disconnected by user Oct 10 15:58:52 oleg256-client sshd[77281]: Disconnected from user root 192.168.202.56 port 60910 Oct 10 15:58:52 oleg256-client sshd[77268]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:52 oleg256-client systemd[1]: session-312.scope: Succeeded. Oct 10 15:58:52 oleg256-client systemd-logind[1023]: Session 312 logged out. Waiting for processes to exit. Oct 10 15:58:52 oleg256-client systemd-logind[1023]: Removed session 312. Oct 10 15:58:52 oleg256-client sshd[77412]: Accepted publickey for root from 192.168.202.56 port 60918 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:53 oleg256-client systemd[1]: Started Session 313 of user root. Oct 10 15:58:53 oleg256-client systemd-logind[1023]: New session 313 of user root. Oct 10 15:58:53 oleg256-client sshd[77412]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:53 oleg256-client sshd[77425]: Received disconnect from 192.168.202.56 port 60918:11: disconnected by user Oct 10 15:58:53 oleg256-client sshd[77425]: Disconnected from user root 192.168.202.56 port 60918 Oct 10 15:58:53 oleg256-client sshd[77412]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:53 oleg256-client systemd[1]: session-313.scope: Succeeded. Oct 10 15:58:53 oleg256-client systemd-logind[1023]: Session 313 logged out. Waiting for processes to exit. Oct 10 15:58:53 oleg256-client systemd-logind[1023]: Removed session 313. Oct 10 15:58:54 oleg256-client sshd[77565]: Accepted publickey for root from 192.168.202.56 port 51936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:58:54 oleg256-client systemd-logind[1023]: New session 314 of user root. Oct 10 15:58:54 oleg256-client systemd[1]: Started Session 314 of user root. Oct 10 15:58:54 oleg256-client sshd[77565]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:58:54 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 233: Check for successful resends ==== 15:58:53 (1760126333) Oct 10 15:58:54 oleg256-client sshd[77578]: Received disconnect from 192.168.202.56 port 51936:11: disconnected by user Oct 10 15:58:54 oleg256-client sshd[77578]: Disconnected from user root 192.168.202.56 port 51936 Oct 10 15:58:54 oleg256-client sshd[77565]: pam_unix(sshd:session): session closed for user root Oct 10 15:58:54 oleg256-client systemd[1]: session-314.scope: Succeeded. Oct 10 15:58:54 oleg256-client systemd-logind[1023]: Session 314 logged out. Waiting for processes to exit. Oct 10 15:58:54 oleg256-client systemd-logind[1023]: Removed session 314. Oct 10 15:58:54 oleg256-client kernel: LNet: 77659:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:58:54 oleg256-client kernel: LNet: 77659:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 8 previous similar messages Oct 10 15:58:54 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:58:54 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:58:55 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:58:55 oleg256-client systemd-udevd[77742]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:58:55 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:58:58 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:58:58 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:58:58 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:58:58 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:58:59 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:58:59 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:59:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:59:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:59:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 15:59:07 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 15:59:07 oleg256-client root[78097]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:59:07 oleg256-client root[78108]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_interrupt -r 2 Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp 192.168.202.156@tcp Oct 10 15:59:08 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:59:08 oleg256-client kernel: LNet: 1 local NIs in recovery (showing 1): 192.168.202.56@tcp Oct 10 15:59:08 oleg256-client kernel: LNet: 78305:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:59:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_dropped -r 2 Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp 192.168.202.156@tcp Oct 10 15:59:09 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:59:09 oleg256-client kernel: LNet: 78413:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:59:09 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_aborted -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp 192.168.202.156@tcp Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_no_route -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_no_route -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_no_route -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_no_route -r 2 Oct 10 15:59:10 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_no_route -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_no_route -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_no_route -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_no_route -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp 192.168.202.156@tcp Oct 10 15:59:11 oleg256-client kernel: LNet: There was an unexpected network error while writing to 192.168.202.156: rc = -22 Oct 10 15:59:11 oleg256-client kernel: LNet: Skipped 2 previous similar messages Oct 10 15:59:11 oleg256-client kernel: LNet: 78630:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 15:59:11 oleg256-client kernel: LNet: 78630:0:(api-ni.c:339:recovery_interval_set()) Skipped 1 previous similar message Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e local_timeout -r 2 Oct 10 15:59:11 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp 192.168.202.156@tcp Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.156@tcp1 -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp -d 192.168.202.56@tcp1 -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.156@tcp1 -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s 192.168.202.56@tcp1 -d 192.168.202.56@tcp1 -m GET -e remote_dropped -r 2 Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --source 192.168.202.56@tcp 192.168.202.156@tcp Oct 10 15:59:12 oleg256-client kernel: LNet: 1 peer NIs in recovery (showing 1): 192.168.202.156@tcp Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 15:59:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 15:59:15 oleg256-client kernel: LNet: 78914:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:59:15 oleg256-client kernel: LNetError: 78914:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:59:15 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:59:15 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 15:59:15 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:59:15 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:59:16 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:59:16 oleg256-client systemd-udevd[78969]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:59:16 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:59:21 oleg256-client sshd[79215]: Accepted publickey for root from 192.168.202.56 port 37458 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:21 oleg256-client systemd-logind[1023]: New session 315 of user root. Oct 10 15:59:21 oleg256-client systemd[1]: Started Session 315 of user root. Oct 10 15:59:21 oleg256-client sshd[79215]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:21 oleg256-client sshd[79228]: Received disconnect from 192.168.202.56 port 37458:11: disconnected by user Oct 10 15:59:21 oleg256-client sshd[79228]: Disconnected from user root 192.168.202.56 port 37458 Oct 10 15:59:21 oleg256-client sshd[79215]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:21 oleg256-client systemd[1]: session-315.scope: Succeeded. Oct 10 15:59:21 oleg256-client systemd-logind[1023]: Session 315 logged out. Waiting for processes to exit. Oct 10 15:59:21 oleg256-client systemd-logind[1023]: Removed session 315. Oct 10 15:59:21 oleg256-client sshd[79353]: Accepted publickey for root from 192.168.202.56 port 37460 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:21 oleg256-client systemd[1]: Started Session 316 of user root. Oct 10 15:59:21 oleg256-client systemd-logind[1023]: New session 316 of user root. Oct 10 15:59:21 oleg256-client sshd[79353]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:22 oleg256-client sshd[79366]: Received disconnect from 192.168.202.56 port 37460:11: disconnected by user Oct 10 15:59:22 oleg256-client sshd[79366]: Disconnected from user root 192.168.202.56 port 37460 Oct 10 15:59:22 oleg256-client sshd[79353]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:22 oleg256-client systemd[1]: session-316.scope: Succeeded. Oct 10 15:59:22 oleg256-client systemd-logind[1023]: Session 316 logged out. Waiting for processes to exit. Oct 10 15:59:22 oleg256-client systemd-logind[1023]: Removed session 316. Oct 10 15:59:22 oleg256-client sshd[79497]: Accepted publickey for root from 192.168.202.56 port 37474 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:22 oleg256-client systemd-logind[1023]: New session 317 of user root. Oct 10 15:59:22 oleg256-client systemd[1]: Started Session 317 of user root. Oct 10 15:59:22 oleg256-client sshd[79497]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:22 oleg256-client sshd[79510]: Received disconnect from 192.168.202.56 port 37474:11: disconnected by user Oct 10 15:59:22 oleg256-client sshd[79510]: Disconnected from user root 192.168.202.56 port 37474 Oct 10 15:59:22 oleg256-client sshd[79497]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:23 oleg256-client systemd[1]: session-317.scope: Succeeded. Oct 10 15:59:23 oleg256-client systemd-logind[1023]: Session 317 logged out. Waiting for processes to exit. Oct 10 15:59:23 oleg256-client systemd-logind[1023]: Removed session 317. Oct 10 15:59:23 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:59:23 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:59:23 oleg256-client sshd[79659]: Accepted publickey for root from 192.168.202.56 port 56102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:23 oleg256-client systemd-logind[1023]: New session 318 of user root. Oct 10 15:59:23 oleg256-client systemd[1]: Started Session 318 of user root. Oct 10 15:59:23 oleg256-client sshd[79659]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:24 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 241: Check setting LND timeout value via lnetctl updates tunables ========================================================== 15:59:23 (1760126363) Oct 10 15:59:24 oleg256-client sshd[79672]: Received disconnect from 192.168.202.56 port 56102:11: disconnected by user Oct 10 15:59:24 oleg256-client sshd[79672]: Disconnected from user root 192.168.202.56 port 56102 Oct 10 15:59:24 oleg256-client sshd[79659]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:24 oleg256-client systemd[1]: session-318.scope: Succeeded. Oct 10 15:59:24 oleg256-client systemd-logind[1023]: Session 318 logged out. Waiting for processes to exit. Oct 10 15:59:24 oleg256-client systemd-logind[1023]: Removed session 318. Oct 10 15:59:24 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 15:59:24 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:59:25 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:59:25 oleg256-client root[79777]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set -h Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --net tcp --lnd-timeout 51 Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show -v Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --net tcp --lnd-timeout 0 Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show -v Oct 10 15:59:25 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --net tcp --lnd-timeout 50 Oct 10 15:59:26 oleg256-client sshd[79980]: Accepted publickey for root from 192.168.202.56 port 56118 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:26 oleg256-client systemd-logind[1023]: New session 319 of user root. Oct 10 15:59:26 oleg256-client systemd[1]: Started Session 319 of user root. Oct 10 15:59:26 oleg256-client sshd[79980]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:26 oleg256-client sshd[79993]: Received disconnect from 192.168.202.56 port 56118:11: disconnected by user Oct 10 15:59:26 oleg256-client sshd[79993]: Disconnected from user root 192.168.202.56 port 56118 Oct 10 15:59:26 oleg256-client sshd[79980]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:26 oleg256-client systemd[1]: session-319.scope: Succeeded. Oct 10 15:59:26 oleg256-client systemd-logind[1023]: Session 319 logged out. Waiting for processes to exit. Oct 10 15:59:26 oleg256-client systemd-logind[1023]: Removed session 319. Oct 10 15:59:27 oleg256-client sshd[80118]: Accepted publickey for root from 192.168.202.56 port 56124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:27 oleg256-client systemd[1]: Started Session 320 of user root. Oct 10 15:59:27 oleg256-client systemd-logind[1023]: New session 320 of user root. Oct 10 15:59:27 oleg256-client sshd[80118]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:27 oleg256-client sshd[80131]: Received disconnect from 192.168.202.56 port 56124:11: disconnected by user Oct 10 15:59:27 oleg256-client sshd[80131]: Disconnected from user root 192.168.202.56 port 56124 Oct 10 15:59:27 oleg256-client sshd[80118]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:27 oleg256-client systemd[1]: session-320.scope: Succeeded. Oct 10 15:59:27 oleg256-client systemd-logind[1023]: Session 320 logged out. Waiting for processes to exit. Oct 10 15:59:27 oleg256-client systemd-logind[1023]: Removed session 320. Oct 10 15:59:28 oleg256-client sshd[80262]: Accepted publickey for root from 192.168.202.56 port 56136 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:28 oleg256-client systemd-logind[1023]: New session 321 of user root. Oct 10 15:59:28 oleg256-client systemd[1]: Started Session 321 of user root. Oct 10 15:59:28 oleg256-client sshd[80262]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:28 oleg256-client sshd[80275]: Received disconnect from 192.168.202.56 port 56136:11: disconnected by user Oct 10 15:59:28 oleg256-client sshd[80275]: Disconnected from user root 192.168.202.56 port 56136 Oct 10 15:59:28 oleg256-client sshd[80262]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:28 oleg256-client systemd-logind[1023]: Session 321 logged out. Waiting for processes to exit. Oct 10 15:59:28 oleg256-client systemd[1]: session-321.scope: Succeeded. Oct 10 15:59:28 oleg256-client systemd-logind[1023]: Removed session 321. Oct 10 15:59:29 oleg256-client sshd[80416]: Accepted publickey for root from 192.168.202.56 port 56142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:29 oleg256-client systemd[1]: Started Session 322 of user root. Oct 10 15:59:29 oleg256-client systemd-logind[1023]: New session 322 of user root. Oct 10 15:59:29 oleg256-client sshd[80416]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:29 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 245: Check read-only params do not appear in export --backup ========================================================== 15:59:28 (1760126368) Oct 10 15:59:29 oleg256-client sshd[80429]: Received disconnect from 192.168.202.56 port 56142:11: disconnected by user Oct 10 15:59:29 oleg256-client sshd[80429]: Disconnected from user root 192.168.202.56 port 56142 Oct 10 15:59:29 oleg256-client sshd[80416]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:29 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:59:29 oleg256-client systemd[1]: session-322.scope: Succeeded. Oct 10 15:59:29 oleg256-client systemd-logind[1023]: Session 322 logged out. Waiting for processes to exit. Oct 10 15:59:29 oleg256-client systemd-logind[1023]: Removed session 322. Oct 10 15:59:29 oleg256-client kernel: LNet: 80467:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:59:29 oleg256-client kernel: LNetError: 80467:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:59:29 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:59:29 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:59:29 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:59:29 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:59:29 oleg256-client root[80500]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:59:30 oleg256-client sshd[80681]: Accepted publickey for root from 192.168.202.56 port 56144 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:30 oleg256-client systemd[1]: Started Session 323 of user root. Oct 10 15:59:30 oleg256-client systemd-logind[1023]: New session 323 of user root. Oct 10 15:59:30 oleg256-client sshd[80681]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:30 oleg256-client sshd[80694]: Received disconnect from 192.168.202.56 port 56144:11: disconnected by user Oct 10 15:59:30 oleg256-client sshd[80694]: Disconnected from user root 192.168.202.56 port 56144 Oct 10 15:59:30 oleg256-client sshd[80681]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:30 oleg256-client systemd[1]: session-323.scope: Succeeded. Oct 10 15:59:30 oleg256-client systemd-logind[1023]: Session 323 logged out. Waiting for processes to exit. Oct 10 15:59:30 oleg256-client systemd-logind[1023]: Removed session 323. Oct 10 15:59:31 oleg256-client sshd[80818]: Accepted publickey for root from 192.168.202.56 port 56146 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:31 oleg256-client systemd-logind[1023]: New session 324 of user root. Oct 10 15:59:31 oleg256-client systemd[1]: Started Session 324 of user root. Oct 10 15:59:31 oleg256-client sshd[80818]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:31 oleg256-client sshd[80831]: Received disconnect from 192.168.202.56 port 56146:11: disconnected by user Oct 10 15:59:31 oleg256-client sshd[80831]: Disconnected from user root 192.168.202.56 port 56146 Oct 10 15:59:31 oleg256-client sshd[80818]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:31 oleg256-client systemd-logind[1023]: Session 324 logged out. Waiting for processes to exit. Oct 10 15:59:31 oleg256-client systemd[1]: session-324.scope: Succeeded. Oct 10 15:59:31 oleg256-client systemd-logind[1023]: Removed session 324. Oct 10 15:59:32 oleg256-client sshd[80963]: Accepted publickey for root from 192.168.202.56 port 56160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:32 oleg256-client systemd-logind[1023]: New session 325 of user root. Oct 10 15:59:32 oleg256-client systemd[1]: Started Session 325 of user root. Oct 10 15:59:32 oleg256-client sshd[80963]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:32 oleg256-client sshd[80976]: Received disconnect from 192.168.202.56 port 56160:11: disconnected by user Oct 10 15:59:32 oleg256-client sshd[80976]: Disconnected from user root 192.168.202.56 port 56160 Oct 10 15:59:32 oleg256-client sshd[80963]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:32 oleg256-client systemd[1]: session-325.scope: Succeeded. Oct 10 15:59:32 oleg256-client systemd-logind[1023]: Session 325 logged out. Waiting for processes to exit. Oct 10 15:59:32 oleg256-client systemd-logind[1023]: Removed session 325. Oct 10 15:59:33 oleg256-client sshd[81117]: Accepted publickey for root from 192.168.202.56 port 56168 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:33 oleg256-client systemd-logind[1023]: New session 326 of user root. Oct 10 15:59:33 oleg256-client systemd[1]: Started Session 326 of user root. Oct 10 15:59:33 oleg256-client sshd[81117]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:33 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 250: test that linux routes are added ========================================================== 15:59:32 (1760126372) Oct 10 15:59:33 oleg256-client sshd[81130]: Received disconnect from 192.168.202.56 port 56168:11: disconnected by user Oct 10 15:59:33 oleg256-client sshd[81130]: Disconnected from user root 192.168.202.56 port 56168 Oct 10 15:59:33 oleg256-client sshd[81117]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:33 oleg256-client systemd[1]: session-326.scope: Succeeded. Oct 10 15:59:33 oleg256-client systemd-logind[1023]: Session 326 logged out. Waiting for processes to exit. Oct 10 15:59:33 oleg256-client systemd-logind[1023]: Removed session 326. Oct 10 15:59:33 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 15:59:33 oleg256-client kernel: LNet: 81168:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:59:33 oleg256-client kernel: LNetError: 81168:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:59:33 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:59:33 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:59:33 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 15:59:33 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:59:33 oleg256-client root[81201]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 15:59:34 oleg256-client sshd[81379]: Accepted publickey for root from 192.168.202.56 port 44486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:34 oleg256-client systemd-logind[1023]: New session 327 of user root. Oct 10 15:59:34 oleg256-client systemd[1]: Started Session 327 of user root. Oct 10 15:59:34 oleg256-client sshd[81379]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:34 oleg256-client sshd[81392]: Received disconnect from 192.168.202.56 port 44486:11: disconnected by user Oct 10 15:59:34 oleg256-client sshd[81392]: Disconnected from user root 192.168.202.56 port 44486 Oct 10 15:59:34 oleg256-client sshd[81379]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:34 oleg256-client systemd[1]: session-327.scope: Succeeded. Oct 10 15:59:34 oleg256-client systemd-logind[1023]: Session 327 logged out. Waiting for processes to exit. Oct 10 15:59:34 oleg256-client systemd-logind[1023]: Removed session 327. Oct 10 15:59:34 oleg256-client sshd[81516]: Accepted publickey for root from 192.168.202.56 port 44496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:35 oleg256-client systemd-logind[1023]: New session 328 of user root. Oct 10 15:59:35 oleg256-client systemd[1]: Started Session 328 of user root. Oct 10 15:59:35 oleg256-client sshd[81516]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:35 oleg256-client sshd[81529]: Received disconnect from 192.168.202.56 port 44496:11: disconnected by user Oct 10 15:59:35 oleg256-client sshd[81529]: Disconnected from user root 192.168.202.56 port 44496 Oct 10 15:59:35 oleg256-client sshd[81516]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:35 oleg256-client systemd[1]: session-328.scope: Succeeded. Oct 10 15:59:35 oleg256-client systemd-logind[1023]: Session 328 logged out. Waiting for processes to exit. Oct 10 15:59:35 oleg256-client systemd-logind[1023]: Removed session 328. Oct 10 15:59:35 oleg256-client sshd[81660]: Accepted publickey for root from 192.168.202.56 port 44504 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:35 oleg256-client systemd-logind[1023]: New session 329 of user root. Oct 10 15:59:35 oleg256-client systemd[1]: Started Session 329 of user root. Oct 10 15:59:35 oleg256-client sshd[81660]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:36 oleg256-client sshd[81673]: Received disconnect from 192.168.202.56 port 44504:11: disconnected by user Oct 10 15:59:36 oleg256-client sshd[81673]: Disconnected from user root 192.168.202.56 port 44504 Oct 10 15:59:36 oleg256-client sshd[81660]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:36 oleg256-client systemd[1]: session-329.scope: Succeeded. Oct 10 15:59:36 oleg256-client systemd-logind[1023]: Session 329 logged out. Waiting for processes to exit. Oct 10 15:59:36 oleg256-client systemd-logind[1023]: Removed session 329. Oct 10 15:59:36 oleg256-client sshd[81813]: Accepted publickey for root from 192.168.202.56 port 44516 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:36 oleg256-client systemd-logind[1023]: New session 330 of user root. Oct 10 15:59:36 oleg256-client systemd[1]: Started Session 330 of user root. Oct 10 15:59:36 oleg256-client sshd[81813]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:36 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 251: Define multiple kfi networks on single interface ========================================================== 15:59:36 (1760126376) Oct 10 15:59:36 oleg256-client sshd[81827]: Received disconnect from 192.168.202.56 port 44516:11: disconnected by user Oct 10 15:59:37 oleg256-client sshd[81827]: Disconnected from user root 192.168.202.56 port 44516 Oct 10 15:59:37 oleg256-client sshd[81813]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:37 oleg256-client systemd-logind[1023]: Session 330 logged out. Waiting for processes to exit. Oct 10 15:59:37 oleg256-client systemd[1]: session-330.scope: Succeeded. Oct 10 15:59:37 oleg256-client systemd-logind[1023]: Removed session 330. Oct 10 15:59:37 oleg256-client sshd[81950]: Accepted publickey for root from 192.168.202.56 port 44528 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:37 oleg256-client systemd-logind[1023]: New session 331 of user root. Oct 10 15:59:37 oleg256-client systemd[1]: Started Session 331 of user root. Oct 10 15:59:37 oleg256-client sshd[81950]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:37 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_251 Need kfi NETTYPE Oct 10 15:59:37 oleg256-client sshd[81963]: Received disconnect from 192.168.202.56 port 44528:11: disconnected by user Oct 10 15:59:37 oleg256-client sshd[81963]: Disconnected from user root 192.168.202.56 port 44528 Oct 10 15:59:37 oleg256-client sshd[81950]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:37 oleg256-client systemd[1]: session-331.scope: Succeeded. Oct 10 15:59:37 oleg256-client systemd-logind[1023]: Session 331 logged out. Waiting for processes to exit. Oct 10 15:59:37 oleg256-client systemd-logind[1023]: Removed session 331. Oct 10 15:59:38 oleg256-client sshd[82102]: Accepted publickey for root from 192.168.202.56 port 44544 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:38 oleg256-client systemd[1]: Started Session 332 of user root. Oct 10 15:59:38 oleg256-client systemd-logind[1023]: New session 332 of user root. Oct 10 15:59:38 oleg256-client sshd[82102]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:38 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 252: Ping to down peer should unlink quickly ========================================================== 15:59:38 (1760126378) Oct 10 15:59:38 oleg256-client sshd[82115]: Received disconnect from 192.168.202.56 port 44544:11: disconnected by user Oct 10 15:59:38 oleg256-client sshd[82115]: Disconnected from user root 192.168.202.56 port 44544 Oct 10 15:59:38 oleg256-client sshd[82102]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:38 oleg256-client systemd[1]: session-332.scope: Succeeded. Oct 10 15:59:39 oleg256-client systemd-logind[1023]: Session 332 logged out. Waiting for processes to exit. Oct 10 15:59:39 oleg256-client systemd-logind[1023]: Removed session 332. Oct 10 15:59:39 oleg256-client kernel: LNet: 82199:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:59:39 oleg256-client kernel: LNetError: 82199:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:59:39 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:59:39 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:59:39 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:59:39 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:59:39 oleg256-client systemd-udevd[82285]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:59:39 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:59:42 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:59:42 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:59:42 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 15:59:42 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:59:43 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 15:59:43 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 15:59:46 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 15:59:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping --timeout 15 192.168.202.156@tcp Oct 10 15:59:49 oleg256-client kernel: LNet: 82609:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:59:49 oleg256-client kernel: LNetError: 82609:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 15:59:49 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 15:59:49 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:59:49 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:59:49 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:59:49 oleg256-client systemd-udevd[82668]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:59:49 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 15:59:52 oleg256-client sshd[82877]: Accepted publickey for root from 192.168.202.56 port 36974 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:52 oleg256-client systemd-logind[1023]: New session 333 of user root. Oct 10 15:59:52 oleg256-client systemd[1]: Started Session 333 of user root. Oct 10 15:59:52 oleg256-client sshd[82877]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:52 oleg256-client sshd[82890]: Received disconnect from 192.168.202.56 port 36974:11: disconnected by user Oct 10 15:59:52 oleg256-client sshd[82890]: Disconnected from user root 192.168.202.56 port 36974 Oct 10 15:59:52 oleg256-client sshd[82877]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:52 oleg256-client systemd[1]: session-333.scope: Succeeded. Oct 10 15:59:52 oleg256-client systemd-logind[1023]: Session 333 logged out. Waiting for processes to exit. Oct 10 15:59:52 oleg256-client systemd-logind[1023]: Removed session 333. Oct 10 15:59:53 oleg256-client sshd[83014]: Accepted publickey for root from 192.168.202.56 port 36988 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:53 oleg256-client systemd-logind[1023]: New session 334 of user root. Oct 10 15:59:53 oleg256-client systemd[1]: Started Session 334 of user root. Oct 10 15:59:53 oleg256-client sshd[83014]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:53 oleg256-client sshd[83027]: Received disconnect from 192.168.202.56 port 36988:11: disconnected by user Oct 10 15:59:53 oleg256-client sshd[83027]: Disconnected from user root 192.168.202.56 port 36988 Oct 10 15:59:53 oleg256-client sshd[83014]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:53 oleg256-client systemd[1]: session-334.scope: Succeeded. Oct 10 15:59:53 oleg256-client systemd-logind[1023]: Session 334 logged out. Waiting for processes to exit. Oct 10 15:59:53 oleg256-client systemd-logind[1023]: Removed session 334. Oct 10 15:59:53 oleg256-client sshd[83158]: Accepted publickey for root from 192.168.202.56 port 40312 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:53 oleg256-client systemd[1]: Started Session 335 of user root. Oct 10 15:59:53 oleg256-client systemd-logind[1023]: New session 335 of user root. Oct 10 15:59:53 oleg256-client sshd[83158]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:54 oleg256-client sshd[83171]: Received disconnect from 192.168.202.56 port 40312:11: disconnected by user Oct 10 15:59:54 oleg256-client sshd[83171]: Disconnected from user root 192.168.202.56 port 40312 Oct 10 15:59:54 oleg256-client sshd[83158]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:54 oleg256-client systemd[1]: session-335.scope: Succeeded. Oct 10 15:59:54 oleg256-client systemd-logind[1023]: Session 335 logged out. Waiting for processes to exit. Oct 10 15:59:54 oleg256-client systemd-logind[1023]: Removed session 335. Oct 10 15:59:54 oleg256-client kernel: Key type ._llcrypt registered Oct 10 15:59:54 oleg256-client kernel: Key type .llcrypt registered Oct 10 15:59:54 oleg256-client sshd[83310]: Accepted publickey for root from 192.168.202.56 port 40326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:54 oleg256-client systemd-logind[1023]: New session 336 of user root. Oct 10 15:59:54 oleg256-client systemd[1]: Started Session 336 of user root. Oct 10 15:59:54 oleg256-client sshd[83310]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:54 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_253 skipping ALWAYS excluded test 253 Oct 10 15:59:54 oleg256-client sshd[83323]: Received disconnect from 192.168.202.56 port 40326:11: disconnected by user Oct 10 15:59:54 oleg256-client sshd[83323]: Disconnected from user root 192.168.202.56 port 40326 Oct 10 15:59:54 oleg256-client sshd[83310]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:54 oleg256-client systemd[1]: session-336.scope: Succeeded. Oct 10 15:59:54 oleg256-client systemd-logind[1023]: Session 336 logged out. Waiting for processes to exit. Oct 10 15:59:54 oleg256-client systemd-logind[1023]: Removed session 336. Oct 10 15:59:55 oleg256-client sshd[83449]: Accepted publickey for root from 192.168.202.56 port 40342 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:55 oleg256-client systemd-logind[1023]: New session 337 of user root. Oct 10 15:59:55 oleg256-client systemd[1]: Started Session 337 of user root. Oct 10 15:59:55 oleg256-client sshd[83449]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:55 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_254 skipping ALWAYS excluded test 254 Oct 10 15:59:55 oleg256-client sshd[83462]: Received disconnect from 192.168.202.56 port 40342:11: disconnected by user Oct 10 15:59:55 oleg256-client sshd[83462]: Disconnected from user root 192.168.202.56 port 40342 Oct 10 15:59:55 oleg256-client sshd[83449]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:55 oleg256-client systemd[1]: session-337.scope: Succeeded. Oct 10 15:59:55 oleg256-client systemd-logind[1023]: Session 337 logged out. Waiting for processes to exit. Oct 10 15:59:55 oleg256-client systemd-logind[1023]: Removed session 337. Oct 10 15:59:56 oleg256-client sshd[83598]: Accepted publickey for root from 192.168.202.56 port 40356 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 15:59:56 oleg256-client systemd-logind[1023]: New session 338 of user root. Oct 10 15:59:56 oleg256-client systemd[1]: Started Session 338 of user root. Oct 10 15:59:56 oleg256-client sshd[83598]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 15:59:56 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 255: Use lnet routes param with pdsh syntax ========================================================== 15:59:55 (1760126395) Oct 10 15:59:56 oleg256-client sshd[83611]: Received disconnect from 192.168.202.56 port 40356:11: disconnected by user Oct 10 15:59:56 oleg256-client sshd[83611]: Disconnected from user root 192.168.202.56 port 40356 Oct 10 15:59:56 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 15:59:56 oleg256-client sshd[83598]: pam_unix(sshd:session): session closed for user root Oct 10 15:59:56 oleg256-client systemd[1]: session-338.scope: Succeeded. Oct 10 15:59:56 oleg256-client systemd-logind[1023]: Session 338 logged out. Waiting for processes to exit. Oct 10 15:59:56 oleg256-client systemd-logind[1023]: Removed session 338. Oct 10 15:59:56 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 15:59:56 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 15:59:57 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 15:59:57 oleg256-client kernel: LNet: 83693:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 15:59:57 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 15:59:57 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 15:59:58 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 15:59:58 oleg256-client systemd-udevd[83779]: Using default interface naming scheme 'rhel-8.0'. Oct 10 15:59:58 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:00:00 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:00:00 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:00:00 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:00:00 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:00:01 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:00:01 oleg256-client kernel: LNet: 83944:0:(router.c:733:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled Oct 10 16:00:01 oleg256-client kernel: LNetError: 83956:0:(router.c:398:lnet_router_discovery_ping_reply()) Peer 192.168.202.58@tcp is being used as a gateway but routing feature is not turned on Oct 10 16:00:01 oleg256-client kernel: LNetError: 83956:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) route to o2ib through 192.168.202.58@tcp has gone from up to down Oct 10 16:00:01 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:00:05 oleg256-client kernel: LNetError: 83956:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) route to o2ib through 192.168.202.61@tcp has gone from up to down Oct 10 16:00:05 oleg256-client kernel: LNetError: 83956:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) Skipped 2 previous similar messages Oct 10 16:00:05 oleg256-client kernel: LNet: 84002:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:00:05 oleg256-client kernel: LNetError: 84002:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:00:05 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:00:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:00:05 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import Oct 10 16:00:05 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:00:05 oleg256-client kernel: LNet: 84010:0:(router.c:733:lnet_add_route()) Use hops = 1 for a single-hop route when avoid_asym_router_failure feature is enabled Oct 10 16:00:05 oleg256-client kernel: LNet: 84010:0:(router.c:733:lnet_add_route()) Skipped 4 previous similar messages Oct 10 16:00:05 oleg256-client kernel: LNetError: 84010:0:(peer.c:368:lnet_peer_ni_del_locked()) Peer NI 192.168.202.58@tcp is a gateway. Can not delete it Oct 10 16:00:05 oleg256-client kernel: LNetError: 84010:0:(peer.c:2208:lnet_del_peer_ni()) 192.168.202.58@tcp is a router. Can not be deleted Oct 10 16:00:05 oleg256-client kernel: LNet: 84010:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 16:00:05 oleg256-client kernel: LNetError: 84007:0:(router.c:398:lnet_router_discovery_ping_reply()) Peer 192.168.202.60@tcp is being used as a gateway but routing feature is not turned on Oct 10 16:00:05 oleg256-client kernel: LNetError: 84007:0:(router.c:398:lnet_router_discovery_ping_reply()) Skipped 2 previous similar messages Oct 10 16:00:05 oleg256-client sshd[84129]: Accepted publickey for root from 192.168.202.56 port 58006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:05 oleg256-client systemd[1]: Started Session 339 of user root. Oct 10 16:00:05 oleg256-client systemd-logind[1023]: New session 339 of user root. Oct 10 16:00:05 oleg256-client sshd[84129]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:06 oleg256-client sshd[84142]: Received disconnect from 192.168.202.56 port 58006:11: disconnected by user Oct 10 16:00:06 oleg256-client sshd[84142]: Disconnected from user root 192.168.202.56 port 58006 Oct 10 16:00:06 oleg256-client sshd[84129]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:06 oleg256-client systemd[1]: session-339.scope: Succeeded. Oct 10 16:00:06 oleg256-client systemd-logind[1023]: Session 339 logged out. Waiting for processes to exit. Oct 10 16:00:06 oleg256-client systemd-logind[1023]: Removed session 339. Oct 10 16:00:06 oleg256-client sshd[84266]: Accepted publickey for root from 192.168.202.56 port 58018 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:06 oleg256-client systemd-logind[1023]: New session 340 of user root. Oct 10 16:00:06 oleg256-client systemd[1]: Started Session 340 of user root. Oct 10 16:00:06 oleg256-client sshd[84266]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:06 oleg256-client sshd[84279]: Received disconnect from 192.168.202.56 port 58018:11: disconnected by user Oct 10 16:00:06 oleg256-client sshd[84279]: Disconnected from user root 192.168.202.56 port 58018 Oct 10 16:00:06 oleg256-client sshd[84266]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:06 oleg256-client systemd[1]: session-340.scope: Succeeded. Oct 10 16:00:06 oleg256-client systemd-logind[1023]: Session 340 logged out. Waiting for processes to exit. Oct 10 16:00:06 oleg256-client systemd-logind[1023]: Removed session 340. Oct 10 16:00:07 oleg256-client sshd[84410]: Accepted publickey for root from 192.168.202.56 port 58020 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:07 oleg256-client systemd[1]: Started Session 341 of user root. Oct 10 16:00:07 oleg256-client systemd-logind[1023]: New session 341 of user root. Oct 10 16:00:07 oleg256-client sshd[84410]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:07 oleg256-client sshd[84423]: Received disconnect from 192.168.202.56 port 58020:11: disconnected by user Oct 10 16:00:07 oleg256-client sshd[84423]: Disconnected from user root 192.168.202.56 port 58020 Oct 10 16:00:07 oleg256-client sshd[84410]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:07 oleg256-client systemd[1]: session-341.scope: Succeeded. Oct 10 16:00:07 oleg256-client systemd-logind[1023]: Session 341 logged out. Waiting for processes to exit. Oct 10 16:00:07 oleg256-client systemd-logind[1023]: Removed session 341. Oct 10 16:00:07 oleg256-client kernel: LNetError: 84012:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) route to o2ib through 192.168.202.61@tcp has gone from up to down Oct 10 16:00:07 oleg256-client kernel: LNetError: 84012:0:(lib-lnet.h:1315:lnet_set_route_aliveness()) Skipped 3 previous similar messages Oct 10 16:00:08 oleg256-client sshd[84563]: Accepted publickey for root from 192.168.202.56 port 58022 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:08 oleg256-client systemd[1]: Started Session 342 of user root. Oct 10 16:00:08 oleg256-client systemd-logind[1023]: New session 342 of user root. Oct 10 16:00:08 oleg256-client sshd[84563]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:08 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 256: Router should not drop messages that are past the deadline ========================================================== 16:00:07 (1760126407) Oct 10 16:00:08 oleg256-client sshd[84576]: Received disconnect from 192.168.202.56 port 58022:11: disconnected by user Oct 10 16:00:08 oleg256-client sshd[84576]: Disconnected from user root 192.168.202.56 port 58022 Oct 10 16:00:08 oleg256-client sshd[84563]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:08 oleg256-client systemd[1]: session-342.scope: Succeeded. Oct 10 16:00:08 oleg256-client systemd-logind[1023]: Session 342 logged out. Waiting for processes to exit. Oct 10 16:00:08 oleg256-client systemd-logind[1023]: Removed session 342. Oct 10 16:00:09 oleg256-client sshd[84748]: Accepted publickey for root from 192.168.202.56 port 58032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:09 oleg256-client systemd[1]: Started Session 343 of user root. Oct 10 16:00:09 oleg256-client systemd-logind[1023]: New session 343 of user root. Oct 10 16:00:09 oleg256-client sshd[84748]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:09 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_256 Need at least 2 remote nodes found oleg256-server Oct 10 16:00:09 oleg256-client sshd[84761]: Received disconnect from 192.168.202.56 port 58032:11: disconnected by user Oct 10 16:00:09 oleg256-client sshd[84761]: Disconnected from user root 192.168.202.56 port 58032 Oct 10 16:00:09 oleg256-client sshd[84748]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:09 oleg256-client systemd[1]: session-343.scope: Succeeded. Oct 10 16:00:09 oleg256-client systemd-logind[1023]: Session 343 logged out. Waiting for processes to exit. Oct 10 16:00:09 oleg256-client systemd-logind[1023]: Removed session 343. Oct 10 16:00:10 oleg256-client sshd[84901]: Accepted publickey for root from 192.168.202.56 port 58038 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:10 oleg256-client systemd-logind[1023]: New session 344 of user root. Oct 10 16:00:10 oleg256-client systemd[1]: Started Session 344 of user root. Oct 10 16:00:10 oleg256-client sshd[84901]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:10 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 257: Test graceful router shutdown/startup ========================================================== 16:00:09 (1760126409) Oct 10 16:00:10 oleg256-client sshd[84914]: Received disconnect from 192.168.202.56 port 58038:11: disconnected by user Oct 10 16:00:10 oleg256-client sshd[84914]: Disconnected from user root 192.168.202.56 port 58038 Oct 10 16:00:10 oleg256-client sshd[84901]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:11 oleg256-client systemd[1]: session-344.scope: Succeeded. Oct 10 16:00:11 oleg256-client systemd-logind[1023]: Session 344 logged out. Waiting for processes to exit. Oct 10 16:00:11 oleg256-client systemd-logind[1023]: Removed session 344. Oct 10 16:00:11 oleg256-client sshd[85086]: Accepted publickey for root from 192.168.202.56 port 58050 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:11 oleg256-client systemd-logind[1023]: New session 345 of user root. Oct 10 16:00:11 oleg256-client systemd[1]: Started Session 345 of user root. Oct 10 16:00:11 oleg256-client sshd[85086]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:12 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_257 Need at least 3 remote nodes found oleg256-server Oct 10 16:00:12 oleg256-client sshd[85099]: Received disconnect from 192.168.202.56 port 58050:11: disconnected by user Oct 10 16:00:12 oleg256-client sshd[85099]: Disconnected from user root 192.168.202.56 port 58050 Oct 10 16:00:12 oleg256-client sshd[85086]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:12 oleg256-client systemd[1]: session-345.scope: Succeeded. Oct 10 16:00:12 oleg256-client systemd-logind[1023]: Session 345 logged out. Waiting for processes to exit. Oct 10 16:00:12 oleg256-client systemd-logind[1023]: Removed session 345. Oct 10 16:00:13 oleg256-client sshd[85238]: Accepted publickey for root from 192.168.202.56 port 58066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:00:13 oleg256-client systemd-logind[1023]: New session 346 of user root. Oct 10 16:00:13 oleg256-client systemd[1]: Started Session 346 of user root. Oct 10 16:00:13 oleg256-client sshd[85238]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:00:13 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 260: test that linux sysctl parameter are set correctly ========================================================== 16:00:12 (1760126412) Oct 10 16:00:13 oleg256-client sshd[85251]: Received disconnect from 192.168.202.56 port 58066:11: disconnected by user Oct 10 16:00:13 oleg256-client sshd[85251]: Disconnected from user root 192.168.202.56 port 58066 Oct 10 16:00:13 oleg256-client sshd[85238]: pam_unix(sshd:session): session closed for user root Oct 10 16:00:13 oleg256-client systemd[1]: session-346.scope: Succeeded. Oct 10 16:00:13 oleg256-client systemd-logind[1023]: Session 346 logged out. Waiting for processes to exit. Oct 10 16:00:13 oleg256-client systemd-logind[1023]: Removed session 346. Oct 10 16:00:14 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:00:14 oleg256-client systemd-udevd[85316]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:00:14 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:00:15 oleg256-client kernel: Lustre: Lustre: Build Version: 2.16.58_106_g01a4b29 Oct 10 16:00:17 oleg256-client kernel: Key type lgssc registered Oct 10 16:00:19 oleg256-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ Oct 10 16:00:45 oleg256-client kernel: Key type lgssc unregistered Oct 10 16:00:45 oleg256-client kernel: LNet: 86427:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:00:45 oleg256-client kernel: LNetError: 86427:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:00:46 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:00:47 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:00:47 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:00:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:00:48 oleg256-client systemd-udevd[86497]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:00:48 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:00:58 oleg256-client systemd[1]: usr-sbin-mount.lustre.mount: Succeeded. Oct 10 16:00:59 oleg256-client sshd[86713]: Accepted publickey for root from 192.168.202.56 port 34130 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:00 oleg256-client systemd-logind[1023]: New session 347 of user root. Oct 10 16:01:00 oleg256-client systemd[1]: Started Session 347 of user root. Oct 10 16:01:00 oleg256-client sshd[86713]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:00 oleg256-client sshd[86726]: Received disconnect from 192.168.202.56 port 34130:11: disconnected by user Oct 10 16:01:00 oleg256-client sshd[86726]: Disconnected from user root 192.168.202.56 port 34130 Oct 10 16:01:00 oleg256-client sshd[86713]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:00 oleg256-client systemd[1]: session-347.scope: Succeeded. Oct 10 16:01:00 oleg256-client systemd-logind[1023]: Session 347 logged out. Waiting for processes to exit. Oct 10 16:01:00 oleg256-client systemd-logind[1023]: Removed session 347. Oct 10 16:01:01 oleg256-client sshd[86850]: Accepted publickey for root from 192.168.202.56 port 34142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:02 oleg256-client CROND[86862]: (root) CMD (run-parts /etc/cron.hourly) Oct 10 16:01:02 oleg256-client run-parts[86862]: (/etc/cron.hourly) starting 0anacron Oct 10 16:01:02 oleg256-client systemd-logind[1023]: New session 348 of user root. Oct 10 16:01:02 oleg256-client systemd[1]: Started Session 348 of user root. Oct 10 16:01:02 oleg256-client sshd[86850]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:02 oleg256-client anacron[86876]: Anacron started on 2025-10-10 Oct 10 16:01:02 oleg256-client anacron[86876]: Will run job `cron.daily' in 44 min. Oct 10 16:01:02 oleg256-client anacron[86876]: Will run job `cron.weekly' in 64 min. Oct 10 16:01:02 oleg256-client anacron[86876]: Will run job `cron.monthly' in 84 min. Oct 10 16:01:02 oleg256-client anacron[86876]: Jobs will be executed sequentially Oct 10 16:01:02 oleg256-client run-parts[86862]: (/etc/cron.hourly) finished 0anacron Oct 10 16:01:02 oleg256-client sshd[86873]: Received disconnect from 192.168.202.56 port 34142:11: disconnected by user Oct 10 16:01:02 oleg256-client sshd[86873]: Disconnected from user root 192.168.202.56 port 34142 Oct 10 16:01:02 oleg256-client sshd[86850]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:02 oleg256-client systemd-logind[1023]: Session 348 logged out. Waiting for processes to exit. Oct 10 16:01:02 oleg256-client systemd[1]: session-348.scope: Succeeded. Oct 10 16:01:02 oleg256-client systemd-logind[1023]: Removed session 348. Oct 10 16:01:04 oleg256-client sshd[87007]: Accepted publickey for root from 192.168.202.56 port 51366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:04 oleg256-client systemd[1]: Started Session 349 of user root. Oct 10 16:01:04 oleg256-client systemd-logind[1023]: New session 349 of user root. Oct 10 16:01:04 oleg256-client sshd[87007]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:04 oleg256-client sshd[87020]: Received disconnect from 192.168.202.56 port 51366:11: disconnected by user Oct 10 16:01:04 oleg256-client sshd[87020]: Disconnected from user root 192.168.202.56 port 51366 Oct 10 16:01:04 oleg256-client sshd[87007]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:05 oleg256-client systemd[1]: session-349.scope: Succeeded. Oct 10 16:01:05 oleg256-client systemd-logind[1023]: Session 349 logged out. Waiting for processes to exit. Oct 10 16:01:05 oleg256-client systemd-logind[1023]: Removed session 349. Oct 10 16:01:05 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:01:05 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:01:06 oleg256-client sshd[87170]: Accepted publickey for root from 192.168.202.56 port 51376 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:06 oleg256-client systemd-logind[1023]: New session 350 of user root. Oct 10 16:01:06 oleg256-client sshd[87170]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:06 oleg256-client systemd[1]: Started Session 350 of user root. Oct 10 16:01:07 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 265: Import of invalid CPT should fail ========================================================== 16:01:05 (1760126465) Oct 10 16:01:07 oleg256-client sshd[87183]: Received disconnect from 192.168.202.56 port 51376:11: disconnected by user Oct 10 16:01:07 oleg256-client sshd[87183]: Disconnected from user root 192.168.202.56 port 51376 Oct 10 16:01:07 oleg256-client sshd[87170]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:07 oleg256-client systemd-logind[1023]: Session 350 logged out. Waiting for processes to exit. Oct 10 16:01:07 oleg256-client systemd[1]: session-350.scope: Succeeded. Oct 10 16:01:07 oleg256-client systemd-logind[1023]: Removed session 350. Oct 10 16:01:07 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 16:01:07 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:01:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:01:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-265.yaml Oct 10 16:01:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-265.yaml Oct 10 16:01:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-265.yaml Oct 10 16:01:08 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-265.yaml Oct 10 16:01:09 oleg256-client sshd[87357]: Accepted publickey for root from 192.168.202.56 port 51388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:09 oleg256-client systemd[1]: Started Session 351 of user root. Oct 10 16:01:09 oleg256-client systemd-logind[1023]: New session 351 of user root. Oct 10 16:01:09 oleg256-client sshd[87357]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:10 oleg256-client sshd[87370]: Received disconnect from 192.168.202.56 port 51388:11: disconnected by user Oct 10 16:01:10 oleg256-client sshd[87370]: Disconnected from user root 192.168.202.56 port 51388 Oct 10 16:01:10 oleg256-client sshd[87357]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:10 oleg256-client systemd[1]: session-351.scope: Succeeded. Oct 10 16:01:10 oleg256-client systemd-logind[1023]: Session 351 logged out. Waiting for processes to exit. Oct 10 16:01:10 oleg256-client systemd-logind[1023]: Removed session 351. Oct 10 16:01:11 oleg256-client sshd[87494]: Accepted publickey for root from 192.168.202.56 port 51398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:11 oleg256-client systemd[1]: Started Session 352 of user root. Oct 10 16:01:11 oleg256-client systemd-logind[1023]: New session 352 of user root. Oct 10 16:01:11 oleg256-client sshd[87494]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:11 oleg256-client sshd[87507]: Received disconnect from 192.168.202.56 port 51398:11: disconnected by user Oct 10 16:01:11 oleg256-client sshd[87507]: Disconnected from user root 192.168.202.56 port 51398 Oct 10 16:01:11 oleg256-client sshd[87494]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:11 oleg256-client systemd[1]: session-352.scope: Succeeded. Oct 10 16:01:11 oleg256-client systemd-logind[1023]: Session 352 logged out. Waiting for processes to exit. Oct 10 16:01:11 oleg256-client systemd-logind[1023]: Removed session 352. Oct 10 16:01:13 oleg256-client sshd[87639]: Accepted publickey for root from 192.168.202.56 port 51406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:13 oleg256-client systemd-logind[1023]: New session 353 of user root. Oct 10 16:01:13 oleg256-client systemd[1]: Started Session 353 of user root. Oct 10 16:01:13 oleg256-client sshd[87639]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:13 oleg256-client sshd[87652]: Received disconnect from 192.168.202.56 port 51406:11: disconnected by user Oct 10 16:01:13 oleg256-client sshd[87652]: Disconnected from user root 192.168.202.56 port 51406 Oct 10 16:01:13 oleg256-client sshd[87639]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:13 oleg256-client systemd[1]: session-353.scope: Succeeded. Oct 10 16:01:13 oleg256-client systemd-logind[1023]: Session 353 logged out. Waiting for processes to exit. Oct 10 16:01:13 oleg256-client systemd-logind[1023]: Removed session 353. Oct 10 16:01:14 oleg256-client sshd[87792]: Accepted publickey for root from 192.168.202.56 port 46210 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:14 oleg256-client systemd-logind[1023]: New session 354 of user root. Oct 10 16:01:14 oleg256-client systemd[1]: Started Session 354 of user root. Oct 10 16:01:14 oleg256-client sshd[87792]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:15 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 266: Validate CPT parsing in network sequence ========================================================== 16:01:13 (1760126473) Oct 10 16:01:15 oleg256-client sshd[87805]: Received disconnect from 192.168.202.56 port 46210:11: disconnected by user Oct 10 16:01:15 oleg256-client sshd[87805]: Disconnected from user root 192.168.202.56 port 46210 Oct 10 16:01:15 oleg256-client sshd[87792]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:01:15 oleg256-client kernel: LNet: 87841:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:01:15 oleg256-client systemd[1]: session-354.scope: Succeeded. Oct 10 16:01:15 oleg256-client systemd-logind[1023]: Session 354 logged out. Waiting for processes to exit. Oct 10 16:01:15 oleg256-client systemd-logind[1023]: Removed session 354. Oct 10 16:01:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:01:15 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:01:15 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:01:15 oleg256-client root[87876]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:01:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:01:16 oleg256-client kernel: LNet: 87984:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:01:16 oleg256-client kernel: LNetError: 87984:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:01:16 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:01:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:01:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-266.yaml Oct 10 16:01:16 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:01:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:01:16 oleg256-client kernel: LNetError: 88012:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:01:16 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:01:16 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:01:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import /tmp/sanity-lnet-266.yaml Oct 10 16:01:17 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:01:18 oleg256-client sshd[88117]: Accepted publickey for root from 192.168.202.56 port 46222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:18 oleg256-client systemd-logind[1023]: New session 355 of user root. Oct 10 16:01:18 oleg256-client systemd[1]: Started Session 355 of user root. Oct 10 16:01:18 oleg256-client sshd[88117]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:18 oleg256-client sshd[88130]: Received disconnect from 192.168.202.56 port 46222:11: disconnected by user Oct 10 16:01:18 oleg256-client sshd[88130]: Disconnected from user root 192.168.202.56 port 46222 Oct 10 16:01:18 oleg256-client sshd[88117]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:18 oleg256-client systemd-logind[1023]: Session 355 logged out. Waiting for processes to exit. Oct 10 16:01:18 oleg256-client systemd[1]: session-355.scope: Succeeded. Oct 10 16:01:18 oleg256-client systemd-logind[1023]: Removed session 355. Oct 10 16:01:19 oleg256-client sshd[88254]: Accepted publickey for root from 192.168.202.56 port 46230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:19 oleg256-client systemd[1]: Started Session 356 of user root. Oct 10 16:01:19 oleg256-client systemd-logind[1023]: New session 356 of user root. Oct 10 16:01:19 oleg256-client sshd[88254]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:19 oleg256-client sshd[88268]: Received disconnect from 192.168.202.56 port 46230:11: disconnected by user Oct 10 16:01:19 oleg256-client sshd[88268]: Disconnected from user root 192.168.202.56 port 46230 Oct 10 16:01:19 oleg256-client sshd[88254]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:19 oleg256-client systemd-logind[1023]: Session 356 logged out. Waiting for processes to exit. Oct 10 16:01:19 oleg256-client systemd[1]: session-356.scope: Succeeded. Oct 10 16:01:19 oleg256-client systemd-logind[1023]: Removed session 356. Oct 10 16:01:20 oleg256-client sshd[88399]: Accepted publickey for root from 192.168.202.56 port 46238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:20 oleg256-client systemd-logind[1023]: New session 357 of user root. Oct 10 16:01:20 oleg256-client systemd[1]: Started Session 357 of user root. Oct 10 16:01:20 oleg256-client sshd[88399]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:20 oleg256-client sshd[88412]: Received disconnect from 192.168.202.56 port 46238:11: disconnected by user Oct 10 16:01:20 oleg256-client sshd[88412]: Disconnected from user root 192.168.202.56 port 46238 Oct 10 16:01:20 oleg256-client sshd[88399]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:20 oleg256-client systemd[1]: session-357.scope: Succeeded. Oct 10 16:01:20 oleg256-client systemd-logind[1023]: Session 357 logged out. Waiting for processes to exit. Oct 10 16:01:20 oleg256-client systemd-logind[1023]: Removed session 357. Oct 10 16:01:22 oleg256-client sshd[88552]: Accepted publickey for root from 192.168.202.56 port 46242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:22 oleg256-client systemd-logind[1023]: New session 358 of user root. Oct 10 16:01:22 oleg256-client systemd[1]: Started Session 358 of user root. Oct 10 16:01:22 oleg256-client sshd[88552]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:22 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 270: Test NID metadata =============== 16:01:21 (1760126481) Oct 10 16:01:22 oleg256-client sshd[88565]: Received disconnect from 192.168.202.56 port 46242:11: disconnected by user Oct 10 16:01:22 oleg256-client sshd[88565]: Disconnected from user root 192.168.202.56 port 46242 Oct 10 16:01:22 oleg256-client sshd[88552]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:22 oleg256-client kernel: LNet: 88597:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:01:22 oleg256-client kernel: LNet: 88597:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Skipped 1 previous similar message Oct 10 16:01:22 oleg256-client kernel: LNetError: 88597:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:01:22 oleg256-client systemd[1]: session-358.scope: Succeeded. Oct 10 16:01:22 oleg256-client systemd-logind[1023]: Session 358 logged out. Waiting for processes to exit. Oct 10 16:01:22 oleg256-client systemd-logind[1023]: Removed session 358. Oct 10 16:01:22 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:01:23 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:01:23 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:01:23 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:01:23 oleg256-client systemd-udevd[88678]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:01:23 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:01:26 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:01:26 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:01:27 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:01:27 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:01:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:01:28 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:01:28 oleg256-client kernel: LNet: *** cfs_fail_loc=e003, val=100*** Oct 10 16:01:28 oleg256-client root[88891]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:01:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 16:01:28 oleg256-client kernel: LNet: *** cfs_fail_loc=e003, val=100*** Oct 10 16:01:28 oleg256-client kernel: LNet: Skipped 2 previous similar messages Oct 10 16:01:28 oleg256-client kernel: Ping reply received with mapping: Oct 10 16:01:28 oleg256-client kernel: found metadata reply NI[192.168.202.56@tcp] Oct 10 16:01:28 oleg256-client kernel: 38 ca a8 c0 00 00 02 00 5a 5a 5a 5a 5a 5a 5a 5a Oct 10 16:01:28 oleg256-client kernel: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a Oct 10 16:01:28 oleg256-client kernel: 5a 5a 5a 5a 5a 5a 5a 5a Oct 10 16:01:28 oleg256-client kernel: LNet: 88991:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:01:28 oleg256-client kernel: LNetError: 88991:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:01:28 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:01:29 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:01:29 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:01:29 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:01:29 oleg256-client systemd-udevd[89077]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:01:29 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:01:33 oleg256-client sshd[89284]: Accepted publickey for root from 192.168.202.56 port 51066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:33 oleg256-client systemd-logind[1023]: New session 359 of user root. Oct 10 16:01:33 oleg256-client systemd[1]: Started Session 359 of user root. Oct 10 16:01:33 oleg256-client sshd[89284]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:33 oleg256-client sshd[89298]: Received disconnect from 192.168.202.56 port 51066:11: disconnected by user Oct 10 16:01:33 oleg256-client sshd[89298]: Disconnected from user root 192.168.202.56 port 51066 Oct 10 16:01:33 oleg256-client sshd[89284]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:33 oleg256-client systemd[1]: session-359.scope: Succeeded. Oct 10 16:01:33 oleg256-client systemd-logind[1023]: Session 359 logged out. Waiting for processes to exit. Oct 10 16:01:33 oleg256-client systemd-logind[1023]: Removed session 359. Oct 10 16:01:34 oleg256-client sshd[89422]: Accepted publickey for root from 192.168.202.56 port 51070 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:34 oleg256-client systemd[1]: Started Session 360 of user root. Oct 10 16:01:34 oleg256-client systemd-logind[1023]: New session 360 of user root. Oct 10 16:01:34 oleg256-client sshd[89422]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:34 oleg256-client sshd[89435]: Received disconnect from 192.168.202.56 port 51070:11: disconnected by user Oct 10 16:01:34 oleg256-client sshd[89435]: Disconnected from user root 192.168.202.56 port 51070 Oct 10 16:01:34 oleg256-client sshd[89422]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:34 oleg256-client systemd[1]: session-360.scope: Succeeded. Oct 10 16:01:34 oleg256-client systemd-logind[1023]: Session 360 logged out. Waiting for processes to exit. Oct 10 16:01:34 oleg256-client systemd-logind[1023]: Removed session 360. Oct 10 16:01:35 oleg256-client sshd[89566]: Accepted publickey for root from 192.168.202.56 port 51072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:35 oleg256-client systemd-logind[1023]: New session 361 of user root. Oct 10 16:01:35 oleg256-client systemd[1]: Started Session 361 of user root. Oct 10 16:01:35 oleg256-client sshd[89566]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:35 oleg256-client sshd[89579]: Received disconnect from 192.168.202.56 port 51072:11: disconnected by user Oct 10 16:01:35 oleg256-client sshd[89579]: Disconnected from user root 192.168.202.56 port 51072 Oct 10 16:01:35 oleg256-client sshd[89566]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:36 oleg256-client systemd-logind[1023]: Session 361 logged out. Waiting for processes to exit. Oct 10 16:01:36 oleg256-client systemd[1]: session-361.scope: Succeeded. Oct 10 16:01:36 oleg256-client systemd-logind[1023]: Removed session 361. Oct 10 16:01:36 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:01:36 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:01:37 oleg256-client sshd[89728]: Accepted publickey for root from 192.168.202.56 port 51078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:37 oleg256-client systemd-logind[1023]: New session 362 of user root. Oct 10 16:01:37 oleg256-client systemd[1]: Started Session 362 of user root. Oct 10 16:01:37 oleg256-client sshd[89728]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:37 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 280: Don't panic when request_module fails ========================================================== 16:01:36 (1760126496) Oct 10 16:01:37 oleg256-client sshd[89741]: Received disconnect from 192.168.202.56 port 51078:11: disconnected by user Oct 10 16:01:37 oleg256-client sshd[89741]: Disconnected from user root 192.168.202.56 port 51078 Oct 10 16:01:37 oleg256-client sshd[89728]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:37 oleg256-client systemd[1]: session-362.scope: Succeeded. Oct 10 16:01:37 oleg256-client systemd-logind[1023]: Session 362 logged out. Waiting for processes to exit. Oct 10 16:01:37 oleg256-client systemd-logind[1023]: Removed session 362. Oct 10 16:01:37 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:01:37 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:01:37 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:01:37 oleg256-client systemd-udevd[89837]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:01:38 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:01:40 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:01:40 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:01:41 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:01:41 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:01:42 oleg256-client kernel: LNetError: 90025:0:(api-ni.c:2710:lnet_load_lnd()) Can't load LND tcp, module ksocklnd, rc=256 Oct 10 16:01:42 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:01:42 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:01:43 oleg256-client sshd[90153]: Accepted publickey for root from 192.168.202.56 port 51092 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:43 oleg256-client systemd-logind[1023]: New session 363 of user root. Oct 10 16:01:43 oleg256-client systemd[1]: Started Session 363 of user root. Oct 10 16:01:43 oleg256-client sshd[90153]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:43 oleg256-client sshd[90166]: Received disconnect from 192.168.202.56 port 51092:11: disconnected by user Oct 10 16:01:43 oleg256-client sshd[90166]: Disconnected from user root 192.168.202.56 port 51092 Oct 10 16:01:43 oleg256-client sshd[90153]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:43 oleg256-client systemd[1]: session-363.scope: Succeeded. Oct 10 16:01:43 oleg256-client systemd-logind[1023]: Session 363 logged out. Waiting for processes to exit. Oct 10 16:01:43 oleg256-client systemd-logind[1023]: Removed session 363. Oct 10 16:01:44 oleg256-client sshd[90290]: Accepted publickey for root from 192.168.202.56 port 47408 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:44 oleg256-client systemd-logind[1023]: New session 364 of user root. Oct 10 16:01:44 oleg256-client systemd[1]: Started Session 364 of user root. Oct 10 16:01:44 oleg256-client sshd[90290]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:44 oleg256-client sshd[90303]: Received disconnect from 192.168.202.56 port 47408:11: disconnected by user Oct 10 16:01:44 oleg256-client sshd[90303]: Disconnected from user root 192.168.202.56 port 47408 Oct 10 16:01:44 oleg256-client sshd[90290]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:44 oleg256-client systemd[1]: session-364.scope: Succeeded. Oct 10 16:01:44 oleg256-client systemd-logind[1023]: Session 364 logged out. Waiting for processes to exit. Oct 10 16:01:44 oleg256-client systemd-logind[1023]: Removed session 364. Oct 10 16:01:45 oleg256-client sshd[90434]: Accepted publickey for root from 192.168.202.56 port 47414 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:45 oleg256-client systemd-logind[1023]: New session 365 of user root. Oct 10 16:01:45 oleg256-client systemd[1]: Started Session 365 of user root. Oct 10 16:01:45 oleg256-client sshd[90434]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:45 oleg256-client sshd[90447]: Received disconnect from 192.168.202.56 port 47414:11: disconnected by user Oct 10 16:01:45 oleg256-client sshd[90447]: Disconnected from user root 192.168.202.56 port 47414 Oct 10 16:01:45 oleg256-client sshd[90434]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:46 oleg256-client systemd-logind[1023]: Session 365 logged out. Waiting for processes to exit. Oct 10 16:01:46 oleg256-client systemd[1]: session-365.scope: Succeeded. Oct 10 16:01:46 oleg256-client systemd-logind[1023]: Removed session 365. Oct 10 16:01:46 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:01:46 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:01:46 oleg256-client sshd[90597]: Accepted publickey for root from 192.168.202.56 port 47422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:46 oleg256-client systemd[1]: Started Session 366 of user root. Oct 10 16:01:46 oleg256-client systemd-logind[1023]: New session 366 of user root. Oct 10 16:01:46 oleg256-client sshd[90597]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:47 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 290: Check that lnet acceptor is using explicit address binding ========================================================== 16:01:46 (1760126506) Oct 10 16:01:47 oleg256-client sshd[90610]: Received disconnect from 192.168.202.56 port 47422:11: disconnected by user Oct 10 16:01:47 oleg256-client sshd[90610]: Disconnected from user root 192.168.202.56 port 47422 Oct 10 16:01:47 oleg256-client sshd[90597]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:47 oleg256-client systemd[1]: session-366.scope: Succeeded. Oct 10 16:01:47 oleg256-client systemd-logind[1023]: Session 366 logged out. Waiting for processes to exit. Oct 10 16:01:47 oleg256-client systemd-logind[1023]: Removed session 366. Oct 10 16:01:47 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:01:47 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:01:47 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:01:47 oleg256-client systemd-udevd[90710]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:01:47 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:01:51 oleg256-client NetworkManager[1026]: [1760126511.1915] device (test1pg): carrier: link connected Oct 10 16:01:51 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 16:01:51 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 16:01:51 oleg256-client NetworkManager[1026]: [1760126511.2140] device (test1pl): carrier: link connected Oct 10 16:01:53 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:01:53 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:01:53 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:01:53 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:01:54 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:01:54 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 16:01:54 oleg256-client root[90950]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 16:01:55 oleg256-client root[91093]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 16:01:55 oleg256-client root[91094]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 16:01:55 oleg256-client root[91095]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 16:01:56 oleg256-client root[91210]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 16:01:56 oleg256-client root[91211]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 16:01:56 oleg256-client root[91212]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 16:01:58 oleg256-client sshd[91308]: Accepted publickey for root from 192.168.202.56 port 38206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:58 oleg256-client systemd[1]: Started Session 367 of user root. Oct 10 16:01:58 oleg256-client systemd-logind[1023]: New session 367 of user root. Oct 10 16:01:58 oleg256-client sshd[91308]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:58 oleg256-client sshd[91321]: Received disconnect from 192.168.202.56 port 38206:11: disconnected by user Oct 10 16:01:58 oleg256-client sshd[91321]: Disconnected from user root 192.168.202.56 port 38206 Oct 10 16:01:58 oleg256-client sshd[91308]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:58 oleg256-client systemd-logind[1023]: Session 367 logged out. Waiting for processes to exit. Oct 10 16:01:58 oleg256-client systemd[1]: session-367.scope: Succeeded. Oct 10 16:01:58 oleg256-client systemd-logind[1023]: Removed session 367. Oct 10 16:01:59 oleg256-client sshd[91445]: Accepted publickey for root from 192.168.202.56 port 38208 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:01:59 oleg256-client systemd-logind[1023]: New session 368 of user root. Oct 10 16:01:59 oleg256-client systemd[1]: Started Session 368 of user root. Oct 10 16:01:59 oleg256-client sshd[91445]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:01:59 oleg256-client sshd[91458]: Received disconnect from 192.168.202.56 port 38208:11: disconnected by user Oct 10 16:01:59 oleg256-client sshd[91458]: Disconnected from user root 192.168.202.56 port 38208 Oct 10 16:01:59 oleg256-client sshd[91445]: pam_unix(sshd:session): session closed for user root Oct 10 16:01:59 oleg256-client systemd[1]: session-368.scope: Succeeded. Oct 10 16:01:59 oleg256-client systemd-logind[1023]: Session 368 logged out. Waiting for processes to exit. Oct 10 16:01:59 oleg256-client systemd-logind[1023]: Removed session 368. Oct 10 16:02:00 oleg256-client sshd[91590]: Accepted publickey for root from 192.168.202.56 port 38218 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:00 oleg256-client systemd-logind[1023]: New session 369 of user root. Oct 10 16:02:00 oleg256-client systemd[1]: Started Session 369 of user root. Oct 10 16:02:00 oleg256-client sshd[91590]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:00 oleg256-client sshd[91603]: Received disconnect from 192.168.202.56 port 38218:11: disconnected by user Oct 10 16:02:00 oleg256-client sshd[91603]: Disconnected from user root 192.168.202.56 port 38218 Oct 10 16:02:00 oleg256-client sshd[91590]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:00 oleg256-client systemd[1]: session-369.scope: Succeeded. Oct 10 16:02:00 oleg256-client systemd-logind[1023]: Session 369 logged out. Waiting for processes to exit. Oct 10 16:02:00 oleg256-client systemd-logind[1023]: Removed session 369. Oct 10 16:02:02 oleg256-client sshd[91743]: Accepted publickey for root from 192.168.202.56 port 38220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:02 oleg256-client systemd-logind[1023]: New session 370 of user root. Oct 10 16:02:02 oleg256-client systemd[1]: Started Session 370 of user root. Oct 10 16:02:02 oleg256-client sshd[91743]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:02 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 291: load lnet using custom accept port for bulk tcp connections ========================================================== 16:02:01 (1760126521) Oct 10 16:02:02 oleg256-client sshd[91756]: Received disconnect from 192.168.202.56 port 38220:11: disconnected by user Oct 10 16:02:02 oleg256-client sshd[91756]: Disconnected from user root 192.168.202.56 port 38220 Oct 10 16:02:02 oleg256-client sshd[91743]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:02:02 oleg256-client kernel: LNet: 91791:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:02:02 oleg256-client kernel: LNetError: 91791:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface test1pg not found Oct 10 16:02:02 oleg256-client systemd-logind[1023]: Session 370 logged out. Waiting for processes to exit. Oct 10 16:02:02 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 16:02:02 oleg256-client systemd[1]: session-370.scope: Succeeded. Oct 10 16:02:02 oleg256-client systemd-logind[1023]: Removed session 370. Oct 10 16:02:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:02:03 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:02:03 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:02:03 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:02:03 oleg256-client systemd-udevd[91910]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:02:03 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:02:06 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:02:06 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:02:06 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:02:06 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:02:07 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:02:07 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 16:02:07 oleg256-client kernel: LNet: 92094:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:02:07 oleg256-client kernel: LNetError: 92094:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:02:08 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:02:09 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:02:09 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:02:09 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:02:09 oleg256-client systemd-udevd[92173]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:02:09 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:02:13 oleg256-client sshd[92381]: Accepted publickey for root from 192.168.202.56 port 48666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:13 oleg256-client systemd[1]: Started Session 371 of user root. Oct 10 16:02:13 oleg256-client systemd-logind[1023]: New session 371 of user root. Oct 10 16:02:13 oleg256-client sshd[92381]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:14 oleg256-client sshd[92394]: Received disconnect from 192.168.202.56 port 48666:11: disconnected by user Oct 10 16:02:14 oleg256-client sshd[92394]: Disconnected from user root 192.168.202.56 port 48666 Oct 10 16:02:14 oleg256-client sshd[92381]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:14 oleg256-client systemd[1]: session-371.scope: Succeeded. Oct 10 16:02:14 oleg256-client systemd-logind[1023]: Session 371 logged out. Waiting for processes to exit. Oct 10 16:02:14 oleg256-client systemd-logind[1023]: Removed session 371. Oct 10 16:02:14 oleg256-client sshd[92519]: Accepted publickey for root from 192.168.202.56 port 48678 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:15 oleg256-client systemd-logind[1023]: New session 372 of user root. Oct 10 16:02:15 oleg256-client systemd[1]: Started Session 372 of user root. Oct 10 16:02:15 oleg256-client sshd[92519]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:15 oleg256-client sshd[92532]: Received disconnect from 192.168.202.56 port 48678:11: disconnected by user Oct 10 16:02:15 oleg256-client sshd[92532]: Disconnected from user root 192.168.202.56 port 48678 Oct 10 16:02:15 oleg256-client sshd[92519]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:15 oleg256-client systemd[1]: session-372.scope: Succeeded. Oct 10 16:02:15 oleg256-client systemd-logind[1023]: Session 372 logged out. Waiting for processes to exit. Oct 10 16:02:15 oleg256-client systemd-logind[1023]: Removed session 372. Oct 10 16:02:16 oleg256-client sshd[92663]: Accepted publickey for root from 192.168.202.56 port 48686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:16 oleg256-client systemd[1]: Started Session 373 of user root. Oct 10 16:02:16 oleg256-client systemd-logind[1023]: New session 373 of user root. Oct 10 16:02:16 oleg256-client sshd[92663]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:16 oleg256-client sshd[92676]: Received disconnect from 192.168.202.56 port 48686:11: disconnected by user Oct 10 16:02:16 oleg256-client sshd[92676]: Disconnected from user root 192.168.202.56 port 48686 Oct 10 16:02:16 oleg256-client sshd[92663]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:16 oleg256-client systemd[1]: session-373.scope: Succeeded. Oct 10 16:02:16 oleg256-client systemd-logind[1023]: Session 373 logged out. Waiting for processes to exit. Oct 10 16:02:16 oleg256-client systemd-logind[1023]: Removed session 373. Oct 10 16:02:16 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:02:16 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:02:17 oleg256-client sshd[92825]: Accepted publickey for root from 192.168.202.56 port 48692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:17 oleg256-client systemd[1]: Started Session 374 of user root. Oct 10 16:02:17 oleg256-client systemd-logind[1023]: New session 374 of user root. Oct 10 16:02:17 oleg256-client sshd[92825]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:17 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 300: packaged LNet UAPI headers can be compiled ========================================================== 16:02:16 (1760126536) Oct 10 16:02:17 oleg256-client sshd[92838]: Received disconnect from 192.168.202.56 port 48692:11: disconnected by user Oct 10 16:02:17 oleg256-client sshd[92838]: Disconnected from user root 192.168.202.56 port 48692 Oct 10 16:02:17 oleg256-client sshd[92825]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:17 oleg256-client systemd[1]: session-374.scope: Succeeded. Oct 10 16:02:17 oleg256-client systemd-logind[1023]: Session 374 logged out. Waiting for processes to exit. Oct 10 16:02:17 oleg256-client systemd-logind[1023]: Removed session 374. Oct 10 16:02:18 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:02:18 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:02:18 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:02:18 oleg256-client systemd-udevd[92931]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:02:18 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:02:21 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:02:21 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:02:21 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:02:21 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:02:23 oleg256-client sshd[93186]: Accepted publickey for root from 192.168.202.56 port 57872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:23 oleg256-client systemd-logind[1023]: New session 375 of user root. Oct 10 16:02:23 oleg256-client systemd[1]: Started Session 375 of user root. Oct 10 16:02:23 oleg256-client sshd[93186]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:23 oleg256-client sshd[93199]: Received disconnect from 192.168.202.56 port 57872:11: disconnected by user Oct 10 16:02:23 oleg256-client sshd[93199]: Disconnected from user root 192.168.202.56 port 57872 Oct 10 16:02:23 oleg256-client sshd[93186]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:23 oleg256-client systemd[1]: session-375.scope: Succeeded. Oct 10 16:02:23 oleg256-client systemd-logind[1023]: Session 375 logged out. Waiting for processes to exit. Oct 10 16:02:23 oleg256-client systemd-logind[1023]: Removed session 375. Oct 10 16:02:24 oleg256-client sshd[93323]: Accepted publickey for root from 192.168.202.56 port 57884 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:24 oleg256-client systemd[1]: Started Session 376 of user root. Oct 10 16:02:24 oleg256-client systemd-logind[1023]: New session 376 of user root. Oct 10 16:02:24 oleg256-client sshd[93323]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:24 oleg256-client sshd[93336]: Received disconnect from 192.168.202.56 port 57884:11: disconnected by user Oct 10 16:02:24 oleg256-client sshd[93336]: Disconnected from user root 192.168.202.56 port 57884 Oct 10 16:02:24 oleg256-client sshd[93323]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:24 oleg256-client systemd[1]: session-376.scope: Succeeded. Oct 10 16:02:24 oleg256-client systemd-logind[1023]: Session 376 logged out. Waiting for processes to exit. Oct 10 16:02:24 oleg256-client systemd-logind[1023]: Removed session 376. Oct 10 16:02:25 oleg256-client sshd[93467]: Accepted publickey for root from 192.168.202.56 port 57894 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:25 oleg256-client systemd-logind[1023]: New session 377 of user root. Oct 10 16:02:25 oleg256-client systemd[1]: Started Session 377 of user root. Oct 10 16:02:25 oleg256-client sshd[93467]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:25 oleg256-client sshd[93480]: Received disconnect from 192.168.202.56 port 57894:11: disconnected by user Oct 10 16:02:25 oleg256-client sshd[93480]: Disconnected from user root 192.168.202.56 port 57894 Oct 10 16:02:26 oleg256-client sshd[93467]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:26 oleg256-client systemd[1]: session-377.scope: Succeeded. Oct 10 16:02:26 oleg256-client systemd-logind[1023]: Session 377 logged out. Waiting for processes to exit. Oct 10 16:02:26 oleg256-client systemd-logind[1023]: Removed session 377. Oct 10 16:02:27 oleg256-client sshd[93620]: Accepted publickey for root from 192.168.202.56 port 57904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:27 oleg256-client systemd-logind[1023]: New session 378 of user root. Oct 10 16:02:27 oleg256-client systemd[1]: Started Session 378 of user root. Oct 10 16:02:27 oleg256-client sshd[93620]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:27 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 16:02:27 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 301: Check for dynamic adds of same/wrong interface (memory leak) ========================================================== 16:02:26 (1760126546) Oct 10 16:02:27 oleg256-client sshd[93634]: Received disconnect from 192.168.202.56 port 57904:11: disconnected by user Oct 10 16:02:27 oleg256-client sshd[93634]: Disconnected from user root 192.168.202.56 port 57904 Oct 10 16:02:27 oleg256-client sshd[93620]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:02:27 oleg256-client systemd[1]: session-378.scope: Succeeded. Oct 10 16:02:27 oleg256-client systemd-logind[1023]: Session 378 logged out. Waiting for processes to exit. Oct 10 16:02:27 oleg256-client systemd-logind[1023]: Removed session 378. Oct 10 16:02:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:02:27 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:02:27 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:02:27 oleg256-client root[93706]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:02:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:02:28 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net del --net tcp --if ens2 Oct 10 16:02:28 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:02:28 oleg256-client kernel: LNet: 93826:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:02:28 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:02:28 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:02:29 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:02:29 oleg256-client systemd-udevd[93880]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:02:29 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:02:33 oleg256-client sshd[94088]: Accepted publickey for root from 192.168.202.56 port 42478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:33 oleg256-client systemd-logind[1023]: New session 379 of user root. Oct 10 16:02:33 oleg256-client systemd[1]: Started Session 379 of user root. Oct 10 16:02:33 oleg256-client sshd[94088]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:34 oleg256-client sshd[94101]: Received disconnect from 192.168.202.56 port 42478:11: disconnected by user Oct 10 16:02:34 oleg256-client sshd[94101]: Disconnected from user root 192.168.202.56 port 42478 Oct 10 16:02:34 oleg256-client sshd[94088]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:34 oleg256-client systemd[1]: session-379.scope: Succeeded. Oct 10 16:02:34 oleg256-client systemd-logind[1023]: Session 379 logged out. Waiting for processes to exit. Oct 10 16:02:34 oleg256-client systemd-logind[1023]: Removed session 379. Oct 10 16:02:34 oleg256-client sshd[94226]: Accepted publickey for root from 192.168.202.56 port 42490 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:34 oleg256-client systemd-logind[1023]: New session 380 of user root. Oct 10 16:02:34 oleg256-client systemd[1]: Started Session 380 of user root. Oct 10 16:02:34 oleg256-client sshd[94226]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:35 oleg256-client sshd[94239]: Received disconnect from 192.168.202.56 port 42490:11: disconnected by user Oct 10 16:02:35 oleg256-client sshd[94239]: Disconnected from user root 192.168.202.56 port 42490 Oct 10 16:02:35 oleg256-client sshd[94226]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:35 oleg256-client systemd[1]: session-380.scope: Succeeded. Oct 10 16:02:35 oleg256-client systemd-logind[1023]: Session 380 logged out. Waiting for processes to exit. Oct 10 16:02:35 oleg256-client systemd-logind[1023]: Removed session 380. Oct 10 16:02:35 oleg256-client sshd[94370]: Accepted publickey for root from 192.168.202.56 port 42502 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:35 oleg256-client systemd-logind[1023]: New session 381 of user root. Oct 10 16:02:35 oleg256-client systemd[1]: Started Session 381 of user root. Oct 10 16:02:35 oleg256-client sshd[94370]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:36 oleg256-client sshd[94383]: Received disconnect from 192.168.202.56 port 42502:11: disconnected by user Oct 10 16:02:36 oleg256-client sshd[94383]: Disconnected from user root 192.168.202.56 port 42502 Oct 10 16:02:36 oleg256-client sshd[94370]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:36 oleg256-client systemd[1]: session-381.scope: Succeeded. Oct 10 16:02:36 oleg256-client systemd-logind[1023]: Session 381 logged out. Waiting for processes to exit. Oct 10 16:02:36 oleg256-client systemd-logind[1023]: Removed session 381. Oct 10 16:02:36 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:02:36 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:02:37 oleg256-client sshd[94532]: Accepted publickey for root from 192.168.202.56 port 42516 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:37 oleg256-client systemd[1]: Started Session 382 of user root. Oct 10 16:02:37 oleg256-client systemd-logind[1023]: New session 382 of user root. Oct 10 16:02:37 oleg256-client sshd[94532]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:37 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 302: Check that peer debug info can be dumped ========================================================== 16:02:36 (1760126556) Oct 10 16:02:37 oleg256-client sshd[94545]: Received disconnect from 192.168.202.56 port 42516:11: disconnected by user Oct 10 16:02:37 oleg256-client sshd[94545]: Disconnected from user root 192.168.202.56 port 42516 Oct 10 16:02:37 oleg256-client sshd[94532]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:37 oleg256-client systemd[1]: session-382.scope: Succeeded. Oct 10 16:02:37 oleg256-client systemd-logind[1023]: Session 382 logged out. Waiting for processes to exit. Oct 10 16:02:37 oleg256-client systemd-logind[1023]: Removed session 382. Oct 10 16:02:38 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 16:02:38 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:02:38 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:02:38 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:02:39 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:02:39 oleg256-client root[94650]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:02:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 16:02:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl debug peer --nid 192.168.202.56@tcp Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 0 [type, closing, crefcnt, srefcnt]: 1, 0, 1, 1 Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 0 rx [scheduled, ready, state]: 0, 0, 1 Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 0 tx [txqcnt, scheduled, last_post, ready, deadline]: 0, 0, 1219, 0, 1269 Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 0 sched [nconns, cpt]: 2, 0 Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 1 [type, closing, crefcnt, srefcnt]: 1, 0, 1, 1 Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 1 rx [scheduled, ready, state]: 0, 0, 1 Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 1 tx [txqcnt, scheduled, last_post, ready, deadline]: 0, 0, 1219, 0, 1269 Oct 10 16:02:39 oleg256-client kernel: LNet: Conn 1 sched [nconns, cpt]: 2, 0 Oct 10 16:02:40 oleg256-client sshd[94830]: Accepted publickey for root from 192.168.202.56 port 42520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:40 oleg256-client systemd[1]: Started Session 383 of user root. Oct 10 16:02:40 oleg256-client systemd-logind[1023]: New session 383 of user root. Oct 10 16:02:40 oleg256-client sshd[94830]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:40 oleg256-client sshd[94843]: Received disconnect from 192.168.202.56 port 42520:11: disconnected by user Oct 10 16:02:40 oleg256-client sshd[94843]: Disconnected from user root 192.168.202.56 port 42520 Oct 10 16:02:40 oleg256-client sshd[94830]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:40 oleg256-client systemd[1]: session-383.scope: Succeeded. Oct 10 16:02:40 oleg256-client systemd-logind[1023]: Session 383 logged out. Waiting for processes to exit. Oct 10 16:02:40 oleg256-client systemd-logind[1023]: Removed session 383. Oct 10 16:02:41 oleg256-client sshd[94968]: Accepted publickey for root from 192.168.202.56 port 42526 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:41 oleg256-client systemd-logind[1023]: New session 384 of user root. Oct 10 16:02:41 oleg256-client systemd[1]: Started Session 384 of user root. Oct 10 16:02:41 oleg256-client sshd[94968]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:41 oleg256-client sshd[94981]: Received disconnect from 192.168.202.56 port 42526:11: disconnected by user Oct 10 16:02:41 oleg256-client sshd[94981]: Disconnected from user root 192.168.202.56 port 42526 Oct 10 16:02:41 oleg256-client sshd[94968]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:42 oleg256-client systemd[1]: session-384.scope: Succeeded. Oct 10 16:02:42 oleg256-client systemd-logind[1023]: Session 384 logged out. Waiting for processes to exit. Oct 10 16:02:42 oleg256-client systemd-logind[1023]: Removed session 384. Oct 10 16:02:42 oleg256-client sshd[95112]: Accepted publickey for root from 192.168.202.56 port 42528 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:42 oleg256-client systemd-logind[1023]: New session 385 of user root. Oct 10 16:02:42 oleg256-client systemd[1]: Started Session 385 of user root. Oct 10 16:02:42 oleg256-client sshd[95112]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:43 oleg256-client sshd[95125]: Received disconnect from 192.168.202.56 port 42528:11: disconnected by user Oct 10 16:02:43 oleg256-client sshd[95125]: Disconnected from user root 192.168.202.56 port 42528 Oct 10 16:02:43 oleg256-client sshd[95112]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:43 oleg256-client systemd[1]: session-385.scope: Succeeded. Oct 10 16:02:43 oleg256-client systemd-logind[1023]: Session 385 logged out. Waiting for processes to exit. Oct 10 16:02:43 oleg256-client systemd-logind[1023]: Removed session 385. Oct 10 16:02:44 oleg256-client sshd[95265]: Accepted publickey for root from 192.168.202.56 port 33984 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:02:44 oleg256-client systemd-logind[1023]: New session 386 of user root. Oct 10 16:02:44 oleg256-client systemd[1]: Started Session 386 of user root. Oct 10 16:02:44 oleg256-client sshd[95265]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:02:44 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 303: Check peer NI health after link down ========================================================== 16:02:43 (1760126563) Oct 10 16:02:44 oleg256-client sshd[95278]: Received disconnect from 192.168.202.56 port 33984:11: disconnected by user Oct 10 16:02:44 oleg256-client sshd[95278]: Disconnected from user root 192.168.202.56 port 33984 Oct 10 16:02:44 oleg256-client sshd[95265]: pam_unix(sshd:session): session closed for user root Oct 10 16:02:44 oleg256-client systemd[1]: session-386.scope: Succeeded. Oct 10 16:02:44 oleg256-client systemd-logind[1023]: Session 386 logged out. Waiting for processes to exit. Oct 10 16:02:44 oleg256-client systemd-logind[1023]: Removed session 386. Oct 10 16:02:44 oleg256-client kernel: LNet: 95359:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:02:44 oleg256-client kernel: LNetError: 95359:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:02:44 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:02:45 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:02:45 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:02:45 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:02:45 oleg256-client systemd-udevd[95435]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:02:45 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:02:49 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:02:49 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:02:49 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:02:49 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:02:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 16:02:50 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:02:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 16:03:01 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:03:01 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 16:03:01 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 16:03:01 oleg256-client root[95791]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:01 oleg256-client root[95802]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:02 oleg256-client NetworkManager[1026]: [1760126582.5000] manager: (test1pg): new Veth device (/org/freedesktop/NetworkManager/Devices/19) Oct 10 16:03:02 oleg256-client systemd-udevd[95898]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 16:03:02 oleg256-client NetworkManager[1026]: [1760126582.5125] manager: (test1pl): new Veth device (/org/freedesktop/NetworkManager/Devices/20) Oct 10 16:03:02 oleg256-client systemd-udevd[95898]: Could not generate persistent MAC address for test1pg: No such file or directory Oct 10 16:03:02 oleg256-client systemd-udevd[95900]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Oct 10 16:03:02 oleg256-client systemd-udevd[95900]: Could not generate persistent MAC address for test1pl: No such file or directory Oct 10 16:03:02 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pl: link is not ready Oct 10 16:03:02 oleg256-client NetworkManager[1026]: [1760126582.6252] device (test1pg): carrier: link connected Oct 10 16:03:02 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 16:03:02 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 16:03:02 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pl: link becomes ready Oct 10 16:03:02 oleg256-client NetworkManager[1026]: [1760126582.6476] device (test1pl): carrier: link connected Oct 10 16:03:04 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp99 --if test1pg Oct 10 16:03:04 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp99 [8/256/0/180] Oct 10 16:03:05 oleg256-client root[95966]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:05 oleg256-client root[95977]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:05 oleg256-client root[95991]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 16:03:05 oleg256-client root[96135]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 16:03:05 oleg256-client root[96136]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 16:03:05 oleg256-client root[96137]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 16:03:06 oleg256-client root[96252]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 16:03:06 oleg256-client root[96253]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 16:03:06 oleg256-client root[96254]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 16:03:08 oleg256-client sshd[96370]: Accepted publickey for root from 192.168.202.56 port 38760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:08 oleg256-client systemd-logind[1023]: New session 387 of user root. Oct 10 16:03:08 oleg256-client systemd[1]: Started Session 387 of user root. Oct 10 16:03:08 oleg256-client sshd[96370]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:08 oleg256-client sshd[96383]: Received disconnect from 192.168.202.56 port 38760:11: disconnected by user Oct 10 16:03:08 oleg256-client sshd[96383]: Disconnected from user root 192.168.202.56 port 38760 Oct 10 16:03:08 oleg256-client sshd[96370]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:08 oleg256-client systemd[1]: session-387.scope: Succeeded. Oct 10 16:03:08 oleg256-client systemd-logind[1023]: Session 387 logged out. Waiting for processes to exit. Oct 10 16:03:08 oleg256-client systemd-logind[1023]: Removed session 387. Oct 10 16:03:09 oleg256-client sshd[96507]: Accepted publickey for root from 192.168.202.56 port 38770 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:09 oleg256-client systemd-logind[1023]: New session 388 of user root. Oct 10 16:03:09 oleg256-client systemd[1]: Started Session 388 of user root. Oct 10 16:03:09 oleg256-client sshd[96507]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:10 oleg256-client sshd[96520]: Received disconnect from 192.168.202.56 port 38770:11: disconnected by user Oct 10 16:03:10 oleg256-client sshd[96520]: Disconnected from user root 192.168.202.56 port 38770 Oct 10 16:03:10 oleg256-client sshd[96507]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:10 oleg256-client systemd[1]: session-388.scope: Succeeded. Oct 10 16:03:10 oleg256-client systemd-logind[1023]: Session 388 logged out. Waiting for processes to exit. Oct 10 16:03:10 oleg256-client systemd-logind[1023]: Removed session 388. Oct 10 16:03:11 oleg256-client sshd[96651]: Accepted publickey for root from 192.168.202.56 port 38784 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:11 oleg256-client systemd-logind[1023]: New session 389 of user root. Oct 10 16:03:11 oleg256-client systemd[1]: Started Session 389 of user root. Oct 10 16:03:11 oleg256-client sshd[96651]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:11 oleg256-client sshd[96664]: Received disconnect from 192.168.202.56 port 38784:11: disconnected by user Oct 10 16:03:11 oleg256-client sshd[96664]: Disconnected from user root 192.168.202.56 port 38784 Oct 10 16:03:11 oleg256-client sshd[96651]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:11 oleg256-client systemd[1]: session-389.scope: Succeeded. Oct 10 16:03:11 oleg256-client systemd-logind[1023]: Session 389 logged out. Waiting for processes to exit. Oct 10 16:03:11 oleg256-client systemd-logind[1023]: Removed session 389. Oct 10 16:03:12 oleg256-client sshd[96804]: Accepted publickey for root from 192.168.202.56 port 38792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:12 oleg256-client systemd-logind[1023]: New session 390 of user root. Oct 10 16:03:12 oleg256-client systemd[1]: Started Session 390 of user root. Oct 10 16:03:12 oleg256-client sshd[96804]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:12 oleg256-client sshd[96817]: Received disconnect from 192.168.202.56 port 38792:11: disconnected by user Oct 10 16:03:12 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 304: Check locked primary peer nid consolidation ========================================================== 16:03:11 (1760126591) Oct 10 16:03:12 oleg256-client sshd[96817]: Disconnected from user root 192.168.202.56 port 38792 Oct 10 16:03:12 oleg256-client sshd[96804]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:12 oleg256-client kernel: LNet: 96852:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:03:12 oleg256-client kernel: LNetError: 96852:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:03:12 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:03:12 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 16:03:13 oleg256-client systemd[1]: session-390.scope: Succeeded. Oct 10 16:03:13 oleg256-client systemd-logind[1023]: Session 390 logged out. Waiting for processes to exit. Oct 10 16:03:13 oleg256-client systemd-logind[1023]: Removed session 390. Oct 10 16:03:13 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp99 Oct 10 16:03:13 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:03:13 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:03:13 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:03:13 oleg256-client systemd-udevd[96931]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:03:13 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:03:17 oleg256-client NetworkManager[1026]: [1760126597.5368] device (test1pg): carrier: link connected Oct 10 16:03:17 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 16:03:17 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 16:03:17 oleg256-client NetworkManager[1026]: [1760126597.5424] device (test1pl): carrier: link connected Oct 10 16:03:19 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:03:19 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:03:20 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:03:20 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:03:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:03:20 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:03:21 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:03:21 oleg256-client root[97179]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:21 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 16:03:21 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 16:03:21 oleg256-client root[97288]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:21 oleg256-client root[97302]: ksocklnd-config: /sbin/ip route flush table test1pg Oct 10 16:03:22 oleg256-client root[97445]: ksocklnd-config: /sbin/ip route add 10.1.2.2/31 dev test1pg proto kernel scope link src 10.1.2.3 table test1pg Oct 10 16:03:22 oleg256-client root[97446]: ksocklnd-config: /sbin/ip rule del from 10.1.2.3 table test1pg Oct 10 16:03:22 oleg256-client root[97447]: ksocklnd-config: /sbin/ip rule add from 10.1.2.3 table test1pg Oct 10 16:03:23 oleg256-client root[97562]: ksocklnd-config: /sbin/ip -6 route add 2001:db8:0:f101::1/64 dev test1pg proto kernel scope link src 2001:db8:0:f101::1 table test1pg Oct 10 16:03:23 oleg256-client root[97563]: ksocklnd-config: /sbin/ip -6 rule del from 2001:db8:0:f101::1 table test1pg Oct 10 16:03:23 oleg256-client root[97564]: ksocklnd-config: /sbin/ip -6 rule add from 2001:db8:0:f101::1 table test1pg Oct 10 16:03:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim_nid 10.1.2.3@tcp --lock_prim Oct 10 16:03:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer show -v 4 --nid 10.1.2.3@tcp Oct 10 16:03:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --nid 10.1.2.3@tcp --state 1048577 Oct 10 16:03:23 oleg256-client kernel: LNetError: 97588:0:(peer.c:2216:lnet_del_peer_ni()) peer 10.1.2.3@tcp created by Lustre. Must preserve primary NID, but will remove other NIDs Oct 10 16:03:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer show -v 4 --nid 10.1.2.3@tcp Oct 10 16:03:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 16:03:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer show -v 4 --nid 10.1.2.3@tcp Oct 10 16:03:24 oleg256-client kernel: LNet: 97608:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:03:24 oleg256-client kernel: LNetError: 97608:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:03:24 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:03:24 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 16:03:24 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:03:24 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:03:25 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:03:25 oleg256-client systemd-udevd[97696]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:03:25 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:03:29 oleg256-client sshd[97902]: Accepted publickey for root from 192.168.202.56 port 43424 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:29 oleg256-client systemd[1]: Started Session 391 of user root. Oct 10 16:03:29 oleg256-client systemd-logind[1023]: New session 391 of user root. Oct 10 16:03:29 oleg256-client sshd[97902]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:30 oleg256-client sshd[97915]: Received disconnect from 192.168.202.56 port 43424:11: disconnected by user Oct 10 16:03:30 oleg256-client sshd[97915]: Disconnected from user root 192.168.202.56 port 43424 Oct 10 16:03:30 oleg256-client sshd[97902]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:30 oleg256-client systemd-logind[1023]: Session 391 logged out. Waiting for processes to exit. Oct 10 16:03:30 oleg256-client systemd[1]: session-391.scope: Succeeded. Oct 10 16:03:30 oleg256-client systemd-logind[1023]: Removed session 391. Oct 10 16:03:30 oleg256-client sshd[98039]: Accepted publickey for root from 192.168.202.56 port 43432 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:30 oleg256-client systemd-logind[1023]: New session 392 of user root. Oct 10 16:03:30 oleg256-client systemd[1]: Started Session 392 of user root. Oct 10 16:03:30 oleg256-client sshd[98039]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:31 oleg256-client sshd[98052]: Received disconnect from 192.168.202.56 port 43432:11: disconnected by user Oct 10 16:03:31 oleg256-client sshd[98052]: Disconnected from user root 192.168.202.56 port 43432 Oct 10 16:03:31 oleg256-client sshd[98039]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:31 oleg256-client systemd[1]: session-392.scope: Succeeded. Oct 10 16:03:31 oleg256-client systemd-logind[1023]: Session 392 logged out. Waiting for processes to exit. Oct 10 16:03:31 oleg256-client systemd-logind[1023]: Removed session 392. Oct 10 16:03:31 oleg256-client sshd[98183]: Accepted publickey for root from 192.168.202.56 port 43446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:31 oleg256-client systemd-logind[1023]: New session 393 of user root. Oct 10 16:03:31 oleg256-client systemd[1]: Started Session 393 of user root. Oct 10 16:03:31 oleg256-client sshd[98183]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:32 oleg256-client sshd[98196]: Received disconnect from 192.168.202.56 port 43446:11: disconnected by user Oct 10 16:03:32 oleg256-client sshd[98196]: Disconnected from user root 192.168.202.56 port 43446 Oct 10 16:03:32 oleg256-client sshd[98183]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:32 oleg256-client systemd[1]: session-393.scope: Succeeded. Oct 10 16:03:32 oleg256-client systemd-logind[1023]: Session 393 logged out. Waiting for processes to exit. Oct 10 16:03:32 oleg256-client systemd-logind[1023]: Removed session 393. Oct 10 16:03:32 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:03:32 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:03:33 oleg256-client sshd[98345]: Accepted publickey for root from 192.168.202.56 port 43462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:33 oleg256-client systemd-logind[1023]: New session 394 of user root. Oct 10 16:03:33 oleg256-client systemd[1]: Started Session 394 of user root. Oct 10 16:03:33 oleg256-client sshd[98345]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:33 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 305: Resolve hostname before lnetctl ping ========================================================== 16:03:32 (1760126612) Oct 10 16:03:33 oleg256-client sshd[98358]: Received disconnect from 192.168.202.56 port 43462:11: disconnected by user Oct 10 16:03:33 oleg256-client sshd[98358]: Disconnected from user root 192.168.202.56 port 43462 Oct 10 16:03:33 oleg256-client sshd[98345]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:33 oleg256-client systemd[1]: session-394.scope: Succeeded. Oct 10 16:03:33 oleg256-client systemd-logind[1023]: Session 394 logged out. Waiting for processes to exit. Oct 10 16:03:33 oleg256-client systemd-logind[1023]: Removed session 394. Oct 10 16:03:33 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 16:03:33 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:03:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:03:34 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:03:34 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:03:34 oleg256-client root[98464]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:35 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.56@tcp Oct 10 16:03:35 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping oleg256-client@tcp Oct 10 16:03:35 oleg256-client sshd[98648]: Accepted publickey for root from 192.168.202.56 port 54862 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:35 oleg256-client systemd-logind[1023]: New session 395 of user root. Oct 10 16:03:35 oleg256-client systemd[1]: Started Session 395 of user root. Oct 10 16:03:35 oleg256-client sshd[98648]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:36 oleg256-client sshd[98661]: Received disconnect from 192.168.202.56 port 54862:11: disconnected by user Oct 10 16:03:36 oleg256-client sshd[98661]: Disconnected from user root 192.168.202.56 port 54862 Oct 10 16:03:36 oleg256-client sshd[98648]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:36 oleg256-client systemd-logind[1023]: Session 395 logged out. Waiting for processes to exit. Oct 10 16:03:36 oleg256-client systemd[1]: session-395.scope: Succeeded. Oct 10 16:03:36 oleg256-client systemd-logind[1023]: Removed session 395. Oct 10 16:03:36 oleg256-client sshd[98785]: Accepted publickey for root from 192.168.202.56 port 54866 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:36 oleg256-client systemd-logind[1023]: New session 396 of user root. Oct 10 16:03:36 oleg256-client systemd[1]: Started Session 396 of user root. Oct 10 16:03:36 oleg256-client sshd[98785]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:37 oleg256-client sshd[98798]: Received disconnect from 192.168.202.56 port 54866:11: disconnected by user Oct 10 16:03:37 oleg256-client sshd[98798]: Disconnected from user root 192.168.202.56 port 54866 Oct 10 16:03:37 oleg256-client sshd[98785]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:37 oleg256-client systemd[1]: session-396.scope: Succeeded. Oct 10 16:03:37 oleg256-client systemd-logind[1023]: Session 396 logged out. Waiting for processes to exit. Oct 10 16:03:37 oleg256-client systemd-logind[1023]: Removed session 396. Oct 10 16:03:37 oleg256-client sshd[98929]: Accepted publickey for root from 192.168.202.56 port 54872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:37 oleg256-client systemd-logind[1023]: New session 397 of user root. Oct 10 16:03:37 oleg256-client systemd[1]: Started Session 397 of user root. Oct 10 16:03:37 oleg256-client sshd[98929]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:38 oleg256-client sshd[98942]: Received disconnect from 192.168.202.56 port 54872:11: disconnected by user Oct 10 16:03:38 oleg256-client sshd[98942]: Disconnected from user root 192.168.202.56 port 54872 Oct 10 16:03:38 oleg256-client sshd[98929]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:38 oleg256-client systemd[1]: session-397.scope: Succeeded. Oct 10 16:03:38 oleg256-client systemd-logind[1023]: Session 397 logged out. Waiting for processes to exit. Oct 10 16:03:38 oleg256-client systemd-logind[1023]: Removed session 397. Oct 10 16:03:39 oleg256-client sshd[99082]: Accepted publickey for root from 192.168.202.56 port 54874 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:39 oleg256-client systemd[1]: Started Session 398 of user root. Oct 10 16:03:39 oleg256-client systemd-logind[1023]: New session 398 of user root. Oct 10 16:03:39 oleg256-client sshd[99082]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:39 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 310: Set timeout and verify ========== 16:03:38 (1760126618) Oct 10 16:03:39 oleg256-client sshd[99095]: Received disconnect from 192.168.202.56 port 54874:11: disconnected by user Oct 10 16:03:39 oleg256-client sshd[99095]: Disconnected from user root 192.168.202.56 port 54874 Oct 10 16:03:39 oleg256-client sshd[99082]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:39 oleg256-client kernel: LNet: 99126:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:03:39 oleg256-client kernel: LNetError: 99126:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:03:39 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:03:39 oleg256-client systemd[1]: session-398.scope: Succeeded. Oct 10 16:03:39 oleg256-client systemd-logind[1023]: Session 398 logged out. Waiting for processes to exit. Oct 10 16:03:39 oleg256-client systemd-logind[1023]: Removed session 398. Oct 10 16:03:40 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:03:40 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:03:40 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:03:40 oleg256-client systemd-udevd[99205]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:03:40 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:03:44 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:03:44 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:03:44 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 16:03:44 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:03:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure --all Oct 10 16:03:45 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:03:45 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show -v Oct 10 16:03:46 oleg256-client sshd[99485]: Accepted publickey for root from 192.168.202.56 port 45060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:46 oleg256-client systemd-logind[1023]: New session 399 of user root. Oct 10 16:03:46 oleg256-client systemd[1]: Started Session 399 of user root. Oct 10 16:03:46 oleg256-client sshd[99485]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:46 oleg256-client sshd[99498]: Received disconnect from 192.168.202.56 port 45060:11: disconnected by user Oct 10 16:03:46 oleg256-client sshd[99498]: Disconnected from user root 192.168.202.56 port 45060 Oct 10 16:03:46 oleg256-client sshd[99485]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:46 oleg256-client systemd[1]: session-399.scope: Succeeded. Oct 10 16:03:46 oleg256-client systemd-logind[1023]: Session 399 logged out. Waiting for processes to exit. Oct 10 16:03:46 oleg256-client systemd-logind[1023]: Removed session 399. Oct 10 16:03:47 oleg256-client sshd[99622]: Accepted publickey for root from 192.168.202.56 port 45066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:47 oleg256-client systemd[1]: Started Session 400 of user root. Oct 10 16:03:47 oleg256-client systemd-logind[1023]: New session 400 of user root. Oct 10 16:03:47 oleg256-client sshd[99622]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:47 oleg256-client sshd[99635]: Received disconnect from 192.168.202.56 port 45066:11: disconnected by user Oct 10 16:03:47 oleg256-client sshd[99635]: Disconnected from user root 192.168.202.56 port 45066 Oct 10 16:03:47 oleg256-client sshd[99622]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:47 oleg256-client systemd-logind[1023]: Session 400 logged out. Waiting for processes to exit. Oct 10 16:03:47 oleg256-client systemd[1]: session-400.scope: Succeeded. Oct 10 16:03:47 oleg256-client systemd-logind[1023]: Removed session 400. Oct 10 16:03:48 oleg256-client sshd[99766]: Accepted publickey for root from 192.168.202.56 port 45068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:48 oleg256-client systemd-logind[1023]: New session 401 of user root. Oct 10 16:03:48 oleg256-client systemd[1]: Started Session 401 of user root. Oct 10 16:03:48 oleg256-client sshd[99766]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:49 oleg256-client sshd[99779]: Received disconnect from 192.168.202.56 port 45068:11: disconnected by user Oct 10 16:03:49 oleg256-client sshd[99779]: Disconnected from user root 192.168.202.56 port 45068 Oct 10 16:03:49 oleg256-client sshd[99766]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:49 oleg256-client systemd[1]: session-401.scope: Succeeded. Oct 10 16:03:49 oleg256-client systemd-logind[1023]: Session 401 logged out. Waiting for processes to exit. Oct 10 16:03:49 oleg256-client systemd-logind[1023]: Removed session 401. Oct 10 16:03:50 oleg256-client sshd[99919]: Accepted publickey for root from 192.168.202.56 port 45082 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:50 oleg256-client systemd-logind[1023]: New session 402 of user root. Oct 10 16:03:50 oleg256-client systemd[1]: Started Session 402 of user root. Oct 10 16:03:50 oleg256-client sshd[99919]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:50 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 311: Fail bulk put in send wait completion ========================================================== 16:03:49 (1760126629) Oct 10 16:03:50 oleg256-client sshd[99932]: Received disconnect from 192.168.202.56 port 45082:11: disconnected by user Oct 10 16:03:50 oleg256-client sshd[99932]: Disconnected from user root 192.168.202.56 port 45082 Oct 10 16:03:50 oleg256-client sshd[99919]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:50 oleg256-client systemd[1]: session-402.scope: Succeeded. Oct 10 16:03:50 oleg256-client systemd-logind[1023]: Session 402 logged out. Waiting for processes to exit. Oct 10 16:03:50 oleg256-client systemd-logind[1023]: Removed session 402. Oct 10 16:03:51 oleg256-client sshd[100055]: Accepted publickey for root from 192.168.202.56 port 45086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:51 oleg256-client systemd-logind[1023]: New session 403 of user root. Oct 10 16:03:51 oleg256-client systemd[1]: Started Session 403 of user root. Oct 10 16:03:51 oleg256-client sshd[100055]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:51 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_311 Need kfi network type Oct 10 16:03:51 oleg256-client sshd[100068]: Received disconnect from 192.168.202.56 port 45086:11: disconnected by user Oct 10 16:03:51 oleg256-client sshd[100068]: Disconnected from user root 192.168.202.56 port 45086 Oct 10 16:03:51 oleg256-client sshd[100055]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:51 oleg256-client systemd[1]: session-403.scope: Succeeded. Oct 10 16:03:51 oleg256-client systemd-logind[1023]: Session 403 logged out. Waiting for processes to exit. Oct 10 16:03:51 oleg256-client systemd-logind[1023]: Removed session 403. Oct 10 16:03:52 oleg256-client systemd[1]: Starting dnf makecache... Oct 10 16:03:52 oleg256-client sshd[100208]: Accepted publickey for root from 192.168.202.56 port 45098 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:52 oleg256-client systemd[1]: Started Session 404 of user root. Oct 10 16:03:52 oleg256-client systemd-logind[1023]: New session 404 of user root. Oct 10 16:03:52 oleg256-client sshd[100208]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:52 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 312: TAG_RX_OK is possible after TX_FAIL ========================================================== 16:03:51 (1760126631) Oct 10 16:03:52 oleg256-client sshd[100222]: Received disconnect from 192.168.202.56 port 45098:11: disconnected by user Oct 10 16:03:53 oleg256-client sshd[100222]: Disconnected from user root 192.168.202.56 port 45098 Oct 10 16:03:53 oleg256-client sshd[100208]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:53 oleg256-client systemd-logind[1023]: Session 404 logged out. Waiting for processes to exit. Oct 10 16:03:53 oleg256-client systemd[1]: session-404.scope: Succeeded. Oct 10 16:03:53 oleg256-client systemd-logind[1023]: Removed session 404. Oct 10 16:03:53 oleg256-client sshd[100347]: Accepted publickey for root from 192.168.202.56 port 47630 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:53 oleg256-client systemd-logind[1023]: New session 405 of user root. Oct 10 16:03:53 oleg256-client systemd[1]: Started Session 405 of user root. Oct 10 16:03:53 oleg256-client sshd[100347]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:54 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_312 Need kfi network type Oct 10 16:03:54 oleg256-client sshd[100360]: Received disconnect from 192.168.202.56 port 47630:11: disconnected by user Oct 10 16:03:54 oleg256-client sshd[100360]: Disconnected from user root 192.168.202.56 port 47630 Oct 10 16:03:54 oleg256-client sshd[100347]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:54 oleg256-client systemd[1]: session-405.scope: Succeeded. Oct 10 16:03:54 oleg256-client systemd-logind[1023]: Session 405 logged out. Waiting for processes to exit. Oct 10 16:03:54 oleg256-client systemd-logind[1023]: Removed session 405. Oct 10 16:03:55 oleg256-client sshd[100499]: Accepted publickey for root from 192.168.202.56 port 47642 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:55 oleg256-client systemd[1]: Started Session 406 of user root. Oct 10 16:03:55 oleg256-client systemd-logind[1023]: New session 406 of user root. Oct 10 16:03:55 oleg256-client sshd[100499]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:55 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 350: Check import --exec of ping/discover ========================================================== 16:03:54 (1760126634) Oct 10 16:03:55 oleg256-client sshd[100513]: Received disconnect from 192.168.202.56 port 47642:11: disconnected by user Oct 10 16:03:55 oleg256-client sshd[100513]: Disconnected from user root 192.168.202.56 port 47642 Oct 10 16:03:55 oleg256-client sshd[100499]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:55 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:03:55 oleg256-client kernel: LNet: 100550:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:03:55 oleg256-client kernel: LNetError: 100550:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:03:55 oleg256-client systemd[1]: session-406.scope: Succeeded. Oct 10 16:03:55 oleg256-client systemd-logind[1023]: Session 406 logged out. Waiting for processes to exit. Oct 10 16:03:55 oleg256-client systemd-logind[1023]: Removed session 406. Oct 10 16:03:56 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:03:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:03:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:03:56 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:03:56 oleg256-client root[100584]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:03:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import -e /tmp/sanity-lnet-350.yaml Oct 10 16:03:56 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl import -e /tmp/sanity-lnet-350.yaml Oct 10 16:03:57 oleg256-client sshd[100772]: Accepted publickey for root from 192.168.202.56 port 47656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:57 oleg256-client systemd-logind[1023]: New session 407 of user root. Oct 10 16:03:57 oleg256-client systemd[1]: Started Session 407 of user root. Oct 10 16:03:57 oleg256-client sshd[100772]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:58 oleg256-client sshd[100785]: Received disconnect from 192.168.202.56 port 47656:11: disconnected by user Oct 10 16:03:58 oleg256-client sshd[100785]: Disconnected from user root 192.168.202.56 port 47656 Oct 10 16:03:58 oleg256-client sshd[100772]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:58 oleg256-client systemd[1]: session-407.scope: Succeeded. Oct 10 16:03:58 oleg256-client systemd-logind[1023]: Session 407 logged out. Waiting for processes to exit. Oct 10 16:03:58 oleg256-client systemd-logind[1023]: Removed session 407. Oct 10 16:03:58 oleg256-client dnf[100216]: Failed determining last makecache time. Oct 10 16:03:59 oleg256-client sshd[100909]: Accepted publickey for root from 192.168.202.56 port 47672 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:03:59 oleg256-client systemd-logind[1023]: New session 408 of user root. Oct 10 16:03:59 oleg256-client sshd[100909]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:03:59 oleg256-client systemd[1]: Started Session 408 of user root. Oct 10 16:03:59 oleg256-client dnf[100216]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' Oct 10 16:03:59 oleg256-client dnf[100216]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' Oct 10 16:03:59 oleg256-client sshd[100923]: Received disconnect from 192.168.202.56 port 47672:11: disconnected by user Oct 10 16:03:59 oleg256-client sshd[100923]: Disconnected from user root 192.168.202.56 port 47672 Oct 10 16:03:59 oleg256-client sshd[100909]: pam_unix(sshd:session): session closed for user root Oct 10 16:03:59 oleg256-client systemd-logind[1023]: Session 408 logged out. Waiting for processes to exit. Oct 10 16:03:59 oleg256-client systemd[1]: session-408.scope: Succeeded. Oct 10 16:03:59 oleg256-client systemd-logind[1023]: Removed session 408. Oct 10 16:03:59 oleg256-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE Oct 10 16:03:59 oleg256-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. Oct 10 16:03:59 oleg256-client systemd[1]: Failed to start dnf makecache. Oct 10 16:04:00 oleg256-client sshd[101055]: Accepted publickey for root from 192.168.202.56 port 47674 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:00 oleg256-client systemd[1]: Started Session 409 of user root. Oct 10 16:04:00 oleg256-client systemd-logind[1023]: New session 409 of user root. Oct 10 16:04:00 oleg256-client sshd[101055]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:00 oleg256-client sshd[101068]: Received disconnect from 192.168.202.56 port 47674:11: disconnected by user Oct 10 16:04:00 oleg256-client sshd[101068]: Disconnected from user root 192.168.202.56 port 47674 Oct 10 16:04:00 oleg256-client sshd[101055]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:01 oleg256-client systemd-logind[1023]: Session 409 logged out. Waiting for processes to exit. Oct 10 16:04:01 oleg256-client systemd[1]: session-409.scope: Succeeded. Oct 10 16:04:01 oleg256-client systemd-logind[1023]: Removed session 409. Oct 10 16:04:02 oleg256-client sshd[101208]: Accepted publickey for root from 192.168.202.56 port 47686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:02 oleg256-client systemd-logind[1023]: New session 410 of user root. Oct 10 16:04:02 oleg256-client systemd[1]: Started Session 410 of user root. Oct 10 16:04:02 oleg256-client sshd[101208]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:02 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 400: Check for udsp add/delete net rule without net num ========================================================== 16:04:01 (1760126641) Oct 10 16:04:02 oleg256-client sshd[101221]: Received disconnect from 192.168.202.56 port 47686:11: disconnected by user Oct 10 16:04:02 oleg256-client sshd[101221]: Disconnected from user root 192.168.202.56 port 47686 Oct 10 16:04:02 oleg256-client sshd[101208]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:04:02 oleg256-client kernel: LNet: 101258:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:04:02 oleg256-client kernel: LNetError: 101258:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:04:02 oleg256-client systemd[1]: session-410.scope: Succeeded. Oct 10 16:04:02 oleg256-client systemd-logind[1023]: Session 410 logged out. Waiting for processes to exit. Oct 10 16:04:02 oleg256-client systemd-logind[1023]: Removed session 410. Oct 10 16:04:02 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:04:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:04:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl udsp add --src tcp --priority 0 Oct 10 16:04:02 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl udsp del --idx 0 Oct 10 16:04:03 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:04:03 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:04:03 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:04:03 oleg256-client systemd-udevd[101353]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:04:03 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:04:07 oleg256-client sshd[101562]: Accepted publickey for root from 192.168.202.56 port 38764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:07 oleg256-client systemd[1]: Started Session 411 of user root. Oct 10 16:04:07 oleg256-client systemd-logind[1023]: New session 411 of user root. Oct 10 16:04:07 oleg256-client sshd[101562]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:07 oleg256-client sshd[101575]: Received disconnect from 192.168.202.56 port 38764:11: disconnected by user Oct 10 16:04:07 oleg256-client sshd[101575]: Disconnected from user root 192.168.202.56 port 38764 Oct 10 16:04:07 oleg256-client sshd[101562]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:07 oleg256-client systemd[1]: session-411.scope: Succeeded. Oct 10 16:04:07 oleg256-client systemd-logind[1023]: Session 411 logged out. Waiting for processes to exit. Oct 10 16:04:07 oleg256-client systemd-logind[1023]: Removed session 411. Oct 10 16:04:08 oleg256-client sshd[101699]: Accepted publickey for root from 192.168.202.56 port 38776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:08 oleg256-client systemd-logind[1023]: New session 412 of user root. Oct 10 16:04:08 oleg256-client systemd[1]: Started Session 412 of user root. Oct 10 16:04:08 oleg256-client sshd[101699]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:08 oleg256-client sshd[101712]: Received disconnect from 192.168.202.56 port 38776:11: disconnected by user Oct 10 16:04:08 oleg256-client sshd[101712]: Disconnected from user root 192.168.202.56 port 38776 Oct 10 16:04:08 oleg256-client sshd[101699]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:08 oleg256-client systemd[1]: session-412.scope: Succeeded. Oct 10 16:04:08 oleg256-client systemd-logind[1023]: Session 412 logged out. Waiting for processes to exit. Oct 10 16:04:08 oleg256-client systemd-logind[1023]: Removed session 412. Oct 10 16:04:09 oleg256-client sshd[101843]: Accepted publickey for root from 192.168.202.56 port 38782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:09 oleg256-client systemd-logind[1023]: New session 413 of user root. Oct 10 16:04:09 oleg256-client systemd[1]: Started Session 413 of user root. Oct 10 16:04:09 oleg256-client sshd[101843]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:09 oleg256-client sshd[101856]: Received disconnect from 192.168.202.56 port 38782:11: disconnected by user Oct 10 16:04:09 oleg256-client sshd[101856]: Disconnected from user root 192.168.202.56 port 38782 Oct 10 16:04:09 oleg256-client sshd[101843]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:09 oleg256-client systemd[1]: session-413.scope: Succeeded. Oct 10 16:04:09 oleg256-client systemd-logind[1023]: Session 413 logged out. Waiting for processes to exit. Oct 10 16:04:09 oleg256-client systemd-logind[1023]: Removed session 413. Oct 10 16:04:10 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:04:10 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:04:10 oleg256-client sshd[102005]: Accepted publickey for root from 192.168.202.56 port 38794 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:10 oleg256-client systemd-logind[1023]: New session 414 of user root. Oct 10 16:04:10 oleg256-client systemd[1]: Started Session 414 of user root. Oct 10 16:04:10 oleg256-client sshd[102005]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:11 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 401: Discover peer after adding peer net UDSP rule ========================================================== 16:04:10 (1760126650) Oct 10 16:04:11 oleg256-client sshd[102018]: Received disconnect from 192.168.202.56 port 38794:11: disconnected by user Oct 10 16:04:11 oleg256-client sshd[102018]: Disconnected from user root 192.168.202.56 port 38794 Oct 10 16:04:11 oleg256-client sshd[102005]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:11 oleg256-client systemd-logind[1023]: Session 414 logged out. Waiting for processes to exit. Oct 10 16:04:11 oleg256-client systemd[1]: session-414.scope: Succeeded. Oct 10 16:04:11 oleg256-client systemd-logind[1023]: Removed session 414. Oct 10 16:04:11 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 16:04:11 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:04:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:04:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:04:12 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:04:12 oleg256-client root[102123]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:04:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl udsp add --dst tcp --prio 1 Oct 10 16:04:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 16:04:13 oleg256-client sshd[102320]: Accepted publickey for root from 192.168.202.56 port 57546 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:13 oleg256-client systemd-logind[1023]: New session 415 of user root. Oct 10 16:04:13 oleg256-client systemd[1]: Started Session 415 of user root. Oct 10 16:04:13 oleg256-client sshd[102320]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:13 oleg256-client sshd[102334]: Received disconnect from 192.168.202.56 port 57546:11: disconnected by user Oct 10 16:04:13 oleg256-client sshd[102334]: Disconnected from user root 192.168.202.56 port 57546 Oct 10 16:04:13 oleg256-client sshd[102320]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:13 oleg256-client systemd[1]: session-415.scope: Succeeded. Oct 10 16:04:13 oleg256-client systemd-logind[1023]: Session 415 logged out. Waiting for processes to exit. Oct 10 16:04:13 oleg256-client systemd-logind[1023]: Removed session 415. Oct 10 16:04:14 oleg256-client sshd[102458]: Accepted publickey for root from 192.168.202.56 port 57556 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:14 oleg256-client systemd-logind[1023]: New session 416 of user root. Oct 10 16:04:14 oleg256-client systemd[1]: Started Session 416 of user root. Oct 10 16:04:14 oleg256-client sshd[102458]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:14 oleg256-client sshd[102471]: Received disconnect from 192.168.202.56 port 57556:11: disconnected by user Oct 10 16:04:14 oleg256-client sshd[102471]: Disconnected from user root 192.168.202.56 port 57556 Oct 10 16:04:14 oleg256-client sshd[102458]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:14 oleg256-client systemd[1]: session-416.scope: Succeeded. Oct 10 16:04:14 oleg256-client systemd-logind[1023]: Session 416 logged out. Waiting for processes to exit. Oct 10 16:04:14 oleg256-client rsyslogd[1087]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Oct 10 16:04:14 oleg256-client systemd-logind[1023]: Removed session 416. Oct 10 16:04:15 oleg256-client sshd[102603]: Accepted publickey for root from 192.168.202.56 port 57570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:15 oleg256-client systemd-logind[1023]: New session 417 of user root. Oct 10 16:04:15 oleg256-client systemd[1]: Started Session 417 of user root. Oct 10 16:04:15 oleg256-client sshd[102603]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:15 oleg256-client sshd[102616]: Received disconnect from 192.168.202.56 port 57570:11: disconnected by user Oct 10 16:04:15 oleg256-client sshd[102616]: Disconnected from user root 192.168.202.56 port 57570 Oct 10 16:04:15 oleg256-client sshd[102603]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:15 oleg256-client systemd-logind[1023]: Session 417 logged out. Waiting for processes to exit. Oct 10 16:04:15 oleg256-client systemd[1]: session-417.scope: Succeeded. Oct 10 16:04:15 oleg256-client systemd-logind[1023]: Removed session 417. Oct 10 16:04:16 oleg256-client sshd[102756]: Accepted publickey for root from 192.168.202.56 port 57572 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:16 oleg256-client systemd[1]: Started Session 418 of user root. Oct 10 16:04:16 oleg256-client systemd-logind[1023]: New session 418 of user root. Oct 10 16:04:16 oleg256-client sshd[102756]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:17 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 402: Destination net rule should not panic ========================================================== 16:04:16 (1760126656) Oct 10 16:04:17 oleg256-client sshd[102769]: Received disconnect from 192.168.202.56 port 57572:11: disconnected by user Oct 10 16:04:17 oleg256-client sshd[102769]: Disconnected from user root 192.168.202.56 port 57572 Oct 10 16:04:17 oleg256-client sshd[102756]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:04:17 oleg256-client kernel: LNet: 102801:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:04:17 oleg256-client kernel: LNetError: 102801:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:04:17 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:04:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:04:17 oleg256-client systemd[1]: session-418.scope: Succeeded. Oct 10 16:04:17 oleg256-client systemd-logind[1023]: Session 418 logged out. Waiting for processes to exit. Oct 10 16:04:17 oleg256-client systemd-logind[1023]: Removed session 418. Oct 10 16:04:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl udsp add --dst kfi --priority 0 Oct 10 16:04:17 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer add --prim 402@kfi Oct 10 16:04:17 oleg256-client sshd[102901]: Accepted publickey for root from 192.168.202.56 port 57584 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:17 oleg256-client systemd[1]: Started Session 419 of user root. Oct 10 16:04:17 oleg256-client systemd-logind[1023]: New session 419 of user root. Oct 10 16:04:17 oleg256-client sshd[102901]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:17 oleg256-client sshd[102914]: Received disconnect from 192.168.202.56 port 57584:11: disconnected by user Oct 10 16:04:17 oleg256-client sshd[102914]: Disconnected from user root 192.168.202.56 port 57584 Oct 10 16:04:17 oleg256-client sshd[102901]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:18 oleg256-client systemd[1]: session-419.scope: Succeeded. Oct 10 16:04:18 oleg256-client systemd-logind[1023]: Session 419 logged out. Waiting for processes to exit. Oct 10 16:04:18 oleg256-client systemd-logind[1023]: Removed session 419. Oct 10 16:04:18 oleg256-client sshd[103039]: Accepted publickey for root from 192.168.202.56 port 57590 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:18 oleg256-client systemd-logind[1023]: New session 420 of user root. Oct 10 16:04:18 oleg256-client systemd[1]: Started Session 420 of user root. Oct 10 16:04:18 oleg256-client sshd[103039]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:19 oleg256-client sshd[103052]: Received disconnect from 192.168.202.56 port 57590:11: disconnected by user Oct 10 16:04:19 oleg256-client sshd[103052]: Disconnected from user root 192.168.202.56 port 57590 Oct 10 16:04:19 oleg256-client sshd[103039]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:19 oleg256-client systemd[1]: session-420.scope: Succeeded. Oct 10 16:04:19 oleg256-client systemd-logind[1023]: Session 420 logged out. Waiting for processes to exit. Oct 10 16:04:19 oleg256-client systemd-logind[1023]: Removed session 420. Oct 10 16:04:20 oleg256-client sshd[103183]: Accepted publickey for root from 192.168.202.56 port 57602 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:20 oleg256-client systemd-logind[1023]: New session 421 of user root. Oct 10 16:04:20 oleg256-client systemd[1]: Started Session 421 of user root. Oct 10 16:04:20 oleg256-client sshd[103183]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:20 oleg256-client sshd[103196]: Received disconnect from 192.168.202.56 port 57602:11: disconnected by user Oct 10 16:04:20 oleg256-client sshd[103196]: Disconnected from user root 192.168.202.56 port 57602 Oct 10 16:04:20 oleg256-client sshd[103183]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:20 oleg256-client systemd[1]: session-421.scope: Succeeded. Oct 10 16:04:20 oleg256-client systemd-logind[1023]: Session 421 logged out. Waiting for processes to exit. Oct 10 16:04:20 oleg256-client systemd-logind[1023]: Removed session 421. Oct 10 16:04:21 oleg256-client sshd[103326]: Accepted publickey for root from 192.168.202.56 port 57612 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:21 oleg256-client systemd-logind[1023]: New session 422 of user root. Oct 10 16:04:21 oleg256-client systemd[1]: Started Session 422 of user root. Oct 10 16:04:21 oleg256-client sshd[103326]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:21 oleg256-client kernel: Lustre: DEBUG MARKER: SKIP: sanity-lnet test_410 skipping ALWAYS excluded test 410 Oct 10 16:04:21 oleg256-client sshd[103339]: Received disconnect from 192.168.202.56 port 57612:11: disconnected by user Oct 10 16:04:21 oleg256-client sshd[103339]: Disconnected from user root 192.168.202.56 port 57612 Oct 10 16:04:21 oleg256-client sshd[103326]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:21 oleg256-client systemd[1]: session-422.scope: Succeeded. Oct 10 16:04:21 oleg256-client systemd-logind[1023]: Session 422 logged out. Waiting for processes to exit. Oct 10 16:04:21 oleg256-client systemd-logind[1023]: Removed session 422. Oct 10 16:04:22 oleg256-client sshd[103475]: Accepted publickey for root from 192.168.202.56 port 57624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:22 oleg256-client systemd[1]: Started Session 423 of user root. Oct 10 16:04:22 oleg256-client systemd-logind[1023]: New session 423 of user root. Oct 10 16:04:22 oleg256-client sshd[103475]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:22 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 500: Check deadlock on ping target update ========================================================== 16:04:21 (1760126661) Oct 10 16:04:22 oleg256-client sshd[103488]: Received disconnect from 192.168.202.56 port 57624:11: disconnected by user Oct 10 16:04:22 oleg256-client sshd[103488]: Disconnected from user root 192.168.202.56 port 57624 Oct 10 16:04:22 oleg256-client sshd[103475]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:22 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet unconfigure Oct 10 16:04:22 oleg256-client kernel: LNet: 103520:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:04:22 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:04:22 oleg256-client systemd[1]: session-423.scope: Succeeded. Oct 10 16:04:22 oleg256-client systemd-logind[1023]: Session 423 logged out. Waiting for processes to exit. Oct 10 16:04:22 oleg256-client systemd-logind[1023]: Removed session 423. Oct 10 16:04:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 Oct 10 16:04:23 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:04:23 oleg256-client root[103578]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:04:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg Oct 10 16:04:23 oleg256-client kernel: LNet: Added LNI 10.1.2.3@tcp [8/256/0/180] Oct 10 16:04:23 oleg256-client root[103688]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:04:23 oleg256-client root[103699]: ksocklnd-config: skip setting up route for test1pg: IPv4 route exists Oct 10 16:04:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.56@tcp Oct 10 16:04:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_delay add -s *@tcp -d *@tcp -r 1 -l 1 -m PUT Oct 10 16:04:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp -d 192.168.202.56@tcp -m PUT -e local_timeout -r 1 Oct 10 16:04:24 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net_drop add -s *@tcp -d 10.1.2.3@tcp -m PUT -e local_timeout -r 1 Oct 10 16:04:24 oleg256-client NetworkManager[1026]: [1760126664.3397] device (test1pg): carrier: link connected Oct 10 16:04:24 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_UP): test1pg: link is not ready Oct 10 16:04:24 oleg256-client kernel: IPv6: ADDRCONF(NETDEV_CHANGE): test1pg: link becomes ready Oct 10 16:04:24 oleg256-client NetworkManager[1026]: [1760126664.3555] device (test1pl): carrier: link connected Oct 10 16:04:24 oleg256-client kernel: LNetError: 103558:0:(lib-move.c:4947:lnet_parse()) 192.168.202.56@tcp, src 192.168.202.56@tcp: Dropping PUT (error -108 looking up sender) Oct 10 16:04:25 oleg256-client kernel: LNet: 103835:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:04:25 oleg256-client kernel: LNetError: 103835:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:04:25 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:04:25 oleg256-client kernel: LNet: Removed LNI 10.1.2.3@tcp Oct 10 16:04:25 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:04:25 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:04:26 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:04:26 oleg256-client systemd-udevd[103879]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:04:26 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:04:29 oleg256-client sshd[104103]: Accepted publickey for root from 192.168.202.56 port 53020 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:29 oleg256-client systemd-logind[1023]: New session 424 of user root. Oct 10 16:04:29 oleg256-client systemd[1]: Started Session 424 of user root. Oct 10 16:04:29 oleg256-client sshd[104103]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:30 oleg256-client sshd[104116]: Received disconnect from 192.168.202.56 port 53020:11: disconnected by user Oct 10 16:04:30 oleg256-client sshd[104116]: Disconnected from user root 192.168.202.56 port 53020 Oct 10 16:04:30 oleg256-client sshd[104103]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:30 oleg256-client systemd-logind[1023]: Session 424 logged out. Waiting for processes to exit. Oct 10 16:04:30 oleg256-client systemd[1]: session-424.scope: Succeeded. Oct 10 16:04:30 oleg256-client systemd-logind[1023]: Removed session 424. Oct 10 16:04:31 oleg256-client sshd[104240]: Accepted publickey for root from 192.168.202.56 port 53036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:31 oleg256-client systemd-logind[1023]: New session 425 of user root. Oct 10 16:04:31 oleg256-client systemd[1]: Started Session 425 of user root. Oct 10 16:04:31 oleg256-client sshd[104240]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:31 oleg256-client sshd[104253]: Received disconnect from 192.168.202.56 port 53036:11: disconnected by user Oct 10 16:04:31 oleg256-client sshd[104253]: Disconnected from user root 192.168.202.56 port 53036 Oct 10 16:04:31 oleg256-client sshd[104240]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:31 oleg256-client systemd[1]: session-425.scope: Succeeded. Oct 10 16:04:31 oleg256-client systemd-logind[1023]: Session 425 logged out. Waiting for processes to exit. Oct 10 16:04:31 oleg256-client systemd-logind[1023]: Removed session 425. Oct 10 16:04:32 oleg256-client sshd[104384]: Accepted publickey for root from 192.168.202.56 port 53050 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:32 oleg256-client systemd[1]: Started Session 426 of user root. Oct 10 16:04:32 oleg256-client systemd-logind[1023]: New session 426 of user root. Oct 10 16:04:32 oleg256-client sshd[104384]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:32 oleg256-client sshd[104397]: Received disconnect from 192.168.202.56 port 53050:11: disconnected by user Oct 10 16:04:32 oleg256-client sshd[104397]: Disconnected from user root 192.168.202.56 port 53050 Oct 10 16:04:32 oleg256-client sshd[104384]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:32 oleg256-client systemd-logind[1023]: Session 426 logged out. Waiting for processes to exit. Oct 10 16:04:32 oleg256-client systemd[1]: session-426.scope: Succeeded. Oct 10 16:04:32 oleg256-client systemd-logind[1023]: Removed session 426. Oct 10 16:04:33 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:04:33 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:04:33 oleg256-client sshd[104546]: Accepted publickey for root from 192.168.202.56 port 34586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:04:33 oleg256-client systemd-logind[1023]: New session 427 of user root. Oct 10 16:04:33 oleg256-client systemd[1]: Started Session 427 of user root. Oct 10 16:04:33 oleg256-client sshd[104546]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:04:34 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 501: Verify lnetctl peer set --health (SR) ========================================================== 16:04:32 (1760126672) Oct 10 16:04:34 oleg256-client sshd[104560]: Received disconnect from 192.168.202.56 port 34586:11: disconnected by user Oct 10 16:04:34 oleg256-client sshd[104560]: Disconnected from user root 192.168.202.56 port 34586 Oct 10 16:04:34 oleg256-client sshd[104546]: pam_unix(sshd:session): session closed for user root Oct 10 16:04:34 oleg256-client systemd-logind[1023]: Session 427 logged out. Waiting for processes to exit. Oct 10 16:04:34 oleg256-client systemd[1]: session-427.scope: Succeeded. Oct 10 16:04:34 oleg256-client systemd-logind[1023]: Removed session 427. Oct 10 16:04:34 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 16:04:34 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:04:35 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:04:35 oleg256-client kernel: LNet: 104684:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:04:35 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:04:35 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:04:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:04:36 oleg256-client systemd-udevd[104765]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:04:36 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:04:40 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:04:40 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:04:40 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:04:40 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:04:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 16:04:41 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:04:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 16:04:47 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp -d *@tcp -r 1 Oct 10 16:04:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 0 --nid 192.168.202.156@tcp Oct 10 16:04:48 oleg256-client kernel: LNet: 105121:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 16:04:48 oleg256-client kernel: LNet: 1 peer NIs in recovery (showing 1): 192.168.202.156@tcp Oct 10 16:04:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:04:48 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:04:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 0 --all Oct 10 16:04:49 oleg256-client kernel: LNet: 105226:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 16:04:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:04:49 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:04:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 500 --nid 192.168.202.156@tcp Oct 10 16:04:50 oleg256-client kernel: LNet: 105332:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 16:04:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:04:50 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:04:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 500 --all Oct 10 16:04:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:04:51 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:04:51 oleg256-client kernel: LNet: 105478:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:04:51 oleg256-client kernel: LNetError: 105478:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:04:51 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:04:52 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:04:52 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:04:52 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:04:52 oleg256-client systemd-udevd[105527]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:04:52 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:05:03 oleg256-client sshd[105781]: Accepted publickey for root from 192.168.202.56 port 40964 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:03 oleg256-client systemd-logind[1023]: New session 428 of user root. Oct 10 16:05:03 oleg256-client systemd[1]: Started Session 428 of user root. Oct 10 16:05:03 oleg256-client sshd[105781]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:05:03 oleg256-client sshd[105794]: Received disconnect from 192.168.202.56 port 40964:11: disconnected by user Oct 10 16:05:03 oleg256-client sshd[105794]: Disconnected from user root 192.168.202.56 port 40964 Oct 10 16:05:03 oleg256-client sshd[105781]: pam_unix(sshd:session): session closed for user root Oct 10 16:05:03 oleg256-client systemd[1]: session-428.scope: Succeeded. Oct 10 16:05:03 oleg256-client systemd-logind[1023]: Session 428 logged out. Waiting for processes to exit. Oct 10 16:05:03 oleg256-client systemd-logind[1023]: Removed session 428. Oct 10 16:05:05 oleg256-client sshd[105919]: Accepted publickey for root from 192.168.202.56 port 44944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:05 oleg256-client systemd-logind[1023]: New session 429 of user root. Oct 10 16:05:05 oleg256-client systemd[1]: Started Session 429 of user root. Oct 10 16:05:05 oleg256-client sshd[105919]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:05:06 oleg256-client sshd[105933]: Received disconnect from 192.168.202.56 port 44944:11: disconnected by user Oct 10 16:05:06 oleg256-client sshd[105933]: Disconnected from user root 192.168.202.56 port 44944 Oct 10 16:05:06 oleg256-client sshd[105919]: pam_unix(sshd:session): session closed for user root Oct 10 16:05:06 oleg256-client systemd[1]: session-429.scope: Succeeded. Oct 10 16:05:06 oleg256-client systemd-logind[1023]: Session 429 logged out. Waiting for processes to exit. Oct 10 16:05:06 oleg256-client systemd-logind[1023]: Removed session 429. Oct 10 16:05:07 oleg256-client sshd[106064]: Accepted publickey for root from 192.168.202.56 port 44960 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:07 oleg256-client systemd-logind[1023]: New session 430 of user root. Oct 10 16:05:07 oleg256-client systemd[1]: Started Session 430 of user root. Oct 10 16:05:07 oleg256-client sshd[106064]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:05:08 oleg256-client sshd[106077]: Received disconnect from 192.168.202.56 port 44960:11: disconnected by user Oct 10 16:05:08 oleg256-client sshd[106077]: Disconnected from user root 192.168.202.56 port 44960 Oct 10 16:05:08 oleg256-client sshd[106064]: pam_unix(sshd:session): session closed for user root Oct 10 16:05:08 oleg256-client systemd-logind[1023]: Session 430 logged out. Waiting for processes to exit. Oct 10 16:05:08 oleg256-client systemd[1]: session-430.scope: Succeeded. Oct 10 16:05:08 oleg256-client systemd-logind[1023]: Removed session 430. Oct 10 16:05:08 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:05:08 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:05:10 oleg256-client sshd[106226]: Accepted publickey for root from 192.168.202.56 port 44966 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:10 oleg256-client systemd-logind[1023]: New session 431 of user root. Oct 10 16:05:10 oleg256-client systemd[1]: Started Session 431 of user root. Oct 10 16:05:10 oleg256-client sshd[106226]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:05:10 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test 502: Verify lnetctl peer set --health (MR) ========================================================== 16:05:08 (1760126708) Oct 10 16:05:10 oleg256-client sshd[106239]: Received disconnect from 192.168.202.56 port 44966:11: disconnected by user Oct 10 16:05:10 oleg256-client sshd[106239]: Disconnected from user root 192.168.202.56 port 44966 Oct 10 16:05:10 oleg256-client sshd[106226]: pam_unix(sshd:session): session closed for user root Oct 10 16:05:10 oleg256-client systemd[1]: session-431.scope: Succeeded. Oct 10 16:05:10 oleg256-client systemd-logind[1023]: Session 431 logged out. Waiting for processes to exit. Oct 10 16:05:10 oleg256-client systemd-logind[1023]: Removed session 431. Oct 10 16:05:11 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 Oct 10 16:05:11 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:05:12 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:05:13 oleg256-client kernel: LNet: 106364:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:05:13 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:05:13 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:05:14 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:05:14 oleg256-client systemd-udevd[106447]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:05:15 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:05:22 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:05:22 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:05:22 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:05:22 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:05:23 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a Oct 10 16:05:23 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:05:30 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl discover 192.168.202.156@tcp Oct 10 16:05:36 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure Oct 10 16:05:36 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp1 --if ens2 Oct 10 16:05:36 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp1 [8/256/0/180] Oct 10 16:05:36 oleg256-client root[106804]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:05:36 oleg256-client root[106815]: ksocklnd-config: skip setting up route for ens2: IPv4 route exists Oct 10 16:05:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl fault drop add -s *@tcp -d *@tcp -r 1 Oct 10 16:05:37 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 0 --nid 192.168.202.156@tcp Oct 10 16:05:37 oleg256-client kernel: LNet: 1 peer NIs in recovery (showing 1): 192.168.202.156@tcp Oct 10 16:05:37 oleg256-client kernel: LNet: 107002:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 16:05:38 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:05:38 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:05:38 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 0 --all Oct 10 16:05:39 oleg256-client kernel: LNet: 107107:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 16:05:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:05:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:05:39 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 500 --nid 192.168.202.156@tcp Oct 10 16:05:40 oleg256-client kernel: LNet: 107212:0:(api-ni.c:339:recovery_interval_set()) 'lnet_recovery_interval' has been deprecated Oct 10 16:05:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:05:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:05:40 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 500 --all Oct 10 16:05:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl peer set --health 1000 --all Oct 10 16:05:41 oleg256-client kernel: Lustre: DEBUG MARKER: /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net set --health 1000 --all Oct 10 16:05:45 oleg256-client kernel: LNet: 107393:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:05:45 oleg256-client kernel: LNetError: 107393:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:05:45 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:05:45 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp1 Oct 10 16:05:46 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:05:46 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:05:46 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:05:46 oleg256-client systemd-udevd[107441]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:05:46 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:05:55 oleg256-client sshd[107695]: Accepted publickey for root from 192.168.202.56 port 37048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:55 oleg256-client systemd[1]: Started Session 432 of user root. Oct 10 16:05:55 oleg256-client systemd-logind[1023]: New session 432 of user root. Oct 10 16:05:55 oleg256-client sshd[107695]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:05:56 oleg256-client sshd[107708]: Received disconnect from 192.168.202.56 port 37048:11: disconnected by user Oct 10 16:05:56 oleg256-client sshd[107708]: Disconnected from user root 192.168.202.56 port 37048 Oct 10 16:05:56 oleg256-client sshd[107695]: pam_unix(sshd:session): session closed for user root Oct 10 16:05:56 oleg256-client systemd[1]: session-432.scope: Succeeded. Oct 10 16:05:56 oleg256-client systemd-logind[1023]: Session 432 logged out. Waiting for processes to exit. Oct 10 16:05:56 oleg256-client systemd-logind[1023]: Removed session 432. Oct 10 16:05:56 oleg256-client sshd[107832]: Accepted publickey for root from 192.168.202.56 port 37064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:56 oleg256-client systemd-logind[1023]: New session 433 of user root. Oct 10 16:05:56 oleg256-client systemd[1]: Started Session 433 of user root. Oct 10 16:05:56 oleg256-client sshd[107832]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:05:57 oleg256-client sshd[107845]: Received disconnect from 192.168.202.56 port 37064:11: disconnected by user Oct 10 16:05:57 oleg256-client sshd[107845]: Disconnected from user root 192.168.202.56 port 37064 Oct 10 16:05:57 oleg256-client sshd[107832]: pam_unix(sshd:session): session closed for user root Oct 10 16:05:57 oleg256-client systemd[1]: session-433.scope: Succeeded. Oct 10 16:05:57 oleg256-client systemd-logind[1023]: Session 433 logged out. Waiting for processes to exit. Oct 10 16:05:57 oleg256-client systemd-logind[1023]: Removed session 433. Oct 10 16:05:58 oleg256-client sshd[107977]: Accepted publickey for root from 192.168.202.56 port 37066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:58 oleg256-client systemd-logind[1023]: New session 434 of user root. Oct 10 16:05:58 oleg256-client systemd[1]: Started Session 434 of user root. Oct 10 16:05:58 oleg256-client sshd[107977]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:05:58 oleg256-client sshd[107990]: Received disconnect from 192.168.202.56 port 37066:11: disconnected by user Oct 10 16:05:58 oleg256-client sshd[107990]: Disconnected from user root 192.168.202.56 port 37066 Oct 10 16:05:58 oleg256-client sshd[107977]: pam_unix(sshd:session): session closed for user root Oct 10 16:05:58 oleg256-client systemd-logind[1023]: Session 434 logged out. Waiting for processes to exit. Oct 10 16:05:58 oleg256-client systemd[1]: session-434.scope: Succeeded. Oct 10 16:05:58 oleg256-client systemd-logind[1023]: Removed session 434. Oct 10 16:05:58 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:05:58 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:05:59 oleg256-client sshd[108130]: Accepted publickey for root from 192.168.202.56 port 37080 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:05:59 oleg256-client systemd-logind[1023]: New session 435 of user root. Oct 10 16:05:59 oleg256-client systemd[1]: Started Session 435 of user root. Oct 10 16:05:59 oleg256-client sshd[108130]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:06:00 oleg256-client kernel: Lustre: DEBUG MARKER: == sanity-lnet test complete, duration 1206 sec ========== 16:05:58 (1760126758) Oct 10 16:06:00 oleg256-client sshd[108143]: Received disconnect from 192.168.202.56 port 37080:11: disconnected by user Oct 10 16:06:00 oleg256-client sshd[108143]: Disconnected from user root 192.168.202.56 port 37080 Oct 10 16:06:00 oleg256-client sshd[108130]: pam_unix(sshd:session): session closed for user root Oct 10 16:06:00 oleg256-client systemd-logind[1023]: Session 435 logged out. Waiting for processes to exit. Oct 10 16:06:00 oleg256-client systemd[1]: session-435.scope: Succeeded. Oct 10 16:06:00 oleg256-client systemd-logind[1023]: Removed session 435. Oct 10 16:06:00 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:06:00 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:06:01 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:06:01 oleg256-client systemd-udevd[108236]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:06:01 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:06:10 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:06:10 oleg256-client systemd-udevd[108590]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:06:10 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:06:10 oleg256-client kernel: Key type ._llcrypt registered Oct 10 16:06:10 oleg256-client kernel: Key type .llcrypt registered Oct 10 16:06:11 oleg256-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Oct 10 16:06:11 oleg256-client kernel: alg: No test for adler32 (adler32-zlib) Oct 10 16:06:12 oleg256-client kernel: Lustre: Lustre: Build Version: 2.16.58_106_g01a4b29 Oct 10 16:06:12 oleg256-client kernel: LNet: Added LNI 192.168.202.56@tcp [8/256/0/180] Oct 10 16:06:14 oleg256-client kernel: Key type lgssc registered Oct 10 16:06:14 oleg256-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ Oct 10 16:07:03 oleg256-client systemd-udevd[110098]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Oct 10 16:07:04 oleg256-client kernel: Lustre: Mounted lustre-client Oct 10 16:07:06 oleg256-client sshd[110149]: Accepted publickey for root from 192.168.202.56 port 49694 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:07:06 oleg256-client systemd[1]: Started Session 436 of user root. Oct 10 16:07:06 oleg256-client systemd-logind[1023]: New session 436 of user root. Oct 10 16:07:06 oleg256-client sshd[110149]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:07:06 oleg256-client sshd[110162]: Received disconnect from 192.168.202.56 port 49694:11: disconnected by user Oct 10 16:07:06 oleg256-client sshd[110162]: Disconnected from user root 192.168.202.56 port 49694 Oct 10 16:07:06 oleg256-client sshd[110149]: pam_unix(sshd:session): session closed for user root Oct 10 16:07:06 oleg256-client systemd[1]: session-436.scope: Succeeded. Oct 10 16:07:06 oleg256-client systemd-logind[1023]: Session 436 logged out. Waiting for processes to exit. Oct 10 16:07:06 oleg256-client systemd-logind[1023]: Removed session 436. Oct 10 16:07:08 oleg256-client sshd[110332]: Accepted publickey for root from 192.168.202.56 port 49702 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:07:08 oleg256-client systemd-logind[1023]: New session 437 of user root. Oct 10 16:07:08 oleg256-client systemd[1]: Started Session 437 of user root. Oct 10 16:07:08 oleg256-client sshd[110332]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:07:08 oleg256-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Oct 10 16:07:08 oleg256-client sshd[110345]: Received disconnect from 192.168.202.56 port 49702:11: disconnected by user Oct 10 16:07:08 oleg256-client sshd[110345]: Disconnected from user root 192.168.202.56 port 49702 Oct 10 16:07:08 oleg256-client sshd[110332]: pam_unix(sshd:session): session closed for user root Oct 10 16:07:08 oleg256-client systemd[1]: session-437.scope: Succeeded. Oct 10 16:07:08 oleg256-client systemd-logind[1023]: Session 437 logged out. Waiting for processes to exit. Oct 10 16:07:08 oleg256-client systemd-logind[1023]: Removed session 437. Oct 10 16:07:09 oleg256-client sshd[110464]: Accepted publickey for root from 192.168.202.56 port 49714 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Oct 10 16:07:09 oleg256-client systemd[1]: Started Session 438 of user root. Oct 10 16:07:09 oleg256-client systemd-logind[1023]: New session 438 of user root. Oct 10 16:07:09 oleg256-client sshd[110464]: pam_unix(sshd:session): session opened for user root by (uid=0) Oct 10 16:07:09 oleg256-client sshd[110477]: Received disconnect from 192.168.202.56 port 49714:11: disconnected by user Oct 10 16:07:09 oleg256-client sshd[110477]: Disconnected from user root 192.168.202.56 port 49714 Oct 10 16:07:09 oleg256-client sshd[110464]: pam_unix(sshd:session): session closed for user root Oct 10 16:07:09 oleg256-client systemd[1]: session-438.scope: Succeeded. Oct 10 16:07:09 oleg256-client systemd-logind[1023]: Session 438 logged out. Waiting for processes to exit. Oct 10 16:07:09 oleg256-client systemd-logind[1023]: Removed session 438. Oct 10 16:07:20 oleg256-client systemd[1]: mnt-lustre.mount: Succeeded. Oct 10 16:07:20 oleg256-client kernel: LustreError: 110615:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9a4c206c3000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Oct 10 16:07:20 oleg256-client kernel: LustreError: 110615:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup Oct 10 16:07:20 oleg256-client kernel: Lustre: Unmounted lustre-client Oct 10 16:07:39 oleg256-client kernel: Key type lgssc unregistered Oct 10 16:07:40 oleg256-client kernel: LNet: 111095:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Oct 10 16:07:40 oleg256-client kernel: LNetError: 111095:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Oct 10 16:07:40 oleg256-client kernel: LNet: Removed LNI 192.168.202.56@tcp Oct 10 16:07:40 oleg256-client kernel: Key type .llcrypt unregistered Oct 10 16:07:40 oleg256-client kernel: Key type ._llcrypt unregistered Oct 10 16:07:41 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event0 (Power Button) Oct 10 16:07:41 oleg256-client systemd-udevd[111168]: Using default interface naming scheme 'rhel-8.0'. Oct 10 16:07:41 oleg256-client systemd-logind[1023]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Oct 10 16:07:48 oleg256-client systemd[1]: usr-sbin-mount.lustre.mount: Succeeded. Oct 10 16:07:48 oleg256-client sshd[1552]: Received disconnect from 192.168.200.253 port 39758:11: disconnected by user Oct 10 16:07:48 oleg256-client sshd[1552]: Disconnected from user root 192.168.200.253 port 39758 Oct 10 16:07:48 oleg256-client sshd[1528]: pam_unix(sshd:session): session closed for user root Oct 10 16:07:48 oleg256-client systemd[1]: session-3.scope: Succeeded. Oct 10 16:07:48 oleg256-client systemd-logind[1023]: Session 3 logged out. Waiting for processes to exit. Oct 10 16:07:48 oleg256-client systemd-logind[1023]: Removed session 3.