-----============= acceptance-small: sanity-lnet ============----- Wed May 20 16:23:45 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky Stopping clients: oleg213-client.virtnet /mnt/lustre (opts:) Stopping client oleg213-client.virtnet /mnt/lustre opts: Stopping clients: oleg213-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg213-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg213-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg213-server unloading modules via unload_modules_local on: 'oleg213-server' oleg213-server: oleg213-server.virtnet: executing unload_modules_local oleg213-server: modules unloaded. Writer error: failed to resolve Netlink family id Stopping clients: oleg213-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg213-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 LNET unconfigure error 22: Invalid argument unloading modules via unload_modules_local on: 'oleg213-server' oleg213-server: oleg213-server.virtnet: executing unload_modules_local oleg213-server: oleg213-server: LNET unconfigure error 22: Invalid argument modules unloaded. /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure -a /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net show net: - net type: lo local NI(s): - nid: 0@lo status: up - net type: tcp local NI(s): - nid: 192.168.202.13@tcp status: up interfaces: 0: ens2 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: ens2: mtu 9000 qdisc fq_codel state UP group default qlen 1000 link/ether 56:a8:44:9c:c4:7e brd ff:ff:ff:ff:ff:ff altname enp0s2 inet 192.168.202.13/24 brd 192.168.202.255 scope global dynamic ens2 valid_lft 59854sec preferred_lft 59854sec inet6 fe80::54a8:44ff:fe9c:c47e/64 scope link valid_lft forever preferred_lft forever oleg213-server: /home/green/git/lustre-release/lustre/tests/except/sanity-lnet.ex - see CLIENT_VERSION >= v2_16_51-17-g22ba71dccb8 (34682136 >= 34616081) for LU-18129, go 230 excepting tests: 253 254 410 Cleaning up LNet Writer error: failed to resolve Netlink family id unloading modules via unload_modules_local on: 'oleg213-server' oleg213-server: oleg213-server.virtnet: executing unload_modules_local oleg213-server: oleg213-server: LNET unconfigure error 22: Invalid argument modules unloaded. Total IP for ens2 found [1] Interface:IP are ens2:192.168.202.13 Using GW_NID:192.168.202.14@tcp == sanity-lnet test 229: Check NI status with lnetctl net disable/enable ========================================================== 16:24:24 (1779308664) Cleaning up LNet LNET unconfigure error 22: Invalid argument unloading modules via unload_modules_local on: 'oleg213-server' oleg213-server: oleg213-server.virtnet: executing unload_modules_local oleg213-server: oleg213-server: LNET unconfigure error 22: Invalid argument modules unloaded. ip link add 'test1pl' type veth peer name test1pg ip link set 'test1pl' up ip addr add "10.1.2.3/31" dev test1pg ip -6 addr add "2001:db8:0:f101::1/64" dev test1pg ip link set test1pg up Waiting 10s for '0' Updated after 2s: want '0' got '0' Loading LNet and configuring DLC /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl lnet configure /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if ens2 /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net add --net tcp --if test1pg default via 192.168.202.254 dev ens2 192.168.202.0/24 dev ens2 proto kernel scope link src 192.168.202.13 NI 192.168.202.13@tcp expect status "up" found "up" NI 10.1.2.3@tcp expect status "up" found "up" Disable test1pg via lnetctl net disable /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net disable --net tcp --if test1pg NI 192.168.202.13@tcp expect status "up" found "up" NI 10.1.2.3@tcp expect status "down" found "down" /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 192.168.202.13@tcp ping: - primary nid: 192.168.202.13@tcp Multi-Rail: false peer_ni: - nid: 192.168.202.13@tcp - nid: 10.1.2.3@tcp Re-enable test1pg via lnetctl net enable /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net enable --net tcp --if test1pg NI 192.168.202.13@tcp expect status "up" found "up" NI 10.1.2.3@tcp expect status "up" found "up" Disable ens2 via lnetctl net disable /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net disable --net tcp --if ens2 NI 192.168.202.13@tcp expect status "down" found "down" NI 10.1.2.3@tcp expect status "up" found "up" /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl ping 10.1.2.3@tcp ping: - primary nid: 10.1.2.3@tcp Multi-Rail: false peer_ni: - nid: 192.168.202.13@tcp - nid: 10.1.2.3@tcp Re-enable ens2 via lnetctl net enable /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net enable --net tcp --if ens2 NI 192.168.202.13@tcp expect status "up" found "up" NI 10.1.2.3@tcp expect status "up" found "up" Verify lnetctl net disable requires --net and --if /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net disable --net tcp Missing required --net or --if parameter /home/green/git/lustre-release/lustre/../lnet/utils/lnetctl net disable --if ens2 Missing required --net or --if parameter Writer error: failed to resolve Netlink family id unloading modules via unload_modules_local on: 'oleg213-server' oleg213-server: oleg213-server.virtnet: executing unload_modules_local oleg213-server: oleg213-server: LNET unconfigure error 22: Invalid argument modules unloaded. pdsh@oleg213-client: oleg213-client: ssh exited with exit code 2 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 2 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 2 pdsh@oleg213-client: oleg213-client: ssh exited with exit code 2 PASS 229 (12s) == sanity-lnet test complete, duration 50 sec ============ 16:24:36 (1779308676) Cleaning up LNet LNET unconfigure error 22: Invalid argument unloading modules via unload_modules_local on: 'oleg213-server' oleg213-server: oleg213-server.virtnet: executing unload_modules_local oleg213-server: oleg213-server: LNET unconfigure error 22: Invalid argument modules unloaded. Checking servers environments Checking clients oleg213-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg213-server' oleg213-server: oleg213-server.virtnet: executing load_modules_local oleg213-server: Loading modules from /home/green/git/lustre-release/lustre oleg213-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg213-server: detected 4 online CPUs by sysfs oleg213-server: MODOPTS_LIBCFS= oleg213-server: Force libcfs to create 2 CPU partitions oleg213-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg213-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg213-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Setup mgs, mdt, osts pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg213-server: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 Started lustre-MDT0000 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg213-server: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 Started lustre-OST0000 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg213-server: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client: oleg213-client.virtnet: -o user_xattr,flock 192.168.202.113@tcp:/lustre /mnt/lustre Starting client oleg213-client.virtnet: -o user_xattr,flock 192.168.202.113@tcp:/lustre /mnt/lustre Started clients oleg213-client.virtnet: 192.168.202.113@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff964e87c0b000.idle_timeout=debug osc.lustre-OST0001-osc-ffff964e87c0b000.idle_timeout=debug disable quota as required