oleg401-server: Warning: Permanently added 'oleg401-server' (ECDSA) to the list of known hosts. pdsh@oleg401-client: oleg401-server: ssh exited with exit code 2 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 2 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 2 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 Started at Sun Dec 15 04:30:01 EST 2024 Lustre is not mounted, trying to do setup ... Stopping clients: oleg401-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg401-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 2 oleg401-server: oleg401-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg401-server' oleg401-server: oleg401-server.virtnet: executing load_modules_local oleg401-server: Loading modules from /home/green/git/lustre-release/lustre oleg401-server: detected 4 online CPUs by sysfs oleg401-server: Force libcfs to create 2 CPU partitions oleg401-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg401-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/vdc pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Format ost1: /dev/vde pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Format ost2: /dev/vdf pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg401-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg401-server' oleg401-server: oleg401-server.virtnet: executing load_modules_local oleg401-server: Loading modules from /home/green/git/lustre-release/lustre oleg401-server: detected 4 online CPUs by sysfs oleg401-server: Force libcfs to create 2 CPU partitions oleg401-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg401-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Setup mgs, mdt, osts pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg401-server: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Commit the device label on /dev/vdc Started lustre-MDT0000 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg401-server: mount.lustre: increased '/sys/devices/virtual/block/dm-1/queue/max_sectors_kb' from 512 to 16384 oleg401-server: mount.lustre: increased '/sys/devices/pci0000:00/0000:00:09.0/virtio5/block/vde/queue/max_sectors_kb' from 512 to 16384 seq.cli-lustre-OST0000-super.width=65536 oleg401-server: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0000 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg401-server: mount.lustre: increased '/sys/devices/virtual/block/dm-2/queue/max_sectors_kb' from 512 to 16384 oleg401-server: mount.lustre: increased '/sys/devices/pci0000:00/0000:00:0a.0/virtio6/block/vdf/queue/max_sectors_kb' from 512 to 16384 seq.cli-lustre-OST0001-super.width=65536 oleg401-server: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Commit the device label on /dev/vdf Started lustre-OST0001 Starting client: oleg401-client.virtnet: -o user_xattr,flock 192.168.204.101@tcp:/lustre /mnt/lustre Starting client oleg401-client.virtnet: -o user_xattr,flock 192.168.204.101@tcp:/lustre /mnt/lustre Started clients oleg401-client.virtnet: 192.168.204.101@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg401-client: Warning: Permanently added 'oleg401-client.virtnet' (ECDSA) to the list of known hosts. Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012aa72800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aa72800.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s for 'procname_uid' Updated after 2s: want 'procname_uid' got 'procname_uid' disable quota as required oleg401-server: oleg401-server.virtnet: executing check_logdir /tmp/testlogs/ oleg401-client: oleg401-client.virtnet: executing check_logdir /tmp/testlogs/ Logging to local directory: /tmp/testlogs/ oleg401-client: oleg401-client.virtnet: executing yml_node oleg401-server: oleg401-server.virtnet: executing yml_node Client: 2.16.50.90 MDS: 2.16.50.90 OSS: 2.16.50.90 running: conf-sanity-1 ONLY=17 18 21c 29 35a 35b 41b 46a 47a 47b 48 49a 49b 50c 50d 50f 50g 51 54a 55 56a 56b 57a 57b 59 60a 62 64 66 70e 75 78 79 83 86 87 89 93 100 104a 105 106 109a 109b 116 122a 123ah 132 133 135 136 137 140 151a 151b 153a 153b 153c 154 run_suite conf-sanity-1 /home/green/git/lustre-release/lustre/tests/conf-sanity-1.sh conf-sanity-1 returned 0 Stopping clients: oleg401-client.virtnet /mnt/lustre (opts:) Stopping clients: oleg401-client.virtnet /mnt/lustre2 (opts:) unloading modules via unload_modules_local on: 'oleg401-server' oleg401-server: oleg401-server.virtnet: executing unload_modules_local modules unloaded. Finished at Sun Dec 15 06:03:41 EST 2024 in 5630s /home/green/git/lustre-release/lustre/tests/auster: completed with rc 0