== conf-sanity test 46b: online OST and MDT addition ===== 18:47:46 (1712357266) Testing with 2 OSTs and 1 MDT(s) Stopping clients: oleg349-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg349-client.virtnet /mnt/lustre2 (opts:-f) oleg349-server: oleg349-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg349-server' oleg349-server: oleg349-server.virtnet: executing load_modules_local oleg349-server: Loading modules from /home/green/git/lustre-release/lustre oleg349-server: detected 4 online CPUs by sysfs oleg349-server: Force libcfs to create 2 CPU partitions oleg349-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg349-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg349-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg349-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg349-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg349-server: oleg349-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg349-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg349-client.virtnet: -o user_xattr,flock oleg349-server@tcp:/lustre /mnt/lustre lmv.lustre-clilmv-ffff8800b7895000.qos_maxage=10 max copy 94460 KiB, should be 94464 KiB available: /etc /usr/lib/python3.6 /usr/lib/udev /usr/lib/python2.7 /usr/lib/systemd /usr/lib/gcc /usr/lib/libptlctl.a /usr/lib/polkit-1 /usr/lib/tuned /usr/lib/tmpfiles.d /usr/lib/binfmt.d /usr/lib/libcfsutil.a /usr/lib/fontconfig /usr/lib/yum-plugins /usr/lib/kdump /usr/lib/kernel /usr/lib/debug /usr/lib/sysctl.d /usr/lib/NetworkManager /usr/lib/modprobe.d /usr/lib/sendmail.postfix /usr/lib/sendmail /usr/lib/cpp fail_val=1 debug=all debug_mb=150 debug=all debug_mb=150 rsync /etc/request-key.d->/mnt/lustre/d46b.conf-sanity/etc/request-key.d: lustre-MDT0000 rsync /etc/firewalld->/mnt/lustre/d46b.conf-sanity/etc/firewalld: lustre-MDT0000 rsync /etc/xdg->/mnt/lustre/d46b.conf-sanity/etc/xdg: lustre-MDT0000 Starting ost2: -o localrecov lustre-ost2/ost2 /mnt/lustre-ost2 rsync /etc/sasl2->/mnt/lustre/d46b.conf-sanity/etc/sasl2: lustre-MDT0000 rsync /etc/sysctl.d->/mnt/lustre/d46b.conf-sanity/etc/sysctl.d: lustre-MDT0000 seq.cli-lustre-OST0001-super.width=65536 rsync /etc/lustre->/mnt/lustre/d46b.conf-sanity/etc/lustre: lustre-MDT0000 oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all rsync /etc/rwtab.d->/mnt/lustre/d46b.conf-sanity/etc/rwtab.d: lustre-MDT0000 pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 Commit the device label on lustre-ost2/ost2 rsync /etc/subversion->/mnt/lustre/d46b.conf-sanity/etc/subversion: lustre-MDT0000 rsync /etc/ld.so.conf.d->/mnt/lustre/d46b.conf-sanity/etc/ld.so.conf.d: lustre-MDT0000 Started lustre-OST0001 OST2 addition finished mount lustre on /mnt/lustre2..... Starting client: oleg349-client.virtnet: -o user_xattr,flock oleg349-server@tcp:/lustre /mnt/lustre2 rsync /etc/binfmt.d->/mnt/lustre/d46b.conf-sanity/etc/binfmt.d: lustre-MDT0000 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 3456 378112 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 382976 3072 372736 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 382976 3072 362496 1% /mnt/lustre2[OST:1] filesystem_summary: 765952 6144 735232 1% /mnt/lustre2 lfs mkdir: dirstripe error on '/mnt/lustre2/d46b.conf-sanity.2': No such device lfs setdirstripe: cannot create dir '/mnt/lustre2/d46b.conf-sanity.2': No such device conf-sanity test_46b: @@@@@@ FAIL: mkdir -i 1 -c -1 /mnt/lustre2/d46b.conf-sanity.2 failed rsync /etc/modules-load.d->/mnt/lustre2/d46b.conf-sanity/etc/modules-load.d: lustre-MDT0000 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6974:error() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4225:test_46b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7314:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7374:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7185:run_test() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4290:main() Dumping lctl log to /tmp/testlogs//conf-sanity.test_46b.*.1712357319.log rsync /etc/dnsmasq.d->/mnt/lustre/d46b.conf-sanity/etc/dnsmasq.d: lustre-MDT0000 rsync /etc/tmpfiles.d->/mnt/lustre2/d46b.conf-sanity/etc/tmpfiles.d: lustre-MDT0000 rsync /etc/iproute2->/mnt/lustre/d46b.conf-sanity/etc/iproute2: lustre-MDT0000 debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout rsync /etc/security->/mnt/lustre2/d46b.conf-sanity/etc/security: lustre-MDT0000 debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4661: 15993 Killed rsync -az -e ssh $node:${prefix}.'*'.${suffix} $LOGDIR debug_mb=21 debug_mb=21 umount lustre on /mnt/lustre2..... Stopping client oleg349-client.virtnet /mnt/lustre2 (opts:) umount lustre on /mnt/lustre..... Stopping client oleg349-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost2 (opts:-f) on oleg349-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg349-server