== conf-sanity test 46b: online OST and MDT addition ===== 18:47:40 (1712357260) Testing with 2 OSTs and 1 MDT(s) Stopping clients: oleg312-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:-f) oleg312-server: oleg312-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: detected 4 online CPUs by sysfs oleg312-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg312-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg312-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg312-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg312-server: oleg312-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg312-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg312-client.virtnet: -o user_xattr,flock oleg312-server@tcp:/lustre /mnt/lustre lmv.lustre-clilmv-ffff8800b6215000.qos_maxage=10 max copy 94460 KiB, should be 94464 KiB available: /etc /usr/lib/python3.6 /usr/lib/udev /usr/lib/python2.7 /usr/lib/systemd /usr/lib/gcc /usr/lib/libptlctl.a /usr/lib/polkit-1 /usr/lib/tuned /usr/lib/tmpfiles.d /usr/lib/binfmt.d /usr/lib/libcfsutil.a /usr/lib/fontconfig /usr/lib/yum-plugins /usr/lib/kdump /usr/lib/kernel /usr/lib/debug /usr/lib/sysctl.d /usr/lib/NetworkManager /usr/lib/modprobe.d /usr/lib/sendmail.postfix /usr/lib/sendmail /usr/lib/cpp fail_val=1 debug=all debug_mb=150 debug=all debug_mb=150 rsync /etc/request-key.d->/mnt/lustre/d46b.conf-sanity/etc/request-key.d: lustre-MDT0000 rsync /etc/firewalld->/mnt/lustre/d46b.conf-sanity/etc/firewalld: lustre-MDT0000 rsync /etc/xdg->/mnt/lustre/d46b.conf-sanity/etc/xdg: lustre-MDT0000 Starting ost2: -o localrecov lustre-ost2/ost2 /mnt/lustre-ost2 rsync /etc/sasl2->/mnt/lustre/d46b.conf-sanity/etc/sasl2: lustre-MDT0000 rsync /etc/sysctl.d->/mnt/lustre/d46b.conf-sanity/etc/sysctl.d: lustre-MDT0000 seq.cli-lustre-OST0001-super.width=65536 rsync /etc/lustre->/mnt/lustre/d46b.conf-sanity/etc/lustre: lustre-MDT0000 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all rsync /etc/rwtab.d->/mnt/lustre/d46b.conf-sanity/etc/rwtab.d: lustre-MDT0000 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Commit the device label on lustre-ost2/ost2 rsync /etc/subversion->/mnt/lustre/d46b.conf-sanity/etc/subversion: lustre-MDT0000 rsync /etc/ld.so.conf.d->/mnt/lustre/d46b.conf-sanity/etc/ld.so.conf.d: lustre-MDT0000 Started lustre-OST0001 OST2 addition finished mount lustre on /mnt/lustre2..... Starting client: oleg312-client.virtnet: -o user_xattr,flock oleg312-server@tcp:/lustre /mnt/lustre2 rsync /etc/binfmt.d->/mnt/lustre/d46b.conf-sanity/etc/binfmt.d: lustre-MDT0000 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 3456 378112 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 382976 3072 372736 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 382976 3072 362496 1% /mnt/lustre2[OST:1] filesystem_summary: 765952 6144 735232 1% /mnt/lustre2 lfs mkdir: dirstripe error on '/mnt/lustre2/d46b.conf-sanity.2': No such device lfs setdirstripe: cannot create dir '/mnt/lustre2/d46b.conf-sanity.2': No such device conf-sanity test_46b: @@@@@@ FAIL: mkdir -i 1 -c -1 /mnt/lustre2/d46b.conf-sanity.2 failed rsync /etc/modules-load.d->/mnt/lustre2/d46b.conf-sanity/etc/modules-load.d: lustre-MDT0000 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6974:error() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4225:test_46b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7314:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7374:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7185:run_test() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4290:main() Dumping lctl log to /tmp/testlogs//conf-sanity.test_46b.*.1712357313.log rsync /etc/dnsmasq.d->/mnt/lustre/d46b.conf-sanity/etc/dnsmasq.d: lustre-MDT0000 rsync /etc/tmpfiles.d->/mnt/lustre/d46b.conf-sanity/etc/tmpfiles.d: lustre-MDT0000 rsync /etc/iproute2->/mnt/lustre2/d46b.conf-sanity/etc/iproute2: lustre-MDT0000 rsync /etc/security->/mnt/lustre2/d46b.conf-sanity/etc/security: lustre-MDT0000 debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4661: 16011 Killed rsync -az -e ssh $node:${prefix}.'*'.${suffix} $LOGDIR debug_mb=21 debug_mb=21 umount lustre on /mnt/lustre2..... Stopping client oleg312-client.virtnet /mnt/lustre2 (opts:) umount lustre on /mnt/lustre..... Stopping client oleg312-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost2 (opts:-f) on oleg312-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg312-server