-----============= acceptance-small: conf-sanity ============----- Fri Apr 5 18:46:32 EDT 2024 excepting tests: 32newtarball 110 skipping tests SLOW=no: 45 69 106 111 114 Stopping clients: oleg357-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg357-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg357-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg357-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg357-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg357-server oleg357-server: oleg357-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory loading modules on: 'oleg357-server' oleg357-server: oleg357-server.virtnet: executing load_modules_local oleg357-server: Loading modules from /home/green/git/lustre-release/lustre oleg357-server: detected 4 online CPUs by sysfs oleg357-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg357-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg357-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg357-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg357-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg357-server: oleg357-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg357-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg357-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg357-server stop mds service on oleg357-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg357-server debug_raw_pointers=Y debug_raw_pointers=Y == conf-sanity test 46b: online OST and MDT addition ===== 18:48:08 (1712357288) Testing with 2 OSTs and 1 MDT(s) Stopping clients: oleg357-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg357-client.virtnet /mnt/lustre2 (opts:-f) oleg357-server: oleg357-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg357-server' oleg357-server: oleg357-server.virtnet: executing load_modules_local oleg357-server: Loading modules from /home/green/git/lustre-release/lustre oleg357-server: detected 4 online CPUs by sysfs oleg357-server: Force libcfs to create 2 CPU partitions oleg357-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg357-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg357-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg357-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg357-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg357-server: oleg357-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg357-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg357-client.virtnet: -o user_xattr,flock oleg357-server@tcp:/lustre /mnt/lustre lmv.lustre-clilmv-ffff8800b4290000.qos_maxage=10 max copy 94460 KiB, should be 94464 KiB available: /etc /usr/lib/python3.6 /usr/lib/udev /usr/lib/python2.7 /usr/lib/systemd /usr/lib/gcc /usr/lib/libptlctl.a /usr/lib/polkit-1 /usr/lib/tuned /usr/lib/tmpfiles.d /usr/lib/binfmt.d /usr/lib/libcfsutil.a /usr/lib/fontconfig /usr/lib/yum-plugins /usr/lib/kdump /usr/lib/kernel /usr/lib/debug /usr/lib/sysctl.d /usr/lib/NetworkManager /usr/lib/modprobe.d /usr/lib/sendmail.postfix /usr/lib/sendmail /usr/lib/cpp fail_val=1 debug=all debug_mb=150 debug=all debug_mb=150 rsync /etc/request-key.d->/mnt/lustre/d46b.conf-sanity/etc/request-key.d: lustre-MDT0000 rsync /etc/firewalld->/mnt/lustre/d46b.conf-sanity/etc/firewalld: lustre-MDT0000 rsync /etc/xdg->/mnt/lustre/d46b.conf-sanity/etc/xdg: lustre-MDT0000 Starting ost2: -o localrecov lustre-ost2/ost2 /mnt/lustre-ost2 rsync /etc/sasl2->/mnt/lustre/d46b.conf-sanity/etc/sasl2: lustre-MDT0000 rsync /etc/sysctl.d->/mnt/lustre/d46b.conf-sanity/etc/sysctl.d: lustre-MDT0000 seq.cli-lustre-OST0001-super.width=65536 rsync /etc/lustre->/mnt/lustre/d46b.conf-sanity/etc/lustre: lustre-MDT0000 rsync /etc/rwtab.d->/mnt/lustre/d46b.conf-sanity/etc/rwtab.d: lustre-MDT0000 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Commit the device label on lustre-ost2/ost2 rsync /etc/subversion->/mnt/lustre/d46b.conf-sanity/etc/subversion: lustre-MDT0000 rsync /etc/ld.so.conf.d->/mnt/lustre/d46b.conf-sanity/etc/ld.so.conf.d: lustre-MDT0000 Started lustre-OST0001 OST2 addition finished mount lustre on /mnt/lustre2..... Starting client: oleg357-client.virtnet: -o user_xattr,flock oleg357-server@tcp:/lustre /mnt/lustre2 rsync /etc/binfmt.d->/mnt/lustre2/d46b.conf-sanity/etc/binfmt.d: lustre-MDT0000 rsync /etc/modules-load.d->/mnt/lustre/d46b.conf-sanity/etc/modules-load.d: lustre-MDT0000 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 3456 378112 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 382976 3072 368640 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 382976 3072 362496 1% /mnt/lustre2[OST:1] filesystem_summary: 765952 6144 731136 1% /mnt/lustre2 lfs mkdir: dirstripe error on '/mnt/lustre2/d46b.conf-sanity.2': No such device lfs setdirstripe: cannot create dir '/mnt/lustre2/d46b.conf-sanity.2': No such device conf-sanity test_46b: @@@@@@ FAIL: mkdir -i 1 -c -1 /mnt/lustre2/d46b.conf-sanity.2 failed rsync /etc/dnsmasq.d->/mnt/lustre2/d46b.conf-sanity/etc/dnsmasq.d: lustre-MDT0000 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6974:error() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4225:test_46b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7314:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7374:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7185:run_test() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4290:main() Dumping lctl log to /tmp/testlogs//conf-sanity.test_46b.*.1712357343.log rsync /etc/tmpfiles.d->/mnt/lustre2/d46b.conf-sanity/etc/tmpfiles.d: lustre-MDT0000 rsync /etc/iproute2->/mnt/lustre/d46b.conf-sanity/etc/iproute2: lustre-MDT0000 rsync /etc/security->/mnt/lustre/d46b.conf-sanity/etc/security: lustre-MDT0000 debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1: 16183 Killed rsync -az -e ssh $node:${prefix}.'*'.${suffix} $LOGDIR debug_mb=21 debug_mb=21 umount lustre on /mnt/lustre2..... Stopping client oleg357-client.virtnet /mnt/lustre2 (opts:) umount lustre on /mnt/lustre..... Stopping client oleg357-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost2 (opts:-f) on oleg357-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg357-server FAIL 46b (77s) debug_raw_pointers=0 debug_raw_pointers=0 Stopping clients: oleg357-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg357-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg357-server oleg357-server: oleg357-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg357-server' oleg357-server: oleg357-server.virtnet: executing load_modules_local oleg357-server: Loading modules from /home/green/git/lustre-release/lustre oleg357-server: detected 4 online CPUs by sysfs oleg357-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 197 sec =========== 18:49:50 (1712357390) conf-sanity: FAIL: test_46b mkdir -i 1 -c -1 /mnt/lustre2/d46b.conf-sanity.2 failed === conf-sanity: start cleanup 18:49:50 (1712357390) === === conf-sanity: finish cleanup 18:49:50 (1712357390) ===