-----============= acceptance-small: conf-sanity ============----- Wed Aug 20 09:12:06 EDT 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg357-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg357-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg357-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg357-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg357-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg357-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg357-server oleg357-server: oleg357-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg357-server' oleg357-server: oleg357-server.virtnet: executing load_modules_local oleg357-server: Loading modules from /home/green/git/lustre-release/lustre oleg357-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy oleg357-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy oleg357-server: detected 4 online CPUs by sysfs oleg357-server: MODOPTS_LIBCFS= oleg357-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg357-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg357-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg357-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg357-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg357-server: oleg357-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg357-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg357-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg357-server stop mds service on oleg357-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg357-server == conf-sanity test 45: long unlink handling in ptlrpcd == 09:13:01 (1755695581) start mds service on oleg357-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg357-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg357-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Started lustre-OST0000 oleg357-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg357-client.virtnet: -o user_xattr,flock 192.168.203.157@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg357-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg357-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... umount: /mnt/lustre: target is busy. df: /mnt/lustre: Input/output error conf-sanity test_45: @@@@@@ FAIL: manual_umount_client failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7363:error() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4409:test_45() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7740:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7803:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7602:run_test() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:4415:main() Dumping lctl log to /tmp/testlogs//conf-sanity.test_45.*.1755695680.log rsync: chown "/tmp/testlogs/.conf-sanity.test_45.debug_log.oleg357-server.1755695680.log.ntR2ZR" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.conf-sanity.test_45.dmesg.oleg357-server.1755695680.log.ZpufPt" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 45 (100s) == conf-sanity test 69: replace an OST with the same index ========================================================== 09:14:43 (1755695683) start mds service on oleg357-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg357-server: oleg357-server.virtnet: executing set_default_debug -1 all pdsh@oleg357-client: oleg357-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg357-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid rpc test_69: @@@@@@ FAIL: can't put import for mdc.lustre-MDT0000-mdc-*.mds_server_uuid into FULL state after 1475 sec, have DISCONN Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7363:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:8884:_wait_import_state() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:8906:wait_import_state() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:8916:wait_import_state_mount() = /home/green/git/lustre-release/lustre/tests/rpc.sh:20:main() rsync: chown "/tmp/testlogs/.rpc.test_69.debug_log.oleg357-server.1755697219.log.NYhxGH" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.rpc.test_69.dmesg.oleg357-server.1755697219.log.g89UdZ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] oleg357-client.virtnet: Dumping lctl log to /tmp/testlogs//rpc.test_69.*.1755697219.log conf-sanity test_69: @@@@@@ FAIL: import is not in FULL state Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7363:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:9162:wait_clients_import_state() = /home/green/git/lustre-release/lustre/tests/conf-sanity-framework.sh:113:start_mds() = /home/green/git/lustre-release/lustre/tests/conf-sanity-framework.sh:188:setup() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:6075:test_69() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7740:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7803:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7602:run_test() = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:6165:main() Dumping lctl log to /tmp/testlogs//conf-sanity.test_69.*.1755697221.log rsync: chown "/tmp/testlogs/.conf-sanity.test_69.debug_log.oleg357-server.1755697221.log.8JLJhB" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.conf-sanity.test_69.dmesg.oleg357-server.1755697221.log.Oe21bl" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 69 (1539s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 09:40:24 (1755697224) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (1s) Stopping clients: oleg357-client.virtnet /mnt/lustre (opts:-f) lsof: WARNING: can't stat() lustre file system /mnt/lustre Output information may be incomplete. lsof: status error on /mnt/lustre: Cannot send after transport endpoint shutdown lsof 4.93.2 latest revision: https://github.com/lsof-org/lsof latest FAQ: https://github.com/lsof-org/lsof/blob/master/00FAQ latest (non-formatted) man page: https://github.com/lsof-org/lsof/blob/master/Lsof.8 usage: [-?abhKlnNoOPRtUvVX] [+|-c c] [+|-d s] [+D D] [+|-E] [+|-e s] [+|-f[gG]] [-F [f]] [-g [s]] [-i [i]] [+|-L [l]] [+m [m]] [+|-M] [-o [o]] [-p s] [+|-r [t]] [-s [p:s]] [-S [t]] [-T [t]] [-u s] [+|-w] [-x [fl]] [--] [names] Use the ``-h'' option to get more help information. Stopping client oleg357-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg357-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg357-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg357-server oleg357-server: oleg357-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg357-server' oleg357-server: oleg357-server.virtnet: executing load_modules_local oleg357-server: Loading modules from /home/green/git/lustre-release/lustre oleg357-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy oleg357-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy oleg357-server: detected 4 online CPUs by sysfs oleg357-server: MODOPTS_LIBCFS= oleg357-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 1730 sec ========== 09:40:56 (1755697256) conf-sanity: FAIL: test_45 manual_umount_client failed conf-sanity: FAIL: test_69 import is not in FULL state === conf-sanity: start cleanup 09:40:56 (1755697256) === === conf-sanity: finish cleanup 09:40:58 (1755697258) ===