-----============= acceptance-small: conf-sanity ============----- Thu Apr 30 14:09:54 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg102-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg102-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg102-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg102-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg102-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg102-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg102-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg102-server oleg102-server: oleg102-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg102-server' oleg102-server: oleg102-server.virtnet: executing load_modules_local oleg102-server: Loading modules from /home/green/git/lustre-release/lustre oleg102-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg102-server: detected 4 online CPUs by sysfs oleg102-server: MODOPTS_LIBCFS= oleg102-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg102-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg102-server: oleg102-server.virtnet: executing set_default_debug -1 all pdsh@oleg102-client: oleg102-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg102-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg102-server: oleg102-server.virtnet: executing set_default_debug -1 all pdsh@oleg102-client: oleg102-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg102-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg102-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg102-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg102-server: oleg102-server.virtnet: executing set_default_debug -1 all pdsh@oleg102-client: oleg102-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg102-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg102-server: oleg102-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg102-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg102-server: oleg102-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg102-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg102-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg102-server stop mds service on oleg102-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg102-server stop mds service on oleg102-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg102-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 14:11:30 (1777572690) start mds service on oleg102-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg102-server: oleg102-server.virtnet: executing set_default_debug -1 all pdsh@oleg102-client: oleg102-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg102-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg102-server: oleg102-server.virtnet: executing set_default_debug -1 all pdsh@oleg102-client: oleg102-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg102-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg102-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg102-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg102-server: oleg102-server.virtnet: executing set_default_debug -1 all pdsh@oleg102-client: oleg102-server: ssh exited with exit code 1 Started lustre-OST0000 oleg102-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg102-client.virtnet: -o user_xattr,flock 192.168.201.102@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 432 49568 1% /mnt/lustre[OST:0] filesystem_summary: 50097 529 49568 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 1556 (time 1777572737.99 total 10.01 last 155.46) - open/close/unlink 3190 (time 1777572748.00 total 20.01 last 163.34) - open/close/unlink 5013 (time 1777572758.00 total 30.01 last 182.29) - open/close/unlink 6866 (time 1777572768.01 total 40.02 last 185.11) - open/close/unlink 8765 (time 1777572778.02 total 50.04 last 189.64) - open/close/unlink 10000 (time 1777572784.51 total 56.53 last 190.33) - open/close/unlink 12052 (time 1777572794.51 total 66.53 last 205.13) - open/close/unlink 14190 (time 1777572804.51 total 76.53 last 213.75) - open/close/unlink 16155 (time 1777572814.52 total 86.53 last 196.46) - open/close/unlink 18431 (time 1777572824.52 total 96.54 last 227.55) - open/close/unlink 20000 (time 1777572832.30 total 104.32 last 201.61) - open/close/unlink 21766 (time 1777572842.30 total 114.32 last 176.57) - open/close/unlink 23995 (time 1777572852.31 total 124.32 last 222.82) - open/close/unlink 26216 (time 1777572862.31 total 134.32 last 222.10) - open/close/unlink 28337 (time 1777572872.31 total 144.33 last 212.05) - open/close/unlink 30000 (time 1777572880.02 total 152.04 last 215.57) - open/close/unlink 32046 (time 1777572890.04 total 162.05 last 204.34) - open/close/unlink 34190 (time 1777572900.05 total 172.07 last 214.10) - open/close/unlink 36295 (time 1777572910.05 total 182.07 last 210.47) - open/close/unlink 38457 (time 1777572920.06 total 192.07 last 216.12) - open/close/unlink 40000 (time 1777572927.64 total 199.65 last 203.56) - open/close/unlink 42063 (time 1777572937.64 total 209.65 last 206.30) - open/close/unlink 44131 (time 1777572947.64 total 219.66 last 206.74) - open/close/unlink 46309 (time 1777572957.64 total 229.66 last 217.78) - open/close/unlink 48423 (time 1777572967.64 total 239.66 last 211.38) - open/close/unlink 50000 (time 1777572975.37 total 247.38 last 204.12) - open/close/unlink 51901 (time 1777572985.37 total 257.39 last 190.02) - open/close/unlink 53972 (time 1777572995.38 total 267.40 last 206.86) - open/close/unlink 56022 (time 1777573005.38 total 277.40 last 204.99) - open/close/unlink 58137 (time 1777573015.39 total 287.40 last 211.44) - open/close/unlink 60000 (time 1777573024.43 total 296.45 last 206.01) - open/close/unlink 62076 (time 1777573034.43 total 306.45 last 207.59) - open/close/unlink 64164 (time 1777573044.43 total 316.45 last 208.73) total: 64768 open/close/unlink in 319.46 seconds: 202.74 ops/second - open/close/unlink 1552 (time 1777572737.94 total 10.02 last 154.92) - open/close/unlink 3189 (time 1777572747.94 total 20.02 last 163.63) - open/close/unlink 5037 (time 1777572757.94 total 30.02 last 184.77) - open/close/unlink 6876 (time 1777572767.95 total 40.03 last 183.80) - open/close/unlink 8783 (time 1777572777.96 total 50.04 last 190.52) - open/close/unlink 10000 (time 1777572784.47 total 56.55 last 186.86) - open/close/unlink 12091 (time 1777572794.47 total 66.55 last 209.09) - open/close/unlink 14241 (time 1777572804.47 total 76.55 last 215.00) - open/close/unlink 16239 (time 1777572814.47 total 86.55 last 199.74) - open/close/unlink 18479 (time 1777572824.48 total 96.56 last 223.89) - open/close/unlink 20000 (time 1777572832.00 total 104.08 last 202.20) - open/close/unlink 21759 (time 1777572842.02 total 114.10 last 175.65) - open/close/unlink 23994 (time 1777572852.02 total 124.10 last 223.47) - open/close/unlink 26206 (time 1777572862.02 total 134.10 last 221.05) - open/close/unlink 28317 (time 1777572872.03 total 144.11 last 210.91) - open/close/unlink 30000 (time 1777572879.71 total 151.79 last 219.20) - open/close/unlink 32055 (time 1777572889.72 total 161.80 last 205.36) - open/close/unlink 34201 (time 1777572899.72 total 171.80 last 214.58) - open/close/unlink 36285 (time 1777572909.72 total 181.80 last 208.33) - open/close/unlink 38357 (time 1777572919.72 total 191.80 last 207.18) - open/close/unlink 40000 (time 1777572927.60 total 199.68 last 208.50) - open/close/unlink 42062 (time 1777572937.61 total 209.69 last 206.16) - open/close/unlink 44125 (time 1777572947.61 total 219.69 last 206.28) - open/close/unlink 46282 (time 1777572957.61 total 229.69 last 215.67) - open/close/unlink 48312 (time 1777572967.61 total 239.69 last 202.95) - open/close/unlink 50000 (time 1777572975.96 total 248.04 last 202.17) - open/close/unlink 51964 (time 1777572985.96 total 258.04 last 196.35) - open/close/unlink 54024 (time 1777572995.96 total 268.04 last 205.98) - open/close/unlink 56097 (time 1777573005.97 total 278.05 last 207.22) - open/close/unlink 58095 (time 1777573015.97 total 288.05 last 199.76) - open/close/unlink 60000 (time 1777573025.02 total 297.10 last 210.56) - open/close/unlink 62032 (time 1777573035.02 total 307.10 last 203.14) - open/close/unlink 64240 (time 1777573045.02 total 317.10 last 220.75) total: 64768 open/close/unlink in 321.32 seconds: 201.57 ops/second - open/close/unlink 1529 (time 1777572737.94 total 10.01 last 152.75) - open/close/unlink 3155 (time 1777572747.94 total 20.01 last 162.57) - open/close/unlink 4991 (time 1777572757.95 total 30.02 last 183.38) - open/close/unlink 6851 (time 1777572767.96 total 40.03 last 185.84) - open/close/unlink 8754 (time 1777572777.98 total 50.05 last 189.93) - open/close/unlink 10000 (time 1777572784.57 total 56.64 last 189.07) - open/close/unlink 12068 (time 1777572794.57 total 66.64 last 206.78) - open/close/unlink 14294 (time 1777572804.57 total 76.64 last 222.56) - open/close/unlink 16343 (time 1777572814.57 total 86.65 last 204.89) - open/close/unlink 18583 (time 1777572824.58 total 96.65 last 223.93) - open/close/unlink 20000 (time 1777572831.67 total 103.74 last 199.70) - open/close/unlink 21762 (time 1777572841.67 total 113.75 last 176.17) - open/close/unlink 24015 (time 1777572851.68 total 123.75 last 225.22) - open/close/unlink 26241 (time 1777572861.68 total 133.75 last 222.57) - open/close/unlink 28329 (time 1777572871.68 total 143.75 last 208.79) - open/close/unlink 30000 (time 1777572879.48 total 151.55 last 214.18) - open/close/unlink 32092 (time 1777572889.49 total 161.56 last 209.01) - open/close/unlink 34212 (time 1777572899.49 total 171.56 last 211.96) - open/close/unlink 36276 (time 1777572909.49 total 181.57 last 206.34) - open/close/unlink 38373 (time 1777572919.50 total 191.57 last 209.61) - open/close/unlink 40000 (time 1777572927.41 total 199.48 last 205.66) - open/close/unlink 42012 (time 1777572937.41 total 209.48 last 201.16) - open/close/unlink 44058 (time 1777572947.41 total 219.49 last 204.57) - open/close/unlink 46210 (time 1777572957.41 total 229.49 last 215.16) - open/close/unlink 48287 (time 1777572967.47 total 239.54 last 206.64) - open/close/unlink 50000 (time 1777572975.66 total 247.74 last 208.96) - open/close/unlink 51925 (time 1777572985.67 total 257.74 last 192.46) - open/close/unlink 54006 (time 1777572995.67 total 267.74 last 208.06) - open/close/unlink 56045 (time 1777573005.68 total 277.75 last 203.72) - open/close/unlink 58076 (time 1777573015.68 total 287.75 last 203.08) - open/close/unlink 60000 (time 1777573024.93 total 297.00 last 207.96) - open/close/unlink 62057 (time 1777573034.93 total 307.01 last 205.63) - open/close/unlink 64163 (time 1777573044.93 total 317.01 last 210.57) total: 64768 open/close/unlink in 323.71 seconds: 200.08 ops/second - open/close/unlink 1561 (time 1777572737.93 total 10.00 last 156.02) - open/close/unlink 3174 (time 1777572747.93 total 20.01 last 161.27) - open/close/unlink 4994 (time 1777572757.94 total 30.01 last 181.96) - open/close/unlink 6844 (time 1777572767.95 total 40.02 last 184.78) - open/close/unlink 8739 (time 1777572777.95 total 50.02 last 189.47) - open/close/unlink 10000 (time 1777572784.62 total 56.69 last 189.15) - open/close/unlink 12079 (time 1777572794.62 total 66.69 last 207.85) - open/close/unlink 14249 (time 1777572804.62 total 76.69 last 216.96) - open/close/unlink 16292 (time 1777572814.63 total 86.70 last 204.21) - open/close/unlink 18521 (time 1777572824.63 total 96.70 last 222.81) - open/close/unlink 20000 (time 1777572831.86 total 103.94 last 204.44) - open/close/unlink 21767 (time 1777572841.87 total 113.94 last 176.64) - open/close/unlink 23991 (time 1777572851.87 total 123.94 last 222.36) - open/close/unlink 26220 (time 1777572861.87 total 133.94 last 222.90) - open/close/unlink 28274 (time 1777572871.87 total 143.94 last 205.38) - open/close/unlink 30000 (time 1777572879.72 total 151.79 last 220.03) - open/close/unlink 32068 (time 1777572889.72 total 161.79 last 206.80) - open/close/unlink 34215 (time 1777572899.72 total 171.79 last 214.63) - open/close/unlink 36335 (time 1777572909.72 total 181.79 last 211.99) - open/close/unlink 38432 (time 1777572919.72 total 191.79 last 209.69) - open/close/unlink 40000 (time 1777572927.50 total 199.57 last 201.51) - open/close/unlink 42058 (time 1777572937.50 total 209.57 last 205.76) - open/close/unlink 44117 (time 1777572947.51 total 219.58 last 205.84) - open/close/unlink 46315 (time 1777572957.51 total 229.58 last 219.79) - open/close/unlink 48356 (time 1777572967.51 total 239.58 last 204.03) - open/close/unlink 50000 (time 1777572975.70 total 247.77 last 200.82) - open/close/unlink 51957 (time 1777572985.70 total 257.77 last 195.67) - open/close/unlink 53996 (time 1777572995.70 total 267.77 last 203.84) - open/close/unlink 56061 (time 1777573005.70 total 277.77 last 206.46) - open/close/unlink 58089 (time 1777573015.71 total 287.78 last 202.71) - open/close/unlink 60000 (time 1777573024.91 total 296.99 last 207.55) - open/close/unlink 62037 (time 1777573034.92 total 306.99 last 203.61) - open/close/unlink 64129 (time 1777573044.92 total 316.99 last 209.17) total: 64768 open/close/unlink in 324.42 seconds: 199.64 ops/second - open/close/unlink 1547 (time 1777572737.85 total 10.01 last 154.59) - open/close/unlink 3170 (time 1777572747.85 total 20.01 last 162.26) - open/close/unlink 5001 (time 1777572757.85 total 30.01 last 183.03) - open/close/unlink 6846 (time 1777572767.86 total 40.02 last 184.45) - open/close/unlink 8755 (time 1777572777.86 total 50.02 last 190.81) - open/close/unlink 10000 (time 1777572784.53 total 56.69 last 186.66) - open/close/unlink 12051 (time 1777572794.54 total 66.70 last 204.99) - open/close/unlink 14162 (time 1777572804.54 total 76.70 last 211.02) - open/close/unlink 16183 (time 1777572814.54 total 86.70 last 202.04) - open/close/unlink 18418 (time 1777572824.54 total 96.71 last 223.44) - open/close/unlink 20000 (time 1777572832.33 total 104.49 last 203.18) - open/close/unlink 21754 (time 1777572842.33 total 114.49 last 175.37) - open/close/unlink 23994 (time 1777572852.34 total 124.50 last 223.92) - open/close/unlink 26160 (time 1777572862.34 total 134.50 last 216.59) - open/close/unlink 28289 (time 1777572872.34 total 144.50 last 212.89) - open/close/unlink 30000 (time 1777572880.23 total 152.40 last 216.65) - open/close/unlink 32038 (time 1777572890.24 total 162.40 last 203.72) - open/close/unlink 34168 (time 1777572900.34 total 172.50 last 210.87) - open/close/unlink 36237 (time 1777572910.34 total 182.50 last 206.83) - open/close/unlink 38317 (time 1777572920.35 total 192.51 last 207.92) - open/close/unlink 40000 (time 1777572928.51 total 200.68 last 206.04) - open/close/unlink 42071 (time 1777572938.52 total 210.68 last 207.00) - open/close/unlink 44086 (time 1777572948.52 total 220.68 last 201.44) - open/close/unlink 46259 (time 1777572958.53 total 230.69 last 217.17) - open/close/unlink 48358 (time 1777572968.53 total 240.69 last 209.87) - open/close/unlink 50000 (time 1777572976.41 total 248.57 last 208.31) - open/close/unlink 51919 (time 1777572986.42 total 258.58 last 191.82) - open/close/unlink 54024 (time 1777572996.42 total 268.58 last 210.44) - open/close/unlink 56084 (time 1777573006.42 total 278.58 last 205.96) - open/close/unlink 58173 (time 1777573016.42 total 288.58 last 208.86) - open/close/unlink 60000 (time 1777573025.25 total 297.41 last 207.03) - open/close/unlink 62047 (time 1777573035.25 total 307.42 last 204.58) - open/close/unlink 64126 (time 1777573045.26 total 317.42 last 207.88) total: 64768 open/close/unlink in 325.24 seconds: 199.14 ops/second Waiting for MDT destroys to complete oleg102-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg102-client: oleg102-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg102-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg102-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg102-server stop mds service on oleg102-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg102-server stop mds service on oleg102-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg102-server unloading modules via unload_modules_local on: 'oleg102-server' oleg102-server: oleg102-server.virtnet: executing unload_modules_local oleg102-server: modules unloaded. pdsh@oleg102-client: oleg102-client: ssh exited with exit code 2 pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 pdsh@oleg102-client: oleg102-client: ssh exited with exit code 2 pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 PASS 106 (396s) Stopping clients: oleg102-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg102-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg102-client: oleg102-server: ssh exited with exit code 2 oleg102-server: oleg102-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg102-server' oleg102-server: oleg102-server.virtnet: executing load_modules_local oleg102-server: Loading modules from /home/green/git/lustre-release/lustre oleg102-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg102-server: detected 4 online CPUs by sysfs oleg102-server: MODOPTS_LIBCFS= oleg102-server: Force libcfs to create 2 CPU partitions oleg102-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg102-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg102-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 516 sec =========== 14:18:31 (1777573111) === conf-sanity: start cleanup 14:18:32 (1777573112) ===