-----============= acceptance-small: conf-sanity ============----- Thu Mar 5 19:44:14 EST 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg323-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg323-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg323-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg323-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg323-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg323-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg323-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg323-server oleg323-server: oleg323-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg323-server' oleg323-server: oleg323-server.virtnet: executing load_modules_local oleg323-server: Loading modules from /home/green/git/lustre-release/lustre oleg323-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg323-server: detected 4 online CPUs by sysfs oleg323-server: MODOPTS_LIBCFS= oleg323-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg323-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg323-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg323-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg323-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg323-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg323-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg323-server: oleg323-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg323-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg323-server: oleg323-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg323-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg323-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg323-server stop mds service on oleg323-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg323-server stop mds service on oleg323-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg323-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 19:46:23 (1772757983) Stopping clients: oleg323-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg323-client.virtnet /mnt/lustre2 (opts:-f) oleg323-server: oleg323-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg323-server' oleg323-server: oleg323-server.virtnet: executing load_modules_local oleg323-server: Loading modules from /home/green/git/lustre-release/lustre oleg323-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg323-server: detected 4 online CPUs by sysfs oleg323-server: MODOPTS_LIBCFS= oleg323-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg323-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg323-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg323-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg323-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg323-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg323-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg323-client.virtnet: -o user_xattr,flock 192.168.203.123@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 368 65440 1% /mnt/lustre[OST:0] filesystem_summary: 65969 529 65440 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 2065 (time 1772758037.68 total 10.01 last 206.36) - open/close 4900 (time 1772758047.68 total 20.01 last 283.48) - open/close 8536 (time 1772758057.68 total 30.01 last 363.57) - open/close 10000 (time 1772758061.98 total 34.30 last 340.73) - open/close 12829 (time 1772758071.98 total 44.31 last 282.82) - open/close 16807 (time 1772758081.98 total 54.31 last 397.77) - open/close 20000 (time 1772758089.97 total 62.30 last 399.65) - open/close 24357 (time 1772758099.97 total 72.30 last 435.69) - open/close 28898 (time 1772758109.98 total 82.30 last 454.04) - open/close 30000 (time 1772758112.38 total 84.71 last 457.94) - open/close 34617 (time 1772758122.38 total 94.71 last 461.67) - open/close 39319 (time 1772758132.38 total 104.71 last 470.13) - open/close 43990 (time 1772758142.39 total 114.71 last 467.03) - open/close 48470 (time 1772758152.39 total 124.71 last 447.95) - open/close 50000 (time 1772758156.06 total 128.38 last 416.57) - open/close 54109 (time 1772758166.06 total 138.38 last 410.90) - open/close 58400 (time 1772758176.06 total 148.38 last 429.05) - open/close 60000 (time 1772758179.48 total 151.80 last 468.39) - open/close 64469 (time 1772758189.48 total 161.80 last 446.83) total: 64768 open/close in 162.59 seconds: 398.34 ops/second - /unlink 6853 (time 1772758201.68 total 10.00 last 685.28) - /unlink 10000 (time 1772758205.36 total 13.69 last 853.67) - /unlink 18620 (time 1772758215.37 total 23.69 last 861.95) - /unlink 26587 (time 1772758225.37 total 33.69 last 796.65) - /unlink 30000 (time 1772758229.43 total 37.76 last 838.78) - /unlink 38651 (time 1772758239.44 total 47.76 last 865.04) - /unlink 47208 (time 1772758249.44 total 57.76 last 855.67) - /unlink 50000 (time 1772758252.60 total 60.93 last 881.39) - /unlink 58833 (time 1772758262.60 total 70.93 last 883.22) total: 64768 /unlink in 77.58 seconds: 834.88 ops/second Waiting for MDT destroys to complete oleg323-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 - open/close 4703 (time 1772758289.59 total 10.00 last 470.26) - open/close 8850 (time 1772758299.59 total 20.00 last 414.67) - open/close 10000 (time 1772758302.42 total 22.83 last 407.27) - open/close 14317 (time 1772758312.42 total 32.83 last 431.62) - open/close 18996 (time 1772758322.42 total 42.83 last 467.82) - open/close 20000 (time 1772758324.69 total 45.10 last 442.35) - open/close 24705 (time 1772758334.69 total 55.10 last 470.49) - open/close 29187 (time 1772758344.69 total 65.10 last 448.15) - open/close 33594 (time 1772758354.69 total 75.10 last 440.65) - open/close 38647 (time 1772758364.69 total 85.10 last 505.24) - open/close 40000 (time 1772758367.24 total 87.65 last 531.87) - open/close 45112 (time 1772758377.24 total 97.65 last 511.13) - open/close 50000 (time 1772758386.79 total 107.20 last 511.65) - open/close 55164 (time 1772758396.79 total 117.20 last 516.36) - open/close 60000 (time 1772758406.67 total 127.08 last 489.43) total: 64768 open/close in 136.45 seconds: 474.67 ops/second - /unlink 9148 (time 1772758427.38 total 10.00 last 914.74) - /unlink 17808 (time 1772758437.38 total 20.00 last 865.91) - /unlink 20000 (time 1772758439.90 total 22.52 last 869.12) - /unlink 28756 (time 1772758449.90 total 32.52 last 875.57) - /unlink 38258 (time 1772758459.90 total 42.52 last 950.19) - /unlink 47823 (time 1772758469.90 total 52.52 last 956.48) - /unlink 50000 (time 1772758472.08 total 54.71 last 997.36) - /unlink 59473 (time 1772758482.08 total 64.71 last 947.23) total: 64768 /unlink in 70.37 seconds: 920.36 ops/second Waiting for MDT destroys to complete oleg323-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 - open/close 5356 (time 1772758509.49 total 10.00 last 535.54) - open/close 10000 (time 1772758517.95 total 18.46 last 548.86) - open/close 14896 (time 1772758527.95 total 28.46 last 489.57) - open/close 19636 (time 1772758537.95 total 38.46 last 473.94) - open/close 24388 (time 1772758547.95 total 48.46 last 475.17) - open/close 29905 (time 1772758557.95 total 58.46 last 551.69) - open/close 34698 (time 1772758567.95 total 68.47 last 479.26) - open/close 40000 (time 1772758577.53 total 78.04 last 553.75) - open/close 45438 (time 1772758587.53 total 88.04 last 543.79) - open/close 50000 (time 1772758595.80 total 96.31 last 551.78) - open/close 55322 (time 1772758605.80 total 106.31 last 532.19) - open/close 60000 (time 1772758614.15 total 114.66 last 559.85) total: 64768 open/close in 123.58 seconds: 524.11 ops/second - /unlink 9251 (time 1772758634.41 total 10.00 last 925.04) - /unlink 18492 (time 1772758644.41 total 20.00 last 924.09) - /unlink 27382 (time 1772758654.41 total 30.00 last 888.95) - /unlink 30000 (time 1772758657.40 total 33.00 last 874.38) - /unlink 38852 (time 1772758667.41 total 43.01 last 884.36) - /unlink 48088 (time 1772758677.41 total 53.01 last 923.60) - /unlink 50000 (time 1772758679.56 total 55.15 last 890.80) - /unlink 59589 (time 1772758689.56 total 65.15 last 958.89) total: 64768 /unlink in 70.84 seconds: 914.23 ops/second Waiting for MDT destroys to complete oleg323-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 - open/close 5090 (time 1772758714.73 total 10.00 last 508.92) - open/close 10000 (time 1772758723.60 total 18.88 last 553.30) - open/close 15515 (time 1772758733.60 total 28.88 last 551.49) - open/close 20000 (time 1772758741.76 total 37.04 last 549.64) - open/close 25615 (time 1772758751.76 total 47.04 last 561.45) - open/close 30000 (time 1772758760.59 total 55.87 last 496.47) - open/close 34776 (time 1772758770.60 total 65.87 last 477.50) - open/close 39352 (time 1772758780.60 total 75.87 last 457.51) - open/close 44696 (time 1772758790.60 total 85.87 last 534.38) - open/close 50000 (time 1772758800.38 total 95.66 last 542.08) - open/close 55107 (time 1772758810.38 total 105.66 last 510.62) - open/close 60000 (time 1772758819.43 total 114.71 last 540.73) total: 64768 open/close in 123.90 seconds: 522.75 ops/second - /unlink 7922 (time 1772758840.03 total 10.00 last 792.15) - /unlink 10000 (time 1772758842.63 total 12.59 last 801.41) - /unlink 17923 (time 1772758852.63 total 22.59 last 792.24) - /unlink 20000 (time 1772758855.20 total 25.17 last 805.95) - /unlink 27906 (time 1772758865.20 total 35.17 last 790.52) - /unlink 30000 (time 1772758867.83 total 37.80 last 796.68) - /unlink 38116 (time 1772758877.83 total 47.80 last 811.52) - /unlink 40000 (time 1772758880.13 total 50.10 last 821.22) - /unlink 48151 (time 1772758890.13 total 60.10 last 815.06) - /unlink 50000 (time 1772758892.32 total 62.29 last 843.04) - /unlink 58163 (time 1772758902.32 total 72.29 last 816.23) - /unlink 60000 (time 1772758904.50 total 74.47 last 842.94) total: 64768 /unlink in 80.32 seconds: 806.42 ops/second Waiting for MDT destroys to complete oleg323-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 - open/close 4756 (time 1772758929.25 total 10.00 last 475.57) - open/close 9604 (time 1772758939.25 total 20.00 last 484.79) - open/close 14496 (time 1772758949.25 total 30.00 last 489.16) - open/close 19381 (time 1772758959.25 total 40.00 last 488.50) - open/close 24225 (time 1772758969.25 total 50.00 last 484.30) - open/close 29053 (time 1772758979.25 total 60.00 last 482.73) - open/close 30000 (time 1772758981.29 total 62.04 last 464.61) - open/close 34841 (time 1772758991.29 total 72.04 last 484.02) - open/close 39641 (time 1772759001.29 total 82.05 last 479.98) - open/close 44293 (time 1772759011.29 total 92.05 last 465.12) - open/close 48931 (time 1772759021.29 total 102.05 last 463.78) - open/close 50000 (time 1772759023.62 total 104.37 last 459.72) - open/close 54736 (time 1772759033.62 total 114.37 last 473.57) - open/close 59422 (time 1772759043.62 total 124.38 last 468.50) - open/close 64172 (time 1772759053.62 total 134.38 last 474.91) total: 64768 open/close in 135.60 seconds: 477.63 ops/second - /unlink 7982 (time 1772759066.27 total 10.00 last 798.14) - /unlink 10000 (time 1772759068.89 total 12.62 last 770.75) - /unlink 17832 (time 1772759078.89 total 22.62 last 783.15) - /unlink 20000 (time 1772759081.61 total 25.34 last 795.60) - /unlink 28096 (time 1772759091.61 total 35.35 last 809.53) - /unlink 30000 (time 1772759094.00 total 37.73 last 797.76) - /unlink 37745 (time 1772759104.00 total 47.73 last 774.44) - /unlink 40000 (time 1772759106.93 total 50.66 last 771.16) - /unlink 47962 (time 1772759116.93 total 60.66 last 796.02) - /unlink 50000 (time 1772759119.45 total 63.19 last 806.89) - /unlink 58026 (time 1772759129.45 total 73.19 last 802.53) - /unlink 60000 (time 1772759131.95 total 75.68 last 792.54) total: 64768 /unlink in 81.59 seconds: 793.85 ops/second Waiting for MDT destroys to complete oleg323-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg323-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg323-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg323-server stop mds service on oleg323-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg323-server stop mds service on oleg323-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg323-server unloading modules via unload_modules_local on: 'oleg323-server' oleg323-server: oleg323-server.virtnet: executing unload_modules_local oleg323-server: modules unloaded. pdsh@oleg323-client: oleg323-client: ssh exited with exit code 2 pdsh@oleg323-client: oleg323-server: ssh exited with exit code 2 pdsh@oleg323-client: oleg323-server: ssh exited with exit code 2 pdsh@oleg323-client: oleg323-client: ssh exited with exit code 2 PASS 106 (1189s) Stopping clients: oleg323-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg323-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg323-client: oleg323-server: ssh exited with exit code 2 oleg323-server: oleg323-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg323-server' oleg323-server: oleg323-server.virtnet: executing load_modules_local oleg323-server: Loading modules from /home/green/git/lustre-release/lustre oleg323-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg323-server: detected 4 online CPUs by sysfs oleg323-server: MODOPTS_LIBCFS= oleg323-server: Force libcfs to create 2 CPU partitions oleg323-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg323-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg323-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1343 sec ========== 20:06:37 (1772759197) === conf-sanity: start cleanup 20:06:37 (1772759197) === === conf-sanity: finish cleanup 20:06:38 (1772759198) ===