-----============= acceptance-small: conf-sanity ============----- Mon Mar 9 20:21:16 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg120-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg120-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg120-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg120-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg120-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg120-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg120-server oleg120-server: oleg120-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg120-server' oleg120-server: oleg120-server.virtnet: executing load_modules_local oleg120-server: Loading modules from /home/green/git/lustre-release/lustre oleg120-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg120-server: detected 4 online CPUs by sysfs oleg120-server: MODOPTS_LIBCFS= oleg120-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg120-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg120-server: oleg120-server.virtnet: executing set_default_debug -1 all pdsh@oleg120-client: oleg120-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg120-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg120-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg120-server: oleg120-server.virtnet: executing set_default_debug -1 all pdsh@oleg120-client: oleg120-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg120-server: oleg120-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg120-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg120-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg120-server stop mds service on oleg120-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg120-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 20:23:15 (1773102195) Stopping clients: oleg120-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg120-client.virtnet /mnt/lustre2 (opts:-f) oleg120-server: oleg120-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg120-server' oleg120-server: oleg120-server.virtnet: executing load_modules_local oleg120-server: Loading modules from /home/green/git/lustre-release/lustre oleg120-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg120-server: detected 4 online CPUs by sysfs oleg120-server: MODOPTS_LIBCFS= oleg120-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg120-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg120-server: oleg120-server.virtnet: executing set_default_debug -1 all pdsh@oleg120-client: oleg120-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg120-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg120-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg120-server: oleg120-server.virtnet: executing set_default_debug -1 all pdsh@oleg120-client: oleg120-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg120-client.virtnet: -o user_xattr,flock 192.168.201.120@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 905 (time 1773102284.81 total 10.00 last 90.48) - open/close 1737 (time 1773102294.82 total 20.01 last 83.13) - open/close 2616 (time 1773102304.83 total 30.02 last 87.83) - open/close 3493 (time 1773102314.84 total 40.02 last 87.65) - open/close 4410 (time 1773102324.85 total 50.03 last 91.61) - open/close 5315 (time 1773102334.85 total 60.04 last 90.46) - open/close 6242 (time 1773102344.85 total 70.04 last 92.67) - open/close 7033 (time 1773102354.86 total 80.04 last 79.08) - open/close 7871 (time 1773102364.86 total 90.05 last 83.76) - open/close 8724 (time 1773102374.86 total 100.05 last 85.26) - open/close 9595 (time 1773102384.87 total 110.06 last 87.05) - open/close 10000 (time 1773102389.32 total 114.51 last 91.08) - open/close 10871 (time 1773102399.32 total 124.51 last 87.05) - open/close 11732 (time 1773102409.32 total 134.51 last 86.08) - open/close 12484 (time 1773102419.34 total 144.53 last 75.10) - open/close 13280 (time 1773102429.34 total 154.53 last 79.59) - open/close 14105 (time 1773102439.35 total 164.53 last 82.45) - open/close 14960 (time 1773102449.36 total 174.55 last 85.38) - open/close 15810 (time 1773102459.36 total 184.55 last 84.96) - open/close 16488 (time 1773102469.37 total 194.56 last 67.78) - open/close 17219 (time 1773102479.38 total 204.57 last 73.01) - open/close 18108 (time 1773102489.39 total 214.58 last 88.83) - open/close 18971 (time 1773102499.39 total 224.58 last 86.24) - open/close 19921 (time 1773102509.40 total 234.59 last 94.94) - open/close 20928 (time 1773102519.40 total 244.59 last 100.68) - open/close 21831 (time 1773102529.41 total 254.60 last 90.23) - open/close 22869 (time 1773102539.41 total 264.60 last 103.77) - open/close 23867 (time 1773102549.43 total 274.62 last 99.62) - open/close 24971 (time 1773102559.44 total 284.63 last 110.35) - open/close 25921 (time 1773102569.44 total 294.63 last 94.96) - open/close 26933 (time 1773102579.45 total 304.64 last 101.06) - open/close 27930 (time 1773102589.46 total 314.65 last 99.65) - open/close 28914 (time 1773102599.46 total 324.65 last 98.37) - open/close 29968 (time 1773102609.46 total 334.65 last 105.39) - open/close 30926 (time 1773102619.47 total 344.66 last 95.72) - open/close 31893 (time 1773102629.48 total 354.66 last 96.66) - open/close 32945 (time 1773102639.48 total 364.67 last 105.13) - open/close 33955 (time 1773102649.49 total 374.68 last 100.94) - open/close 34918 (time 1773102659.49 total 384.68 last 96.26) - open/close 35903 (time 1773102669.50 total 394.69 last 98.44) - open/close 36955 (time 1773102679.50 total 404.69 last 105.19) - open/close 37988 (time 1773102689.50 total 414.69 last 103.28) - open/close 39148 (time 1773102699.51 total 424.70 last 115.90) - open/close 40000 (time 1773102709.07 total 434.26 last 89.10) - open/close 40961 (time 1773102719.08 total 444.27 last 96.05) - open/close 41892 (time 1773102729.09 total 454.28 last 93.01) - open/close 42876 (time 1773102739.09 total 464.28 last 98.39) - open/close 43842 (time 1773102749.10 total 474.29 last 96.49) - open/close 44681 (time 1773102759.10 total 484.29 last 83.89) - open/close 45522 (time 1773102769.11 total 494.30 last 84.03) - open/close 46409 (time 1773102779.11 total 504.30 last 88.67) - open/close 47336 (time 1773102789.12 total 514.31 last 92.64) - open/close 48255 (time 1773102799.12 total 524.31 last 91.84) - open/close 49206 (time 1773102809.13 total 534.32 last 95.07) - open/close 50000 (time 1773102817.78 total 542.97 last 91.80) - open/close 51080 (time 1773102827.79 total 552.98 last 107.89) - open/close 52064 (time 1773102837.80 total 562.99 last 98.32) - open/close 53129 (time 1773102847.80 total 572.99 last 106.45) - open/close 54126 (time 1773102857.80 total 582.99 last 99.66) - open/close 55119 (time 1773102867.82 total 593.01 last 99.14) - open/close 56105 (time 1773102877.83 total 603.02 last 98.51) - open/close 57154 (time 1773102887.84 total 613.03 last 104.82) - open/close 58301 (time 1773102897.84 total 623.03 last 114.69) - open/close 59503 (time 1773102907.85 total 633.03 last 120.10) - open/close 60000 (time 1773102911.95 total 637.14 last 121.02) - open/close 61148 (time 1773102921.96 total 647.15 last 114.76) - open/close 62293 (time 1773102931.96 total 657.15 last 114.47) - open/close 63423 (time 1773102941.96 total 667.15 last 112.99) - open/close 64493 (time 1773102951.96 total 677.15 last 106.98) total: 64768 open/close in 679.72 seconds: 95.29 ops/second - /unlink 1025 (time 1773102967.20 total 10.01 last 102.44) - /unlink 2133 (time 1773102977.20 total 20.01 last 110.79) - /unlink 3179 (time 1773102987.21 total 30.01 last 104.54) - /unlink 4169 (time 1773102997.22 total 40.02 last 98.92) - /unlink 5199 (time 1773103007.22 total 50.02 last 102.98) - /unlink 6363 (time 1773103017.22 total 60.03 last 116.36) - /unlink 7406 (time 1773103027.23 total 70.04 last 104.18) - /unlink 8465 (time 1773103037.23 total 80.04 last 105.88) - /unlink 9705 (time 1773103047.24 total 90.04 last 123.97) - /unlink 10000 (time 1773103049.62 total 92.43 last 123.66) - /unlink 11214 (time 1773103059.63 total 102.43 last 121.34) - /unlink 12302 (time 1773103069.64 total 112.44 last 108.71) - /unlink 13479 (time 1773103079.64 total 122.44 last 117.69) - /unlink 14717 (time 1773103089.64 total 132.44 last 123.80) - /unlink 15953 (time 1773103099.65 total 142.45 last 123.48) - /unlink 17097 (time 1773103109.65 total 152.46 last 114.33) - /unlink 18332 (time 1773103119.66 total 162.46 last 123.47) - /unlink 19477 (time 1773103129.67 total 172.47 last 114.39) - /unlink 20000 (time 1773103134.58 total 177.38 last 106.45) - /unlink 21187 (time 1773103144.58 total 187.38 last 118.67) - /unlink 22428 (time 1773103154.59 total 197.39 last 124.04) - /unlink 23652 (time 1773103164.59 total 207.40 last 122.32) - /unlink 24821 (time 1773103174.60 total 217.40 last 116.86) - /unlink 26064 (time 1773103184.60 total 227.41 last 124.23) - /unlink 27329 (time 1773103194.61 total 237.41 last 126.41) - /unlink 28632 (time 1773103204.62 total 247.43 last 130.12) - /unlink 30000 (time 1773103214.36 total 257.16 last 140.49) - /unlink 31535 (time 1773103224.37 total 267.17 last 153.41) - /unlink 34146 (time 1773103234.37 total 277.17 last 260.97) - /unlink 36365 (time 1773103244.37 total 287.18 last 221.85) - /unlink 38573 (time 1773103254.38 total 297.18 last 220.76) - /unlink 40000 (time 1773103262.34 total 305.14 last 179.25) - /unlink 42158 (time 1773103272.34 total 315.14 last 215.76) - /unlink 44331 (time 1773103282.34 total 325.14 last 217.25) - /unlink 46774 (time 1773103292.34 total 335.15 last 244.24) - /unlink 49127 (time 1773103302.34 total 345.15 last 235.28) - /unlink 50000 (time 1773103305.68 total 348.49 last 261.42) - /unlink 52202 (time 1773103315.68 total 358.49 last 220.18) - /unlink 54736 (time 1773103325.68 total 368.49 last 253.39) - /unlink 57065 (time 1773103335.69 total 378.49 last 232.85) - /unlink 59748 (time 1773103345.69 total 388.49 last 268.30) - /unlink 62352 (time 1773103355.69 total 398.49 last 260.39) total: 64768 /unlink in 407.29 seconds: 159.02 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1553 (time 1773103396.94 total 10.00 last 155.26) - open/close 3150 (time 1773103406.95 total 20.01 last 159.53) - open/close 4854 (time 1773103416.95 total 30.02 last 170.28) - open/close 6433 (time 1773103426.96 total 40.03 last 157.83) - open/close 8196 (time 1773103436.96 total 50.03 last 176.26) - open/close 10000 (time 1773103445.65 total 58.71 last 207.70) - open/close 11954 (time 1773103455.65 total 68.72 last 195.26) - open/close 13592 (time 1773103465.66 total 78.73 last 163.72) - open/close 15004 (time 1773103475.67 total 88.74 last 141.05) - open/close 16567 (time 1773103485.67 total 98.74 last 156.27) - open/close 18192 (time 1773103495.67 total 108.74 last 162.48) - open/close 19887 (time 1773103505.67 total 118.74 last 169.48) - open/close 21606 (time 1773103515.68 total 128.74 last 171.84) - open/close 23078 (time 1773103525.68 total 138.74 last 147.18) - open/close 24518 (time 1773103535.68 total 148.75 last 143.89) - open/close 26064 (time 1773103545.70 total 158.77 last 154.35) - open/close 27401 (time 1773103555.70 total 168.77 last 133.67) - open/close 28995 (time 1773103565.71 total 178.77 last 159.34) - open/close 30000 (time 1773103571.53 total 184.60 last 172.46) - open/close 31650 (time 1773103581.54 total 194.60 last 164.99) - open/close 33454 (time 1773103591.54 total 204.60 last 180.37) - open/close 35237 (time 1773103601.54 total 214.61 last 178.25) - open/close 37336 (time 1773103611.55 total 224.61 last 209.79) - open/close 39493 (time 1773103621.55 total 234.61 last 215.67) - open/close 40000 (time 1773103624.14 total 237.20 last 195.74) - open/close 41792 (time 1773103634.14 total 247.21 last 179.18) - open/close 43537 (time 1773103644.14 total 257.21 last 174.45) - open/close 45209 (time 1773103654.14 total 267.21 last 167.19) - open/close 47289 (time 1773103664.14 total 277.21 last 207.94) - open/close 48963 (time 1773103674.15 total 287.21 last 167.37) - open/close 50000 (time 1773103680.17 total 293.24 last 172.14) - open/close 51966 (time 1773103690.18 total 303.25 last 196.44) - open/close 53678 (time 1773103700.18 total 313.25 last 171.18) - open/close 55388 (time 1773103710.18 total 323.25 last 170.94) - open/close 57205 (time 1773103720.18 total 333.25 last 181.69) - open/close 59085 (time 1773103730.19 total 343.25 last 187.94) - open/close 60000 (time 1773103734.84 total 347.91 last 196.51) - open/close 61933 (time 1773103744.84 total 357.91 last 193.28) - open/close 63662 (time 1773103754.85 total 367.92 last 172.80) total: 64768 open/close in 373.53 seconds: 173.39 ops/second - /unlink 3652 (time 1773103772.41 total 10.00 last 365.13) - /unlink 7738 (time 1773103782.41 total 20.00 last 408.51) - /unlink 10000 (time 1773103788.30 total 25.89 last 384.60) - /unlink 13635 (time 1773103798.30 total 35.89 last 363.48) - /unlink 16818 (time 1773103808.30 total 45.89 last 318.28) - /unlink 20000 (time 1773103817.47 total 55.06 last 346.80) - /unlink 23881 (time 1773103827.48 total 65.07 last 387.80) - /unlink 28532 (time 1773103837.48 total 75.07 last 465.06) - /unlink 30000 (time 1773103841.62 total 79.21 last 355.01) - /unlink 34149 (time 1773103851.62 total 89.21 last 414.87) - /unlink 38274 (time 1773103861.62 total 99.21 last 412.46) - /unlink 40000 (time 1773103866.08 total 103.67 last 386.37) - /unlink 43637 (time 1773103876.09 total 113.68 last 363.67) - /unlink 47535 (time 1773103886.09 total 123.68 last 389.75) - /unlink 50000 (time 1773103892.65 total 130.23 last 375.86) - /unlink 53702 (time 1773103902.65 total 140.24 last 370.17) - /unlink 57475 (time 1773103912.65 total 150.24 last 377.30) - /unlink 60000 (time 1773103918.15 total 155.74 last 458.83) total: 64768 /unlink in 165.56 seconds: 391.21 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2292 (time 1773103963.41 total 10.00 last 229.18) - open/close 4829 (time 1773103973.42 total 20.00 last 253.69) - open/close 7308 (time 1773103983.42 total 30.00 last 247.89) - open/close 9747 (time 1773103993.42 total 40.00 last 243.83) - open/close 12484 (time 1773104003.42 total 50.01 last 273.64) - open/close 15165 (time 1773104013.42 total 60.01 last 268.04) - open/close 17765 (time 1773104023.42 total 70.01 last 259.96) - open/close 20000 (time 1773104031.99 total 78.57 last 261.08) - open/close 22318 (time 1773104041.99 total 88.58 last 231.64) - open/close 24693 (time 1773104051.99 total 98.58 last 237.47) - open/close 27023 (time 1773104061.99 total 108.58 last 232.97) - open/close 29530 (time 1773104072.00 total 118.58 last 250.63) - open/close 30000 (time 1773104074.17 total 120.76 last 215.83) - open/close 32119 (time 1773104084.18 total 130.76 last 211.88) - open/close 34254 (time 1773104094.18 total 140.77 last 213.34) - open/close 36197 (time 1773104104.19 total 150.77 last 194.19) - open/close 37883 (time 1773104114.19 total 160.78 last 168.56) - open/close 40000 (time 1773104123.73 total 170.31 last 221.95) - open/close 42465 (time 1773104133.73 total 180.32 last 246.45) - open/close 44892 (time 1773104143.73 total 190.32 last 242.64) - open/close 46949 (time 1773104153.73 total 200.32 last 205.70) - open/close 49103 (time 1773104163.73 total 210.32 last 215.39) - open/close 50000 (time 1773104167.72 total 214.30 last 225.23) - open/close 51772 (time 1773104177.72 total 224.30 last 177.17) - open/close 53806 (time 1773104187.72 total 234.31 last 203.35) - open/close 55656 (time 1773104197.72 total 244.31 last 184.97) - open/close 57552 (time 1773104207.73 total 254.32 last 189.42) - open/close 59479 (time 1773104217.73 total 264.32 last 192.68) - open/close 60000 (time 1773104219.89 total 266.47 last 241.81) - open/close 62073 (time 1773104229.89 total 276.47 last 207.26) - open/close 64102 (time 1773104239.89 total 286.48 last 202.85) total: 64768 open/close in 290.14 seconds: 223.23 ops/second - /unlink 3471 (time 1773104255.66 total 10.00 last 347.08) - /unlink 6926 (time 1773104265.67 total 20.00 last 345.44) - /unlink 10000 (time 1773104274.44 total 28.78 last 350.35) - /unlink 13653 (time 1773104284.44 total 38.78 last 365.27) - /unlink 17585 (time 1773104294.44 total 48.78 last 393.07) - /unlink 20000 (time 1773104300.60 total 54.93 last 392.43) - /unlink 23444 (time 1773104310.60 total 64.94 last 344.36) - /unlink 26727 (time 1773104320.60 total 74.94 last 328.27) - /unlink 30000 (time 1773104328.42 total 82.75 last 418.72) - /unlink 33810 (time 1773104338.42 total 92.75 last 380.99) - /unlink 38016 (time 1773104348.42 total 102.75 last 420.57) - /unlink 40000 (time 1773104353.44 total 107.77 last 395.21) - /unlink 44439 (time 1773104363.44 total 117.78 last 443.86) - /unlink 48712 (time 1773104373.44 total 127.78 last 427.29) - /unlink 50000 (time 1773104376.33 total 130.66 last 446.11) - /unlink 54762 (time 1773104386.33 total 140.66 last 476.10) - /unlink 60000 (time 1773104396.18 total 150.52 last 531.75) - /unlink 64495 (time 1773104406.18 total 160.52 last 449.44) total: 64768 /unlink in 161.20 seconds: 401.79 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2318 (time 1773104437.17 total 10.01 last 231.68) - open/close 5224 (time 1773104447.17 total 20.01 last 290.57) - open/close 7982 (time 1773104457.17 total 30.01 last 275.73) - open/close 10000 (time 1773104465.61 total 38.45 last 239.09) - open/close 12332 (time 1773104475.61 total 48.45 last 233.17) - open/close 15110 (time 1773104485.61 total 58.45 last 277.75) - open/close 17784 (time 1773104495.61 total 68.45 last 267.39) - open/close 20000 (time 1773104504.31 total 77.15 last 254.86) - open/close 22399 (time 1773104514.31 total 87.15 last 239.89) - open/close 24914 (time 1773104524.31 total 97.15 last 251.49) - open/close 27222 (time 1773104534.31 total 107.15 last 230.79) - open/close 29979 (time 1773104544.31 total 117.15 last 275.62) - open/close 33063 (time 1773104554.31 total 127.15 last 308.34) - open/close 36147 (time 1773104564.31 total 137.15 last 308.39) - open/close 39314 (time 1773104574.32 total 147.16 last 316.59) - open/close 40000 (time 1773104576.75 total 149.59 last 281.62) - open/close 43109 (time 1773104586.76 total 159.59 last 310.85) - open/close 46239 (time 1773104596.76 total 169.60 last 312.86) - open/close 49028 (time 1773104606.76 total 179.60 last 278.85) - open/close 50000 (time 1773104610.88 total 183.72 last 236.09) - open/close 53114 (time 1773104620.88 total 193.72 last 311.31) - open/close 55993 (time 1773104630.88 total 203.72 last 287.82) - open/close 58701 (time 1773104640.89 total 213.73 last 270.75) - open/close 60000 (time 1773104645.37 total 218.21 last 289.83) - open/close 63171 (time 1773104655.37 total 228.21 last 317.05) total: 64768 open/close in 233.25 seconds: 277.67 ops/second - /unlink 5491 (time 1773104672.06 total 10.00 last 549.02) - /unlink 10000 (time 1773104681.01 total 18.95 last 503.74) - /unlink 15318 (time 1773104691.01 total 28.95 last 531.77) - /unlink 20000 (time 1773104699.93 total 37.87 last 525.02) - /unlink 25179 (time 1773104709.93 total 47.87 last 517.86) - /unlink 30000 (time 1773104718.69 total 56.63 last 550.40) - /unlink 34918 (time 1773104728.69 total 66.63 last 491.74) - /unlink 40000 (time 1773104738.20 total 76.14 last 534.73) - /unlink 45478 (time 1773104748.20 total 86.14 last 547.75) - /unlink 50000 (time 1773104756.63 total 94.57 last 536.37) - /unlink 55196 (time 1773104766.63 total 104.57 last 519.58) - /unlink 59988 (time 1773104776.65 total 114.59 last 477.97) - /unlink 64493 (time 1773104786.66 total 124.60 last 450.43) total: 64768 /unlink in 125.37 seconds: 516.61 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 3181 (time 1773104818.48 total 10.00 last 318.09) - open/close 6119 (time 1773104828.49 total 20.00 last 293.75) - open/close 8941 (time 1773104838.49 total 30.00 last 282.19) - open/close 10000 (time 1773104841.60 total 33.11 last 340.54) - open/close 13504 (time 1773104851.60 total 43.11 last 350.33) - open/close 16354 (time 1773104861.60 total 53.12 last 284.89) - open/close 19486 (time 1773104871.61 total 63.12 last 313.03) - open/close 22623 (time 1773104881.61 total 73.12 last 313.68) - open/close 25698 (time 1773104891.61 total 83.13 last 307.39) - open/close 29182 (time 1773104901.61 total 93.13 last 348.39) - open/close 30000 (time 1773104904.10 total 95.61 last 328.94) - open/close 33049 (time 1773104914.10 total 105.61 last 304.89) - open/close 35989 (time 1773104924.10 total 115.62 last 293.91) - open/close 39076 (time 1773104934.10 total 125.62 last 308.64) - open/close 40000 (time 1773104936.97 total 128.49 last 321.87) - open/close 43392 (time 1773104946.98 total 138.49 last 339.17) - open/close 46261 (time 1773104956.98 total 148.49 last 286.85) - open/close 49262 (time 1773104966.98 total 158.50 last 300.02) - open/close 50000 (time 1773104969.85 total 161.37 last 256.74) - open/close 52771 (time 1773104979.85 total 171.37 last 277.07) - open/close 55330 (time 1773104989.86 total 181.37 last 255.85) - open/close 57686 (time 1773104999.86 total 191.38 last 235.53) - open/close 59927 (time 1773105009.86 total 201.38 last 224.02) - open/close 62546 (time 1773105019.86 total 211.38 last 261.89) - open/close 64031 (time 1773105029.86 total 221.38 last 148.49) total: 64768 open/close in 225.13 seconds: 287.69 ops/second - /unlink 4256 (time 1773105045.56 total 10.00 last 425.55) - /unlink 8083 (time 1773105055.56 total 20.00 last 382.69) - /unlink 10000 (time 1773105060.06 total 24.50 last 425.72) - /unlink 14342 (time 1773105070.06 total 34.51 last 434.16) - /unlink 19390 (time 1773105080.06 total 44.51 last 504.73) - /unlink 24121 (time 1773105090.07 total 54.51 last 473.05) - /unlink 29100 (time 1773105100.07 total 64.51 last 497.83) - /unlink 33438 (time 1773105110.07 total 74.51 last 433.76) - /unlink 38431 (time 1773105120.07 total 84.51 last 499.21) - /unlink 40000 (time 1773105122.79 total 87.23 last 577.36) - /unlink 45175 (time 1773105132.79 total 97.23 last 517.49) - /unlink 50000 (time 1773105141.26 total 105.70 last 569.39) - /unlink 55922 (time 1773105151.26 total 115.70 last 592.13) - /unlink 60000 (time 1773105157.93 total 122.38 last 611.17) total: 64768 /unlink in 131.94 seconds: 490.87 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg120-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg120-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg120-server stop mds service on oleg120-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg120-server unloading modules via unload_modules_local on: 'oleg120-server' oleg120-server: oleg120-server.virtnet: executing unload_modules_local oleg120-server: modules unloaded. pdsh@oleg120-client: oleg120-client: ssh exited with exit code 2 pdsh@oleg120-client: oleg120-server: ssh exited with exit code 2 pdsh@oleg120-client: oleg120-server: ssh exited with exit code 2 pdsh@oleg120-client: oleg120-client: ssh exited with exit code 2 PASS 106 (3006s) Stopping clients: oleg120-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg120-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg120-client: oleg120-server: ssh exited with exit code 2 oleg120-server: oleg120-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg120-server' oleg120-server: oleg120-server.virtnet: executing load_modules_local oleg120-server: Loading modules from /home/green/git/lustre-release/lustre oleg120-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg120-server: detected 4 online CPUs by sysfs oleg120-server: MODOPTS_LIBCFS= oleg120-server: Force libcfs to create 2 CPU partitions oleg120-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg120-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg120-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3153 sec ========== 21:13:50 (1773105230) === conf-sanity: start cleanup 21:13:51 (1773105231) === === conf-sanity: finish cleanup 21:13:52 (1773105232) ===