-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:42 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:47 (1734015827) === oleg350-client.virtnet: executing check_config_client /mnt/lustre oleg350-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg350-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cf5000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cf5000.idle_timeout=debug disable quota as required oleg350-server: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:03:55 (1734015835) === == sanity-benchmark test dbench: dbench ================== 10:03:55 (1734015835) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6974] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg350-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg350-client.virtnet at Thu Dec 12 10:03:57 EST 2024 waiting for dbench pid 9441 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 72 64.71 MB/sec warmup 1 sec latency 121.658 ms 20 173 70.46 MB/sec warmup 2 sec latency 135.056 ms 20 263 66.05 MB/sec warmup 3 sec latency 103.347 ms 20 342 61.56 MB/sec warmup 4 sec latency 117.931 ms 20 432 60.93 MB/sec warmup 5 sec latency 98.392 ms 20 546 63.16 MB/sec warmup 6 sec latency 82.211 ms 20 659 60.31 MB/sec warmup 7 sec latency 365.222 ms 20 705 52.96 MB/sec warmup 8 sec latency 379.339 ms 20 738 47.32 MB/sec warmup 9 sec latency 247.042 ms 20 790 42.87 MB/sec warmup 10 sec latency 205.124 ms 20 829 39.07 MB/sec warmup 11 sec latency 207.534 ms 20 879 36.07 MB/sec warmup 12 sec latency 387.965 ms 20 911 33.39 MB/sec warmup 13 sec latency 232.065 ms 20 956 31.16 MB/sec warmup 14 sec latency 269.103 ms 20 996 29.38 MB/sec warmup 15 sec latency 266.544 ms 20 1081 28.63 MB/sec warmup 16 sec latency 171.971 ms 20 1145 27.03 MB/sec warmup 17 sec latency 107.790 ms 20 1199 25.58 MB/sec warmup 18 sec latency 105.463 ms 20 1258 24.58 MB/sec warmup 19 sec latency 103.265 ms 20 1383 25.63 MB/sec warmup 20 sec latency 100.267 ms 20 1440 24.75 MB/sec warmup 21 sec latency 193.712 ms 20 1494 23.66 MB/sec warmup 22 sec latency 227.833 ms 20 1539 22.67 MB/sec warmup 23 sec latency 190.621 ms 20 1647 0.63 MB/sec execute 1 sec latency 272.003 ms 20 1708 0.82 MB/sec execute 2 sec latency 210.361 ms 20 1768 0.91 MB/sec execute 3 sec latency 100.171 ms 20 1826 0.94 MB/sec execute 4 sec latency 244.358 ms 20 1873 0.85 MB/sec execute 5 sec latency 250.527 ms 20 1938 0.92 MB/sec execute 6 sec latency 163.707 ms 20 2002 1.01 MB/sec execute 7 sec latency 170.145 ms 20 2050 1.07 MB/sec execute 8 sec latency 119.386 ms 20 2104 1.12 MB/sec execute 9 sec latency 115.150 ms 20 2160 1.30 MB/sec execute 10 sec latency 116.348 ms 20 2207 1.44 MB/sec execute 11 sec latency 307.868 ms 20 2271 1.95 MB/sec execute 12 sec latency 318.278 ms 20 2351 2.66 MB/sec execute 13 sec latency 320.520 ms 20 2394 2.69 MB/sec execute 14 sec latency 406.751 ms 20 2425 2.62 MB/sec execute 15 sec latency 638.708 ms 20 2454 2.79 MB/sec execute 16 sec latency 1116.292 ms 20 2529 3.29 MB/sec execute 17 sec latency 340.487 ms 20 2593 3.60 MB/sec execute 18 sec latency 391.901 ms 20 2701 4.71 MB/sec execute 19 sec latency 284.910 ms 20 2812 5.81 MB/sec execute 20 sec latency 258.799 ms 20 2910 6.45 MB/sec execute 21 sec latency 426.438 ms 20 2982 6.66 MB/sec execute 22 sec latency 445.462 ms 20 3090 6.77 MB/sec execute 23 sec latency 450.227 ms 20 3157 6.75 MB/sec execute 24 sec latency 367.479 ms 20 3272 6.98 MB/sec execute 25 sec latency 346.157 ms 20 3357 7.41 MB/sec execute 26 sec latency 311.891 ms 20 3454 7.96 MB/sec execute 27 sec latency 290.808 ms 20 3536 8.26 MB/sec execute 28 sec latency 103.646 ms 20 3620 8.59 MB/sec execute 29 sec latency 94.935 ms 20 3683 8.45 MB/sec execute 30 sec latency 108.837 ms 20 3729 8.42 MB/sec execute 31 sec latency 166.396 ms 20 3771 8.28 MB/sec execute 32 sec latency 127.046 ms 20 3821 8.25 MB/sec execute 33 sec latency 122.054 ms 20 3862 8.02 MB/sec execute 34 sec latency 93.885 ms 20 3904 7.87 MB/sec execute 35 sec latency 104.538 ms 20 3937 7.69 MB/sec execute 36 sec latency 169.175 ms 20 3971 7.51 MB/sec execute 37 sec latency 193.580 ms 20 4005 7.31 MB/sec execute 38 sec latency 104.274 ms 20 4045 7.13 MB/sec execute 39 sec latency 99.373 ms 20 4095 6.96 MB/sec execute 40 sec latency 102.937 ms 20 4134 6.80 MB/sec execute 41 sec latency 454.880 ms 20 4190 6.67 MB/sec execute 42 sec latency 436.863 ms 20 4237 6.55 MB/sec execute 43 sec latency 545.427 ms 20 4272 6.44 MB/sec execute 44 sec latency 357.950 ms 20 4298 6.33 MB/sec execute 45 sec latency 534.130 ms 20 4336 6.23 MB/sec execute 46 sec latency 220.571 ms 20 4377 6.14 MB/sec execute 47 sec latency 233.375 ms 20 4423 6.06 MB/sec execute 48 sec latency 245.340 ms 20 4468 5.98 MB/sec execute 49 sec latency 275.023 ms 20 4510 5.93 MB/sec execute 50 sec latency 267.105 ms 20 4554 5.86 MB/sec execute 51 sec latency 288.226 ms 20 4603 5.91 MB/sec execute 52 sec latency 322.892 ms 20 4665 5.95 MB/sec execute 53 sec latency 282.497 ms 20 4727 5.91 MB/sec execute 54 sec latency 113.882 ms 20 4791 5.98 MB/sec execute 55 sec latency 120.479 ms 20 4852 6.01 MB/sec execute 56 sec latency 126.392 ms 20 4918 6.25 MB/sec execute 57 sec latency 144.822 ms 20 4983 6.41 MB/sec execute 58 sec latency 346.972 ms 20 5036 6.44 MB/sec execute 59 sec latency 249.988 ms 20 5073 6.34 MB/sec execute 60 sec latency 300.574 ms 20 5114 6.25 MB/sec execute 61 sec latency 209.380 ms 20 5159 6.16 MB/sec execute 62 sec latency 217.482 ms 20 5194 6.07 MB/sec execute 63 sec latency 226.448 ms 20 5240 5.99 MB/sec execute 64 sec latency 201.918 ms 20 5284 5.91 MB/sec execute 65 sec latency 232.409 ms 20 5329 5.83 MB/sec execute 66 sec latency 100.762 ms 20 5369 5.75 MB/sec execute 67 sec latency 238.668 ms 20 5406 5.68 MB/sec execute 68 sec latency 245.103 ms 20 5444 5.60 MB/sec execute 69 sec latency 201.135 ms 20 5490 5.53 MB/sec execute 70 sec latency 244.905 ms 20 5553 5.48 MB/sec execute 71 sec latency 251.585 ms 20 5607 5.42 MB/sec execute 72 sec latency 86.893 ms 20 5651 5.36 MB/sec execute 73 sec latency 136.368 ms 20 5713 5.32 MB/sec execute 74 sec latency 100.768 ms 20 5764 5.29 MB/sec execute 75 sec latency 297.081 ms 20 5818 5.31 MB/sec execute 76 sec latency 380.060 ms 20 5882 5.33 MB/sec execute 77 sec latency 329.390 ms 20 5943 5.37 MB/sec execute 78 sec latency 422.225 ms 20 5980 5.33 MB/sec execute 79 sec latency 320.974 ms 20 6031 5.34 MB/sec execute 80 sec latency 353.704 ms 20 6101 5.45 MB/sec execute 81 sec latency 319.533 ms 20 6180 5.52 MB/sec execute 82 sec latency 379.071 ms 20 6267 5.70 MB/sec execute 83 sec latency 309.449 ms 20 6401 6.07 MB/sec execute 84 sec latency 323.169 ms 20 6500 6.12 MB/sec execute 85 sec latency 333.597 ms 20 6573 6.19 MB/sec execute 86 sec latency 348.297 ms 20 6682 6.22 MB/sec execute 87 sec latency 390.168 ms 20 6808 6.30 MB/sec execute 88 sec latency 297.532 ms 20 6920 6.52 MB/sec execute 89 sec latency 257.923 ms 20 7019 6.70 MB/sec execute 90 sec latency 310.461 ms 20 7097 6.75 MB/sec execute 91 sec latency 89.638 ms 20 7180 6.87 MB/sec execute 92 sec latency 90.742 ms 20 7245 6.87 MB/sec execute 93 sec latency 99.982 ms 20 7293 6.87 MB/sec execute 94 sec latency 175.192 ms 20 7330 6.82 MB/sec execute 95 sec latency 119.763 ms 20 7379 6.82 MB/sec execute 96 sec latency 122.689 ms 20 7421 6.76 MB/sec execute 97 sec latency 103.427 ms 20 7462 6.71 MB/sec execute 98 sec latency 95.269 ms 20 7495 6.66 MB/sec execute 99 sec latency 147.932 ms 20 7532 6.60 MB/sec execute 100 sec latency 150.049 ms 20 7573 6.53 MB/sec execute 101 sec latency 94.330 ms 20 7618 6.47 MB/sec execute 102 sec latency 102.838 ms 20 7651 6.42 MB/sec execute 103 sec latency 300.834 ms 20 7692 6.36 MB/sec execute 104 sec latency 385.319 ms 20 7743 6.31 MB/sec execute 105 sec latency 517.426 ms 20 7792 6.27 MB/sec execute 106 sec latency 356.576 ms 20 7830 6.23 MB/sec execute 107 sec latency 277.592 ms 20 7869 6.19 MB/sec execute 108 sec latency 250.077 ms 20 7908 6.15 MB/sec execute 109 sec latency 289.526 ms 20 7951 6.11 MB/sec execute 110 sec latency 286.059 ms 20 7995 6.07 MB/sec execute 111 sec latency 268.661 ms 20 8046 6.05 MB/sec execute 112 sec latency 262.614 ms 20 8096 6.04 MB/sec execute 113 sec latency 260.688 ms 20 8161 6.07 MB/sec execute 114 sec latency 195.360 ms 20 8218 6.06 MB/sec execute 115 sec latency 337.048 ms 20 8284 6.07 MB/sec execute 116 sec latency 102.597 ms 20 8353 6.10 MB/sec execute 117 sec latency 133.050 ms 20 8421 6.15 MB/sec execute 118 sec latency 163.508 ms 20 8492 6.24 MB/sec execute 119 sec latency 259.727 ms 20 cleanup 120 sec 20 cleanup 121 sec 13 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23756 52.151 241.956 Close 17566 12.653 110.660 Rename 1040 76.782 204.993 Unlink 4911 17.892 135.834 Qpathinfo 22044 12.742 171.895 Qfileinfo 3760 0.313 67.135 Qfsinfo 4080 0.187 25.310 Sfileinfo 2000 45.924 162.800 Find 8462 3.439 159.708 WriteX 11872 4.100 95.711 ReadX 38050 0.039 8.521 LockX 80 19.699 73.290 UnlockX 80 19.438 49.143 Flush 1702 184.785 1114.217 Throughput 6.2361 MB/sec 20 clients 20 procs max_latency=1116.292 ms stopping dbench on /mnt/lustre/d0.oleg350-client.virtnet at Thu Dec 12 10:06:24 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg350-client.virtnet /mnt/lustre/d0.oleg350-client.virtnet /mnt/lustre/d0.oleg350-client.virtnet removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg350-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:31 (1734015991) min OST has 3516416kB available, using 5274624kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6974] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5151] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg350-clien 5151M 84024 63 59599 48 149744 32 641.8 111 Latency 18802us 245ms 76423us 444ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg350-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 254 17 7332 32 376 13 350 17 854 12 444 12 Latency 21421us 15161us 57904us 16036us 4560us 15977us 1.97,1.97,oleg350-client.virtnet,1,1734005479,5151M,,,,84024,63,59599,48,,,149744,32,641.8,111,10,,,,,254,17,7332,32,376,13,350,17,854,12,444,12,,18802us,245ms,,76423us,444ms,21421us,15161us,57904us,16036us,4560us,15977us debug=0x33f0484 PASS bonnie (340s) == sanity-benchmark test iozone: iozone ================== 10:12:11 (1734016331) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6974] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:32 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 152157 145714 121833 204780 69388 104906 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:56 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 24318 26015 111177 110660 89735 33607 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1147s) == sanity-benchmark test fsx: fsx ======================== 10:31:18 (1734017478) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 19489 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 19489 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x3705e8 truncating to largest ever: 0x45ff9f truncating to largest ever: 0x55428d 001000 1734017481.901609 mapwrite 0x3d84dd thru 0x3e3472 (0xaf96 bytes) truncating to largest ever: 0x555c8a 002000 1734017484.416978 mapread 0x211148 thru 0x214e5b (0x3d14 bytes) truncating to largest ever: 0x55cd27 truncating to largest ever: 0x5614fb 008000 1734017499.858154 read 0x3a93e5 thru 0x3ad317 (0x3f33 bytes) 009000 1734017502.661368 mapread 0x09e7f5 thru 0x09fb4e (0x135a bytes) 010000 1734017505.375376 write 0x0e326d thru 0x0e3308 (0x9c bytes) 011000 1734017508.142198 mapread 0x0e54a3 thru 0x0ebb40 (0x669e bytes) 015000 1734017519.601660 mapread 0x004fde thru 0x013ce0 (0xed03 bytes) 019000 1734017531.617653 mapwrite 0x2e8476 thru 0x2ee54e (0x60d9 bytes) 020000 1734017534.240935 trunc from 0x45aacb to 0x0e67e1 (0x3742e9 bytes) 021000 1734017537.062299 read 0x311824 thru 0x320f14 (0xf6f1 bytes) 024000 1734017545.895450 mapread 0x228bdb thru 0x233c05 (0xb02b bytes) 025000 1734017548.336907 write 0x067c69 thru 0x075bf9 (0xdf91 bytes) 026000 1734017551.552129 trunc from 0x49d6ec to 0x4d7756 (0x3a06b bytes) 028000 1734017557.131279 write 0x33366d thru 0x3419be (0xe352 bytes) skipping zero size read 032000 1734017568.552543 trunc from 0x41fac2 to 0x45cd4e (0x3d28d bytes) 034000 1734017573.913082 read 0x22d614 thru 0x237f16 (0xa903 bytes) 037000 1734017582.473706 write 0x5474b1 thru 0x54c204 (0x4d54 bytes) 041000 1734017593.469047 write 0x3c1457 thru 0x3c23fe (0xfa8 bytes) 046000 1734017607.317067 read 0x06f46b thru 0x072c54 (0x37ea bytes) truncating to largest ever: 0x561a42 050000 1734017618.657249 write 0x2a5b40 thru 0x2b0172 (0xa633 bytes) 051000 1734017621.180458 read 0x10b592 thru 0x117320 (0xbd8f bytes) 056000 1734017634.958765 mapread 0x04276b thru 0x044019 (0x18af bytes) 057000 1734017637.762067 mapwrite 0x0a502e thru 0x0a85e4 (0x35b7 bytes) 058000 1734017640.833579 write 0x210c76 thru 0x2139cd (0x2d58 bytes) 059000 1734017643.397376 mapread 0x0d8ae5 thru 0x0dfee7 (0x7403 bytes) 060000 1734017645.982567 trunc from 0x48b972 to 0x4ebf57 (0x605e6 bytes) 062000 1734017650.773977 mapwrite 0x2f2460 thru 0x2fc569 (0xa10a bytes) 063000 1734017653.400827 trunc from 0x2164e4 to 0x3de345 (0x1c7e62 bytes) 065000 1734017659.134082 trunc from 0x500742 to 0x322bcf (0x1ddb72 bytes) 066000 1734017661.956328 mapread 0x113c2f thru 0x119e93 (0x6265 bytes) 067000 1734017664.844492 mapread 0x12e3ac thru 0x137031 (0x8c86 bytes) 068000 1734017667.284112 trunc from 0x4f21e3 to 0x45e1cf (0x94013 bytes) 069000 1734017670.055695 mapread 0x080521 thru 0x084b60 (0x4640 bytes) 072000 1734017677.735005 mapread 0x3485ad thru 0x34bff8 (0x3a4c bytes) 073000 1734017680.371836 read 0x2691f0 thru 0x26b4d9 (0x22ea bytes) 074000 1734017683.114847 mapread 0x347460 thru 0x34f37e (0x7f1f bytes) 077000 1734017690.716611 read 0x1ff3e9 thru 0x206413 (0x702b bytes) 080000 1734017698.888144 mapwrite 0x01c6ca thru 0x02be78 (0xf7af bytes) 081000 1734017701.390174 mapread 0x0b9d63 thru 0x0c5cfe (0xbf9c bytes) 082000 1734017703.861036 read 0x455f6b thru 0x456351 (0x3e7 bytes) 083000 1734017707.046778 mapwrite 0x3683c6 thru 0x36b61e (0x3259 bytes) 084000 1734017709.899187 read 0x10eec3 thru 0x119bd8 (0xad16 bytes) 085000 1734017712.551076 mapread 0x04b6f5 thru 0x05795b (0xc267 bytes) 086000 1734017715.329968 read 0x51af8a thru 0x524e7a (0x9ef1 bytes) 087000 1734017717.678239 mapwrite 0x1111b4 thru 0x11f22c (0xe079 bytes) 088000 1734017720.453287 read 0x2ae89b thru 0x2b034d (0x1ab3 bytes) 090000 1734017725.593260 read 0x03d261 thru 0x049d7b (0xcb1b bytes) 092000 1734017730.583939 mapread 0x177b04 thru 0x1831eb (0xb6e8 bytes) 095000 1734017737.702625 trunc from 0x07ca16 to 0x55c3a3 (0x4df98e bytes) truncating to largest ever: 0x561aed All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 1633247 (1664 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (273s) == sanity-benchmark test complete, duration 1929 sec ===== 10:35:51 (1734017751) === sanity-benchmark: start cleanup 10:35:51 (1734017751) === === sanity-benchmark: finish cleanup 10:35:52 (1734017752) ===