-----============= acceptance-small: sanity-benchmark ============----- Tue Feb 27 12:09:22 EST 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 12:09:24 (1709053764) === oleg101-client.virtnet: executing check_config_client /mnt/lustre oleg101-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg101-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aadcb000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aadcb000.idle_timeout=debug disable quota as required oleg101-server: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 12:09:30 (1709053770) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 12:09:31 (1709053771) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6700] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg101-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg101-client.virtnet at Tue Feb 27 12:09:32 EST 2024 waiting for dbench pid 8623 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 217 168.24 MB/sec warmup 1 sec latency 97.433 ms 20 454 159.25 MB/sec warmup 2 sec latency 43.564 ms 20 690 141.21 MB/sec warmup 3 sec latency 238.810 ms 20 848 107.80 MB/sec warmup 4 sec latency 121.667 ms 20 1012 89.16 MB/sec warmup 5 sec latency 104.090 ms 20 1248 77.41 MB/sec warmup 6 sec latency 29.248 ms 20 1504 74.44 MB/sec warmup 7 sec latency 161.531 ms 20 1736 65.64 MB/sec warmup 8 sec latency 88.189 ms 20 2010 58.94 MB/sec warmup 9 sec latency 118.269 ms 20 2345 55.73 MB/sec warmup 10 sec latency 109.212 ms 20 2579 52.87 MB/sec warmup 11 sec latency 104.827 ms 20 3032 56.08 MB/sec warmup 12 sec latency 110.536 ms 20 3565 59.13 MB/sec warmup 13 sec latency 96.226 ms 20 3832 56.82 MB/sec warmup 14 sec latency 24.012 ms 20 4040 53.41 MB/sec warmup 15 sec latency 26.135 ms 20 4243 50.36 MB/sec warmup 16 sec latency 257.168 ms 20 4406 47.83 MB/sec warmup 17 sec latency 193.510 ms 20 4673 46.73 MB/sec warmup 18 sec latency 86.825 ms 20 5055 47.54 MB/sec warmup 19 sec latency 98.159 ms 20 5300 45.38 MB/sec warmup 20 sec latency 64.824 ms 20 5613 43.51 MB/sec warmup 21 sec latency 60.884 ms 20 5943 42.82 MB/sec warmup 22 sec latency 111.512 ms 20 6219 42.92 MB/sec warmup 23 sec latency 142.120 ms 20 7106 79.09 MB/sec execute 1 sec latency 128.447 ms 20 7366 56.41 MB/sec execute 2 sec latency 30.067 ms 20 7547 39.56 MB/sec execute 3 sec latency 26.139 ms 20 7735 30.19 MB/sec execute 4 sec latency 232.103 ms 20 7901 25.67 MB/sec execute 5 sec latency 136.362 ms 20 8104 23.58 MB/sec execute 6 sec latency 127.090 ms 20 8418 25.59 MB/sec execute 7 sec latency 96.424 ms 20 8732 27.88 MB/sec execute 8 sec latency 101.101 ms 20 9010 25.30 MB/sec execute 9 sec latency 57.677 ms 20 9338 24.04 MB/sec execute 10 sec latency 146.713 ms 20 9651 26.03 MB/sec execute 11 sec latency 151.047 ms 20 10152 31.49 MB/sec execute 12 sec latency 177.956 ms 20 10633 35.13 MB/sec execute 13 sec latency 124.074 ms 20 10926 35.43 MB/sec execute 14 sec latency 23.565 ms 20 11103 33.41 MB/sec execute 15 sec latency 176.898 ms 20 11328 31.54 MB/sec execute 16 sec latency 152.109 ms 20 11474 30.10 MB/sec execute 17 sec latency 163.199 ms 20 11658 29.44 MB/sec execute 18 sec latency 99.438 ms 20 11980 30.00 MB/sec execute 19 sec latency 113.611 ms 20 12282 30.27 MB/sec execute 20 sec latency 84.286 ms 20 12545 29.09 MB/sec execute 21 sec latency 59.970 ms 20 12869 28.39 MB/sec execute 22 sec latency 76.653 ms 20 13167 28.53 MB/sec execute 23 sec latency 99.005 ms 20 13621 31.31 MB/sec execute 24 sec latency 114.932 ms 20 14108 32.86 MB/sec execute 25 sec latency 106.417 ms 20 14426 33.56 MB/sec execute 26 sec latency 48.248 ms 20 14614 32.70 MB/sec execute 27 sec latency 142.564 ms 20 14827 31.65 MB/sec execute 28 sec latency 113.799 ms 20 14989 30.81 MB/sec execute 29 sec latency 153.618 ms 20 15186 30.22 MB/sec execute 30 sec latency 94.697 ms 20 15482 30.26 MB/sec execute 31 sec latency 111.381 ms 20 15807 30.86 MB/sec execute 32 sec latency 81.814 ms 20 16065 30.09 MB/sec execute 33 sec latency 51.682 ms 20 16389 29.58 MB/sec execute 34 sec latency 67.740 ms 20 16694 29.72 MB/sec execute 35 sec latency 160.617 ms 20 17112 31.26 MB/sec execute 36 sec latency 124.498 ms 20 17546 31.84 MB/sec execute 37 sec latency 166.371 ms 20 17907 32.79 MB/sec execute 38 sec latency 90.803 ms 20 18133 32.42 MB/sec execute 39 sec latency 135.290 ms 20 18336 31.69 MB/sec execute 40 sec latency 189.574 ms 20 18525 31.11 MB/sec execute 41 sec latency 195.037 ms 20 18711 30.65 MB/sec execute 42 sec latency 110.408 ms 20 19003 30.69 MB/sec execute 43 sec latency 100.336 ms 20 19317 31.12 MB/sec execute 44 sec latency 90.487 ms 20 19540 30.54 MB/sec execute 45 sec latency 72.288 ms 20 19812 30.07 MB/sec execute 46 sec latency 54.059 ms 20 20126 29.88 MB/sec execute 47 sec latency 63.005 ms 20 20390 30.06 MB/sec execute 48 sec latency 123.250 ms 20 20810 31.03 MB/sec execute 49 sec latency 102.957 ms 20 21217 31.56 MB/sec execute 50 sec latency 123.610 ms 20 21552 32.05 MB/sec execute 51 sec latency 71.856 ms 20 21773 31.73 MB/sec execute 52 sec latency 131.852 ms 20 22005 31.21 MB/sec execute 53 sec latency 106.256 ms 20 22193 30.83 MB/sec execute 54 sec latency 135.419 ms 20 22422 30.54 MB/sec execute 55 sec latency 101.384 ms 20 22743 30.75 MB/sec execute 56 sec latency 101.078 ms 20 23065 30.88 MB/sec execute 57 sec latency 81.786 ms 20 23349 30.49 MB/sec execute 58 sec latency 65.550 ms 20 23679 30.32 MB/sec execute 59 sec latency 72.344 ms 20 24018 30.69 MB/sec execute 60 sec latency 146.168 ms 20 24481 31.51 MB/sec execute 61 sec latency 126.351 ms 20 24902 32.03 MB/sec execute 62 sec latency 97.276 ms 20 25186 32.16 MB/sec execute 63 sec latency 94.880 ms 20 25420 31.83 MB/sec execute 64 sec latency 76.807 ms 20 25631 31.42 MB/sec execute 65 sec latency 163.830 ms 20 25806 31.08 MB/sec execute 66 sec latency 126.136 ms 20 26097 31.10 MB/sec execute 67 sec latency 89.613 ms 20 26471 31.48 MB/sec execute 68 sec latency 98.998 ms 20 26758 31.13 MB/sec execute 69 sec latency 90.625 ms 20 27075 30.88 MB/sec execute 70 sec latency 81.296 ms 20 27451 31.04 MB/sec execute 71 sec latency 78.807 ms 20 27909 31.69 MB/sec execute 72 sec latency 116.442 ms 20 28367 32.21 MB/sec execute 73 sec latency 108.856 ms 20 28697 32.47 MB/sec execute 74 sec latency 90.114 ms 20 28950 32.26 MB/sec execute 75 sec latency 160.656 ms 20 29173 31.90 MB/sec execute 76 sec latency 145.032 ms 20 29374 31.64 MB/sec execute 77 sec latency 108.423 ms 20 29668 31.70 MB/sec execute 78 sec latency 100.602 ms 20 30029 31.96 MB/sec execute 79 sec latency 59.361 ms 20 30326 31.67 MB/sec execute 80 sec latency 73.709 ms 20 30652 31.47 MB/sec execute 81 sec latency 69.878 ms 20 30963 31.47 MB/sec execute 82 sec latency 101.753 ms 20 31366 31.89 MB/sec execute 83 sec latency 110.873 ms 20 31829 32.42 MB/sec execute 84 sec latency 100.727 ms 20 32181 32.72 MB/sec execute 85 sec latency 85.826 ms 20 32425 32.55 MB/sec execute 86 sec latency 108.732 ms 20 32631 32.23 MB/sec execute 87 sec latency 238.296 ms 20 32813 31.94 MB/sec execute 88 sec latency 151.063 ms 20 33056 31.80 MB/sec execute 89 sec latency 107.370 ms 20 33396 31.96 MB/sec execute 90 sec latency 88.936 ms 20 33712 31.99 MB/sec execute 91 sec latency 74.810 ms 20 34020 31.75 MB/sec execute 92 sec latency 54.265 ms 20 34328 31.61 MB/sec execute 93 sec latency 82.085 ms 20 34660 31.75 MB/sec execute 94 sec latency 139.222 ms 20 35079 32.22 MB/sec execute 95 sec latency 137.201 ms 20 35507 32.57 MB/sec execute 96 sec latency 135.205 ms 20 35815 32.68 MB/sec execute 97 sec latency 122.674 ms 20 36035 32.49 MB/sec execute 98 sec latency 118.183 ms 20 36238 32.21 MB/sec execute 99 sec latency 98.445 ms 20 36417 31.97 MB/sec execute 100 sec latency 178.051 ms 20 36652 31.88 MB/sec execute 101 sec latency 104.259 ms 20 36945 31.97 MB/sec execute 102 sec latency 98.054 ms 20 37174 31.96 MB/sec execute 103 sec latency 117.391 ms 20 37327 31.70 MB/sec execute 104 sec latency 99.875 ms 20 37427 31.43 MB/sec execute 105 sec latency 187.267 ms 20 37518 31.16 MB/sec execute 106 sec latency 201.738 ms 20 37592 30.89 MB/sec execute 107 sec latency 190.266 ms 20 37681 30.65 MB/sec execute 108 sec latency 192.628 ms 20 37773 30.39 MB/sec execute 109 sec latency 210.520 ms 20 37870 30.22 MB/sec execute 110 sec latency 167.669 ms 20 37965 30.03 MB/sec execute 111 sec latency 197.900 ms 20 38050 29.85 MB/sec execute 112 sec latency 249.467 ms 20 38180 29.75 MB/sec execute 113 sec latency 270.427 ms 20 38303 29.70 MB/sec execute 114 sec latency 215.645 ms 20 38435 29.64 MB/sec execute 115 sec latency 233.793 ms 20 38557 29.56 MB/sec execute 116 sec latency 263.786 ms 20 38696 29.51 MB/sec execute 117 sec latency 268.259 ms 20 38793 29.40 MB/sec execute 118 sec latency 249.360 ms 20 38887 29.24 MB/sec execute 119 sec latency 347.106 ms 20 cleanup 120 sec 20 cleanup 121 sec 19 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 111590 10.852 104.670 Close 82002 2.579 71.607 Rename 4725 14.451 106.527 Unlink 22552 4.190 67.190 Qpathinfo 100933 2.540 97.597 Qfileinfo 17590 0.075 8.487 Qfsinfo 18746 0.082 13.608 Sfileinfo 9020 6.798 93.414 Find 39449 0.576 45.051 WriteX 55132 0.845 42.980 ReadX 176221 0.012 3.374 LockX 360 3.786 54.417 UnlockX 360 3.618 28.937 Flush 7838 53.181 347.100 Throughput 29.2359 MB/sec 20 clients 20 procs max_latency=347.106 ms stopping dbench on /mnt/lustre/d0.oleg101-client.virtnet at Tue Feb 27 12:11:59 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg101-client.virtnet /mnt/lustre/d0.oleg101-client.virtnet /mnt/lustre/d0.oleg101-client.virtnet removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg101-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (153s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 12:12:06 (1709053926) min OST has 3272704kB available, using 4909056kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6700] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4794] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg101-clien 4794M 127994 87 114400 83 275544 63 869.8 125 Latency 29132us 32032us 49088us 887ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg101-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 113 24 2445 40 145 26 73 15 134 22 84 17 Latency 92138us 28958us 128ms 11068ms 1051ms 11043ms 1.97,1.97,oleg101-client.virtnet,1,1709060568,4794M,,,,127994,87,114400,83,,,275544,63,869.8,125,10,,,,,113,24,2445,40,145,26,73,15,134,22,84,17,,29132us,32032us,,49088us,887ms,92138us,28958us,128ms,11068ms,1051ms,11043ms debug=0x33f0484 PASS bonnie (618s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 12:22:29 (1709054549) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 22906 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 22906 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x542e7e truncating to largest ever: 0x5485fc 001000 1709054568.747550 mapread 0x110764 thru 0x11bcae (0xb54b bytes) truncating to largest ever: 0x55baff 003000 1709054592.966976 mapread 0x0fc6a3 thru 0x109466 (0xcdc4 bytes) truncating to largest ever: 0x561e5f 004000 1709054606.324497 mapread 0x4d92ad thru 0x4dedab (0x5aff bytes) 005000 1709054622.702020 mapwrite 0x0901ba thru 0x095f74 (0x5dbb bytes) 006000 1709054658.730237 trunc from 0x279977 to 0x4c47e5 (0x24ae6f bytes) 007000 1709054672.259722 mapread 0x51e088 thru 0x52c347 (0xe2c0 bytes) 009000 1709054717.387649 write 0x42f38b thru 0x436c9f (0x7915 bytes) 011000 1709054764.866331 trunc from 0x4648ed to 0x4456db (0x1f211 bytes) 012000 1709054777.181755 mapread 0x45ea49 thru 0x46a36f (0xb927 bytes) skipping zero size read 015000 1709054810.039573 mapread 0x2a7bfe thru 0x2a7e9b (0x29e bytes) 016000 1709054822.459281 mapwrite 0x0602b3 thru 0x06e817 (0xe565 bytes) 023000 1709054914.162474 mapwrite 0x539ac0 thru 0x53edd4 (0x5315 bytes) 025000 1709054933.607015 mapwrite 0x278f61 thru 0x27c61a (0x36ba bytes) 027000 1709054949.533025 mapread 0x42ba86 thru 0x42db56 (0x20d1 bytes) 028000 1709054956.739216 mapread 0x17f15a thru 0x18922e (0xa0d5 bytes) 029000 1709054964.784874 trunc from 0x36213b to 0x285407 (0xdcd33 bytes) 030000 1709054974.039300 mapwrite 0x280f77 thru 0x28bdd2 (0xae5c bytes) 032000 1709054999.650423 mapwrite 0x321d58 thru 0x32acb4 (0x8f5d bytes) 033000 1709055037.588484 write 0x04e1d1 thru 0x05ca22 (0xe852 bytes) truncating to largest ever: 0x562d5e 035000 1709055067.553457 write 0x32bfb2 thru 0x32e1ce (0x221d bytes) 036000 1709055081.218155 mapread 0x12ce47 thru 0x1316f9 (0x48b3 bytes) 040000 1709055132.452582 write 0x057224 thru 0x05ac7e (0x3a5b bytes) 042000 1709055151.049302 trunc from 0x0fd6ea to 0x2579de (0x15a2f5 bytes) 046000 1709055191.376181 mapread 0x4221d0 thru 0x427f82 (0x5db3 bytes) 047000 1709055200.532362 mapread 0x18cf66 thru 0x19a4c9 (0xd564 bytes) 048000 1709055211.801668 write 0x4cead6 thru 0x4d40af (0x55da bytes) 051000 1709055243.153035 read 0x01ef91 thru 0x02b66c (0xc6dc bytes) 052000 1709055252.973575 read 0x21bd07 thru 0x229e75 (0xe16f bytes) 054000 1709055277.841835 trunc from 0x479734 to 0x0ce00d (0x3ab726 bytes) 056000 1709055328.675458 trunc from 0x55aa98 to 0x43d928 (0x11d16f bytes) 057000 1709055342.042245 mapwrite 0x055b0e thru 0x064b39 (0xf02c bytes) 058000 1709055354.643742 mapwrite 0x25762f thru 0x26246b (0xae3d bytes) 061000 1709055399.009548 mapwrite 0x53f612 thru 0x545786 (0x6175 bytes) 062000 1709055411.249566 mapwrite 0x278584 thru 0x282664 (0xa0e1 bytes) 067000 1709055490.510820 write 0x3c4062 thru 0x3c74c0 (0x345f bytes) 070000 1709055521.050808 trunc from 0x460743 to 0x055078 (0x40b6ca bytes) 074000 1709055558.852511 mapread 0x1c474d thru 0x1cc8cb (0x817f bytes) 075000 1709055568.720836 trunc from 0x43f6b6 to 0x0fcb81 (0x342b34 bytes) 080000 1709055611.770327 write 0x1ce2d3 thru 0x1dcb0c (0xe83a bytes) 082000 1709055632.062304 write 0x2da569 thru 0x2dc592 (0x202a bytes) 083000 1709055641.884960 trunc from 0x3b79d9 to 0x21fc37 (0x197da1 bytes) 085000 1709055662.414874 read 0x12b313 thru 0x12e32d (0x301b bytes) 088000 1709055691.809184 mapread 0x0456f0 thru 0x0528eb (0xd1fc bytes) 093000 1709055732.802582 read 0x3ec6e5 thru 0x3f9be9 (0xd505 bytes) 095000 1709055749.610955 mapwrite 0x50cf95 thru 0x51c1d0 (0xf23c bytes) 100000 1709055789.938689 trunc from 0x3f3d15 to 0x24bd90 (0x1a7f84 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (1243s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 12:43:14 (1709055794) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1709055830.348613 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1709055865.141536 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1709055876.086840 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1709055922.426027 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1709055945.279749 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1709055985.346521 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1709055995.652742 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1709056015.135029 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1709056035.545985 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1709056044.033290 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1709056062.624476 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1709056086.584783 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1709056123.057230 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1709056141.388440 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1709056170.091725 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1709056201.829685 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1709056210.995606 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1709056249.650721 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1709056261.296566 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1709056304.538010 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1709056313.270790 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1709056323.136769 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1709056353.444606 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1709056382.982820 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1709056398.290558 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1709056409.677865 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1709056516.181409 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1709056546.024322 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1709056556.435925 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1709056565.790733 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1709056574.935623 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1709056605.217822 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1709056616.569793 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1709056659.624959 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1709056672.147135 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1709056705.160112 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1709056739.703577 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1709056749.834722 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1709056780.361567 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1709056846.039393 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1709056855.521633 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1709056884.950598 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1709056904.371722 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (1119s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 3150 sec ===== 13:01:53 (1709056913) === sanity-benchmark: start cleanup 13:01:54 (1709056914) === === sanity-benchmark: finish cleanup 13:01:54 (1709056914) ===