-----============= acceptance-small: sanity-benchmark ============----- Thu Jun 13 18:04:25 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 18:04:29 (1718316269) === oleg120-client.virtnet: executing check_config_client /mnt/lustre oleg120-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg120-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ad929000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ad929000.idle_timeout=debug disable quota as required oleg120-server: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 18:04:35 (1718316275) === == sanity-benchmark test dbench: dbench ================== 18:04:35 (1718316275) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6941] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg120-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg120-client.virtnet at Thu Jun 13 18:04:36 EDT 2024 waiting for dbench pid 8924 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 155 130.38 MB/sec warmup 1 sec latency 95.939 ms 20 325 118.10 MB/sec warmup 2 sec latency 72.733 ms 20 504 116.94 MB/sec warmup 3 sec latency 50.597 ms 20 676 105.82 MB/sec warmup 4 sec latency 288.378 ms 20 772 85.46 MB/sec warmup 5 sec latency 172.759 ms 20 901 72.30 MB/sec warmup 6 sec latency 88.272 ms 20 1099 65.53 MB/sec warmup 7 sec latency 102.258 ms 20 1395 64.29 MB/sec warmup 8 sec latency 34.198 ms 20 1589 58.08 MB/sec warmup 9 sec latency 172.078 ms 20 1832 52.68 MB/sec warmup 10 sec latency 84.341 ms 20 2121 48.50 MB/sec warmup 11 sec latency 83.801 ms 20 2405 46.72 MB/sec warmup 12 sec latency 154.633 ms 20 2682 46.93 MB/sec warmup 13 sec latency 140.713 ms 20 3088 48.44 MB/sec warmup 14 sec latency 154.751 ms 20 3516 49.89 MB/sec warmup 15 sec latency 129.303 ms 20 3808 49.64 MB/sec warmup 16 sec latency 28.255 ms 20 3999 47.13 MB/sec warmup 17 sec latency 27.115 ms 20 4170 44.62 MB/sec warmup 18 sec latency 245.861 ms 20 4304 42.56 MB/sec warmup 19 sec latency 192.854 ms 20 4463 40.81 MB/sec warmup 20 sec latency 101.008 ms 20 4700 40.09 MB/sec warmup 21 sec latency 139.788 ms 20 5040 41.05 MB/sec warmup 22 sec latency 83.883 ms 20 5252 39.42 MB/sec warmup 23 sec latency 75.855 ms 20 5783 12.02 MB/sec execute 1 sec latency 74.331 ms 20 6015 19.18 MB/sec execute 2 sec latency 125.271 ms 20 6338 34.55 MB/sec execute 3 sec latency 186.450 ms 20 6722 39.58 MB/sec execute 4 sec latency 124.912 ms 20 7070 44.35 MB/sec execute 5 sec latency 157.235 ms 20 7330 43.71 MB/sec execute 6 sec latency 28.463 ms 20 7500 38.89 MB/sec execute 7 sec latency 34.493 ms 20 7654 34.24 MB/sec execute 8 sec latency 195.077 ms 20 7799 30.87 MB/sec execute 9 sec latency 193.219 ms 20 7909 28.28 MB/sec execute 10 sec latency 137.972 ms 20 8063 26.55 MB/sec execute 11 sec latency 266.081 ms 20 8346 27.53 MB/sec execute 12 sec latency 96.599 ms 20 8635 28.90 MB/sec execute 13 sec latency 147.986 ms 20 8834 27.07 MB/sec execute 14 sec latency 86.138 ms 20 9074 25.63 MB/sec execute 15 sec latency 85.977 ms 20 9338 24.87 MB/sec execute 16 sec latency 77.078 ms 20 9579 25.06 MB/sec execute 17 sec latency 125.291 ms 20 9915 27.24 MB/sec execute 18 sec latency 127.812 ms 20 10288 28.73 MB/sec execute 19 sec latency 151.081 ms 20 10657 30.63 MB/sec execute 20 sec latency 106.798 ms 20 10866 30.59 MB/sec execute 21 sec latency 38.252 ms 20 11044 29.73 MB/sec execute 22 sec latency 34.154 ms 20 11180 28.51 MB/sec execute 23 sec latency 181.430 ms 20 11342 27.49 MB/sec execute 24 sec latency 197.680 ms 20 11431 26.57 MB/sec execute 25 sec latency 180.541 ms 20 11556 25.82 MB/sec execute 26 sec latency 128.873 ms 20 11760 25.64 MB/sec execute 27 sec latency 119.965 ms 20 12022 26.39 MB/sec execute 28 sec latency 91.762 ms 20 12259 26.18 MB/sec execute 29 sec latency 83.187 ms 20 12500 25.45 MB/sec execute 30 sec latency 95.917 ms 20 12766 24.88 MB/sec execute 31 sec latency 101.369 ms 20 13054 25.00 MB/sec execute 32 sec latency 112.921 ms 20 13332 25.44 MB/sec execute 33 sec latency 133.053 ms 20 13718 27.08 MB/sec execute 34 sec latency 139.860 ms 20 14092 27.60 MB/sec execute 35 sec latency 137.505 ms 20 14436 28.52 MB/sec execute 36 sec latency 120.065 ms 20 14640 28.06 MB/sec execute 37 sec latency 185.501 ms 20 14848 27.39 MB/sec execute 38 sec latency 149.402 ms 20 15014 26.89 MB/sec execute 39 sec latency 230.239 ms 20 15233 26.69 MB/sec execute 40 sec latency 121.283 ms 20 15514 26.85 MB/sec execute 41 sec latency 191.967 ms 20 15828 27.19 MB/sec execute 42 sec latency 85.260 ms 20 16098 26.72 MB/sec execute 43 sec latency 75.782 ms 20 16425 26.47 MB/sec execute 44 sec latency 61.177 ms 20 16784 26.86 MB/sec execute 45 sec latency 102.778 ms 20 17271 28.38 MB/sec execute 46 sec latency 177.925 ms 20 17707 28.94 MB/sec execute 47 sec latency 128.009 ms 20 18046 29.48 MB/sec execute 48 sec latency 147.415 ms 20 18214 29.00 MB/sec execute 49 sec latency 140.143 ms 20 18436 28.49 MB/sec execute 50 sec latency 148.345 ms 20 18624 28.18 MB/sec execute 51 sec latency 122.771 ms 20 18869 28.02 MB/sec execute 52 sec latency 93.857 ms 20 19259 28.70 MB/sec execute 53 sec latency 75.782 ms 20 19532 28.30 MB/sec execute 54 sec latency 86.331 ms 20 19808 27.98 MB/sec execute 55 sec latency 71.788 ms 20 20117 27.85 MB/sec execute 56 sec latency 92.677 ms 20 20397 28.04 MB/sec execute 57 sec latency 127.983 ms 20 20775 28.85 MB/sec execute 58 sec latency 157.187 ms 20 21130 29.09 MB/sec execute 59 sec latency 163.092 ms 20 21466 29.68 MB/sec execute 60 sec latency 124.540 ms 20 21692 29.52 MB/sec execute 61 sec latency 96.419 ms 20 21872 29.14 MB/sec execute 62 sec latency 141.748 ms 20 22064 28.75 MB/sec execute 63 sec latency 194.020 ms 20 22204 28.48 MB/sec execute 64 sec latency 123.798 ms 20 22376 28.22 MB/sec execute 65 sec latency 115.759 ms 20 22606 28.19 MB/sec execute 66 sec latency 117.083 ms 20 22889 28.48 MB/sec execute 67 sec latency 96.189 ms 20 23112 28.14 MB/sec execute 68 sec latency 75.592 ms 20 23364 27.93 MB/sec execute 69 sec latency 65.801 ms 20 23681 27.81 MB/sec execute 70 sec latency 68.828 ms 20 23945 27.90 MB/sec execute 71 sec latency 186.207 ms 20 24315 28.43 MB/sec execute 72 sec latency 120.319 ms 20 24685 28.79 MB/sec execute 73 sec latency 145.658 ms 20 25010 29.22 MB/sec execute 74 sec latency 133.810 ms 20 25198 29.06 MB/sec execute 75 sec latency 117.483 ms 20 25379 28.80 MB/sec execute 76 sec latency 132.556 ms 20 25561 28.51 MB/sec execute 77 sec latency 137.502 ms 20 25732 28.26 MB/sec execute 78 sec latency 121.848 ms 20 25905 28.04 MB/sec execute 79 sec latency 111.917 ms 20 26104 27.93 MB/sec execute 80 sec latency 116.441 ms 20 26378 28.06 MB/sec execute 81 sec latency 86.473 ms 20 26555 27.98 MB/sec execute 82 sec latency 100.544 ms 20 26698 27.73 MB/sec execute 83 sec latency 103.238 ms 20 26870 27.50 MB/sec execute 84 sec latency 94.561 ms 20 27055 27.28 MB/sec execute 85 sec latency 84.548 ms 20 27279 27.15 MB/sec execute 86 sec latency 87.966 ms 20 27492 27.16 MB/sec execute 87 sec latency 138.386 ms 20 27709 27.23 MB/sec execute 88 sec latency 138.208 ms 20 28016 27.58 MB/sec execute 89 sec latency 144.866 ms 20 28266 27.64 MB/sec execute 90 sec latency 142.140 ms 20 28509 27.80 MB/sec execute 91 sec latency 109.559 ms 20 28702 27.77 MB/sec execute 92 sec latency 110.030 ms 20 28865 27.62 MB/sec execute 93 sec latency 120.207 ms 20 29047 27.42 MB/sec execute 94 sec latency 119.336 ms 20 29228 27.21 MB/sec execute 95 sec latency 141.649 ms 20 29367 27.01 MB/sec execute 96 sec latency 157.387 ms 20 29536 26.84 MB/sec execute 97 sec latency 106.141 ms 20 29733 26.81 MB/sec execute 98 sec latency 113.280 ms 20 29947 26.79 MB/sec execute 99 sec latency 121.647 ms 20 30142 26.82 MB/sec execute 100 sec latency 122.533 ms 20 30302 26.65 MB/sec execute 101 sec latency 236.418 ms 20 30498 26.48 MB/sec execute 102 sec latency 120.590 ms 20 30706 26.36 MB/sec execute 103 sec latency 93.660 ms 20 30899 26.23 MB/sec execute 104 sec latency 87.938 ms 20 31123 26.28 MB/sec execute 105 sec latency 122.463 ms 20 31381 26.41 MB/sec execute 106 sec latency 150.041 ms 20 31684 26.69 MB/sec execute 107 sec latency 158.345 ms 20 31937 26.73 MB/sec execute 108 sec latency 162.662 ms 20 32171 26.90 MB/sec execute 109 sec latency 128.364 ms 20 32327 26.76 MB/sec execute 110 sec latency 129.924 ms 20 32492 26.64 MB/sec execute 111 sec latency 132.453 ms 20 32642 26.46 MB/sec execute 112 sec latency 128.810 ms 20 32806 26.26 MB/sec execute 113 sec latency 172.871 ms 20 32940 26.12 MB/sec execute 114 sec latency 126.907 ms 20 33116 26.02 MB/sec execute 115 sec latency 115.820 ms 20 33301 25.92 MB/sec execute 116 sec latency 132.077 ms 20 33548 25.99 MB/sec execute 117 sec latency 115.097 ms 20 33801 26.05 MB/sec execute 118 sec latency 108.305 ms 20 34017 25.94 MB/sec execute 119 sec latency 74.434 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 99433 12.155 58.505 Close 73217 2.977 23.470 Rename 4204 15.763 53.193 Unlink 19978 4.652 31.689 Qpathinfo 90194 2.743 46.681 Qfileinfo 15753 0.078 9.508 Qfsinfo 16479 0.034 6.410 Sfileinfo 8068 8.058 33.538 Find 34846 0.497 39.840 WriteX 49149 0.980 26.622 ReadX 156331 0.014 4.911 LockX 326 3.697 12.142 UnlockX 326 3.614 11.938 Flush 6932 61.412 266.073 Throughput 25.9378 MB/sec 20 clients 20 procs max_latency=266.081 ms stopping dbench on /mnt/lustre/d0.oleg120-client.virtnet at Thu Jun 13 18:07:01 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg120-client.virtnet /mnt/lustre/d0.oleg120-client.virtnet /mnt/lustre/d0.oleg120-client.virtnet removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg120-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 18:07:04 (1718316424) min OST has 3230720kB available, using 4846080kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6941] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4732] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg120-clien 4732M 146403 98 124328 93 376600 83 1903 138 Latency 3159us 33575us 31069us 197ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg120-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 457 16 8058 32 580 11 434 15 1299 12 611 11 Latency 14080us 13141us 57723us 14549us 4853us 14373us 1.97,1.97,oleg120-client.virtnet,1,1718307482,4732M,,,,146403,98,124328,93,,,376600,83,1903,138,10,,,,,457,16,8058,32,580,11,434,15,1299,12,611,11,,3159us,33575us,,31069us,197ms,14080us,13141us,57723us,14549us,4853us,14373us debug=0x33f0484 PASS bonnie (185s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 18:10:09 (1718316609) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 2778 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 2778 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x30ff0a truncating to largest ever: 0x53e7f5 truncating to largest ever: 0x54f1aa truncating to largest ever: 0x55b806 002000 1718316615.847517 read 0x2048e9 thru 0x20aa1c (0x6134 bytes) 003000 1718316618.682441 write 0x0d0f28 thru 0x0d655d (0x5636 bytes) 004000 1718316621.432572 trunc from 0x4f8cf3 to 0x051a89 (0x4a7269 bytes) 005000 1718316624.328445 trunc from 0x363da7 to 0x2040ce (0x15fcd8 bytes) 006000 1718316627.930587 trunc from 0x25dcb3 to 0x3f5674 (0x1979c2 bytes) truncating to largest ever: 0x55c3f6 007000 1718316631.283624 mapwrite 0x175de5 thru 0x1797e2 (0x39fe bytes) 008000 1718316634.717280 read 0x0d109c thru 0x0e09a6 (0xf90b bytes) truncating to largest ever: 0x55c766 009000 1718316637.752696 read 0x00f6b1 thru 0x0150a2 (0x59f2 bytes) 010000 1718316640.619477 mapread 0x2ebf29 thru 0x2f4975 (0x8a4d bytes) truncating to largest ever: 0x55e235 014000 1718316651.199332 write 0x3ebaf8 thru 0x3ef86d (0x3d76 bytes) 017000 1718316659.633357 trunc from 0x265533 to 0x555cb9 (0x2f0787 bytes) truncating to largest ever: 0x55f7aa truncating to largest ever: 0x5606e8 021000 1718316672.492201 mapwrite 0x1fc8f3 thru 0x20039b (0x3aa9 bytes) 027000 1718316690.837054 trunc from 0x4ffb26 to 0x41a4a3 (0xe5682 bytes) truncating to largest ever: 0x56137a 032000 1718316706.379442 mapread 0x182701 thru 0x18bc2c (0x952c bytes) 036000 1718316717.045415 read 0x457783 thru 0x45f1de (0x7a5c bytes) 038000 1718316722.539692 trunc from 0x4fc5b5 to 0x529b24 (0x2d570 bytes) 040000 1718316727.954333 read 0x05c87b thru 0x065f03 (0x9689 bytes) 041000 1718316730.410813 trunc from 0x4e7b81 to 0x4f3312 (0xb792 bytes) 044000 1718316737.983861 trunc from 0x406017 to 0x2b34d2 (0x152b44 bytes) 045000 1718316741.002302 read 0x1c4e1d thru 0x1ca2fe (0x54e2 bytes) 046000 1718316743.962648 trunc from 0x4f7ee2 to 0x0a7cac (0x450235 bytes) truncating to largest ever: 0x562511 047000 1718316746.485459 mapread 0x00777f thru 0x00fa1c (0x829e bytes) 048000 1718316749.156531 read 0x3611a0 thru 0x361ec8 (0xd29 bytes) 051000 1718316757.142208 read 0x14336e thru 0x147df2 (0x4a85 bytes) 052000 1718316759.684572 mapread 0x0de2cd thru 0x0e0d4d (0x2a81 bytes) 055000 1718316768.266503 mapwrite 0x4a1a40 thru 0x4aec1f (0xd1e0 bytes) 057000 1718316774.235490 trunc from 0x250290 to 0x12ada6 (0x1254e9 bytes) 058000 1718316777.451578 write 0x0e3214 thru 0x0f24e2 (0xf2cf bytes) 059000 1718316780.648812 read 0x131b3f thru 0x139855 (0x7d17 bytes) 060000 1718316783.498809 read 0x420695 thru 0x42c537 (0xbea3 bytes) 062000 1718316789.748584 write 0x3b9475 thru 0x3be0b7 (0x4c43 bytes) 064000 1718316795.170605 read 0x143122 thru 0x151f0e (0xeded bytes) 065000 1718316797.894845 mapwrite 0x2fec24 thru 0x30114b (0x2528 bytes) 066000 1718316800.444704 mapread 0x054a5d thru 0x059cb6 (0x525a bytes) 068000 1718316806.025241 mapread 0x0feb96 thru 0x1004e4 (0x194f bytes) 071000 1718316814.521510 mapread 0x09c2c2 thru 0x0a3fb7 (0x7cf6 bytes) 074000 1718316822.753444 read 0x07f9d5 thru 0x081607 (0x1c33 bytes) 078000 1718316833.917801 mapwrite 0x47d635 thru 0x480741 (0x310d bytes) 082000 1718316844.596418 trunc from 0x541d4d to 0x468e2c (0xd8f20 bytes) 084000 1718316849.905115 trunc from 0x50ae23 to 0x37b310 (0x18fb12 bytes) 089000 1718316863.829175 trunc from 0x50fe2c to 0x3c0adf (0x14f34c bytes) 090000 1718316866.486715 read 0x3051d6 thru 0x313de5 (0xec10 bytes) 091000 1718316868.888796 read 0x0bfd52 thru 0x0c272b (0x29da bytes) 092000 1718316871.515349 trunc from 0x4507c3 to 0x232f88 (0x21d83a bytes) 093000 1718316874.266945 mapwrite 0x4aab56 thru 0x4b4077 (0x9522 bytes) 094000 1718316876.989873 mapread 0x06a664 thru 0x06ed64 (0x4701 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (286s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 18:14:55 (1718316895) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1718316905.731029 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1718316913.568048 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1718316917.357083 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1718316930.064118 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1718316932.691112 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1718316943.382827 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1718316946.197264 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1718316952.272781 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1718316959.282996 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1718316962.920037 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1718316969.404654 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1718316973.369233 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1718316986.495984 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1718316992.571004 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1718317003.035295 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1718317012.144784 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1718317014.814221 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1718317026.873345 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1718317030.327886 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1718317039.456397 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1718317042.130528 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1718317045.447535 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1718317054.710679 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1718317061.180793 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1718317083.865450 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1718317105.418492 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1718317218.778911 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1718317252.243804 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1718317263.536185 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1718317273.846755 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1718317285.042425 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1718317313.323097 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1718317321.807087 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1718317349.098121 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1718317356.589764 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1718317374.760208 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1718317396.438424 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1718317407.214436 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1718317441.325467 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1718317504.925907 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1718317515.866901 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1718317539.018059 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1718317564.699347 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (683s) == sanity-benchmark test complete, duration 1312 sec ===== 18:26:18 (1718317578) === sanity-benchmark: start cleanup 18:26:18 (1718317578) === === sanity-benchmark: finish cleanup 18:26:18 (1718317578) ===