== sanity-quota test 8: Run dbench with quota enabled ==== 05:53:57 (1730804037) sleep 5 for ZFS zfs Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 Waiting 90s for 'ugp' Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr /home/green/git/lustre-release/lustre/utils/lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Tue Nov 5 05:54:07 EST 2024 waiting for dbench pid 16281 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 1 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 228 26.39 MB/sec warmup 1 sec latency 31.208 ms 3 461 24.25 MB/sec warmup 2 sec latency 23.785 ms 3 703 21.20 MB/sec warmup 3 sec latency 86.437 ms 3 893 16.26 MB/sec warmup 4 sec latency 30.784 ms 3 1099 13.77 MB/sec warmup 5 sec latency 32.842 ms 3 1376 13.00 MB/sec warmup 6 sec latency 23.623 ms 3 1587 11.21 MB/sec warmup 7 sec latency 41.444 ms 3 1805 9.87 MB/sec warmup 8 sec latency 30.600 ms 3 2018 8.85 MB/sec warmup 9 sec latency 35.179 ms 3 2281 8.22 MB/sec warmup 10 sec latency 15.607 ms 3 2467 7.80 MB/sec warmup 11 sec latency 44.159 ms 3 2849 8.03 MB/sec warmup 12 sec latency 37.643 ms 3 3207 7.91 MB/sec warmup 13 sec latency 35.106 ms 3 3499 8.22 MB/sec warmup 14 sec latency 23.980 ms 3 3718 7.76 MB/sec warmup 15 sec latency 22.003 ms 3 3891 7.49 MB/sec warmup 16 sec latency 19.326 ms 3 4029 7.07 MB/sec warmup 17 sec latency 17.720 ms 3 4216 6.70 MB/sec warmup 18 sec latency 20.818 ms 3 4378 6.41 MB/sec warmup 19 sec latency 41.462 ms 3 4585 6.25 MB/sec warmup 20 sec latency 26.715 ms 3 4805 6.03 MB/sec warmup 21 sec latency 22.889 ms 3 5065 6.16 MB/sec warmup 22 sec latency 43.866 ms 3 5265 5.91 MB/sec warmup 23 sec latency 29.264 ms 3 5658 0.87 MB/sec execute 1 sec latency 32.760 ms 3 5903 2.25 MB/sec execute 2 sec latency 32.939 ms 3 6091 2.48 MB/sec execute 3 sec latency 42.477 ms 3 6468 5.17 MB/sec execute 4 sec latency 25.771 ms 3 6839 5.38 MB/sec execute 5 sec latency 31.951 ms 3 7117 6.03 MB/sec execute 6 sec latency 19.929 ms 3 7333 5.74 MB/sec execute 7 sec latency 20.492 ms 3 7473 5.13 MB/sec execute 8 sec latency 17.520 ms 3 7616 4.57 MB/sec execute 9 sec latency 18.560 ms 3 7803 4.18 MB/sec execute 10 sec latency 87.672 ms 3 7994 3.93 MB/sec execute 11 sec latency 36.886 ms 3 8182 3.92 MB/sec execute 12 sec latency 49.856 ms 3 8381 3.66 MB/sec execute 13 sec latency 23.819 ms 3 8653 4.04 MB/sec execute 14 sec latency 52.217 ms 3 8834 3.80 MB/sec execute 15 sec latency 31.770 ms 3 9036 3.59 MB/sec execute 16 sec latency 27.893 ms 3 9252 3.43 MB/sec execute 17 sec latency 23.274 ms 3 9482 3.45 MB/sec execute 18 sec latency 31.904 ms 3 9660 3.42 MB/sec execute 19 sec latency 43.783 ms 3 10010 3.87 MB/sec execute 20 sec latency 36.028 ms 3 10330 3.93 MB/sec execute 21 sec latency 31.260 ms 3 10578 4.11 MB/sec execute 22 sec latency 31.855 ms 3 10798 4.11 MB/sec execute 23 sec latency 22.499 ms 3 10958 4.06 MB/sec execute 24 sec latency 19.195 ms 3 11111 3.94 MB/sec execute 25 sec latency 17.012 ms 3 11290 3.80 MB/sec execute 26 sec latency 18.595 ms 3 11449 3.70 MB/sec execute 27 sec latency 62.825 ms 3 11641 3.62 MB/sec execute 28 sec latency 36.910 ms 3 11877 3.61 MB/sec execute 29 sec latency 26.633 ms 3 12159 3.79 MB/sec execute 30 sec latency 31.841 ms 3 12370 3.69 MB/sec execute 31 sec latency 27.589 ms 3 12602 3.59 MB/sec execute 32 sec latency 23.474 ms 3 12846 3.51 MB/sec execute 33 sec latency 19.500 ms 3 13096 3.55 MB/sec execute 34 sec latency 28.913 ms 3 13454 3.72 MB/sec execute 35 sec latency 37.126 ms 3 13823 3.86 MB/sec execute 36 sec latency 23.756 ms 3 14140 4.00 MB/sec execute 37 sec latency 21.884 ms 3 14401 4.05 MB/sec execute 38 sec latency 17.866 ms 3 14578 3.99 MB/sec execute 39 sec latency 16.623 ms 3 14742 3.90 MB/sec execute 40 sec latency 15.757 ms 3 14951 3.83 MB/sec execute 41 sec latency 75.770 ms 3 15158 3.77 MB/sec execute 42 sec latency 43.555 ms 3 15410 3.77 MB/sec execute 43 sec latency 27.459 ms 3 15708 3.89 MB/sec execute 44 sec latency 37.087 ms 3 15932 3.82 MB/sec execute 45 sec latency 26.691 ms 3 16177 3.75 MB/sec execute 46 sec latency 29.523 ms 3 16476 3.73 MB/sec execute 47 sec latency 12.511 ms 3 16721 3.73 MB/sec execute 48 sec latency 30.614 ms 3 17142 3.92 MB/sec execute 49 sec latency 26.155 ms 3 17519 3.98 MB/sec execute 50 sec latency 28.224 ms 3 17836 4.10 MB/sec execute 51 sec latency 14.951 ms 3 18057 4.09 MB/sec execute 52 sec latency 17.402 ms 3 18226 4.02 MB/sec execute 53 sec latency 15.235 ms 3 18441 3.96 MB/sec execute 54 sec latency 72.916 ms 3 18647 3.92 MB/sec execute 55 sec latency 32.141 ms 3 18893 3.92 MB/sec execute 56 sec latency 24.563 ms 3 19205 4.01 MB/sec execute 57 sec latency 33.444 ms 3 19435 3.95 MB/sec execute 58 sec latency 25.120 ms 3 19695 3.89 MB/sec execute 59 sec latency 22.985 ms 3 19955 3.84 MB/sec execute 60 sec latency 20.545 ms 3 20197 3.85 MB/sec execute 61 sec latency 36.067 ms 3 20467 3.92 MB/sec execute 62 sec latency 28.034 ms 3 20866 4.00 MB/sec execute 63 sec latency 26.925 ms 3 21132 4.01 MB/sec execute 64 sec latency 25.526 ms 3 21426 4.10 MB/sec execute 65 sec latency 17.791 ms 3 21631 4.09 MB/sec execute 66 sec latency 16.953 ms 3 21787 4.04 MB/sec execute 67 sec latency 17.611 ms 3 21963 3.99 MB/sec execute 68 sec latency 61.992 ms 3 22171 3.95 MB/sec execute 69 sec latency 67.674 ms 3 22390 3.94 MB/sec execute 70 sec latency 32.788 ms 3 22663 3.98 MB/sec execute 71 sec latency 21.748 ms 3 22894 3.97 MB/sec execute 72 sec latency 37.737 ms 3 23127 3.93 MB/sec execute 73 sec latency 23.208 ms 3 23374 3.89 MB/sec execute 74 sec latency 24.441 ms 3 23640 3.87 MB/sec execute 75 sec latency 27.262 ms 3 23881 3.87 MB/sec execute 76 sec latency 31.876 ms 3 24300 4.00 MB/sec execute 77 sec latency 26.065 ms 3 24675 4.03 MB/sec execute 78 sec latency 26.367 ms 3 24969 4.10 MB/sec execute 79 sec latency 16.901 ms 3 25170 4.09 MB/sec execute 80 sec latency 19.006 ms 3 25335 4.05 MB/sec execute 81 sec latency 15.462 ms 3 25524 4.01 MB/sec execute 82 sec latency 87.163 ms 3 25733 3.97 MB/sec execute 83 sec latency 35.370 ms 3 25955 3.96 MB/sec execute 84 sec latency 28.892 ms 3 26203 4.00 MB/sec execute 85 sec latency 28.594 ms 3 26437 3.99 MB/sec execute 86 sec latency 35.926 ms 3 26659 3.96 MB/sec execute 87 sec latency 23.737 ms 3 26858 3.92 MB/sec execute 88 sec latency 26.840 ms 3 27110 3.90 MB/sec execute 89 sec latency 26.897 ms 3 27276 3.88 MB/sec execute 90 sec latency 50.288 ms 3 27435 3.86 MB/sec execute 91 sec latency 39.511 ms 3 27696 3.93 MB/sec execute 92 sec latency 57.723 ms 3 28007 3.95 MB/sec execute 93 sec latency 43.579 ms 3 28291 4.01 MB/sec execute 94 sec latency 34.514 ms 3 28503 4.01 MB/sec execute 95 sec latency 25.141 ms 3 28668 3.99 MB/sec execute 96 sec latency 24.663 ms 3 28809 3.97 MB/sec execute 97 sec latency 21.274 ms 3 28946 3.93 MB/sec execute 98 sec latency 20.113 ms 3 29119 3.90 MB/sec execute 99 sec latency 67.679 ms 3 29294 3.87 MB/sec execute 100 sec latency 39.159 ms 3 29504 3.86 MB/sec execute 101 sec latency 25.774 ms 3 29767 3.90 MB/sec execute 102 sec latency 25.865 ms 3 30005 3.89 MB/sec execute 103 sec latency 37.754 ms 3 30209 3.86 MB/sec execute 104 sec latency 32.059 ms 3 30451 3.83 MB/sec execute 105 sec latency 24.061 ms 3 30727 3.82 MB/sec execute 106 sec latency 28.941 ms 3 30962 3.82 MB/sec execute 107 sec latency 29.746 ms 3 31344 3.90 MB/sec execute 108 sec latency 35.318 ms 3 31733 3.92 MB/sec execute 109 sec latency 25.217 ms 3 32044 3.99 MB/sec execute 110 sec latency 32.376 ms 3 32244 3.98 MB/sec execute 111 sec latency 18.640 ms 3 32398 3.95 MB/sec execute 112 sec latency 18.101 ms 3 32579 3.92 MB/sec execute 113 sec latency 17.020 ms 3 32749 3.90 MB/sec execute 114 sec latency 90.045 ms 3 32976 3.89 MB/sec execute 115 sec latency 34.154 ms 3 33265 3.92 MB/sec execute 116 sec latency 26.688 ms 3 33514 3.92 MB/sec execute 117 sec latency 30.133 ms 3 33745 3.89 MB/sec execute 118 sec latency 25.892 ms 3 33985 3.86 MB/sec execute 119 sec latency 23.808 ms 3 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 14957 11.199 34.972 Close 11075 1.143 8.850 Rename 626 19.537 43.840 Unlink 2994 7.117 18.946 Qpathinfo 13655 4.176 19.264 Qfileinfo 2368 0.372 2.514 Qfsinfo 2458 5.717 19.390 Sfileinfo 1212 7.949 16.137 Find 5246 6.006 22.639 WriteX 7403 1.499 14.829 ReadX 23346 0.064 5.215 LockX 48 1.107 1.964 UnlockX 48 1.148 1.884 Flush 1045 18.910 90.032 Throughput 3.86202 MB/sec 3 clients 3 procs max_latency=90.045 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Tue Nov 5 05:56:32 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished /home/green/git/lustre-release/lustre/utils/lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete