== sanity-quota test 8: Run dbench with quota enabled ==== 23:19:52 (1735100392) Waiting for MDT destroys to complete oleg327-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg327-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg327-client: oleg327-server: ssh exited with exit code 1 pdsh@oleg327-client: oleg327-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Waiting 90s for 'ugp' Updated after 2s: want 'ugp' got 'ugp' Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr /home/green/git/lustre-release/lustre/utils/lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 0 [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Tue Dec 24 23:20:00 EST 2024 waiting for dbench pid 26410 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 1 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 231 26.65 MB/sec warmup 1 sec latency 30.474 ms 3 472 24.77 MB/sec warmup 2 sec latency 24.545 ms 3 706 21.20 MB/sec warmup 3 sec latency 23.401 ms 3 900 16.26 MB/sec warmup 4 sec latency 29.147 ms 3 1127 13.79 MB/sec warmup 5 sec latency 23.900 ms 3 1440 13.01 MB/sec warmup 6 sec latency 21.128 ms 3 1677 11.23 MB/sec warmup 7 sec latency 23.230 ms 3 1946 9.92 MB/sec warmup 8 sec latency 21.827 ms 3 2190 8.92 MB/sec warmup 9 sec latency 20.140 ms 3 2449 8.43 MB/sec warmup 10 sec latency 21.230 ms 3 2891 8.89 MB/sec warmup 11 sec latency 20.184 ms 3 3283 8.83 MB/sec warmup 12 sec latency 26.284 ms 3 3582 8.87 MB/sec warmup 13 sec latency 14.598 ms 3 3792 8.52 MB/sec warmup 14 sec latency 26.811 ms 3 3926 8.01 MB/sec warmup 15 sec latency 20.720 ms 3 4067 7.51 MB/sec warmup 16 sec latency 18.246 ms 3 4246 7.10 MB/sec warmup 17 sec latency 47.962 ms 3 4446 6.79 MB/sec warmup 18 sec latency 27.644 ms 3 4641 6.64 MB/sec warmup 19 sec latency 30.598 ms 3 4836 6.34 MB/sec warmup 20 sec latency 29.038 ms 3 5119 6.46 MB/sec warmup 21 sec latency 22.780 ms 3 5328 6.19 MB/sec warmup 22 sec latency 27.289 ms 3 5563 5.95 MB/sec warmup 23 sec latency 17.503 ms 3 6079 3.64 MB/sec execute 1 sec latency 23.528 ms 3 6506 8.78 MB/sec execute 2 sec latency 18.742 ms 3 6896 7.99 MB/sec execute 3 sec latency 21.888 ms 3 7230 8.47 MB/sec execute 4 sec latency 15.760 ms 3 7432 7.52 MB/sec execute 5 sec latency 16.090 ms 3 7586 6.32 MB/sec execute 6 sec latency 18.179 ms 3 7764 5.49 MB/sec execute 7 sec latency 31.132 ms 3 7981 4.99 MB/sec execute 8 sec latency 41.732 ms 3 8185 4.77 MB/sec execute 9 sec latency 23.713 ms 3 8436 5.01 MB/sec execute 10 sec latency 24.017 ms 3 8639 4.85 MB/sec execute 11 sec latency 36.932 ms 3 8863 4.49 MB/sec execute 12 sec latency 23.959 ms 3 9073 4.19 MB/sec execute 13 sec latency 16.721 ms 3 9324 3.95 MB/sec execute 14 sec latency 19.159 ms 3 9541 4.02 MB/sec execute 15 sec latency 22.475 ms 3 9814 4.25 MB/sec execute 16 sec latency 25.791 ms 3 10202 4.53 MB/sec execute 17 sec latency 29.528 ms 3 10456 4.52 MB/sec execute 18 sec latency 26.651 ms 3 10741 4.79 MB/sec execute 19 sec latency 19.151 ms 3 10923 4.72 MB/sec execute 20 sec latency 21.359 ms 3 11048 4.54 MB/sec execute 21 sec latency 25.682 ms 3 11165 4.33 MB/sec execute 22 sec latency 30.363 ms 3 11332 4.17 MB/sec execute 23 sec latency 41.468 ms 3 11502 4.05 MB/sec execute 24 sec latency 27.192 ms 3 11668 4.00 MB/sec execute 25 sec latency 32.775 ms 3 11865 3.91 MB/sec execute 26 sec latency 26.905 ms 3 12127 4.09 MB/sec execute 27 sec latency 27.453 ms 3 12333 3.97 MB/sec execute 28 sec latency 22.995 ms 3 12567 3.85 MB/sec execute 29 sec latency 21.668 ms 3 12792 3.75 MB/sec execute 30 sec latency 14.990 ms 3 13040 3.75 MB/sec execute 31 sec latency 27.915 ms 3 13309 3.90 MB/sec execute 32 sec latency 28.522 ms 3 13730 4.03 MB/sec execute 33 sec latency 27.077 ms 3 14076 4.25 MB/sec execute 34 sec latency 20.552 ms 3 14306 4.24 MB/sec execute 35 sec latency 18.298 ms 3 14488 4.21 MB/sec execute 36 sec latency 22.011 ms 3 14639 4.12 MB/sec execute 37 sec latency 22.526 ms 3 14794 4.02 MB/sec execute 38 sec latency 19.490 ms 3 14955 3.94 MB/sec execute 39 sec latency 37.518 ms 3 15180 3.93 MB/sec execute 40 sec latency 22.208 ms 3 15390 3.88 MB/sec execute 41 sec latency 25.265 ms 3 15655 3.93 MB/sec execute 42 sec latency 23.113 ms 3 15897 3.92 MB/sec execute 43 sec latency 25.049 ms 3 16116 3.84 MB/sec execute 44 sec latency 21.852 ms 3 16324 3.77 MB/sec execute 45 sec latency 26.656 ms 3 16535 3.75 MB/sec execute 46 sec latency 30.188 ms 3 16737 3.74 MB/sec execute 47 sec latency 26.292 ms 3 17071 3.87 MB/sec execute 48 sec latency 25.635 ms 3 17426 3.96 MB/sec execute 49 sec latency 27.683 ms 3 17724 4.05 MB/sec execute 50 sec latency 26.785 ms 3 17940 4.08 MB/sec execute 51 sec latency 20.236 ms 3 18094 4.03 MB/sec execute 52 sec latency 20.660 ms 3 18249 3.96 MB/sec execute 53 sec latency 17.799 ms 3 18445 3.90 MB/sec execute 54 sec latency 32.549 ms 3 18659 3.86 MB/sec execute 55 sec latency 24.431 ms 3 18884 3.84 MB/sec execute 56 sec latency 23.419 ms 3 19131 3.90 MB/sec execute 57 sec latency 22.967 ms 3 19333 3.89 MB/sec execute 58 sec latency 28.697 ms 3 19514 3.83 MB/sec execute 59 sec latency 23.154 ms 3 19729 3.78 MB/sec execute 60 sec latency 27.961 ms 3 19984 3.76 MB/sec execute 61 sec latency 17.225 ms 3 20233 3.74 MB/sec execute 62 sec latency 23.917 ms 3 20545 3.85 MB/sec execute 63 sec latency 21.610 ms 3 20887 3.91 MB/sec execute 64 sec latency 27.998 ms 3 21203 3.97 MB/sec execute 65 sec latency 24.418 ms 3 21456 4.02 MB/sec execute 66 sec latency 20.407 ms 3 21638 3.97 MB/sec execute 67 sec latency 17.782 ms 3 21789 3.93 MB/sec execute 68 sec latency 20.239 ms 3 21943 3.88 MB/sec execute 69 sec latency 47.121 ms 3 22134 3.84 MB/sec execute 70 sec latency 28.828 ms 3 22330 3.83 MB/sec execute 71 sec latency 27.581 ms 3 22540 3.82 MB/sec execute 72 sec latency 29.582 ms 3 22779 3.83 MB/sec execute 73 sec latency 22.816 ms 3 22990 3.83 MB/sec execute 74 sec latency 26.313 ms 3 23190 3.78 MB/sec execute 75 sec latency 18.168 ms 3 23404 3.74 MB/sec execute 76 sec latency 23.574 ms 3 23631 3.73 MB/sec execute 77 sec latency 23.389 ms 3 23910 3.80 MB/sec execute 78 sec latency 23.133 ms 3 24267 3.82 MB/sec execute 79 sec latency 24.724 ms 3 24630 3.94 MB/sec execute 80 sec latency 20.370 ms 3 24903 3.92 MB/sec execute 81 sec latency 22.846 ms 3 25122 3.94 MB/sec execute 82 sec latency 19.607 ms 3 25287 3.91 MB/sec execute 83 sec latency 17.582 ms 3 25462 3.87 MB/sec execute 84 sec latency 35.257 ms 3 25665 3.84 MB/sec execute 85 sec latency 39.331 ms 3 25897 3.83 MB/sec execute 86 sec latency 23.440 ms 3 26141 3.86 MB/sec execute 87 sec latency 23.907 ms 3 26347 3.83 MB/sec execute 88 sec latency 21.299 ms 3 26552 3.83 MB/sec execute 89 sec latency 27.130 ms 3 26738 3.79 MB/sec execute 90 sec latency 24.023 ms 3 26935 3.76 MB/sec execute 91 sec latency 22.407 ms 3 27152 3.75 MB/sec execute 92 sec latency 32.205 ms 3 27359 3.73 MB/sec execute 93 sec latency 22.790 ms 3 27695 3.80 MB/sec execute 94 sec latency 22.240 ms 3 28045 3.84 MB/sec execute 95 sec latency 22.453 ms 3 28401 3.90 MB/sec execute 96 sec latency 21.522 ms 3 28627 3.92 MB/sec execute 97 sec latency 17.202 ms 3 28803 3.90 MB/sec execute 98 sec latency 18.500 ms 3 28981 3.86 MB/sec execute 99 sec latency 19.452 ms 3 29183 3.84 MB/sec execute 100 sec latency 31.355 ms 3 29399 3.83 MB/sec execute 101 sec latency 23.032 ms 3 29656 3.85 MB/sec execute 102 sec latency 24.507 ms 3 29861 3.83 MB/sec execute 103 sec latency 18.531 ms 3 30069 3.83 MB/sec execute 104 sec latency 31.017 ms 3 30261 3.79 MB/sec execute 105 sec latency 20.781 ms 3 30436 3.76 MB/sec execute 106 sec latency 26.154 ms 3 30600 3.75 MB/sec execute 107 sec latency 30.748 ms 3 30742 3.73 MB/sec execute 108 sec latency 31.314 ms 3 31002 3.76 MB/sec execute 109 sec latency 24.251 ms 3 31236 3.77 MB/sec execute 110 sec latency 35.521 ms 3 31495 3.78 MB/sec execute 111 sec latency 33.066 ms 3 31772 3.84 MB/sec execute 112 sec latency 29.540 ms 3 32034 3.84 MB/sec execute 113 sec latency 26.379 ms 3 32222 3.84 MB/sec execute 114 sec latency 19.588 ms 3 32388 3.82 MB/sec execute 115 sec latency 18.128 ms 3 32553 3.79 MB/sec execute 116 sec latency 34.816 ms 3 32756 3.77 MB/sec execute 117 sec latency 27.964 ms 3 32980 3.76 MB/sec execute 118 sec latency 24.996 ms 3 33229 3.79 MB/sec execute 119 sec latency 24.590 ms 3 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 14263 12.044 47.106 Close 10412 1.244 8.550 Rename 618 20.546 35.502 Unlink 2942 7.660 41.440 Qpathinfo 12846 4.492 22.395 Qfileinfo 2246 0.399 3.916 Qfsinfo 2437 6.689 25.129 Sfileinfo 1191 8.756 22.378 Find 5037 6.564 32.542 WriteX 7084 1.720 21.941 ReadX 22686 0.064 1.272 LockX 48 1.169 2.594 UnlockX 48 1.184 1.833 Flush 1020 6.946 39.319 Throughput 3.7859 MB/sec 3 clients 3 procs max_latency=47.121 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Tue Dec 24 23:22:25 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished /home/green/git/lustre-release/lustre/utils/lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg327-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg327-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg327-client: oleg327-server: ssh exited with exit code 1 pdsh@oleg327-client: oleg327-server: ssh exited with exit code 1