== sanity-quota test 8: Run dbench with quota enabled ==== 02:27:41 (1734679661) Waiting for MDT destroys to complete oleg205-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1 oleg205-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr /home/green/git/lustre-release/lustre/utils/lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 0 [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Fri Dec 20 02:27:51 EST 2024 waiting for dbench pid 24782 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 1 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 80 10.68 MB/sec warmup 1 sec latency 76.723 ms 3 160 9.94 MB/sec warmup 2 sec latency 97.783 ms 3 249 9.49 MB/sec warmup 3 sec latency 83.276 ms 3 335 9.12 MB/sec warmup 4 sec latency 76.544 ms 3 411 8.71 MB/sec warmup 5 sec latency 86.712 ms 3 490 8.55 MB/sec warmup 6 sec latency 104.601 ms 3 602 8.95 MB/sec warmup 7 sec latency 99.146 ms 3 674 7.93 MB/sec warmup 8 sec latency 67.604 ms 3 715 7.08 MB/sec warmup 9 sec latency 123.239 ms 3 775 6.40 MB/sec warmup 10 sec latency 124.569 ms 3 839 5.87 MB/sec warmup 11 sec latency 108.438 ms 3 895 5.41 MB/sec warmup 12 sec latency 67.066 ms 3 934 5.02 MB/sec warmup 13 sec latency 105.313 ms 3 987 4.69 MB/sec warmup 14 sec latency 78.606 ms 3 1062 4.57 MB/sec warmup 15 sec latency 59.172 ms 3 1134 4.31 MB/sec warmup 16 sec latency 71.698 ms 3 1195 4.06 MB/sec warmup 17 sec latency 65.737 ms 3 1251 3.84 MB/sec warmup 18 sec latency 77.757 ms 3 1388 4.10 MB/sec warmup 19 sec latency 69.862 ms 3 1443 3.90 MB/sec warmup 20 sec latency 73.490 ms 3 1488 3.72 MB/sec warmup 21 sec latency 69.517 ms 3 1551 3.56 MB/sec warmup 22 sec latency 63.908 ms 3 1604 3.41 MB/sec warmup 23 sec latency 58.997 ms 3 1709 0.08 MB/sec execute 1 sec latency 100.886 ms 3 1776 0.12 MB/sec execute 2 sec latency 67.028 ms 3 1826 0.14 MB/sec execute 3 sec latency 72.897 ms 3 1873 0.12 MB/sec execute 4 sec latency 63.608 ms 3 1929 0.15 MB/sec execute 5 sec latency 80.547 ms 3 1989 0.14 MB/sec execute 6 sec latency 71.138 ms 3 2031 0.16 MB/sec execute 7 sec latency 99.500 ms 3 2094 0.17 MB/sec execute 8 sec latency 59.384 ms 3 2153 0.16 MB/sec execute 9 sec latency 103.222 ms 3 2186 0.16 MB/sec execute 10 sec latency 102.226 ms 3 2257 0.17 MB/sec execute 11 sec latency 71.563 ms 3 2332 0.41 MB/sec execute 12 sec latency 70.171 ms 3 2379 0.40 MB/sec execute 13 sec latency 74.390 ms 3 2412 0.40 MB/sec execute 14 sec latency 156.322 ms 3 2456 0.40 MB/sec execute 15 sec latency 111.262 ms 3 2562 0.51 MB/sec execute 16 sec latency 77.284 ms 3 2611 0.50 MB/sec execute 17 sec latency 82.242 ms 3 2768 0.96 MB/sec execute 18 sec latency 59.028 ms 3 2909 1.10 MB/sec execute 19 sec latency 73.373 ms 3 2980 1.10 MB/sec execute 20 sec latency 73.528 ms 3 3023 1.05 MB/sec execute 21 sec latency 89.090 ms 3 3220 1.11 MB/sec execute 22 sec latency 79.999 ms 3 3291 1.19 MB/sec execute 23 sec latency 71.860 ms 3 3330 1.14 MB/sec execute 24 sec latency 42.776 ms 3 3373 1.11 MB/sec execute 25 sec latency 79.253 ms 3 3510 1.40 MB/sec execute 26 sec latency 67.123 ms 3 3567 1.36 MB/sec execute 27 sec latency 73.436 ms 3 3641 1.33 MB/sec execute 28 sec latency 78.049 ms 3 3691 1.30 MB/sec execute 29 sec latency 93.556 ms 3 3762 1.35 MB/sec execute 30 sec latency 95.069 ms 3 3796 1.31 MB/sec execute 31 sec latency 101.209 ms 3 3825 1.27 MB/sec execute 32 sec latency 82.262 ms 3 3848 1.23 MB/sec execute 33 sec latency 89.536 ms 3 3875 1.20 MB/sec execute 34 sec latency 99.026 ms 3 3905 1.19 MB/sec execute 35 sec latency 101.811 ms 3 3938 1.15 MB/sec execute 36 sec latency 84.163 ms 3 3969 1.12 MB/sec execute 37 sec latency 80.333 ms 3 3995 1.09 MB/sec execute 38 sec latency 100.229 ms 3 4020 1.07 MB/sec execute 39 sec latency 87.041 ms 3 4044 1.04 MB/sec execute 40 sec latency 97.538 ms 3 4077 1.01 MB/sec execute 41 sec latency 74.019 ms 3 4122 0.99 MB/sec execute 42 sec latency 71.696 ms 3 4168 0.97 MB/sec execute 43 sec latency 78.881 ms 3 4228 0.95 MB/sec execute 44 sec latency 62.155 ms 3 4276 0.94 MB/sec execute 45 sec latency 162.473 ms 3 4329 0.93 MB/sec execute 46 sec latency 113.868 ms 3 4377 0.92 MB/sec execute 47 sec latency 100.714 ms 3 4436 0.91 MB/sec execute 48 sec latency 69.991 ms 3 4490 0.90 MB/sec execute 49 sec latency 84.083 ms 3 4547 0.89 MB/sec execute 50 sec latency 93.821 ms 3 4617 0.93 MB/sec execute 51 sec latency 78.751 ms 3 4688 0.92 MB/sec execute 52 sec latency 66.457 ms 3 4741 0.90 MB/sec execute 53 sec latency 80.406 ms 3 4797 0.89 MB/sec execute 54 sec latency 87.195 ms 3 4846 0.88 MB/sec execute 55 sec latency 104.756 ms 3 4969 1.01 MB/sec execute 56 sec latency 85.861 ms 3 5023 1.00 MB/sec execute 57 sec latency 70.363 ms 3 5069 0.98 MB/sec execute 58 sec latency 62.272 ms 3 5137 0.97 MB/sec execute 59 sec latency 54.934 ms 3 5180 0.95 MB/sec execute 60 sec latency 64.453 ms 3 5245 0.94 MB/sec execute 61 sec latency 91.436 ms 3 5282 0.93 MB/sec execute 62 sec latency 120.343 ms 3 5350 0.91 MB/sec execute 63 sec latency 69.162 ms 3 5394 0.90 MB/sec execute 64 sec latency 76.276 ms 3 5429 0.89 MB/sec execute 65 sec latency 90.472 ms 3 5486 0.88 MB/sec execute 66 sec latency 113.108 ms 3 5554 0.87 MB/sec execute 67 sec latency 69.034 ms 3 5611 0.86 MB/sec execute 68 sec latency 71.952 ms 3 5699 0.85 MB/sec execute 69 sec latency 47.089 ms 3 5741 0.84 MB/sec execute 70 sec latency 80.653 ms 3 5812 0.83 MB/sec execute 71 sec latency 60.247 ms 3 5894 0.86 MB/sec execute 72 sec latency 81.792 ms 3 5942 0.86 MB/sec execute 73 sec latency 69.025 ms 3 5983 0.85 MB/sec execute 74 sec latency 99.839 ms 3 6019 0.85 MB/sec execute 75 sec latency 109.053 ms 3 6092 0.86 MB/sec execute 76 sec latency 110.589 ms 3 6159 0.85 MB/sec execute 77 sec latency 87.597 ms 3 6304 0.96 MB/sec execute 78 sec latency 74.249 ms 3 6435 0.95 MB/sec execute 79 sec latency 78.956 ms 3 6525 0.99 MB/sec execute 80 sec latency 77.627 ms 3 6571 0.98 MB/sec execute 81 sec latency 83.985 ms 3 6757 0.99 MB/sec execute 82 sec latency 82.129 ms 3 6830 1.02 MB/sec execute 83 sec latency 118.715 ms 3 6872 1.01 MB/sec execute 84 sec latency 52.859 ms 3 6914 1.00 MB/sec execute 85 sec latency 71.880 ms 3 6971 1.01 MB/sec execute 86 sec latency 70.846 ms 3 7082 1.08 MB/sec execute 87 sec latency 80.305 ms 3 7128 1.07 MB/sec execute 88 sec latency 72.362 ms 3 7186 1.06 MB/sec execute 89 sec latency 98.044 ms 3 7236 1.05 MB/sec execute 90 sec latency 60.940 ms 3 7305 1.08 MB/sec execute 91 sec latency 94.727 ms 3 7342 1.06 MB/sec execute 92 sec latency 85.008 ms 3 7376 1.05 MB/sec execute 93 sec latency 82.460 ms 3 7404 1.04 MB/sec execute 94 sec latency 78.062 ms 3 7440 1.04 MB/sec execute 95 sec latency 97.793 ms 3 7479 1.03 MB/sec execute 96 sec latency 66.011 ms 3 7516 1.02 MB/sec execute 97 sec latency 85.946 ms 3 7548 1.01 MB/sec execute 98 sec latency 106.678 ms 3 7583 1.00 MB/sec execute 99 sec latency 64.213 ms 3 7619 0.99 MB/sec execute 100 sec latency 61.342 ms 3 7668 0.98 MB/sec execute 101 sec latency 64.469 ms 3 7717 0.97 MB/sec execute 102 sec latency 54.930 ms 3 7762 0.96 MB/sec execute 103 sec latency 155.841 ms 3 7805 0.96 MB/sec execute 104 sec latency 89.429 ms 3 7845 0.95 MB/sec execute 105 sec latency 116.639 ms 3 7894 0.95 MB/sec execute 106 sec latency 114.287 ms 3 7940 0.94 MB/sec execute 107 sec latency 120.981 ms 3 7994 0.94 MB/sec execute 108 sec latency 83.383 ms 3 8032 0.93 MB/sec execute 109 sec latency 137.229 ms 3 8089 0.92 MB/sec execute 110 sec latency 83.743 ms 3 8160 0.94 MB/sec execute 111 sec latency 76.766 ms 3 8226 0.94 MB/sec execute 112 sec latency 81.264 ms 3 8272 0.93 MB/sec execute 113 sec latency 122.088 ms 3 8317 0.92 MB/sec execute 114 sec latency 100.254 ms 3 8366 0.92 MB/sec execute 115 sec latency 99.496 ms 3 8493 0.98 MB/sec execute 116 sec latency 76.058 ms 3 8541 0.97 MB/sec execute 117 sec latency 93.258 ms 3 8588 0.97 MB/sec execute 118 sec latency 77.309 ms 3 8644 0.96 MB/sec execute 119 sec latency 71.551 ms 3 cleanup 120 sec 3 cleanup 121 sec 3 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 3620 46.606 162.458 Close 2676 5.257 26.109 Rename 156 79.544 137.205 Unlink 744 29.628 102.415 Qpathinfo 3343 18.074 115.275 Qfileinfo 567 0.758 7.770 Qfsinfo 612 31.258 155.805 Sfileinfo 300 33.507 85.579 Find 1272 28.700 113.376 WriteX 1788 4.799 35.220 ReadX 5747 0.125 7.607 LockX 12 4.015 6.891 UnlockX 12 4.061 6.118 Flush 252 27.030 111.252 Throughput 0.960547 MB/sec 3 clients 3 procs max_latency=162.473 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Fri Dec 20 02:30:18 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished /home/green/git/lustre-release/lustre/utils/lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg205-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1 oleg205-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1