== sanity-quota test 8: Run dbench with quota enabled ==== 00:17:55 (1721881075) Waiting for MDT destroys to complete oleg209-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg209-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Waiting 90s for 'ugp' Updated after 2s: want 'ugp' got 'ugp' Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Thu Jul 25 00:18:01 EDT 2024 waiting for dbench pid 25425 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 1 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 312 34.18 MB/sec warmup 1 sec latency 18.571 ms 3 666 31.70 MB/sec warmup 2 sec latency 19.417 ms 3 1008 22.23 MB/sec warmup 3 sec latency 13.324 ms 3 1479 19.53 MB/sec warmup 4 sec latency 15.545 ms 3 1901 15.85 MB/sec warmup 5 sec latency 13.321 ms 3 2394 13.98 MB/sec warmup 6 sec latency 11.704 ms 3 2987 14.36 MB/sec warmup 7 sec latency 15.135 ms 3 3673 14.52 MB/sec warmup 8 sec latency 15.701 ms 3 3981 13.35 MB/sec warmup 9 sec latency 13.489 ms 3 4321 12.13 MB/sec warmup 10 sec latency 41.598 ms 3 4686 11.48 MB/sec warmup 11 sec latency 20.492 ms 3 5130 11.31 MB/sec warmup 12 sec latency 16.908 ms 3 5534 10.52 MB/sec warmup 13 sec latency 15.403 ms 3 5972 10.11 MB/sec warmup 14 sec latency 14.466 ms 3 6550 10.53 MB/sec warmup 15 sec latency 14.701 ms 3 7210 10.84 MB/sec warmup 16 sec latency 13.448 ms 3 7536 10.44 MB/sec warmup 17 sec latency 17.473 ms 3 7875 9.93 MB/sec warmup 18 sec latency 27.832 ms 3 8245 9.67 MB/sec warmup 19 sec latency 14.629 ms 3 8682 9.66 MB/sec warmup 20 sec latency 15.928 ms 3 9074 9.24 MB/sec warmup 21 sec latency 13.856 ms 3 9498 9.03 MB/sec warmup 22 sec latency 12.570 ms 3 10081 9.36 MB/sec warmup 23 sec latency 16.926 ms 3 11055 4.34 MB/sec execute 1 sec latency 14.075 ms 3 11394 2.71 MB/sec execute 2 sec latency 31.889 ms 3 11760 3.45 MB/sec execute 3 sec latency 19.177 ms 3 12201 4.95 MB/sec execute 4 sec latency 15.662 ms 3 12572 4.15 MB/sec execute 5 sec latency 14.937 ms 3 13030 4.22 MB/sec execute 6 sec latency 12.733 ms 3 13604 5.94 MB/sec execute 7 sec latency 14.975 ms 3 14250 7.14 MB/sec execute 8 sec latency 12.463 ms 3 14569 6.85 MB/sec execute 9 sec latency 15.049 ms 3 14863 6.22 MB/sec execute 10 sec latency 33.246 ms 3 15133 5.83 MB/sec execute 11 sec latency 149.211 ms 3 15546 6.17 MB/sec execute 12 sec latency 13.716 ms 3 15937 5.97 MB/sec execute 13 sec latency 17.782 ms 3 16336 5.64 MB/sec execute 14 sec latency 14.606 ms 3 16748 5.70 MB/sec execute 15 sec latency 15.183 ms 3 17487 6.49 MB/sec execute 16 sec latency 13.009 ms 3 17946 6.89 MB/sec execute 17 sec latency 11.681 ms 3 18235 6.62 MB/sec execute 18 sec latency 13.979 ms 3 18577 6.35 MB/sec execute 19 sec latency 30.177 ms 3 18902 6.26 MB/sec execute 20 sec latency 23.170 ms 3 19325 6.41 MB/sec execute 21 sec latency 16.058 ms 3 19705 6.16 MB/sec execute 22 sec latency 14.729 ms 3 20113 6.04 MB/sec execute 23 sec latency 15.168 ms 3 20626 6.43 MB/sec execute 24 sec latency 14.186 ms 3 21273 6.75 MB/sec execute 25 sec latency 14.037 ms 3 21650 6.78 MB/sec execute 26 sec latency 13.322 ms 3 21967 6.56 MB/sec execute 27 sec latency 26.634 ms 3 22298 6.40 MB/sec execute 28 sec latency 31.669 ms 3 22709 6.51 MB/sec execute 29 sec latency 14.605 ms 3 23079 6.42 MB/sec execute 30 sec latency 19.116 ms 3 23476 6.25 MB/sec execute 31 sec latency 12.750 ms 3 23894 6.27 MB/sec execute 32 sec latency 18.281 ms 3 24627 6.63 MB/sec execute 33 sec latency 14.245 ms 3 25081 6.82 MB/sec execute 34 sec latency 16.152 ms 3 25383 6.69 MB/sec execute 35 sec latency 12.744 ms 3 25728 6.55 MB/sec execute 36 sec latency 26.655 ms 3 26099 6.49 MB/sec execute 37 sec latency 14.438 ms 3 26534 6.57 MB/sec execute 38 sec latency 19.442 ms 3 26935 6.43 MB/sec execute 39 sec latency 15.547 ms 3 27342 6.41 MB/sec execute 40 sec latency 13.887 ms 3 28006 6.67 MB/sec execute 41 sec latency 15.375 ms 3 28541 6.84 MB/sec execute 42 sec latency 12.490 ms 3 28858 6.77 MB/sec execute 43 sec latency 12.967 ms 3 29191 6.65 MB/sec execute 44 sec latency 31.001 ms 3 29536 6.59 MB/sec execute 45 sec latency 17.091 ms 3 29987 6.67 MB/sec execute 46 sec latency 17.166 ms 3 30376 6.55 MB/sec execute 47 sec latency 14.382 ms 3 30822 6.51 MB/sec execute 48 sec latency 11.758 ms 3 31458 6.71 MB/sec execute 49 sec latency 14.318 ms 3 32037 6.89 MB/sec execute 50 sec latency 13.408 ms 3 32368 6.83 MB/sec execute 51 sec latency 11.526 ms 3 32694 6.72 MB/sec execute 52 sec latency 24.839 ms 3 33054 6.67 MB/sec execute 53 sec latency 13.098 ms 3 33490 6.74 MB/sec execute 54 sec latency 12.968 ms 3 33862 6.64 MB/sec execute 55 sec latency 15.667 ms 3 34291 6.58 MB/sec execute 56 sec latency 12.190 ms 3 34820 6.70 MB/sec execute 57 sec latency 12.863 ms 3 35496 6.87 MB/sec execute 58 sec latency 12.694 ms 3 35862 6.88 MB/sec execute 59 sec latency 11.713 ms 3 36177 6.78 MB/sec execute 60 sec latency 36.662 ms 3 36536 6.73 MB/sec execute 61 sec latency 17.574 ms 3 36958 6.75 MB/sec execute 62 sec latency 15.190 ms 3 37341 6.70 MB/sec execute 63 sec latency 13.868 ms 3 37790 6.65 MB/sec execute 64 sec latency 15.732 ms 3 38309 6.75 MB/sec execute 65 sec latency 14.956 ms 3 38973 6.89 MB/sec execute 66 sec latency 12.771 ms 3 39358 6.90 MB/sec execute 67 sec latency 11.027 ms 3 39680 6.82 MB/sec execute 68 sec latency 30.551 ms 3 40019 6.78 MB/sec execute 69 sec latency 19.326 ms 3 40431 6.79 MB/sec execute 70 sec latency 13.563 ms 3 40800 6.75 MB/sec execute 71 sec latency 14.697 ms 3 41227 6.67 MB/sec execute 72 sec latency 14.949 ms 3 41692 6.75 MB/sec execute 73 sec latency 13.730 ms 3 42295 6.82 MB/sec execute 74 sec latency 15.733 ms 3 42791 6.91 MB/sec execute 75 sec latency 19.661 ms 3 43110 6.85 MB/sec execute 76 sec latency 12.834 ms 3 43445 6.79 MB/sec execute 77 sec latency 45.329 ms 3 43805 6.76 MB/sec execute 78 sec latency 22.763 ms 3 44252 6.79 MB/sec execute 79 sec latency 19.619 ms 3 44658 6.72 MB/sec execute 80 sec latency 14.471 ms 3 45104 6.71 MB/sec execute 81 sec latency 13.587 ms 3 45782 6.84 MB/sec execute 82 sec latency 14.731 ms 3 46288 6.94 MB/sec execute 83 sec latency 14.223 ms 3 46594 6.88 MB/sec execute 84 sec latency 12.548 ms 3 46915 6.82 MB/sec execute 85 sec latency 25.158 ms 3 47270 6.78 MB/sec execute 86 sec latency 20.700 ms 3 47675 6.79 MB/sec execute 87 sec latency 14.195 ms 3 48073 6.76 MB/sec execute 88 sec latency 16.264 ms 3 48495 6.72 MB/sec execute 89 sec latency 15.171 ms 3 49112 6.80 MB/sec execute 90 sec latency 12.879 ms 3 49675 6.90 MB/sec execute 91 sec latency 17.631 ms 3 50048 6.90 MB/sec execute 92 sec latency 11.628 ms 3 50370 6.84 MB/sec execute 93 sec latency 34.854 ms 3 50722 6.81 MB/sec execute 94 sec latency 21.962 ms 3 51134 6.82 MB/sec execute 95 sec latency 20.005 ms 3 51532 6.79 MB/sec execute 96 sec latency 16.541 ms 3 51962 6.75 MB/sec execute 97 sec latency 13.268 ms 3 52486 6.81 MB/sec execute 98 sec latency 13.832 ms 3 53091 6.90 MB/sec execute 99 sec latency 17.930 ms 3 53521 6.91 MB/sec execute 100 sec latency 13.251 ms 3 53853 6.87 MB/sec execute 101 sec latency 35.025 ms 3 54208 6.83 MB/sec execute 102 sec latency 19.873 ms 3 54629 6.85 MB/sec execute 103 sec latency 15.550 ms 3 55025 6.82 MB/sec execute 104 sec latency 16.985 ms 3 55463 6.78 MB/sec execute 105 sec latency 15.433 ms 3 56005 6.84 MB/sec execute 106 sec latency 17.276 ms 3 56598 6.92 MB/sec execute 107 sec latency 22.000 ms 3 57048 6.93 MB/sec execute 108 sec latency 12.577 ms 3 57383 6.89 MB/sec execute 109 sec latency 25.184 ms 3 57727 6.86 MB/sec execute 110 sec latency 17.317 ms 3 58149 6.87 MB/sec execute 111 sec latency 12.875 ms 3 58553 6.84 MB/sec execute 112 sec latency 15.429 ms 3 58996 6.81 MB/sec execute 113 sec latency 14.915 ms 3 59516 6.86 MB/sec execute 114 sec latency 17.908 ms 3 60113 6.92 MB/sec execute 115 sec latency 16.890 ms 3 60553 6.95 MB/sec execute 116 sec latency 17.106 ms 3 60905 6.90 MB/sec execute 117 sec latency 17.935 ms 3 61238 6.88 MB/sec execute 118 sec latency 15.925 ms 3 61653 6.88 MB/sec execute 119 sec latency 23.292 ms 3 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 26870 6.807 36.645 Close 19642 1.166 21.176 Rename 1134 10.517 25.541 Unlink 5474 3.613 23.855 Qpathinfo 24224 1.791 19.993 Qfileinfo 4180 0.380 2.666 Qfsinfo 4425 4.518 28.316 Sfileinfo 2202 6.339 23.159 Find 9295 0.712 28.641 WriteX 13144 1.627 16.052 ReadX 41356 0.062 1.511 LockX 84 1.077 4.148 UnlockX 84 1.092 1.432 Flush 1884 6.290 149.204 Throughput 6.87861 MB/sec 3 clients 3 procs max_latency=149.211 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Thu Jul 25 00:20:26 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg209-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg209-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1