== sanity-quota test 8: Run dbench with quota enabled ==== 11:50:32 (1736787032) Waiting for MDT destroys to complete oleg407-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 oleg407-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr /home/green/git/lustre-release/lustre/utils/lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 0 [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Mon Jan 13 11:50:37 EST 2025 waiting for dbench pid 25443 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 2 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 248 28.27 MB/sec warmup 1 sec latency 25.505 ms 3 490 25.67 MB/sec warmup 2 sec latency 30.262 ms 3 754 21.33 MB/sec warmup 3 sec latency 22.888 ms 3 930 16.33 MB/sec warmup 4 sec latency 39.397 ms 3 1065 13.74 MB/sec warmup 5 sec latency 42.102 ms 3 1269 11.56 MB/sec warmup 6 sec latency 22.502 ms 3 1562 11.19 MB/sec warmup 7 sec latency 22.227 ms 3 1814 9.87 MB/sec warmup 8 sec latency 21.485 ms 3 2080 8.88 MB/sec warmup 9 sec latency 12.934 ms 3 2365 8.37 MB/sec warmup 10 sec latency 18.228 ms 3 2567 7.89 MB/sec warmup 11 sec latency 28.342 ms 3 2929 8.37 MB/sec warmup 12 sec latency 30.865 ms 3 3293 8.16 MB/sec warmup 13 sec latency 26.030 ms 3 3576 8.23 MB/sec warmup 14 sec latency 16.653 ms 3 3801 7.95 MB/sec warmup 15 sec latency 19.814 ms 3 3940 7.51 MB/sec warmup 16 sec latency 21.238 ms 3 4094 7.07 MB/sec warmup 17 sec latency 17.672 ms 3 4299 6.73 MB/sec warmup 18 sec latency 40.666 ms 3 4526 6.46 MB/sec warmup 19 sec latency 29.736 ms 3 4767 6.32 MB/sec warmup 20 sec latency 21.804 ms 3 5065 6.45 MB/sec warmup 21 sec latency 21.423 ms 3 5286 6.19 MB/sec warmup 22 sec latency 25.496 ms 3 5538 5.94 MB/sec warmup 23 sec latency 16.493 ms 3 6017 4.53 MB/sec execute 1 sec latency 23.504 ms 3 6412 8.34 MB/sec execute 2 sec latency 23.679 ms 3 6832 8.57 MB/sec execute 3 sec latency 21.995 ms 3 7129 8.74 MB/sec execute 4 sec latency 13.619 ms 3 7363 7.79 MB/sec execute 5 sec latency 18.687 ms 3 7523 6.65 MB/sec execute 6 sec latency 16.117 ms 3 7698 5.71 MB/sec execute 7 sec latency 15.279 ms 3 7927 5.19 MB/sec execute 8 sec latency 58.709 ms 3 8164 5.08 MB/sec execute 9 sec latency 22.873 ms 3 8384 4.65 MB/sec execute 10 sec latency 30.977 ms 3 8652 5.03 MB/sec execute 11 sec latency 28.677 ms 3 8761 4.64 MB/sec execute 12 sec latency 36.033 ms 3 8881 4.30 MB/sec execute 13 sec latency 47.950 ms 3 9059 4.03 MB/sec execute 14 sec latency 28.124 ms 3 9299 3.82 MB/sec execute 15 sec latency 14.870 ms 3 9546 3.83 MB/sec execute 16 sec latency 24.465 ms 3 9880 4.29 MB/sec execute 17 sec latency 23.763 ms 3 10119 4.31 MB/sec execute 18 sec latency 40.669 ms 3 10407 4.38 MB/sec execute 19 sec latency 38.097 ms 3 10600 4.60 MB/sec execute 20 sec latency 27.033 ms 3 10787 4.44 MB/sec execute 21 sec latency 20.534 ms 3 10927 4.38 MB/sec execute 22 sec latency 28.356 ms 3 11072 4.23 MB/sec execute 23 sec latency 19.896 ms 3 11227 4.05 MB/sec execute 24 sec latency 38.938 ms 3 11448 3.95 MB/sec execute 25 sec latency 21.916 ms 3 11687 3.96 MB/sec execute 26 sec latency 21.244 ms 3 11904 3.84 MB/sec execute 27 sec latency 23.492 ms 3 12182 4.02 MB/sec execute 28 sec latency 17.167 ms 3 12394 3.90 MB/sec execute 29 sec latency 21.455 ms 3 12636 3.79 MB/sec execute 30 sec latency 14.929 ms 3 12866 3.70 MB/sec execute 31 sec latency 14.003 ms 3 13107 3.71 MB/sec execute 32 sec latency 21.764 ms 3 13525 3.97 MB/sec execute 33 sec latency 21.470 ms 3 13908 4.10 MB/sec execute 34 sec latency 22.761 ms 3 14196 4.28 MB/sec execute 35 sec latency 13.694 ms 3 14424 4.27 MB/sec execute 36 sec latency 17.226 ms 3 14575 4.18 MB/sec execute 37 sec latency 19.238 ms 3 14717 4.07 MB/sec execute 38 sec latency 17.906 ms 3 14916 3.98 MB/sec execute 39 sec latency 40.467 ms 3 15137 3.93 MB/sec execute 40 sec latency 23.667 ms 3 15371 3.92 MB/sec execute 41 sec latency 22.289 ms 3 15671 4.04 MB/sec execute 42 sec latency 19.834 ms 3 15896 3.96 MB/sec execute 43 sec latency 22.003 ms 3 16131 3.89 MB/sec execute 44 sec latency 14.752 ms 3 16390 3.82 MB/sec execute 45 sec latency 12.899 ms 3 16638 3.83 MB/sec execute 46 sec latency 22.747 ms 3 16992 3.99 MB/sec execute 47 sec latency 21.980 ms 3 17422 4.07 MB/sec execute 48 sec latency 21.708 ms 3 17721 4.22 MB/sec execute 49 sec latency 21.711 ms 3 17945 4.21 MB/sec execute 50 sec latency 21.518 ms 3 18108 4.16 MB/sec execute 51 sec latency 16.095 ms 3 18263 4.08 MB/sec execute 52 sec latency 17.143 ms 3 18474 4.02 MB/sec execute 53 sec latency 31.418 ms 3 18696 3.97 MB/sec execute 54 sec latency 28.794 ms 3 18932 3.97 MB/sec execute 55 sec latency 21.839 ms 3 19223 4.06 MB/sec execute 56 sec latency 22.458 ms 3 19438 4.00 MB/sec execute 57 sec latency 22.658 ms 3 19668 3.94 MB/sec execute 58 sec latency 23.166 ms 3 19924 3.89 MB/sec execute 59 sec latency 13.906 ms 3 20171 3.89 MB/sec execute 60 sec latency 22.146 ms 3 20424 3.92 MB/sec execute 61 sec latency 25.196 ms 3 20804 4.03 MB/sec execute 62 sec latency 24.644 ms 3 21163 4.06 MB/sec execute 63 sec latency 21.754 ms 3 21459 4.15 MB/sec execute 64 sec latency 19.501 ms 3 21645 4.14 MB/sec execute 65 sec latency 17.608 ms 3 21796 4.08 MB/sec execute 66 sec latency 18.280 ms 3 21993 4.03 MB/sec execute 67 sec latency 40.229 ms 3 22232 4.00 MB/sec execute 68 sec latency 21.681 ms 3 22469 3.99 MB/sec execute 69 sec latency 21.846 ms 3 22766 4.07 MB/sec execute 70 sec latency 22.376 ms 3 22984 4.02 MB/sec execute 71 sec latency 18.067 ms 3 23197 3.97 MB/sec execute 72 sec latency 22.924 ms 3 23458 3.93 MB/sec execute 73 sec latency 17.098 ms 3 23723 3.93 MB/sec execute 74 sec latency 19.312 ms 3 24019 3.99 MB/sec execute 75 sec latency 21.900 ms 3 24431 4.06 MB/sec execute 76 sec latency 25.200 ms 3 24767 4.14 MB/sec execute 77 sec latency 22.340 ms 3 25021 4.14 MB/sec execute 78 sec latency 17.944 ms 3 25191 4.13 MB/sec execute 79 sec latency 22.520 ms 3 25338 4.09 MB/sec execute 80 sec latency 18.119 ms 3 25521 4.04 MB/sec execute 81 sec latency 39.959 ms 3 25743 4.01 MB/sec execute 82 sec latency 31.197 ms 3 25978 4.01 MB/sec execute 83 sec latency 22.485 ms 3 26237 4.04 MB/sec execute 84 sec latency 23.847 ms 3 26471 4.03 MB/sec execute 85 sec latency 20.137 ms 3 26697 3.99 MB/sec execute 86 sec latency 22.411 ms 3 26954 3.95 MB/sec execute 87 sec latency 13.243 ms 3 27232 3.95 MB/sec execute 88 sec latency 19.731 ms 3 27439 3.94 MB/sec execute 89 sec latency 28.118 ms 3 27850 4.04 MB/sec execute 90 sec latency 22.216 ms 3 28219 4.07 MB/sec execute 91 sec latency 21.924 ms 3 28526 4.13 MB/sec execute 92 sec latency 16.725 ms 3 28731 4.13 MB/sec execute 93 sec latency 17.061 ms 3 28882 4.09 MB/sec execute 94 sec latency 17.176 ms 3 29081 4.05 MB/sec execute 95 sec latency 28.576 ms 3 29325 4.02 MB/sec execute 96 sec latency 21.219 ms 3 29569 4.02 MB/sec execute 97 sec latency 21.979 ms 3 29876 4.08 MB/sec execute 98 sec latency 19.826 ms 3 30104 4.04 MB/sec execute 99 sec latency 23.247 ms 3 30361 4.01 MB/sec execute 100 sec latency 20.647 ms 3 30643 3.98 MB/sec execute 101 sec latency 16.695 ms 3 30888 3.99 MB/sec execute 102 sec latency 19.768 ms 3 31278 4.08 MB/sec execute 103 sec latency 24.127 ms 3 31691 4.10 MB/sec execute 104 sec latency 21.795 ms 3 32014 4.16 MB/sec execute 105 sec latency 17.208 ms 3 32236 4.16 MB/sec execute 106 sec latency 16.634 ms 3 32399 4.13 MB/sec execute 107 sec latency 17.290 ms 3 32588 4.09 MB/sec execute 108 sec latency 16.222 ms 3 32816 4.07 MB/sec execute 109 sec latency 31.112 ms 3 33061 4.06 MB/sec execute 110 sec latency 21.178 ms 3 33343 4.09 MB/sec execute 111 sec latency 20.280 ms 3 33586 4.08 MB/sec execute 112 sec latency 21.707 ms 3 33826 4.05 MB/sec execute 113 sec latency 21.869 ms 3 34081 4.02 MB/sec execute 114 sec latency 14.482 ms 3 34334 4.01 MB/sec execute 115 sec latency 21.011 ms 3 34624 4.06 MB/sec execute 116 sec latency 23.431 ms 3 35040 4.10 MB/sec execute 117 sec latency 24.567 ms 3 35387 4.16 MB/sec execute 118 sec latency 22.451 ms 3 35645 4.17 MB/sec execute 119 sec latency 18.572 ms 3 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 15388 11.148 58.693 Close 11323 1.147 8.047 Rename 669 19.272 47.925 Unlink 3116 7.119 31.179 Qpathinfo 13945 4.203 38.916 Qfileinfo 2469 0.377 5.452 Qfsinfo 2641 6.170 32.684 Sfileinfo 1248 7.880 37.786 Find 5474 6.065 40.213 WriteX 7731 1.626 11.891 ReadX 24954 0.060 1.631 LockX 54 1.177 4.007 UnlockX 54 1.171 2.015 Flush 1071 6.269 39.951 Throughput 4.17354 MB/sec 3 clients 3 procs max_latency=58.709 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Mon Jan 13 11:53:02 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished /home/green/git/lustre-release/lustre/utils/lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg407-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 oleg407-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1