== sanity-quota test 8: Run dbench with quota enabled ==== 13:50:41 (1733165441) Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Waiting 90s for 'ugp' Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr /home/green/git/lustre-release/lustre/utils/lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Mon Dec 2 13:50:47 EST 2024 waiting for dbench pid 25378 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 2 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 214 24.89 MB/sec warmup 1 sec latency 29.626 ms 3 424 22.43 MB/sec warmup 2 sec latency 34.195 ms 3 675 21.17 MB/sec warmup 3 sec latency 27.976 ms 3 855 16.18 MB/sec warmup 4 sec latency 27.309 ms 3 1027 13.73 MB/sec warmup 5 sec latency 30.081 ms 3 1186 11.51 MB/sec warmup 6 sec latency 28.397 ms 3 1416 11.15 MB/sec warmup 7 sec latency 33.230 ms 3 1595 9.81 MB/sec warmup 8 sec latency 26.683 ms 3 1804 8.78 MB/sec warmup 9 sec latency 29.060 ms 3 1992 7.95 MB/sec warmup 10 sec latency 24.652 ms 3 2174 7.29 MB/sec warmup 11 sec latency 20.772 ms 3 2401 6.99 MB/sec warmup 12 sec latency 24.845 ms 3 2599 6.69 MB/sec warmup 13 sec latency 29.603 ms 3 2984 7.18 MB/sec warmup 14 sec latency 26.413 ms 3 3331 7.07 MB/sec warmup 15 sec latency 23.088 ms 3 3650 7.25 MB/sec warmup 16 sec latency 18.307 ms 3 3833 7.02 MB/sec warmup 17 sec latency 20.601 ms 3 3966 6.68 MB/sec warmup 18 sec latency 20.024 ms 3 4102 6.33 MB/sec warmup 19 sec latency 18.376 ms 3 4304 6.06 MB/sec warmup 20 sec latency 37.376 ms 3 4505 5.84 MB/sec warmup 21 sec latency 32.812 ms 3 4733 5.74 MB/sec warmup 22 sec latency 24.727 ms 3 5004 5.89 MB/sec warmup 23 sec latency 24.795 ms 3 5351 0.44 MB/sec execute 1 sec latency 31.184 ms 3 5554 0.49 MB/sec execute 2 sec latency 20.226 ms 3 5752 0.60 MB/sec execute 3 sec latency 19.281 ms 3 5978 1.43 MB/sec execute 4 sec latency 26.377 ms 3 6159 1.71 MB/sec execute 5 sec latency 29.827 ms 3 6511 3.67 MB/sec execute 6 sec latency 27.332 ms 3 6835 3.94 MB/sec execute 7 sec latency 32.849 ms 3 7079 4.58 MB/sec execute 8 sec latency 20.790 ms 3 7258 4.21 MB/sec execute 9 sec latency 25.029 ms 3 7396 4.08 MB/sec execute 10 sec latency 24.452 ms 3 7525 3.79 MB/sec execute 11 sec latency 41.136 ms 3 7649 3.48 MB/sec execute 12 sec latency 49.836 ms 3 7844 3.29 MB/sec execute 13 sec latency 24.013 ms 3 8047 3.16 MB/sec execute 14 sec latency 38.216 ms 3 8262 3.19 MB/sec execute 15 sec latency 24.387 ms 3 8540 3.56 MB/sec execute 16 sec latency 23.894 ms 3 8706 3.37 MB/sec execute 17 sec latency 26.551 ms 3 8901 3.21 MB/sec execute 18 sec latency 27.677 ms 3 9116 3.08 MB/sec execute 19 sec latency 16.161 ms 3 9327 2.96 MB/sec execute 20 sec latency 17.724 ms 3 9534 3.01 MB/sec execute 21 sec latency 26.963 ms 3 9713 3.00 MB/sec execute 22 sec latency 33.415 ms 3 10065 3.45 MB/sec execute 23 sec latency 29.579 ms 3 10399 3.54 MB/sec execute 24 sec latency 30.948 ms 3 10656 3.76 MB/sec execute 25 sec latency 19.722 ms 3 10836 3.74 MB/sec execute 26 sec latency 22.881 ms 3 10958 3.64 MB/sec execute 27 sec latency 24.683 ms 3 11079 3.54 MB/sec execute 28 sec latency 22.269 ms 3 11190 3.42 MB/sec execute 29 sec latency 66.484 ms 3 11368 3.33 MB/sec execute 30 sec latency 36.804 ms 3 11563 3.27 MB/sec execute 31 sec latency 25.369 ms 3 11761 3.28 MB/sec execute 32 sec latency 23.556 ms 3 12009 3.38 MB/sec execute 33 sec latency 21.609 ms 3 12238 3.37 MB/sec execute 34 sec latency 26.246 ms 3 12433 3.29 MB/sec execute 35 sec latency 31.581 ms 3 12652 3.22 MB/sec execute 36 sec latency 17.826 ms 3 12861 3.15 MB/sec execute 37 sec latency 21.003 ms 3 13086 3.17 MB/sec execute 38 sec latency 26.758 ms 3 13363 3.31 MB/sec execute 39 sec latency 25.005 ms 3 13762 3.45 MB/sec execute 40 sec latency 25.253 ms 3 14027 3.48 MB/sec execute 41 sec latency 26.438 ms 3 14308 3.63 MB/sec execute 42 sec latency 23.047 ms 3 14473 3.62 MB/sec execute 43 sec latency 20.305 ms 3 14609 3.56 MB/sec execute 44 sec latency 18.847 ms 3 14738 3.48 MB/sec execute 45 sec latency 22.065 ms 3 14901 3.42 MB/sec execute 46 sec latency 54.536 ms 3 15078 3.37 MB/sec execute 47 sec latency 33.838 ms 3 15263 3.36 MB/sec execute 48 sec latency 31.352 ms 3 15449 3.33 MB/sec execute 49 sec latency 28.028 ms 3 15684 3.43 MB/sec execute 50 sec latency 25.414 ms 3 15848 3.38 MB/sec execute 51 sec latency 21.256 ms 3 16013 3.32 MB/sec execute 52 sec latency 28.563 ms 3 16208 3.27 MB/sec execute 53 sec latency 18.858 ms 3 16446 3.26 MB/sec execute 54 sec latency 17.509 ms 3 16638 3.25 MB/sec execute 55 sec latency 26.206 ms 3 16893 3.33 MB/sec execute 56 sec latency 34.158 ms 3 17177 3.40 MB/sec execute 57 sec latency 27.921 ms 3 17523 3.45 MB/sec execute 58 sec latency 26.861 ms 3 17812 3.55 MB/sec execute 59 sec latency 17.131 ms 3 18009 3.55 MB/sec execute 60 sec latency 18.168 ms 3 18164 3.50 MB/sec execute 61 sec latency 16.903 ms 3 18314 3.45 MB/sec execute 62 sec latency 19.351 ms 3 18510 3.41 MB/sec execute 63 sec latency 47.050 ms 3 18698 3.38 MB/sec execute 64 sec latency 26.151 ms 3 18912 3.38 MB/sec execute 65 sec latency 23.991 ms 3 19164 3.43 MB/sec execute 66 sec latency 24.465 ms 3 19360 3.42 MB/sec execute 67 sec latency 20.298 ms 3 19531 3.38 MB/sec execute 68 sec latency 30.506 ms 3 19701 3.34 MB/sec execute 69 sec latency 21.552 ms 3 19883 3.30 MB/sec execute 70 sec latency 22.136 ms 3 20075 3.29 MB/sec execute 71 sec latency 26.428 ms 3 20234 3.28 MB/sec execute 72 sec latency 32.518 ms 3 20482 3.34 MB/sec execute 73 sec latency 29.278 ms 3 20756 3.38 MB/sec execute 74 sec latency 28.486 ms 3 21059 3.41 MB/sec execute 75 sec latency 31.759 ms 3 21250 3.46 MB/sec execute 76 sec latency 30.228 ms 3 21413 3.47 MB/sec execute 77 sec latency 26.340 ms 3 21551 3.45 MB/sec execute 78 sec latency 26.762 ms 3 21677 3.43 MB/sec execute 79 sec latency 22.977 ms 3 21774 3.39 MB/sec execute 80 sec latency 26.045 ms 3 21877 3.35 MB/sec execute 81 sec latency 40.295 ms 3 22007 3.32 MB/sec execute 82 sec latency 37.425 ms 3 22142 3.29 MB/sec execute 83 sec latency 32.790 ms 3 22277 3.26 MB/sec execute 84 sec latency 38.901 ms 3 22419 3.25 MB/sec execute 85 sec latency 34.953 ms 3 22549 3.23 MB/sec execute 86 sec latency 36.595 ms 3 22704 3.26 MB/sec execute 87 sec latency 41.612 ms 3 22854 3.26 MB/sec execute 88 sec latency 55.375 ms 3 23004 3.23 MB/sec execute 89 sec latency 27.054 ms 3 23139 3.19 MB/sec execute 90 sec latency 42.937 ms 3 23305 3.16 MB/sec execute 91 sec latency 22.078 ms 3 23464 3.14 MB/sec execute 92 sec latency 27.826 ms 3 23627 3.13 MB/sec execute 93 sec latency 27.146 ms 3 23813 3.13 MB/sec execute 94 sec latency 34.848 ms 3 24047 3.17 MB/sec execute 95 sec latency 31.016 ms 3 24427 3.23 MB/sec execute 96 sec latency 25.410 ms 3 24749 3.30 MB/sec execute 97 sec latency 27.100 ms 3 24957 3.31 MB/sec execute 98 sec latency 22.417 ms 3 25121 3.30 MB/sec execute 99 sec latency 22.433 ms 3 25246 3.28 MB/sec execute 100 sec latency 26.951 ms 3 25335 3.25 MB/sec execute 101 sec latency 40.230 ms 3 25450 3.22 MB/sec execute 102 sec latency 65.360 ms 3 25668 3.20 MB/sec execute 103 sec latency 20.207 ms 3 25903 3.21 MB/sec execute 104 sec latency 20.444 ms 3 26105 3.19 MB/sec execute 105 sec latency 24.836 ms 3 26341 3.22 MB/sec execute 106 sec latency 26.922 ms 3 26520 3.22 MB/sec execute 107 sec latency 38.470 ms 3 26681 3.19 MB/sec execute 108 sec latency 21.165 ms 3 26890 3.17 MB/sec execute 109 sec latency 26.848 ms 3 27167 3.17 MB/sec execute 110 sec latency 16.184 ms 3 27408 3.17 MB/sec execute 111 sec latency 23.578 ms 3 27741 3.23 MB/sec execute 112 sec latency 24.182 ms 3 28083 3.28 MB/sec execute 113 sec latency 26.369 ms 3 28347 3.32 MB/sec execute 114 sec latency 28.850 ms 3 28561 3.34 MB/sec execute 115 sec latency 24.334 ms 3 28727 3.33 MB/sec execute 116 sec latency 21.976 ms 3 28852 3.30 MB/sec execute 117 sec latency 23.801 ms 3 29003 3.27 MB/sec execute 118 sec latency 21.850 ms 3 29169 3.25 MB/sec execute 119 sec latency 43.269 ms 3 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 12576 13.758 66.477 Close 9228 1.412 8.966 Rename 526 23.307 55.353 Unlink 2565 8.776 38.155 Qpathinfo 11350 5.140 36.789 Qfileinfo 1982 0.423 2.774 Qfsinfo 2092 7.862 38.202 Sfileinfo 992 9.736 33.737 Find 4406 7.559 49.818 WriteX 6218 1.893 12.934 ReadX 19725 0.072 2.204 LockX 42 1.280 2.239 UnlockX 42 1.428 2.225 Flush 893 7.238 30.310 Throughput 3.25309 MB/sec 3 clients 3 procs max_latency=66.484 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Mon Dec 2 13:53:12 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished /home/green/git/lustre-release/lustre/utils/lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1