== sanity-quota test 8: Run dbench with quota enabled ==== 11:46:09 (1740674769) Waiting for MDT destroys to complete oleg434-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 oleg434-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr /home/green/git/lustre-release/lustre/utils/lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 0 [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Thu Feb 27 11:46:16 EST 2025 waiting for dbench pid 26457 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 2 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 170 20.93 MB/sec warmup 1 sec latency 46.246 ms 3 354 19.05 MB/sec warmup 2 sec latency 33.638 ms 3 551 19.10 MB/sec warmup 3 sec latency 38.828 ms 3 732 15.98 MB/sec warmup 4 sec latency 37.005 ms 3 859 12.94 MB/sec warmup 5 sec latency 44.635 ms 3 967 10.91 MB/sec warmup 6 sec latency 42.755 ms 3 1103 9.83 MB/sec warmup 7 sec latency 42.885 ms 3 1220 8.65 MB/sec warmup 8 sec latency 43.817 ms 3 1399 8.67 MB/sec warmup 9 sec latency 52.828 ms 3 1522 7.83 MB/sec warmup 10 sec latency 33.754 ms 3 1689 7.15 MB/sec warmup 11 sec latency 29.404 ms 3 1882 6.59 MB/sec warmup 12 sec latency 20.864 ms 3 2093 6.15 MB/sec warmup 13 sec latency 18.895 ms 3 2301 5.95 MB/sec warmup 14 sec latency 23.426 ms 3 2454 5.62 MB/sec warmup 15 sec latency 26.329 ms 3 2719 5.99 MB/sec warmup 16 sec latency 37.005 ms 3 2992 5.91 MB/sec warmup 17 sec latency 33.525 ms 3 3301 5.89 MB/sec warmup 18 sec latency 29.580 ms 3 3540 6.06 MB/sec warmup 19 sec latency 20.684 ms 3 3702 5.82 MB/sec warmup 20 sec latency 26.548 ms 3 3823 5.68 MB/sec warmup 21 sec latency 31.507 ms 3 3889 5.43 MB/sec warmup 22 sec latency 40.717 ms 3 3963 5.22 MB/sec warmup 23 sec latency 49.921 ms 3 4101 0.07 MB/sec execute 1 sec latency 48.941 ms 3 4194 0.09 MB/sec execute 2 sec latency 35.956 ms 3 4286 0.31 MB/sec execute 3 sec latency 57.476 ms 3 4363 0.39 MB/sec execute 4 sec latency 77.828 ms 3 4454 0.43 MB/sec execute 5 sec latency 53.256 ms 3 4565 0.50 MB/sec execute 6 sec latency 39.928 ms 3 4688 0.87 MB/sec execute 7 sec latency 61.320 ms 3 4795 0.80 MB/sec execute 8 sec latency 45.025 ms 3 4969 1.69 MB/sec execute 9 sec latency 46.423 ms 3 5066 1.53 MB/sec execute 10 sec latency 37.012 ms 3 5191 1.42 MB/sec execute 11 sec latency 29.479 ms 3 5343 1.34 MB/sec execute 12 sec latency 42.555 ms 3 5523 1.27 MB/sec execute 13 sec latency 22.936 ms 3 5700 1.23 MB/sec execute 14 sec latency 26.251 ms 3 5897 1.38 MB/sec execute 15 sec latency 31.843 ms 3 6018 1.36 MB/sec execute 16 sec latency 34.738 ms 3 6304 1.94 MB/sec execute 17 sec latency 37.314 ms 3 6533 2.09 MB/sec execute 18 sec latency 36.548 ms 3 6837 2.27 MB/sec execute 19 sec latency 28.848 ms 3 7057 2.61 MB/sec execute 20 sec latency 22.178 ms 3 7242 2.54 MB/sec execute 21 sec latency 24.351 ms 3 7381 2.57 MB/sec execute 22 sec latency 24.352 ms 3 7488 2.49 MB/sec execute 23 sec latency 25.289 ms 3 7576 2.39 MB/sec execute 24 sec latency 77.285 ms 3 7682 2.30 MB/sec execute 25 sec latency 30.846 ms 3 7866 2.25 MB/sec execute 26 sec latency 44.193 ms 3 8023 2.21 MB/sec execute 27 sec latency 32.955 ms 3 8235 2.27 MB/sec execute 28 sec latency 26.558 ms 3 8492 2.50 MB/sec execute 29 sec latency 25.156 ms 3 8658 2.43 MB/sec execute 30 sec latency 23.561 ms 3 8840 2.37 MB/sec execute 31 sec latency 24.911 ms 3 9087 2.31 MB/sec execute 32 sec latency 17.394 ms 3 9340 2.27 MB/sec execute 33 sec latency 14.367 ms 3 9562 2.35 MB/sec execute 34 sec latency 23.530 ms 3 9889 2.58 MB/sec execute 35 sec latency 23.179 ms 3 10233 2.68 MB/sec execute 36 sec latency 29.164 ms 3 10594 2.91 MB/sec execute 37 sec latency 18.181 ms 3 10825 2.97 MB/sec execute 38 sec latency 20.876 ms 3 10974 2.93 MB/sec execute 39 sec latency 20.719 ms 3 11116 2.87 MB/sec execute 40 sec latency 18.247 ms 3 11280 2.80 MB/sec execute 41 sec latency 16.772 ms 3 11420 2.76 MB/sec execute 42 sec latency 49.511 ms 3 11567 2.72 MB/sec execute 43 sec latency 46.756 ms 3 11728 2.74 MB/sec execute 44 sec latency 35.049 ms 3 11887 2.69 MB/sec execute 45 sec latency 32.146 ms 3 12121 2.83 MB/sec execute 46 sec latency 27.962 ms 3 12290 2.78 MB/sec execute 47 sec latency 35.679 ms 3 12478 2.73 MB/sec execute 48 sec latency 28.749 ms 3 12692 2.69 MB/sec execute 49 sec latency 19.077 ms 3 12889 2.65 MB/sec execute 50 sec latency 23.543 ms 3 13089 2.67 MB/sec execute 51 sec latency 23.947 ms 3 13440 2.79 MB/sec execute 52 sec latency 22.323 ms 3 13819 2.92 MB/sec execute 53 sec latency 25.356 ms 3 14118 3.04 MB/sec execute 54 sec latency 21.657 ms 3 14324 3.06 MB/sec execute 55 sec latency 24.513 ms 3 14465 3.06 MB/sec execute 56 sec latency 30.886 ms 3 14565 3.01 MB/sec execute 57 sec latency 27.386 ms 3 14673 2.97 MB/sec execute 58 sec latency 28.710 ms 3 14775 2.92 MB/sec execute 59 sec latency 71.518 ms 3 14884 2.88 MB/sec execute 60 sec latency 40.857 ms 3 15017 2.85 MB/sec execute 61 sec latency 48.422 ms 3 15145 2.81 MB/sec execute 62 sec latency 30.995 ms 3 15295 2.83 MB/sec execute 63 sec latency 46.820 ms 3 15423 2.79 MB/sec execute 64 sec latency 54.476 ms 3 15597 2.84 MB/sec execute 65 sec latency 39.413 ms 3 15746 2.84 MB/sec execute 66 sec latency 36.905 ms 3 15883 2.80 MB/sec execute 67 sec latency 33.167 ms 3 16024 2.77 MB/sec execute 68 sec latency 39.760 ms 3 16189 2.74 MB/sec execute 69 sec latency 22.204 ms 3 16374 2.71 MB/sec execute 70 sec latency 19.775 ms 3 16589 2.72 MB/sec execute 71 sec latency 29.485 ms 3 16759 2.72 MB/sec execute 72 sec latency 29.887 ms 3 17093 2.85 MB/sec execute 73 sec latency 28.906 ms 3 17383 2.88 MB/sec execute 74 sec latency 30.619 ms 3 17628 2.95 MB/sec execute 75 sec latency 27.071 ms 3 17787 2.96 MB/sec execute 76 sec latency 30.148 ms 3 17912 2.95 MB/sec execute 77 sec latency 46.144 ms 3 17999 2.93 MB/sec execute 78 sec latency 44.496 ms 3 18089 2.90 MB/sec execute 79 sec latency 30.389 ms 3 18181 2.87 MB/sec execute 80 sec latency 55.327 ms 3 18285 2.83 MB/sec execute 81 sec latency 30.688 ms 3 18422 2.80 MB/sec execute 82 sec latency 31.444 ms 3 18527 2.78 MB/sec execute 83 sec latency 50.287 ms 3 18631 2.76 MB/sec execute 84 sec latency 46.872 ms 3 18727 2.74 MB/sec execute 85 sec latency 48.071 ms 3 18832 2.73 MB/sec execute 86 sec latency 40.085 ms 3 18957 2.71 MB/sec execute 87 sec latency 47.851 ms 3 19139 2.75 MB/sec execute 88 sec latency 32.744 ms 3 19286 2.75 MB/sec execute 89 sec latency 28.738 ms 3 19414 2.72 MB/sec execute 90 sec latency 45.953 ms 3 19546 2.70 MB/sec execute 91 sec latency 33.109 ms 3 19696 2.67 MB/sec execute 92 sec latency 24.719 ms 3 19853 2.65 MB/sec execute 93 sec latency 28.471 ms 3 20011 2.63 MB/sec execute 94 sec latency 24.362 ms 3 20182 2.64 MB/sec execute 95 sec latency 27.464 ms 3 20344 2.64 MB/sec execute 96 sec latency 35.063 ms 3 20661 2.74 MB/sec execute 97 sec latency 29.252 ms 3 20957 2.76 MB/sec execute 98 sec latency 34.293 ms 3 21209 2.82 MB/sec execute 99 sec latency 29.099 ms 3 21360 2.82 MB/sec execute 100 sec latency 30.205 ms 3 21500 2.82 MB/sec execute 101 sec latency 30.895 ms 3 21592 2.80 MB/sec execute 102 sec latency 43.668 ms 3 21667 2.78 MB/sec execute 103 sec latency 44.493 ms 3 21732 2.76 MB/sec execute 104 sec latency 37.900 ms 3 21803 2.73 MB/sec execute 105 sec latency 39.243 ms 3 21875 2.71 MB/sec execute 106 sec latency 45.336 ms 3 21975 2.69 MB/sec execute 107 sec latency 54.128 ms 3 22077 2.67 MB/sec execute 108 sec latency 53.879 ms 3 22193 2.65 MB/sec execute 109 sec latency 44.551 ms 3 22284 2.63 MB/sec execute 110 sec latency 65.710 ms 3 22392 2.63 MB/sec execute 111 sec latency 47.353 ms 3 22490 2.62 MB/sec execute 112 sec latency 43.976 ms 3 22575 2.60 MB/sec execute 113 sec latency 51.668 ms 3 22733 2.63 MB/sec execute 114 sec latency 45.419 ms 3 22860 2.63 MB/sec execute 115 sec latency 58.556 ms 3 22953 2.61 MB/sec execute 116 sec latency 44.520 ms 3 23061 2.59 MB/sec execute 117 sec latency 48.977 ms 3 23153 2.57 MB/sec execute 118 sec latency 45.681 ms 3 23262 2.55 MB/sec execute 119 sec latency 42.997 ms 3 cleanup 120 sec 3 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 10132 17.180 77.268 Close 7482 1.801 16.734 Rename 423 29.141 77.795 Unlink 2027 11.012 36.082 Qpathinfo 9185 6.195 45.290 Qfileinfo 1587 0.462 5.071 Qfsinfo 1638 9.914 47.426 Sfileinfo 852 13.070 51.929 Find 3515 9.344 45.310 WriteX 4954 2.135 17.961 ReadX 15435 0.074 1.640 LockX 30 1.320 2.043 UnlockX 30 1.422 2.404 Flush 735 10.137 39.020 Throughput 2.54906 MB/sec 3 clients 3 procs max_latency=77.828 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Thu Feb 27 11:48:41 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished /home/green/git/lustre-release/lustre/utils/lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg434-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg434-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1