== sanity-quota test 8: Run dbench with quota enabled ==== 16:58:46 (1741899526) Waiting for MDT destroys to complete oleg417-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg417-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr /home/green/git/lustre-release/lustre/utils/lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 0 [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Thu Mar 13 16:58:51 EDT 2025 waiting for dbench pid 25447 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 2 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 216 25.09 MB/sec warmup 1 sec latency 40.479 ms 3 443 23.37 MB/sec warmup 2 sec latency 29.899 ms 3 700 21.20 MB/sec warmup 3 sec latency 28.063 ms 3 870 16.24 MB/sec warmup 4 sec latency 26.326 ms 3 1042 13.73 MB/sec warmup 5 sec latency 31.398 ms 3 1222 11.54 MB/sec warmup 6 sec latency 29.199 ms 3 1486 11.16 MB/sec warmup 7 sec latency 29.002 ms 3 1684 9.83 MB/sec warmup 8 sec latency 21.371 ms 3 1878 8.79 MB/sec warmup 9 sec latency 27.832 ms 3 2132 8.00 MB/sec warmup 10 sec latency 19.074 ms 3 2357 7.61 MB/sec warmup 11 sec latency 21.981 ms 3 2502 7.18 MB/sec warmup 12 sec latency 34.085 ms 3 2879 7.43 MB/sec warmup 13 sec latency 28.738 ms 3 3209 7.35 MB/sec warmup 14 sec latency 35.772 ms 3 3515 7.67 MB/sec warmup 15 sec latency 21.551 ms 3 3726 7.32 MB/sec warmup 16 sec latency 24.454 ms 3 3874 7.02 MB/sec warmup 17 sec latency 25.378 ms 3 3996 6.68 MB/sec warmup 18 sec latency 27.548 ms 3 4128 6.33 MB/sec warmup 19 sec latency 25.687 ms 3 4316 6.07 MB/sec warmup 20 sec latency 29.735 ms 3 4504 5.84 MB/sec warmup 21 sec latency 27.328 ms 3 4722 5.74 MB/sec warmup 22 sec latency 23.436 ms 3 4941 5.80 MB/sec warmup 23 sec latency 30.341 ms 3 5322 0.41 MB/sec execute 1 sec latency 30.967 ms 3 5526 0.48 MB/sec execute 2 sec latency 16.693 ms 3 5750 0.61 MB/sec execute 3 sec latency 16.211 ms 3 5972 1.44 MB/sec execute 4 sec latency 29.098 ms 3 6166 1.74 MB/sec execute 5 sec latency 30.496 ms 3 6538 3.69 MB/sec execute 6 sec latency 30.728 ms 3 6880 3.96 MB/sec execute 7 sec latency 24.409 ms 3 7148 4.65 MB/sec execute 8 sec latency 19.225 ms 3 7315 4.43 MB/sec execute 9 sec latency 34.928 ms 3 7458 4.15 MB/sec execute 10 sec latency 20.658 ms 3 7592 3.80 MB/sec execute 11 sec latency 19.942 ms 3 7769 3.52 MB/sec execute 12 sec latency 46.171 ms 3 7992 3.38 MB/sec execute 13 sec latency 25.795 ms 3 8207 3.41 MB/sec execute 14 sec latency 24.114 ms 3 8442 3.60 MB/sec execute 15 sec latency 24.911 ms 3 8649 3.58 MB/sec execute 16 sec latency 31.851 ms 3 8846 3.40 MB/sec execute 17 sec latency 31.288 ms 3 9011 3.23 MB/sec execute 18 sec latency 26.268 ms 3 9182 3.10 MB/sec execute 19 sec latency 24.620 ms 3 9430 3.08 MB/sec execute 20 sec latency 18.008 ms 3 9643 3.10 MB/sec execute 21 sec latency 25.338 ms 3 9978 3.54 MB/sec execute 22 sec latency 25.619 ms 3 10349 3.64 MB/sec execute 23 sec latency 25.463 ms 3 10550 3.79 MB/sec execute 24 sec latency 37.314 ms 3 10762 3.80 MB/sec execute 25 sec latency 24.541 ms 3 10923 3.78 MB/sec execute 26 sec latency 24.884 ms 3 11051 3.67 MB/sec execute 27 sec latency 24.881 ms 3 11182 3.54 MB/sec execute 28 sec latency 19.513 ms 3 11336 3.44 MB/sec execute 29 sec latency 51.644 ms 3 11526 3.37 MB/sec execute 30 sec latency 29.333 ms 3 11703 3.35 MB/sec execute 31 sec latency 35.190 ms 3 11870 3.30 MB/sec execute 32 sec latency 33.557 ms 3 12111 3.47 MB/sec execute 33 sec latency 22.339 ms 3 12303 3.38 MB/sec execute 34 sec latency 20.146 ms 3 12478 3.29 MB/sec execute 35 sec latency 28.869 ms 3 12681 3.22 MB/sec execute 36 sec latency 18.707 ms 3 12926 3.21 MB/sec execute 37 sec latency 16.573 ms 3 13154 3.21 MB/sec execute 38 sec latency 24.507 ms 3 13472 3.39 MB/sec execute 39 sec latency 23.721 ms 3 13838 3.51 MB/sec execute 40 sec latency 27.255 ms 3 14109 3.62 MB/sec execute 41 sec latency 28.546 ms 3 14315 3.63 MB/sec execute 42 sec latency 22.331 ms 3 14489 3.62 MB/sec execute 43 sec latency 23.392 ms 3 14619 3.56 MB/sec execute 44 sec latency 19.746 ms 3 14762 3.48 MB/sec execute 45 sec latency 19.337 ms 3 14939 3.42 MB/sec execute 46 sec latency 44.388 ms 3 15147 3.38 MB/sec execute 47 sec latency 26.342 ms 3 15359 3.39 MB/sec execute 48 sec latency 25.529 ms 3 15593 3.45 MB/sec execute 49 sec latency 25.657 ms 3 15782 3.44 MB/sec execute 50 sec latency 28.812 ms 3 15984 3.38 MB/sec execute 51 sec latency 28.238 ms 3 16198 3.33 MB/sec execute 52 sec latency 18.006 ms 3 16426 3.32 MB/sec execute 53 sec latency 18.435 ms 3 16590 3.29 MB/sec execute 54 sec latency 33.194 ms 3 16822 3.38 MB/sec execute 55 sec latency 30.959 ms 3 17124 3.44 MB/sec execute 56 sec latency 29.691 ms 3 17496 3.49 MB/sec execute 57 sec latency 27.625 ms 3 17748 3.56 MB/sec execute 58 sec latency 24.383 ms 3 17952 3.59 MB/sec execute 59 sec latency 23.240 ms 3 18088 3.56 MB/sec execute 60 sec latency 24.443 ms 3 18220 3.51 MB/sec execute 61 sec latency 18.567 ms 3 18394 3.46 MB/sec execute 62 sec latency 64.619 ms 3 18593 3.42 MB/sec execute 63 sec latency 26.090 ms 3 18802 3.42 MB/sec execute 64 sec latency 25.515 ms 3 19049 3.48 MB/sec execute 65 sec latency 29.271 ms 3 19278 3.47 MB/sec execute 66 sec latency 24.379 ms 3 19484 3.43 MB/sec execute 67 sec latency 24.031 ms 3 19710 3.39 MB/sec execute 68 sec latency 20.178 ms 3 19931 3.35 MB/sec execute 69 sec latency 25.919 ms 3 20167 3.35 MB/sec execute 70 sec latency 25.612 ms 3 20457 3.43 MB/sec execute 71 sec latency 23.951 ms 3 20838 3.50 MB/sec execute 72 sec latency 24.908 ms 3 21171 3.59 MB/sec execute 73 sec latency 25.919 ms 3 21362 3.57 MB/sec execute 74 sec latency 22.577 ms 3 21573 3.59 MB/sec execute 75 sec latency 18.704 ms 3 21724 3.57 MB/sec execute 76 sec latency 19.972 ms 3 21865 3.52 MB/sec execute 77 sec latency 21.108 ms 3 22021 3.49 MB/sec execute 78 sec latency 60.381 ms 3 22217 3.46 MB/sec execute 79 sec latency 26.173 ms 3 22408 3.45 MB/sec execute 80 sec latency 29.337 ms 3 22650 3.50 MB/sec execute 81 sec latency 25.390 ms 3 22865 3.50 MB/sec execute 82 sec latency 26.097 ms 3 23052 3.46 MB/sec execute 83 sec latency 25.886 ms 3 23263 3.43 MB/sec execute 84 sec latency 22.555 ms 3 23472 3.39 MB/sec execute 85 sec latency 20.081 ms 3 23678 3.39 MB/sec execute 86 sec latency 23.556 ms 3 23960 3.45 MB/sec execute 87 sec latency 26.846 ms 3 24210 3.46 MB/sec execute 88 sec latency 27.053 ms 3 24581 3.52 MB/sec execute 89 sec latency 23.491 ms 3 24885 3.57 MB/sec execute 90 sec latency 24.820 ms 3 25091 3.59 MB/sec execute 91 sec latency 22.252 ms 3 25250 3.57 MB/sec execute 92 sec latency 19.767 ms 3 25376 3.54 MB/sec execute 93 sec latency 24.808 ms 3 25518 3.50 MB/sec execute 94 sec latency 52.344 ms 3 25702 3.48 MB/sec execute 95 sec latency 27.176 ms 3 25887 3.47 MB/sec execute 96 sec latency 31.692 ms 3 26073 3.45 MB/sec execute 97 sec latency 25.945 ms 3 26323 3.48 MB/sec execute 98 sec latency 27.251 ms 3 26562 3.48 MB/sec execute 99 sec latency 23.971 ms 3 26778 3.45 MB/sec execute 100 sec latency 27.105 ms 3 26995 3.42 MB/sec execute 101 sec latency 26.694 ms 3 27223 3.42 MB/sec execute 102 sec latency 23.708 ms 3 27498 3.47 MB/sec execute 103 sec latency 29.452 ms 3 27745 3.48 MB/sec execute 104 sec latency 28.814 ms 3 28080 3.53 MB/sec execute 105 sec latency 28.891 ms 3 28379 3.57 MB/sec execute 106 sec latency 29.181 ms 3 28581 3.59 MB/sec execute 107 sec latency 21.567 ms 3 28713 3.56 MB/sec execute 108 sec latency 24.869 ms 3 28836 3.54 MB/sec execute 109 sec latency 23.325 ms 3 28964 3.51 MB/sec execute 110 sec latency 26.144 ms 3 29122 3.49 MB/sec execute 111 sec latency 55.076 ms 3 29293 3.46 MB/sec execute 112 sec latency 33.469 ms 3 29477 3.46 MB/sec execute 113 sec latency 32.199 ms 3 29697 3.49 MB/sec execute 114 sec latency 28.323 ms 3 29878 3.47 MB/sec execute 115 sec latency 29.965 ms 3 30081 3.46 MB/sec execute 116 sec latency 32.473 ms 3 30244 3.44 MB/sec execute 117 sec latency 22.368 ms 3 30440 3.41 MB/sec execute 118 sec latency 28.086 ms 3 30619 3.41 MB/sec execute 119 sec latency 22.182 ms 3 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 13396 12.931 64.599 Close 9919 1.329 9.121 Rename 555 22.482 37.300 Unlink 2641 8.334 44.370 Qpathinfo 12183 4.816 36.703 Qfileinfo 2130 0.405 4.096 Qfsinfo 2158 7.425 21.463 Sfileinfo 1070 9.415 20.043 Find 4655 7.081 46.152 WriteX 6595 1.757 10.795 ReadX 20599 0.067 1.152 LockX 42 1.164 2.063 UnlockX 42 1.269 2.032 Flush 924 7.309 35.630 Throughput 3.40648 MB/sec 3 clients 3 procs max_latency=64.619 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Thu Mar 13 17:01:16 EDT 2025 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished /home/green/git/lustre-release/lustre/utils/lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg417-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg417-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1