== sanity-quota test 8: Run dbench with quota enabled ==== 01:54:42 (1724306082) Waiting for MDT destroys to complete oleg401-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 oleg401-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Waiting 90s for 'ugp' Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Thu Aug 22 01:54:51 EDT 2024 waiting for dbench pid 24124 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 1 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 134 17.78 MB/sec warmup 1 sec latency 59.760 ms 3 247 14.09 MB/sec warmup 2 sec latency 54.450 ms 3 382 13.60 MB/sec warmup 3 sec latency 41.377 ms 3 512 13.29 MB/sec warmup 4 sec latency 50.708 ms 3 683 12.70 MB/sec warmup 5 sec latency 54.155 ms 3 784 10.70 MB/sec warmup 6 sec latency 49.582 ms 3 891 9.28 MB/sec warmup 7 sec latency 56.671 ms 3 984 8.21 MB/sec warmup 8 sec latency 44.906 ms 3 1142 7.66 MB/sec warmup 9 sec latency 34.737 ms 3 1272 6.94 MB/sec warmup 10 sec latency 34.212 ms 3 1507 7.10 MB/sec warmup 11 sec latency 39.850 ms 3 1678 6.55 MB/sec warmup 12 sec latency 31.729 ms 3 1821 6.08 MB/sec warmup 13 sec latency 48.925 ms 3 1972 5.67 MB/sec warmup 14 sec latency 38.637 ms 3 2125 5.33 MB/sec warmup 15 sec latency 39.042 ms 3 2262 5.09 MB/sec warmup 16 sec latency 45.698 ms 3 2392 4.93 MB/sec warmup 17 sec latency 64.343 ms 3 2488 4.78 MB/sec warmup 18 sec latency 41.249 ms 3 2632 4.65 MB/sec warmup 19 sec latency 52.046 ms 3 2904 4.95 MB/sec warmup 20 sec latency 54.678 ms 3 3072 4.82 MB/sec warmup 21 sec latency 56.053 ms 3 3329 4.82 MB/sec warmup 22 sec latency 48.469 ms 3 3530 5.00 MB/sec warmup 23 sec latency 38.693 ms 3 3800 3.18 MB/sec execute 1 sec latency 39.602 ms 3 3902 1.98 MB/sec execute 2 sec latency 33.315 ms 3 3983 1.36 MB/sec execute 3 sec latency 102.397 ms 3 4062 1.03 MB/sec execute 4 sec latency 49.044 ms 3 4181 0.83 MB/sec execute 5 sec latency 40.020 ms 3 4283 0.82 MB/sec execute 6 sec latency 73.039 ms 3 4377 0.81 MB/sec execute 7 sec latency 70.743 ms 3 4480 0.81 MB/sec execute 8 sec latency 50.876 ms 3 4582 0.98 MB/sec execute 9 sec latency 53.748 ms 3 4679 1.01 MB/sec execute 10 sec latency 105.815 ms 3 4778 0.95 MB/sec execute 11 sec latency 46.908 ms 3 4916 1.36 MB/sec execute 12 sec latency 67.885 ms 3 5026 1.49 MB/sec execute 13 sec latency 68.492 ms 3 5107 1.39 MB/sec execute 14 sec latency 99.635 ms 3 5180 1.31 MB/sec execute 15 sec latency 115.777 ms 3 5274 1.25 MB/sec execute 16 sec latency 69.350 ms 3 5353 1.19 MB/sec execute 17 sec latency 61.695 ms 3 5440 1.13 MB/sec execute 18 sec latency 52.247 ms 3 5571 1.09 MB/sec execute 19 sec latency 59.643 ms 3 5716 1.07 MB/sec execute 20 sec latency 43.874 ms 3 5838 1.12 MB/sec execute 21 sec latency 75.707 ms 3 5955 1.15 MB/sec execute 22 sec latency 49.327 ms 3 6036 1.16 MB/sec execute 23 sec latency 55.682 ms 3 6165 1.18 MB/sec execute 24 sec latency 57.138 ms 3 6410 1.55 MB/sec execute 25 sec latency 59.116 ms 3 6527 1.61 MB/sec execute 26 sec latency 94.062 ms 3 6748 1.63 MB/sec execute 27 sec latency 79.037 ms 3 6892 1.69 MB/sec execute 28 sec latency 56.506 ms 3 7066 1.94 MB/sec execute 29 sec latency 53.608 ms 3 7166 1.90 MB/sec execute 30 sec latency 36.960 ms 3 7262 1.86 MB/sec execute 31 sec latency 43.111 ms 3 7360 1.89 MB/sec execute 32 sec latency 77.354 ms 3 7421 1.83 MB/sec execute 33 sec latency 99.211 ms 3 7492 1.81 MB/sec execute 34 sec latency 56.990 ms 3 7557 1.75 MB/sec execute 35 sec latency 67.497 ms 3 7620 1.71 MB/sec execute 36 sec latency 59.919 ms 3 7705 1.66 MB/sec execute 37 sec latency 59.951 ms 3 7782 1.63 MB/sec execute 38 sec latency 120.139 ms 3 7840 1.60 MB/sec execute 39 sec latency 74.489 ms 3 7903 1.57 MB/sec execute 40 sec latency 74.824 ms 3 8009 1.55 MB/sec execute 41 sec latency 64.116 ms 3 8089 1.53 MB/sec execute 42 sec latency 60.700 ms 3 8194 1.57 MB/sec execute 43 sec latency 61.912 ms 3 8292 1.54 MB/sec execute 44 sec latency 44.792 ms 3 8392 1.52 MB/sec execute 45 sec latency 55.019 ms 3 8559 1.67 MB/sec execute 46 sec latency 52.945 ms 3 8660 1.63 MB/sec execute 47 sec latency 70.029 ms 3 8741 1.61 MB/sec execute 48 sec latency 51.823 ms 3 8823 1.58 MB/sec execute 49 sec latency 85.496 ms 3 8897 1.55 MB/sec execute 50 sec latency 65.475 ms 3 8980 1.52 MB/sec execute 51 sec latency 53.932 ms 3 9104 1.50 MB/sec execute 52 sec latency 52.789 ms 3 9208 1.48 MB/sec execute 53 sec latency 65.982 ms 3 9294 1.46 MB/sec execute 54 sec latency 56.232 ms 3 9442 1.49 MB/sec execute 55 sec latency 70.009 ms 3 9536 1.48 MB/sec execute 56 sec latency 50.860 ms 3 9685 1.50 MB/sec execute 57 sec latency 48.387 ms 3 9916 1.63 MB/sec execute 58 sec latency 59.818 ms 3 10097 1.68 MB/sec execute 59 sec latency 47.343 ms 3 10339 1.70 MB/sec execute 60 sec latency 64.222 ms 3 10531 1.77 MB/sec execute 61 sec latency 45.342 ms 3 10714 1.84 MB/sec execute 62 sec latency 39.543 ms 3 10826 1.84 MB/sec execute 63 sec latency 46.550 ms 3 10916 1.84 MB/sec execute 64 sec latency 82.473 ms 3 11020 1.83 MB/sec execute 65 sec latency 52.743 ms 3 11107 1.80 MB/sec execute 66 sec latency 43.092 ms 3 11177 1.77 MB/sec execute 67 sec latency 71.009 ms 3 11289 1.75 MB/sec execute 68 sec latency 56.001 ms 3 11368 1.73 MB/sec execute 69 sec latency 89.190 ms 3 11462 1.72 MB/sec execute 70 sec latency 52.642 ms 3 11563 1.70 MB/sec execute 71 sec latency 47.657 ms 3 11653 1.69 MB/sec execute 72 sec latency 44.775 ms 3 11796 1.71 MB/sec execute 73 sec latency 51.771 ms 3 11903 1.69 MB/sec execute 74 sec latency 52.279 ms 3 12085 1.79 MB/sec execute 75 sec latency 53.265 ms 3 12217 1.77 MB/sec execute 76 sec latency 60.776 ms 3 12381 1.75 MB/sec execute 77 sec latency 27.594 ms 3 12552 1.73 MB/sec execute 78 sec latency 29.694 ms 3 12754 1.72 MB/sec execute 79 sec latency 37.046 ms 3 12969 1.74 MB/sec execute 80 sec latency 38.694 ms 3 13126 1.75 MB/sec execute 81 sec latency 44.330 ms 3 13402 1.85 MB/sec execute 82 sec latency 44.703 ms 3 13649 1.88 MB/sec execute 83 sec latency 40.410 ms 3 13946 1.93 MB/sec execute 84 sec latency 54.772 ms 3 14165 2.01 MB/sec execute 85 sec latency 34.463 ms 3 14258 1.99 MB/sec execute 86 sec latency 58.303 ms 3 14373 1.99 MB/sec execute 87 sec latency 47.609 ms 3 14483 1.99 MB/sec execute 88 sec latency 43.956 ms 3 14581 1.98 MB/sec execute 89 sec latency 78.610 ms 3 14667 1.96 MB/sec execute 90 sec latency 69.436 ms 3 14763 1.94 MB/sec execute 91 sec latency 41.336 ms 3 14889 1.92 MB/sec execute 92 sec latency 63.450 ms 3 14987 1.91 MB/sec execute 93 sec latency 51.367 ms 3 15110 1.90 MB/sec execute 94 sec latency 44.999 ms 3 15227 1.90 MB/sec execute 95 sec latency 56.692 ms 3 15387 1.90 MB/sec execute 96 sec latency 37.383 ms 3 15562 1.95 MB/sec execute 97 sec latency 47.451 ms 3 15700 1.95 MB/sec execute 98 sec latency 39.052 ms 3 15803 1.94 MB/sec execute 99 sec latency 49.328 ms 3 15921 1.92 MB/sec execute 100 sec latency 46.599 ms 3 16032 1.90 MB/sec execute 101 sec latency 50.478 ms 3 16188 1.89 MB/sec execute 102 sec latency 45.856 ms 3 16318 1.88 MB/sec execute 103 sec latency 47.437 ms 3 16486 1.88 MB/sec execute 104 sec latency 34.659 ms 3 16613 1.88 MB/sec execute 105 sec latency 46.277 ms 3 16776 1.89 MB/sec execute 106 sec latency 54.464 ms 3 17109 1.99 MB/sec execute 107 sec latency 34.522 ms 3 17436 2.01 MB/sec execute 108 sec latency 40.536 ms 3 17657 2.07 MB/sec execute 109 sec latency 44.416 ms 3 17806 2.08 MB/sec execute 110 sec latency 41.987 ms 3 17919 2.08 MB/sec execute 111 sec latency 60.852 ms 3 18048 2.08 MB/sec execute 112 sec latency 37.457 ms 3 18147 2.07 MB/sec execute 113 sec latency 68.928 ms 3 18235 2.05 MB/sec execute 114 sec latency 63.383 ms 3 18375 2.03 MB/sec execute 115 sec latency 51.201 ms 3 18486 2.02 MB/sec execute 116 sec latency 61.680 ms 3 18597 2.01 MB/sec execute 117 sec latency 52.403 ms 3 18698 2.00 MB/sec execute 118 sec latency 57.312 ms 3 18814 2.01 MB/sec execute 119 sec latency 43.805 ms 3 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 8098 23.011 115.763 Close 5848 4.655 33.895 Rename 340 32.117 79.013 Unlink 1724 9.999 75.523 Qpathinfo 7248 5.393 64.374 Qfileinfo 1214 0.696 10.599 Qfsinfo 1345 20.115 120.124 Sfileinfo 678 21.659 75.806 Find 2762 1.750 55.979 WriteX 3947 4.165 80.961 ReadX 11998 0.110 10.616 LockX 24 4.684 11.610 UnlockX 24 4.528 10.104 Flush 588 22.590 99.613 Throughput 2.0103 MB/sec 3 clients 3 procs max_latency=120.139 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Thu Aug 22 01:57:16 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg401-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 oleg401-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1