== sanity-quota test 8: Run dbench with quota enabled ==== 00:29:17 (1721881757) sleep 5 for ZFS zfs Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 Waiting 90s for 'ugp' Set enough high limit for user: quota_usr Set enough high limit for group: quota_usr lfs project -sp 1000 /mnt/lustre/d8.sanity-quota Set enough high limit for project: 1000 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [bash] [rundbench] [-D] [/mnt/lustre/d8.sanity-quota] [3] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 3 -t 120' on /mnt/lustre/d8.sanity-quota at Thu Jul 25 00:29:28 EDT 2024 waiting for dbench pid 15880 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 2 of 3 processes prepared for launch 0 sec 3 of 3 processes prepared for launch 0 sec releasing clients 3 285 31.79 MB/sec warmup 1 sec latency 22.474 ms 3 649 31.64 MB/sec warmup 2 sec latency 19.509 ms 3 889 21.68 MB/sec warmup 3 sec latency 78.706 ms 3 1245 17.31 MB/sec warmup 4 sec latency 31.801 ms 3 1720 15.75 MB/sec warmup 5 sec latency 42.421 ms 3 2163 13.36 MB/sec warmup 6 sec latency 32.351 ms 3 2586 12.42 MB/sec warmup 7 sec latency 41.760 ms 3 3280 13.18 MB/sec warmup 8 sec latency 32.496 ms 3 3796 13.25 MB/sec warmup 9 sec latency 18.532 ms 3 4103 12.03 MB/sec warmup 10 sec latency 12.559 ms 3 4366 11.07 MB/sec warmup 11 sec latency 104.322 ms 3 4715 10.53 MB/sec warmup 12 sec latency 26.524 ms 3 5146 10.44 MB/sec warmup 13 sec latency 51.446 ms 3 5549 9.77 MB/sec warmup 14 sec latency 29.460 ms 3 5969 9.43 MB/sec warmup 15 sec latency 39.554 ms 3 6485 9.86 MB/sec warmup 16 sec latency 52.237 ms 3 7100 10.15 MB/sec warmup 17 sec latency 40.086 ms 3 7467 9.86 MB/sec warmup 18 sec latency 10.845 ms 3 7761 9.36 MB/sec warmup 19 sec latency 21.437 ms 3 7993 8.99 MB/sec warmup 20 sec latency 123.259 ms 3 8348 8.76 MB/sec warmup 21 sec latency 31.727 ms 3 8786 8.79 MB/sec warmup 22 sec latency 35.041 ms 3 9197 8.46 MB/sec warmup 23 sec latency 30.981 ms 3 10284 16.60 MB/sec execute 1 sec latency 40.157 ms 3 10773 15.08 MB/sec execute 2 sec latency 31.040 ms 3 11085 11.38 MB/sec execute 3 sec latency 15.785 ms 3 11380 8.78 MB/sec execute 4 sec latency 87.965 ms 3 11651 7.46 MB/sec execute 5 sec latency 47.822 ms 3 12130 8.23 MB/sec execute 6 sec latency 31.635 ms 3 12491 7.19 MB/sec execute 7 sec latency 35.920 ms 3 12962 6.72 MB/sec execute 8 sec latency 33.823 ms 3 13381 7.21 MB/sec execute 9 sec latency 44.546 ms 3 14028 7.77 MB/sec execute 10 sec latency 33.712 ms 3 14466 8.24 MB/sec execute 11 sec latency 22.217 ms 3 14747 7.63 MB/sec execute 12 sec latency 17.526 ms 3 15002 7.15 MB/sec execute 13 sec latency 121.708 ms 3 15350 6.98 MB/sec execute 14 sec latency 27.575 ms 3 15789 7.14 MB/sec execute 15 sec latency 39.846 ms 3 16155 6.75 MB/sec execute 16 sec latency 37.042 ms 3 16586 6.62 MB/sec execute 17 sec latency 31.824 ms 3 17136 7.14 MB/sec execute 18 sec latency 37.335 ms 3 17683 7.42 MB/sec execute 19 sec latency 35.577 ms 3 18048 7.40 MB/sec execute 20 sec latency 13.169 ms 3 18376 7.10 MB/sec execute 21 sec latency 13.797 ms 3 18606 6.86 MB/sec execute 22 sec latency 91.874 ms 3 18953 6.75 MB/sec execute 23 sec latency 37.795 ms 3 19389 6.86 MB/sec execute 24 sec latency 45.023 ms 3 19784 6.63 MB/sec execute 25 sec latency 34.729 ms 3 20202 6.55 MB/sec execute 26 sec latency 34.372 ms 3 20750 6.91 MB/sec execute 27 sec latency 35.284 ms 3 21379 7.21 MB/sec execute 28 sec latency 26.456 ms 3 21641 7.09 MB/sec execute 29 sec latency 20.916 ms 3 21797 6.88 MB/sec execute 30 sec latency 22.501 ms 3 21992 6.67 MB/sec execute 31 sec latency 113.883 ms 3 22263 6.52 MB/sec execute 32 sec latency 37.988 ms 3 22672 6.62 MB/sec execute 33 sec latency 30.700 ms 3 23049 6.54 MB/sec execute 34 sec latency 39.414 ms 3 23463 6.39 MB/sec execute 35 sec latency 27.445 ms 3 23867 6.39 MB/sec execute 36 sec latency 39.065 ms 3 24544 6.69 MB/sec execute 37 sec latency 30.935 ms 3 25037 6.87 MB/sec execute 38 sec latency 24.920 ms 3 25332 6.76 MB/sec execute 39 sec latency 13.081 ms 3 25616 6.62 MB/sec execute 40 sec latency 76.943 ms 3 25897 6.55 MB/sec execute 41 sec latency 41.186 ms 3 26345 6.64 MB/sec execute 42 sec latency 39.040 ms 3 26710 6.51 MB/sec execute 43 sec latency 33.270 ms 3 27162 6.44 MB/sec execute 44 sec latency 31.461 ms 3 27590 6.53 MB/sec execute 45 sec latency 35.085 ms 3 28224 6.68 MB/sec execute 46 sec latency 29.109 ms 3 28688 6.81 MB/sec execute 47 sec latency 13.137 ms 3 28904 6.69 MB/sec execute 48 sec latency 22.885 ms 3 29155 6.57 MB/sec execute 49 sec latency 89.231 ms 3 29460 6.52 MB/sec execute 50 sec latency 37.168 ms 3 29926 6.60 MB/sec execute 51 sec latency 32.010 ms 3 30272 6.49 MB/sec execute 52 sec latency 36.542 ms 3 30732 6.43 MB/sec execute 53 sec latency 33.138 ms 3 31206 6.51 MB/sec execute 54 sec latency 35.972 ms 3 31778 6.63 MB/sec execute 55 sec latency 34.881 ms 3 32222 6.74 MB/sec execute 56 sec latency 18.599 ms 3 32486 6.64 MB/sec execute 57 sec latency 20.498 ms 3 32755 6.55 MB/sec execute 58 sec latency 79.774 ms 3 33082 6.52 MB/sec execute 59 sec latency 36.568 ms 3 33530 6.57 MB/sec execute 60 sec latency 29.752 ms 3 33915 6.47 MB/sec execute 61 sec latency 36.241 ms 3 34365 6.45 MB/sec execute 62 sec latency 30.128 ms 3 34915 6.58 MB/sec execute 63 sec latency 35.755 ms 3 35540 6.74 MB/sec execute 64 sec latency 34.615 ms 3 35891 6.70 MB/sec execute 65 sec latency 12.064 ms 3 36093 6.60 MB/sec execute 66 sec latency 22.080 ms 3 36345 6.53 MB/sec execute 67 sec latency 130.073 ms 3 36626 6.50 MB/sec execute 68 sec latency 40.050 ms 3 36969 6.54 MB/sec execute 69 sec latency 35.161 ms 3 37343 6.46 MB/sec execute 70 sec latency 38.922 ms 3 37803 6.42 MB/sec execute 71 sec latency 25.809 ms 3 38269 6.47 MB/sec execute 72 sec latency 41.082 ms 3 38872 6.57 MB/sec execute 73 sec latency 36.552 ms 3 39328 6.65 MB/sec execute 74 sec latency 16.029 ms 3 39582 6.58 MB/sec execute 75 sec latency 18.716 ms 3 39864 6.51 MB/sec execute 76 sec latency 91.928 ms 3 40210 6.48 MB/sec execute 77 sec latency 35.441 ms 3 40661 6.52 MB/sec execute 78 sec latency 51.317 ms 3 41036 6.45 MB/sec execute 79 sec latency 29.594 ms 3 41473 6.43 MB/sec execute 80 sec latency 33.995 ms 3 42025 6.54 MB/sec execute 81 sec latency 32.651 ms 3 42641 6.66 MB/sec execute 82 sec latency 31.653 ms 3 42982 6.63 MB/sec execute 83 sec latency 12.512 ms 3 43289 6.56 MB/sec execute 84 sec latency 90.301 ms 3 43567 6.51 MB/sec execute 85 sec latency 44.494 ms 3 44004 6.55 MB/sec execute 86 sec latency 25.329 ms 3 44381 6.51 MB/sec execute 87 sec latency 50.678 ms 3 44819 6.46 MB/sec execute 88 sec latency 27.066 ms 3 45264 6.52 MB/sec execute 89 sec latency 35.373 ms 3 45898 6.59 MB/sec execute 90 sec latency 38.924 ms 3 46364 6.66 MB/sec execute 91 sec latency 24.950 ms 3 46675 6.61 MB/sec execute 92 sec latency 12.022 ms 3 46960 6.55 MB/sec execute 93 sec latency 94.589 ms 3 47297 6.53 MB/sec execute 94 sec latency 35.866 ms 3 47752 6.56 MB/sec execute 95 sec latency 36.221 ms 3 48113 6.50 MB/sec execute 96 sec latency 40.765 ms 3 48550 6.49 MB/sec execute 97 sec latency 32.153 ms 3 49095 6.57 MB/sec execute 98 sec latency 35.097 ms 3 49716 6.67 MB/sec execute 99 sec latency 33.553 ms 3 49995 6.65 MB/sec execute 100 sec latency 20.983 ms 3 50170 6.59 MB/sec execute 101 sec latency 21.154 ms 3 50458 6.53 MB/sec execute 102 sec latency 92.047 ms 3 50774 6.51 MB/sec execute 103 sec latency 30.776 ms 3 51242 6.55 MB/sec execute 104 sec latency 28.465 ms 3 51615 6.49 MB/sec execute 105 sec latency 30.064 ms 3 52054 6.47 MB/sec execute 106 sec latency 29.207 ms 3 52593 6.55 MB/sec execute 107 sec latency 31.761 ms 3 53199 6.62 MB/sec execute 108 sec latency 35.407 ms 3 53580 6.63 MB/sec execute 109 sec latency 15.254 ms 3 53753 6.57 MB/sec execute 110 sec latency 21.742 ms 3 53989 6.52 MB/sec execute 111 sec latency 140.060 ms 3 54305 6.50 MB/sec execute 112 sec latency 34.483 ms 3 54767 6.53 MB/sec execute 113 sec latency 35.764 ms 3 55155 6.48 MB/sec execute 114 sec latency 29.672 ms 3 55595 6.46 MB/sec execute 115 sec latency 30.085 ms 3 56126 6.54 MB/sec execute 116 sec latency 38.675 ms 3 56729 6.60 MB/sec execute 117 sec latency 38.017 ms 3 57064 6.60 MB/sec execute 118 sec latency 15.567 ms 3 57242 6.55 MB/sec execute 119 sec latency 19.197 ms 3 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 24833 6.979 38.677 Close 18124 1.189 12.367 Rename 1054 10.323 25.523 Unlink 5107 3.850 23.494 Qpathinfo 22447 1.815 22.415 Qfileinfo 3897 0.355 3.065 Qfsinfo 4193 4.083 16.535 Sfileinfo 1978 6.172 15.053 Find 8727 0.700 18.394 WriteX 12197 1.455 11.435 ReadX 39401 0.058 1.812 LockX 84 1.017 1.669 UnlockX 84 1.144 3.297 Flush 1734 20.715 140.051 Throughput 6.55424 MB/sec 3 clients 3 procs max_latency=140.060 ms stopping dbench on /mnt/lustre/d8.sanity-quota at Thu Jul 25 00:31:53 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota /mnt/lustre/d8.sanity-quota removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d8.sanity-quota dbench successfully finished lfs project -C /mnt/lustre/d8.sanity-quota Delete files... Wait for unlink objects finished... sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete