-----============= acceptance-small: sanity-benchmark ============----- Wed Jan 15 20:22:34 EST 2025 excepting tests: skipping tests SLOW=no: iozone oleg250-client.virtnet: executing check_config_client /mnt/lustre oleg250-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg250-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b58cd000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b58cd000.idle_timeout=debug disable quota as required oleg250-server: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 20:22:43 (1736990563) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6824] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg250-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg250-client.virtnet at Wed Jan 15 20:22:44 EST 2025 waiting for dbench pid 8754 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 225 173.27 MB/sec warmup 1 sec latency 65.473 ms 20 492 171.45 MB/sec warmup 2 sec latency 56.674 ms 20 772 142.28 MB/sec warmup 3 sec latency 194.989 ms 20 1017 112.31 MB/sec warmup 4 sec latency 74.723 ms 20 1436 104.01 MB/sec warmup 5 sec latency 21.460 ms 20 1704 87.40 MB/sec warmup 6 sec latency 91.499 ms 20 2038 75.88 MB/sec warmup 7 sec latency 53.033 ms 20 2388 69.96 MB/sec warmup 8 sec latency 84.329 ms 20 2728 68.87 MB/sec warmup 9 sec latency 117.934 ms 20 3126 68.09 MB/sec warmup 10 sec latency 123.534 ms 20 3591 69.99 MB/sec warmup 11 sec latency 97.095 ms 20 3823 66.30 MB/sec warmup 12 sec latency 34.640 ms 20 3985 61.62 MB/sec warmup 13 sec latency 34.991 ms 20 4163 57.34 MB/sec warmup 14 sec latency 185.358 ms 20 4328 53.96 MB/sec warmup 15 sec latency 192.693 ms 20 4534 51.42 MB/sec warmup 16 sec latency 89.476 ms 20 4898 51.39 MB/sec warmup 17 sec latency 96.508 ms 20 5209 50.34 MB/sec warmup 18 sec latency 98.522 ms 20 5491 47.94 MB/sec warmup 19 sec latency 45.523 ms 20 5854 46.60 MB/sec warmup 20 sec latency 63.857 ms 20 6146 46.27 MB/sec warmup 21 sec latency 104.370 ms 20 6654 48.33 MB/sec warmup 22 sec latency 85.225 ms 20 7161 50.14 MB/sec warmup 23 sec latency 81.782 ms 20 7621 4.47 MB/sec execute 1 sec latency 29.935 ms 20 7806 4.70 MB/sec execute 2 sec latency 285.806 ms 20 8008 6.22 MB/sec execute 3 sec latency 89.727 ms 20 8282 11.37 MB/sec execute 4 sec latency 80.903 ms 20 8620 21.30 MB/sec execute 5 sec latency 59.766 ms 20 8871 18.47 MB/sec execute 6 sec latency 54.077 ms 20 9175 16.70 MB/sec execute 7 sec latency 62.404 ms 20 9488 18.09 MB/sec execute 8 sec latency 83.928 ms 20 9874 23.64 MB/sec execute 9 sec latency 97.057 ms 20 10404 29.18 MB/sec execute 10 sec latency 89.436 ms 20 10775 32.89 MB/sec execute 11 sec latency 117.425 ms 20 11017 32.04 MB/sec execute 12 sec latency 26.581 ms 20 11257 29.85 MB/sec execute 13 sec latency 150.434 ms 20 11459 28.34 MB/sec execute 14 sec latency 133.235 ms 20 11724 28.19 MB/sec execute 15 sec latency 81.829 ms 20 12085 30.19 MB/sec execute 16 sec latency 63.059 ms 20 12344 28.93 MB/sec execute 17 sec latency 60.311 ms 20 12590 27.58 MB/sec execute 18 sec latency 47.193 ms 20 12915 26.88 MB/sec execute 19 sec latency 60.417 ms 20 13166 27.12 MB/sec execute 20 sec latency 101.014 ms 20 13604 30.26 MB/sec execute 21 sec latency 105.258 ms 20 14006 31.10 MB/sec execute 22 sec latency 118.573 ms 20 14320 32.36 MB/sec execute 23 sec latency 57.393 ms 20 14506 31.85 MB/sec execute 24 sec latency 35.159 ms 20 14630 30.75 MB/sec execute 25 sec latency 48.397 ms 20 14773 29.62 MB/sec execute 26 sec latency 156.535 ms 20 14968 28.79 MB/sec execute 27 sec latency 121.540 ms 20 15190 28.25 MB/sec execute 28 sec latency 83.836 ms 20 15536 28.81 MB/sec execute 29 sec latency 83.576 ms 20 15835 29.12 MB/sec execute 30 sec latency 63.287 ms 20 16078 28.32 MB/sec execute 31 sec latency 48.085 ms 20 16362 27.73 MB/sec execute 32 sec latency 55.455 ms 20 16637 27.79 MB/sec execute 33 sec latency 112.363 ms 20 16977 28.83 MB/sec execute 34 sec latency 124.977 ms 20 17343 29.67 MB/sec execute 35 sec latency 134.303 ms 20 17721 30.63 MB/sec execute 36 sec latency 80.113 ms 20 17938 30.72 MB/sec execute 37 sec latency 41.159 ms 20 18132 30.25 MB/sec execute 38 sec latency 35.166 ms 20 18310 29.54 MB/sec execute 39 sec latency 164.893 ms 20 18515 28.99 MB/sec execute 40 sec latency 108.255 ms 20 18671 28.52 MB/sec execute 41 sec latency 130.428 ms 20 18892 28.49 MB/sec execute 42 sec latency 91.137 ms 20 19200 28.99 MB/sec execute 43 sec latency 67.495 ms 20 19445 28.56 MB/sec execute 44 sec latency 72.456 ms 20 19713 28.04 MB/sec execute 45 sec latency 59.419 ms 20 20009 27.69 MB/sec execute 46 sec latency 84.199 ms 20 20316 28.02 MB/sec execute 47 sec latency 77.776 ms 20 20812 29.29 MB/sec execute 48 sec latency 85.812 ms 20 21327 30.36 MB/sec execute 49 sec latency 75.584 ms 20 21638 30.61 MB/sec execute 50 sec latency 24.436 ms 20 21859 30.11 MB/sec execute 51 sec latency 170.474 ms 20 22109 29.68 MB/sec execute 52 sec latency 100.181 ms 20 22347 29.46 MB/sec execute 53 sec latency 121.910 ms 20 22736 30.03 MB/sec execute 54 sec latency 70.503 ms 20 23032 29.82 MB/sec execute 55 sec latency 60.324 ms 20 23345 29.41 MB/sec execute 56 sec latency 52.607 ms 20 23717 29.38 MB/sec execute 57 sec latency 65.280 ms 20 24132 30.15 MB/sec execute 58 sec latency 95.697 ms 20 24565 30.80 MB/sec execute 59 sec latency 95.104 ms 20 24981 31.53 MB/sec execute 60 sec latency 92.599 ms 20 25219 31.37 MB/sec execute 61 sec latency 29.795 ms 20 25416 30.94 MB/sec execute 62 sec latency 175.009 ms 20 25652 30.57 MB/sec execute 63 sec latency 114.573 ms 20 25881 30.30 MB/sec execute 64 sec latency 109.993 ms 20 26257 30.66 MB/sec execute 65 sec latency 73.753 ms 20 26557 30.64 MB/sec execute 66 sec latency 69.881 ms 20 26838 30.26 MB/sec execute 67 sec latency 45.858 ms 20 27187 30.15 MB/sec execute 68 sec latency 55.561 ms 20 27538 30.48 MB/sec execute 69 sec latency 89.603 ms 20 28084 31.41 MB/sec execute 70 sec latency 90.403 ms 20 28523 32.03 MB/sec execute 71 sec latency 149.550 ms 20 28800 31.91 MB/sec execute 72 sec latency 22.344 ms 20 29045 31.54 MB/sec execute 73 sec latency 140.394 ms 20 29255 31.23 MB/sec execute 74 sec latency 128.252 ms 20 29547 31.27 MB/sec execute 75 sec latency 93.826 ms 20 29929 31.60 MB/sec execute 76 sec latency 72.058 ms 20 30218 31.26 MB/sec execute 77 sec latency 49.165 ms 20 30563 31.00 MB/sec execute 78 sec latency 43.211 ms 20 30937 31.17 MB/sec execute 79 sec latency 75.246 ms 20 31404 31.87 MB/sec execute 80 sec latency 102.832 ms 20 31830 32.17 MB/sec execute 81 sec latency 98.869 ms 20 32181 32.55 MB/sec execute 82 sec latency 50.066 ms 20 32404 32.31 MB/sec execute 83 sec latency 129.750 ms 20 32649 31.98 MB/sec execute 84 sec latency 152.650 ms 20 32849 31.74 MB/sec execute 85 sec latency 172.856 ms 20 33160 31.79 MB/sec execute 86 sec latency 70.432 ms 20 33510 32.01 MB/sec execute 87 sec latency 51.123 ms 20 33772 31.70 MB/sec execute 88 sec latency 84.171 ms 20 34078 31.46 MB/sec execute 89 sec latency 49.189 ms 20 34404 31.49 MB/sec execute 90 sec latency 77.223 ms 20 34768 31.76 MB/sec execute 91 sec latency 109.718 ms 20 35270 32.30 MB/sec execute 92 sec latency 92.555 ms 20 35686 32.74 MB/sec execute 93 sec latency 72.715 ms 20 35924 32.58 MB/sec execute 94 sec latency 118.809 ms 20 36145 32.29 MB/sec execute 95 sec latency 89.218 ms 20 36369 32.07 MB/sec execute 96 sec latency 121.438 ms 20 36625 32.01 MB/sec execute 97 sec latency 86.600 ms 20 36971 32.18 MB/sec execute 98 sec latency 66.603 ms 20 37281 32.03 MB/sec execute 99 sec latency 48.308 ms 20 37611 31.83 MB/sec execute 100 sec latency 69.866 ms 20 38004 31.93 MB/sec execute 101 sec latency 76.968 ms 20 38423 32.31 MB/sec execute 102 sec latency 90.551 ms 20 38955 32.84 MB/sec execute 103 sec latency 87.215 ms 20 39333 33.04 MB/sec execute 104 sec latency 41.672 ms 20 39562 32.84 MB/sec execute 105 sec latency 192.001 ms 20 39798 32.58 MB/sec execute 106 sec latency 117.783 ms 20 39994 32.39 MB/sec execute 107 sec latency 89.509 ms 20 40293 32.40 MB/sec execute 108 sec latency 81.396 ms 20 40643 32.57 MB/sec execute 109 sec latency 70.148 ms 20 40929 32.32 MB/sec execute 110 sec latency 49.539 ms 20 41259 32.16 MB/sec execute 111 sec latency 57.064 ms 20 41631 32.31 MB/sec execute 112 sec latency 91.380 ms 20 42147 32.88 MB/sec execute 113 sec latency 107.106 ms 20 42576 33.12 MB/sec execute 114 sec latency 103.821 ms 20 42899 33.25 MB/sec execute 115 sec latency 29.566 ms 20 43110 33.02 MB/sec execute 116 sec latency 220.773 ms 20 43356 32.79 MB/sec execute 117 sec latency 122.728 ms 20 43587 32.64 MB/sec execute 118 sec latency 98.747 ms 20 43914 32.71 MB/sec execute 119 sec latency 72.375 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 128277 10.034 52.213 Close 93903 2.183 16.899 Rename 5406 12.164 35.600 Unlink 26186 3.198 32.124 Qpathinfo 115674 2.161 35.893 Qfileinfo 19983 0.066 6.965 Qfsinfo 21185 0.024 3.305 Sfileinfo 10680 5.543 21.034 Find 44576 0.416 33.596 WriteX 62794 0.769 18.171 ReadX 197944 0.010 2.067 LockX 400 2.714 8.665 UnlockX 400 2.718 10.491 Flush 9116 40.849 285.799 Throughput 32.7054 MB/sec 20 clients 20 procs max_latency=285.806 ms stopping dbench on /mnt/lustre/d0.oleg250-client.virtnet at Wed Jan 15 20:25:08 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg250-client.virtnet /mnt/lustre/d0.oleg250-client.virtnet /mnt/lustre/d0.oleg250-client.virtnet removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg250-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 20:25:11 (1736990711) min OST has 3258368kB available, using 4887552kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6824] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4773] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg250-clien 4773M 162005 98 143977 98 276116 55 2429 143 Latency 1811us 35768us 50163us 221ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg250-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 482 17 3455 17 659 13 464 16 537 15 626 13 Latency 15473us 10705us 55507us 17928us 6170us 16037us 1.97,1.97,oleg250-client.virtnet,1,1736997271,4773M,,,,162005,98,143977,98,,,276116,55,2429,143,10,,,,,482,17,3455,17,659,13,464,16,537,15,626,13,,1811us,35768us,,50163us,221ms,15473us,10705us,55507us,17928us,6170us,16037us debug=0x33f0484 PASS bonnie (188s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 20:28:20 (1736990900) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 31442 -P /tmp -l 5644800 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 31442 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x18586a truncating to largest ever: 0x1d91ce truncating to largest ever: 0x440745 truncating to largest ever: 0x52b25d truncating to largest ever: 0x539c05 truncating to largest ever: 0x53a209 truncating to largest ever: 0x5529bd 001000 1736990904.143353 trunc from 0x52ed52 to 0x0d4a03 (0x45a34e bytes) truncating to largest ever: 0x56001b 002000 1736990907.441794 mapwrite 0x1620d3 thru 0x16d51d (0xb44b bytes) truncating to largest ever: 0x561c7b 004000 1736990914.211383 mapread 0x009afa thru 0x01273b (0x8c42 bytes) 005000 1736990917.451128 trunc from 0x55f1c9 to 0x4f99e6 (0x657e2 bytes) 006000 1736990920.577032 mapwrite 0x17f29e thru 0x18bd75 (0xcad8 bytes) 007000 1736990923.971678 mapwrite 0x52feaf thru 0x5363e9 (0x653b bytes) 008000 1736990927.175531 mapread 0x08e765 thru 0x0940fa (0x5996 bytes) 009000 1736990930.292171 trunc from 0x4c90f9 to 0x4e8286 (0x1f18e bytes) 010000 1736990933.559421 write 0x3a6968 thru 0x3a8d90 (0x2429 bytes) 016000 1736990952.403467 mapwrite 0x16d74b thru 0x17b6c8 (0xdf7e bytes) 017000 1736990955.324601 read 0x06e624 thru 0x0707a6 (0x2183 bytes) 019000 1736990961.554540 trunc from 0x0e7b8b to 0x330296 (0x24870c bytes) 020000 1736990964.622983 write 0x37316c thru 0x382bb8 (0xfa4d bytes) 023000 1736990973.826678 mapread 0x118281 thru 0x1189c8 (0x748 bytes) 025000 1736990980.560377 mapwrite 0x4d304d thru 0x4d4f2d (0x1ee1 bytes) 028000 1736990991.206858 read 0x1a079d thru 0x1a7581 (0x6de5 bytes) 029000 1736990994.379321 mapwrite 0x13d1b3 thru 0x142a26 (0x5874 bytes) 031000 1736991001.013679 mapread 0x1b0234 thru 0x1bd4d5 (0xd2a2 bytes) 032000 1736991004.787241 trunc from 0x4929b3 to 0x207440 (0x28b572 bytes) 033000 1736991008.498957 read 0x38fbd2 thru 0x390c4c (0x107b bytes) 036000 1736991019.840798 mapread 0x186a68 thru 0x19520e (0xe7a7 bytes) 037000 1736991023.552240 mapwrite 0x3eb782 thru 0x3f84bd (0xcd3c bytes) 040000 1736991034.890419 trunc from 0x0524d8 to 0x2a9905 (0x25742e bytes) 045000 1736991052.069372 trunc from 0x4b7126 to 0x02e9e5 (0x488740 bytes) 047000 1736991059.210632 write 0x04ae04 thru 0x05113c (0x6339 bytes) 050000 1736991070.027052 write 0x469b18 thru 0x469b72 (0x5b bytes) 051000 1736991073.185376 mapread 0x463add thru 0x46cfa3 (0x94c7 bytes) 053000 1736991080.408120 read 0x11ae96 thru 0x1259ad (0xab18 bytes) 054000 1736991083.340250 mapwrite 0x372762 thru 0x378b67 (0x6406 bytes) 055000 1736991086.817121 write 0x41bed3 thru 0x4290f9 (0xd227 bytes) 056000 1736991090.356166 read 0x12510f thru 0x127a5c (0x294e bytes) 057000 1736991093.807956 read 0x0b6c69 thru 0x0c286e (0xbc06 bytes) 058000 1736991097.876097 write 0x37bf68 thru 0x388928 (0xc9c1 bytes) truncating to largest ever: 0x562058 063000 1736991114.250746 write 0x1376a6 thru 0x141e46 (0xa7a1 bytes) 065000 1736991120.521172 trunc from 0x1915e9 to 0x1d2024 (0x40a3c bytes) 067000 1736991126.950859 read 0x06dde0 thru 0x07c9fc (0xec1d bytes) 068000 1736991129.874200 mapread 0x1435d4 thru 0x150c3e (0xd66b bytes) 071000 1736991140.352456 mapwrite 0x0a0046 thru 0x0ae17f (0xe13a bytes) 073000 1736991147.969526 mapread 0x07160b thru 0x080422 (0xee18 bytes) 074000 1736991151.160665 write 0x33104a thru 0x33d1c3 (0xc17a bytes) 077000 1736991161.445431 write 0x0b7cab thru 0x0bf5b2 (0x7908 bytes) 079000 1736991168.111998 mapread 0x41689a thru 0x423a21 (0xd188 bytes) 080000 1736991171.392306 write 0x29d6fc thru 0x29f3c9 (0x1cce bytes) 081000 1736991174.374746 trunc from 0x47ebbd to 0x4afdce (0x31212 bytes) 082000 1736991177.354469 mapread 0x38e4e8 thru 0x38e758 (0x271 bytes) 083000 1736991180.348260 trunc from 0x508bd1 to 0x02fc8d (0x4d8f43 bytes) 084000 1736991183.523106 read 0x2bda96 thru 0x2c23c6 (0x4931 bytes) 085000 1736991186.640622 trunc from 0x2df5b6 to 0x11ead1 (0x1c0ae4 bytes) 087000 1736991193.439789 trunc from 0x54cd15 to 0x29424f (0x2b8ac5 bytes) 088000 1736991197.008241 write 0x54edd3 thru 0x557d33 (0x8f61 bytes) 090000 1736991203.486159 read 0x00f70e thru 0x01651b (0x6e0e bytes) 091000 1736991206.656428 trunc from 0x2c2059 to 0x4bd854 (0x1fb7fc bytes) 093000 1736991213.393381 read 0x01f355 thru 0x0209b5 (0x1661 bytes) 094000 1736991216.472651 trunc from 0x0d52d5 to 0x26957f (0x1942ab bytes) 095000 1736991219.818962 trunc from 0x4a1313 to 0x4fe128 (0x5ce16 bytes) 099000 1736991232.436854 write 0x54e72a thru 0x558450 (0x9d27 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (336s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 20:33:56 (1736991236) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1736991247.693152 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1736991250.726038 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1736991257.581160 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1736991261.546335 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1736991265.291470 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1736991286.321445 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1736991289.307942 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1736991292.813554 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1736991300.204887 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1736991303.626997 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1736991307.182806 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1736991314.905263 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1736991318.790042 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1736991327.547569 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1736991331.303398 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1736991334.671440 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1736991341.716508 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1736991345.415281 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1736991356.269547 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1736991371.141676 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1736991374.808653 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1736991378.723566 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1736991382.728862 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1736991386.579780 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1736991408.111654 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1736991411.736073 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1736991418.688506 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1736991433.274327 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1736991447.845635 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1736991455.228490 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1736991458.824799 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1736991466.128535 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1736991473.528608 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1736991480.543230 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1736991484.064730 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1736991487.862303 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1736991504.263364 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1736991507.889241 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1736991511.181432 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1736991518.367666 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1736991525.495068 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1736991529.212663 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1736991540.093926 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1736991546.855147 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1736991550.275774 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1736991553.932309 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1736991557.364472 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1736991560.978831 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1736991564.638373 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1736991568.073690 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1736991585.415441 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1736991589.561176 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1736991596.676673 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (364s) == sanity-benchmark test complete, duration 1046 sec ===== 20:40:00 (1736991600)