-----============= acceptance-small: sanity-benchmark ============----- Tue Jan 7 10:22:05 EST 2025 excepting tests: skipping tests SLOW=no: iozone oleg329-client.virtnet: executing check_config_client /mnt/lustre oleg329-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg329-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a4cb800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a4cb800.idle_timeout=debug disable quota as required oleg329-server: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 10:22:15 (1736263335) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6872] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg329-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg329-client.virtnet at Tue Jan 7 10:22:16 EST 2025 waiting for dbench pid 8802 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 124 111.76 MB/sec warmup 1 sec latency 86.976 ms 20 270 101.37 MB/sec warmup 2 sec latency 61.957 ms 20 399 94.36 MB/sec warmup 3 sec latency 91.440 ms 20 589 100.53 MB/sec warmup 4 sec latency 85.508 ms 20 721 85.10 MB/sec warmup 5 sec latency 266.322 ms 20 798 71.52 MB/sec warmup 6 sec latency 160.969 ms 20 902 61.90 MB/sec warmup 7 sec latency 151.307 ms 20 972 54.54 MB/sec warmup 8 sec latency 163.597 ms 20 1090 50.93 MB/sec warmup 9 sec latency 143.144 ms 20 1200 46.06 MB/sec warmup 10 sec latency 79.583 ms 20 1397 47.26 MB/sec warmup 11 sec latency 55.793 ms 20 1492 43.38 MB/sec warmup 12 sec latency 155.596 ms 20 1612 40.22 MB/sec warmup 13 sec latency 127.925 ms 20 1715 37.47 MB/sec warmup 14 sec latency 105.335 ms 20 1839 35.11 MB/sec warmup 15 sec latency 43.153 ms 20 1974 33.08 MB/sec warmup 16 sec latency 147.723 ms 20 2105 31.35 MB/sec warmup 17 sec latency 50.184 ms 20 2243 30.16 MB/sec warmup 18 sec latency 88.072 ms 20 2393 29.45 MB/sec warmup 19 sec latency 166.803 ms 20 2486 28.52 MB/sec warmup 20 sec latency 196.362 ms 20 2633 28.12 MB/sec warmup 21 sec latency 154.531 ms 20 2895 29.91 MB/sec warmup 22 sec latency 184.119 ms 20 3041 29.26 MB/sec warmup 23 sec latency 203.562 ms 20 3435 28.68 MB/sec execute 1 sec latency 216.999 ms 20 3623 35.31 MB/sec execute 2 sec latency 54.093 ms 20 3763 29.27 MB/sec execute 3 sec latency 55.665 ms 20 3855 23.88 MB/sec execute 4 sec latency 60.497 ms 20 3926 19.82 MB/sec execute 5 sec latency 78.867 ms 20 3976 16.72 MB/sec execute 6 sec latency 140.003 ms 20 4040 14.35 MB/sec execute 7 sec latency 72.240 ms 20 4125 12.68 MB/sec execute 8 sec latency 191.349 ms 20 4236 11.57 MB/sec execute 9 sec latency 221.779 ms 20 4281 10.62 MB/sec execute 10 sec latency 260.557 ms 20 4338 9.92 MB/sec execute 11 sec latency 168.147 ms 20 4417 9.41 MB/sec execute 12 sec latency 138.308 ms 20 4505 9.08 MB/sec execute 13 sec latency 158.069 ms 20 4599 9.20 MB/sec execute 14 sec latency 225.432 ms 20 4695 9.39 MB/sec execute 15 sec latency 185.759 ms 20 4807 9.64 MB/sec execute 16 sec latency 58.297 ms 20 4931 10.67 MB/sec execute 17 sec latency 194.213 ms 20 5053 11.25 MB/sec execute 18 sec latency 149.257 ms 20 5139 10.74 MB/sec execute 19 sec latency 103.172 ms 20 5224 10.27 MB/sec execute 20 sec latency 110.219 ms 20 5307 9.85 MB/sec execute 21 sec latency 123.803 ms 20 5389 9.47 MB/sec execute 22 sec latency 115.861 ms 20 5483 9.13 MB/sec execute 23 sec latency 107.500 ms 20 5604 8.86 MB/sec execute 24 sec latency 118.304 ms 20 5696 8.60 MB/sec execute 25 sec latency 65.639 ms 20 5801 8.60 MB/sec execute 26 sec latency 156.400 ms 20 5929 8.90 MB/sec execute 27 sec latency 162.605 ms 20 6029 8.90 MB/sec execute 28 sec latency 200.037 ms 20 6168 9.48 MB/sec execute 29 sec latency 188.848 ms 20 6379 10.88 MB/sec execute 30 sec latency 159.965 ms 20 6572 11.45 MB/sec execute 31 sec latency 176.259 ms 20 6758 11.62 MB/sec execute 32 sec latency 233.412 ms 20 7002 12.72 MB/sec execute 33 sec latency 139.625 ms 20 7180 13.38 MB/sec execute 34 sec latency 81.616 ms 20 7295 13.36 MB/sec execute 35 sec latency 61.382 ms 20 7386 13.26 MB/sec execute 36 sec latency 68.244 ms 20 7458 12.98 MB/sec execute 37 sec latency 67.836 ms 20 7520 12.70 MB/sec execute 38 sec latency 99.796 ms 20 7616 12.38 MB/sec execute 39 sec latency 55.110 ms 20 7724 12.13 MB/sec execute 40 sec latency 188.121 ms 20 7817 11.91 MB/sec execute 41 sec latency 179.338 ms 20 7883 11.70 MB/sec execute 42 sec latency 150.628 ms 20 7964 11.52 MB/sec execute 43 sec latency 178.569 ms 20 8048 11.39 MB/sec execute 44 sec latency 171.997 ms 20 8143 11.37 MB/sec execute 45 sec latency 201.092 ms 20 8248 11.36 MB/sec execute 46 sec latency 208.420 ms 20 8364 11.48 MB/sec execute 47 sec latency 73.005 ms 20 8468 11.68 MB/sec execute 48 sec latency 158.143 ms 20 8563 11.87 MB/sec execute 49 sec latency 185.889 ms 20 8640 11.71 MB/sec execute 50 sec latency 153.535 ms 20 8719 11.51 MB/sec execute 51 sec latency 127.642 ms 20 8787 11.31 MB/sec execute 52 sec latency 112.218 ms 20 8849 11.12 MB/sec execute 53 sec latency 133.945 ms 20 8917 10.93 MB/sec execute 54 sec latency 139.798 ms 20 8998 10.76 MB/sec execute 55 sec latency 142.228 ms 20 9081 10.60 MB/sec execute 56 sec latency 168.298 ms 20 9173 10.45 MB/sec execute 57 sec latency 139.388 ms 20 9246 10.33 MB/sec execute 58 sec latency 89.444 ms 20 9345 10.28 MB/sec execute 59 sec latency 196.874 ms 20 9436 10.26 MB/sec execute 60 sec latency 239.926 ms 20 9522 10.27 MB/sec execute 61 sec latency 271.859 ms 20 9612 10.33 MB/sec execute 62 sec latency 255.689 ms 20 9742 10.57 MB/sec execute 63 sec latency 200.252 ms 20 9918 11.03 MB/sec execute 64 sec latency 185.772 ms 20 10104 11.31 MB/sec execute 65 sec latency 162.711 ms 20 10279 11.40 MB/sec execute 66 sec latency 214.297 ms 20 10472 11.71 MB/sec execute 67 sec latency 183.869 ms 20 10633 12.11 MB/sec execute 68 sec latency 120.281 ms 20 10748 12.15 MB/sec execute 69 sec latency 63.485 ms 20 10834 12.12 MB/sec execute 70 sec latency 74.640 ms 20 10908 12.08 MB/sec execute 71 sec latency 91.724 ms 20 10975 11.96 MB/sec execute 72 sec latency 86.114 ms 20 11035 11.83 MB/sec execute 73 sec latency 111.960 ms 20 11112 11.69 MB/sec execute 74 sec latency 64.614 ms 20 11168 11.54 MB/sec execute 75 sec latency 182.226 ms 20 11259 11.41 MB/sec execute 76 sec latency 182.567 ms 20 11353 11.30 MB/sec execute 77 sec latency 234.491 ms 20 11414 11.19 MB/sec execute 78 sec latency 227.870 ms 20 11472 11.08 MB/sec execute 79 sec latency 206.245 ms 20 11545 11.01 MB/sec execute 80 sec latency 175.494 ms 20 11621 10.93 MB/sec execute 81 sec latency 174.425 ms 20 11724 10.94 MB/sec execute 82 sec latency 141.704 ms 20 11853 10.99 MB/sec execute 83 sec latency 97.530 ms 20 12014 11.19 MB/sec execute 84 sec latency 106.210 ms 20 12171 11.38 MB/sec execute 85 sec latency 91.203 ms 20 12288 11.27 MB/sec execute 86 sec latency 136.047 ms 20 12377 11.16 MB/sec execute 87 sec latency 130.799 ms 20 12476 11.05 MB/sec execute 88 sec latency 144.222 ms 20 12607 10.96 MB/sec execute 89 sec latency 71.203 ms 20 12767 10.90 MB/sec execute 90 sec latency 132.275 ms 20 12909 10.89 MB/sec execute 91 sec latency 144.753 ms 20 13039 10.92 MB/sec execute 92 sec latency 158.338 ms 20 13190 11.03 MB/sec execute 93 sec latency 138.652 ms 20 13457 11.47 MB/sec execute 94 sec latency 133.776 ms 20 13684 11.78 MB/sec execute 95 sec latency 119.374 ms 20 13910 11.96 MB/sec execute 96 sec latency 133.153 ms 20 14129 12.25 MB/sec execute 97 sec latency 123.388 ms 20 14300 12.47 MB/sec execute 98 sec latency 64.736 ms 20 14420 12.47 MB/sec execute 99 sec latency 63.202 ms 20 14530 12.44 MB/sec execute 100 sec latency 52.432 ms 20 14640 12.35 MB/sec execute 101 sec latency 45.882 ms 20 14729 12.23 MB/sec execute 102 sec latency 194.167 ms 20 14853 12.14 MB/sec execute 103 sec latency 132.221 ms 20 14948 12.06 MB/sec execute 104 sec latency 183.927 ms 20 15026 11.98 MB/sec execute 105 sec latency 199.046 ms 20 15114 11.93 MB/sec execute 106 sec latency 185.209 ms 20 15218 11.91 MB/sec execute 107 sec latency 117.904 ms 20 15354 11.97 MB/sec execute 108 sec latency 123.401 ms 20 15541 12.11 MB/sec execute 109 sec latency 94.277 ms 20 15704 12.27 MB/sec execute 110 sec latency 93.309 ms 20 15821 12.18 MB/sec execute 111 sec latency 113.486 ms 20 15933 12.08 MB/sec execute 112 sec latency 91.970 ms 20 16060 12.00 MB/sec execute 113 sec latency 109.530 ms 20 16222 11.93 MB/sec execute 114 sec latency 81.721 ms 20 16372 11.89 MB/sec execute 115 sec latency 97.704 ms 20 16529 11.89 MB/sec execute 116 sec latency 102.795 ms 20 16683 11.99 MB/sec execute 117 sec latency 147.936 ms 20 16916 12.27 MB/sec execute 118 sec latency 122.798 ms 20 17194 12.57 MB/sec execute 119 sec latency 122.482 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 49112 26.882 139.996 Close 36067 6.548 38.101 Rename 2076 31.491 142.032 Unlink 9932 8.364 46.633 Qpathinfo 44678 5.542 107.277 Qfileinfo 7746 0.144 28.053 Qfsinfo 8209 0.070 14.377 Sfileinfo 4000 16.147 86.357 Find 17373 0.930 87.475 WriteX 24221 1.967 46.498 ReadX 76788 0.016 6.053 LockX 160 8.016 22.962 UnlockX 160 7.292 19.816 Flush 3456 90.327 271.853 Throughput 12.5729 MB/sec 20 clients 20 procs max_latency=271.859 ms stopping dbench on /mnt/lustre/d0.oleg329-client.virtnet at Tue Jan 7 10:24:42 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg329-client.virtnet /mnt/lustre/d0.oleg329-client.virtnet /mnt/lustre/d0.oleg329-client.virtnet removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg329-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 10:24:45 (1736263485) min OST has 3112960kB available, using 4669440kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6872] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4560] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg329-clien 4560M 125132 86 112485 81 225551 45 1338 149 Latency 14508us 46767us 59249us 339ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg329-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 280 18 3287 18 560 13 416 17 537 15 564 14 Latency 17370us 6281us 60395us 13916us 6690us 10448us 1.97,1.97,oleg329-client.virtnet,1,1736270246,4560M,,,,125132,86,112485,81,,,225551,45,1338,149,10,,,,,280,18,3287,18,560,13,416,17,537,15,564,14,,14508us,46767us,,59249us,339ms,17370us,6281us,60395us,13916us,6690us,10448us debug=0x33f0484 PASS bonnie (232s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 10:28:38 (1736263718) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 14720 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 14720 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x3bc38b truncating to largest ever: 0x48ec9a truncating to largest ever: 0x545cc2 truncating to largest ever: 0x55fe73 truncating to largest ever: 0x5608ff 002000 1736263725.647058 mapread 0x19b1e5 thru 0x1a9c9e (0xeaba bytes) truncating to largest ever: 0x562860 004000 1736263733.528774 mapwrite 0x50a3e3 thru 0x50b68c (0x12aa bytes) 005000 1736263737.957131 mapwrite 0x4ba0d1 thru 0x4c6e02 (0xcd32 bytes) 008000 1736263750.142842 read 0x29fc5d thru 0x2a0988 (0xd2c bytes) 009000 1736263754.122903 trunc from 0x53d23c to 0x50aed5 (0x32366 bytes) truncating to largest ever: 0x562b28 012000 1736263766.439947 mapread 0x2370ce thru 0x245651 (0xe584 bytes) 013000 1736263769.894408 mapwrite 0x4af1b7 thru 0x4b42c6 (0x5110 bytes) 014000 1736263773.105170 mapwrite 0x07c49b thru 0x083fb7 (0x7b1d bytes) 016000 1736263780.574741 read 0x000b2e thru 0x01083e (0xfd11 bytes) 017000 1736263785.203214 write 0x067cb1 thru 0x06fa2b (0x7d7b bytes) 019000 1736263793.717024 trunc from 0x553146 to 0x33d1d2 (0x215f73 bytes) 020000 1736263797.606540 trunc from 0x276d71 to 0x2a46ee (0x2d97e bytes) 022000 1736263804.809681 trunc from 0x4e3173 to 0x0ed04d (0x3f6125 bytes) 023000 1736263809.941767 trunc from 0x51cf39 to 0x24b4e3 (0x2d1a55 bytes) truncating to largest ever: 0x562c8f 024000 1736263814.449868 read 0x0c9ef2 thru 0x0ce6f8 (0x4807 bytes) 025000 1736263818.157839 read 0x1a3166 thru 0x1ac91c (0x97b7 bytes) 028000 1736263830.167132 read 0x3e0702 thru 0x3ec9ec (0xc2eb bytes) 033000 1736263850.770541 read 0x30ade1 thru 0x30ecf7 (0x3f17 bytes) 034000 1736263855.997982 mapread 0x30d17a thru 0x316888 (0x970f bytes) 038000 1736263874.295955 mapread 0x4762bd thru 0x47fd60 (0x9aa4 bytes) 039000 1736263879.224260 write 0x4304b6 thru 0x43bf87 (0xbad2 bytes) 041000 1736263888.785939 write 0x36adfb thru 0x37ad80 (0xff86 bytes) 042000 1736263893.412327 mapwrite 0x2ecd13 thru 0x2f51f6 (0x84e4 bytes) 043000 1736263897.558458 read 0x061c22 thru 0x06979f (0x7b7e bytes) 044000 1736263901.607455 mapwrite 0x26c87c thru 0x2700c0 (0x3845 bytes) 045000 1736263906.319656 mapwrite 0x47dcd9 thru 0x485b30 (0x7e58 bytes) 046000 1736263911.128875 trunc from 0x4ac0ea to 0x3e358f (0xc8b5a bytes) 047000 1736263916.885785 read 0x338a19 thru 0x342def (0xa3d7 bytes) 048000 1736263921.279351 trunc from 0x54129f to 0x53635a (0xaf44 bytes) 051000 1736263934.532494 read 0x43de65 thru 0x43ff42 (0x20de bytes) 052000 1736263938.770673 read 0x206d1d thru 0x2102d3 (0x95b7 bytes) 054000 1736263947.681633 write 0x398cbe thru 0x39c753 (0x3a96 bytes) 057000 1736263961.286055 mapread 0x1e3fbf thru 0x1eb451 (0x7493 bytes) 058000 1736263965.744373 mapread 0x1ade4c thru 0x1ba39a (0xc54f bytes) 060000 1736263973.947928 mapread 0x034860 thru 0x040a67 (0xc208 bytes) 061000 1736263978.556294 write 0x0ce23a thru 0x0d6d89 (0x8b50 bytes) 064000 1736263990.454998 mapwrite 0x488f16 thru 0x494311 (0xb3fc bytes) 068000 1736264004.466626 mapread 0x265eb4 thru 0x2733b3 (0xd500 bytes) 070000 1736264009.959228 write 0x418baa thru 0x41efde (0x6435 bytes) 072000 1736264016.300017 read 0x0060fe thru 0x01088e (0xa791 bytes) 073000 1736264019.576880 mapread 0x3b3d93 thru 0x3bc223 (0x8491 bytes) 074000 1736264022.442379 mapwrite 0x245d5a thru 0x24bea8 (0x614f bytes) 075000 1736264025.521223 trunc from 0x42d7b0 to 0x311d05 (0x11baaa bytes) 076000 1736264028.251022 trunc from 0x503e6a to 0x38576f (0x17e6fa bytes) 079000 1736264035.949116 mapread 0x3025dd thru 0x30d390 (0xadb4 bytes) 081000 1736264041.740068 read 0x023584 thru 0x03111f (0xdb9c bytes) 082000 1736264044.340585 trunc from 0x510aa5 to 0x00d0ae (0x5039f6 bytes) 084000 1736264049.903794 read 0x32998e thru 0x32c68f (0x2d02 bytes) 085000 1736264052.609827 mapread 0x2264c0 thru 0x23048b (0x9fcc bytes) 088000 1736264061.297581 mapwrite 0x131176 thru 0x13d690 (0xc51b bytes) 090000 1736264066.940793 read 0x02f82c thru 0x03e36c (0xeb41 bytes) 091000 1736264070.001552 mapread 0x2f0b28 thru 0x2f400d (0x34e6 bytes) 093000 1736264075.201459 mapread 0x3a726d thru 0x3aea43 (0x77d7 bytes) 095000 1736264081.618776 mapread 0x000e6c thru 0x00fdb0 (0xef45 bytes) 097000 1736264088.120702 write 0x3045f4 thru 0x3131d6 (0xebe3 bytes) 098000 1736264091.053729 trunc from 0x3247bb to 0x414fc1 (0xf0807 bytes) 100000 1736264098.101406 write 0x0693e5 thru 0x06a3ee (0x100a bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (381s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 10:34:59 (1736264099) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1736264110.355846 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1736264113.493488 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1736264119.636240 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1736264123.141163 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1736264126.371560 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1736264144.836480 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1736264147.783453 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1736264150.920358 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1736264157.413327 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1736264160.597976 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1736264163.631159 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1736264169.938626 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1736264173.312924 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1736264180.669086 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1736264183.854475 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1736264186.751074 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1736264192.564567 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1736264195.708364 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1736264204.885641 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1736264219.028261 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1736264222.548350 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1736264226.306072 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1736264230.189513 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1736264233.747687 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1736264255.821638 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1736264259.301166 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1736264266.125132 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1736264280.574519 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1736264295.080368 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1736264301.323947 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1736264304.564780 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1736264311.919097 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1736264318.764073 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1736264325.598896 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1736264328.886666 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1736264332.607362 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1736264347.775786 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1736264351.147816 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1736264354.519549 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1736264362.095451 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1736264369.522135 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1736264373.474241 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1736264383.929475 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1736264390.482813 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1736264393.768305 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1736264397.596447 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1736264401.327263 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1736264405.378966 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1736264409.213221 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1736264412.931274 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1736264431.374760 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1736264435.372988 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1736264442.514601 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (347s) == sanity-benchmark test complete, duration 1121 sec ===== 10:40:46 (1736264446)