-----============= acceptance-small: sanity-benchmark ============----- Fri Jul 19 05:37:58 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg301-client.virtnet: executing check_config_client /mnt/lustre oleg301-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg301-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b05be000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b05be000.idle_timeout=debug disable quota as required oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 05:38:08 (1721381888) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7448] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg301-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg301-client.virtnet at Fri Jul 19 05:38:09 EDT 2024 waiting for dbench pid 9587 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 219 169.65 MB/sec warmup 1 sec latency 56.771 ms 20 420 148.42 MB/sec warmup 2 sec latency 41.614 ms 20 664 140.99 MB/sec warmup 3 sec latency 350.791 ms 20 841 107.71 MB/sec warmup 4 sec latency 700.481 ms 20 1172 92.05 MB/sec warmup 5 sec latency 23.919 ms 20 1548 87.00 MB/sec warmup 6 sec latency 34.949 ms 20 1892 75.40 MB/sec warmup 7 sec latency 27.330 ms 20 2308 69.00 MB/sec warmup 8 sec latency 19.951 ms 20 2642 66.29 MB/sec warmup 9 sec latency 26.034 ms 20 3265 69.76 MB/sec warmup 10 sec latency 32.840 ms 20 3747 71.49 MB/sec warmup 11 sec latency 22.658 ms 20 3970 66.76 MB/sec warmup 12 sec latency 32.585 ms 20 4215 61.86 MB/sec warmup 13 sec latency 42.055 ms 20 4471 58.31 MB/sec warmup 14 sec latency 30.730 ms 20 4775 56.22 MB/sec warmup 15 sec latency 26.799 ms 20 5118 56.52 MB/sec warmup 16 sec latency 36.031 ms 20 5365 53.45 MB/sec warmup 17 sec latency 29.829 ms 20 5716 50.91 MB/sec warmup 18 sec latency 20.144 ms 20 6018 49.97 MB/sec warmup 19 sec latency 25.160 ms 20 6507 52.48 MB/sec warmup 20 sec latency 32.676 ms 20 7031 53.85 MB/sec warmup 21 sec latency 31.200 ms 20 7329 53.43 MB/sec warmup 22 sec latency 30.468 ms 20 7530 51.46 MB/sec warmup 23 sec latency 28.360 ms 20 8011 11.85 MB/sec execute 1 sec latency 50.288 ms 20 8299 19.36 MB/sec execute 2 sec latency 28.389 ms 20 8629 33.20 MB/sec execute 3 sec latency 43.531 ms 20 8902 26.06 MB/sec execute 4 sec latency 23.342 ms 20 9262 22.45 MB/sec execute 5 sec latency 19.230 ms 20 9590 24.71 MB/sec execute 6 sec latency 23.953 ms 20 10110 35.76 MB/sec execute 7 sec latency 30.368 ms 20 10674 43.32 MB/sec execute 8 sec latency 24.911 ms 20 10936 41.59 MB/sec execute 9 sec latency 35.851 ms 20 11160 37.94 MB/sec execute 10 sec latency 25.040 ms 20 11401 35.14 MB/sec execute 11 sec latency 55.115 ms 20 11687 34.10 MB/sec execute 12 sec latency 26.970 ms 20 12047 35.93 MB/sec execute 13 sec latency 26.287 ms 20 12329 34.62 MB/sec execute 14 sec latency 31.636 ms 20 12642 32.70 MB/sec execute 15 sec latency 25.720 ms 20 12996 32.16 MB/sec execute 16 sec latency 26.320 ms 20 13328 33.35 MB/sec execute 17 sec latency 40.967 ms 20 13854 36.21 MB/sec execute 18 sec latency 28.529 ms 20 14303 38.64 MB/sec execute 19 sec latency 24.539 ms 20 14535 37.94 MB/sec execute 20 sec latency 29.646 ms 20 14774 36.33 MB/sec execute 21 sec latency 65.480 ms 20 15015 35.10 MB/sec execute 22 sec latency 49.649 ms 20 15274 34.58 MB/sec execute 23 sec latency 31.971 ms 20 15587 35.24 MB/sec execute 24 sec latency 30.706 ms 20 15873 34.68 MB/sec execute 25 sec latency 27.810 ms 20 16165 33.56 MB/sec execute 26 sec latency 27.043 ms 20 16529 33.14 MB/sec execute 27 sec latency 20.770 ms 20 16922 34.29 MB/sec execute 28 sec latency 27.669 ms 20 17453 36.02 MB/sec execute 29 sec latency 34.153 ms 20 17897 37.53 MB/sec execute 30 sec latency 27.028 ms 20 18139 36.87 MB/sec execute 31 sec latency 25.456 ms 20 18388 35.86 MB/sec execute 32 sec latency 49.304 ms 20 18670 35.17 MB/sec execute 33 sec latency 27.993 ms 20 19036 35.50 MB/sec execute 34 sec latency 29.563 ms 20 19389 35.68 MB/sec execute 35 sec latency 31.300 ms 20 19748 34.87 MB/sec execute 36 sec latency 27.561 ms 20 20141 34.63 MB/sec execute 37 sec latency 18.042 ms 20 20595 35.92 MB/sec execute 38 sec latency 20.684 ms 20 21179 37.30 MB/sec execute 39 sec latency 92.210 ms 20 21569 37.95 MB/sec execute 40 sec latency 25.058 ms 20 21814 37.26 MB/sec execute 41 sec latency 37.991 ms 20 22077 36.54 MB/sec execute 42 sec latency 56.362 ms 20 22344 36.19 MB/sec execute 43 sec latency 30.306 ms 20 22723 36.63 MB/sec execute 44 sec latency 34.371 ms 20 23031 36.29 MB/sec execute 45 sec latency 24.039 ms 20 23338 35.64 MB/sec execute 46 sec latency 25.422 ms 20 23716 35.49 MB/sec execute 47 sec latency 22.751 ms 20 24197 36.65 MB/sec execute 48 sec latency 26.652 ms 20 24787 37.82 MB/sec execute 49 sec latency 34.265 ms 20 25115 38.02 MB/sec execute 50 sec latency 26.032 ms 20 25331 37.45 MB/sec execute 51 sec latency 28.728 ms 20 25570 36.82 MB/sec execute 52 sec latency 44.551 ms 20 25865 36.47 MB/sec execute 53 sec latency 25.985 ms 20 26199 36.60 MB/sec execute 54 sec latency 30.538 ms 20 26523 36.63 MB/sec execute 55 sec latency 29.676 ms 20 26840 36.08 MB/sec execute 56 sec latency 22.181 ms 20 27243 35.95 MB/sec execute 57 sec latency 20.786 ms 20 27659 36.62 MB/sec execute 58 sec latency 29.004 ms 20 28212 37.46 MB/sec execute 59 sec latency 31.986 ms 20 28589 37.90 MB/sec execute 60 sec latency 23.009 ms 20 28808 37.57 MB/sec execute 61 sec latency 29.326 ms 20 29016 37.00 MB/sec execute 62 sec latency 56.283 ms 20 29283 36.59 MB/sec execute 63 sec latency 40.119 ms 20 29570 36.44 MB/sec execute 64 sec latency 30.543 ms 20 29921 36.81 MB/sec execute 65 sec latency 30.320 ms 20 30196 36.35 MB/sec execute 66 sec latency 23.931 ms 20 30549 35.94 MB/sec execute 67 sec latency 21.947 ms 20 30883 35.90 MB/sec execute 68 sec latency 22.198 ms 20 31351 36.73 MB/sec execute 69 sec latency 81.411 ms 20 31919 37.52 MB/sec execute 70 sec latency 28.074 ms 20 32228 37.57 MB/sec execute 71 sec latency 24.635 ms 20 32454 37.15 MB/sec execute 72 sec latency 28.907 ms 20 32709 36.74 MB/sec execute 73 sec latency 71.922 ms 20 32988 36.53 MB/sec execute 74 sec latency 28.091 ms 20 33357 36.89 MB/sec execute 75 sec latency 32.423 ms 20 33651 36.58 MB/sec execute 76 sec latency 24.895 ms 20 33991 36.19 MB/sec execute 77 sec latency 29.612 ms 20 34354 36.08 MB/sec execute 78 sec latency 20.805 ms 20 34787 36.68 MB/sec execute 79 sec latency 24.354 ms 20 35364 37.32 MB/sec execute 80 sec latency 26.850 ms 20 35729 37.61 MB/sec execute 81 sec latency 30.187 ms 20 35945 37.28 MB/sec execute 82 sec latency 29.588 ms 20 36173 36.88 MB/sec execute 83 sec latency 61.866 ms 20 36443 36.61 MB/sec execute 84 sec latency 36.900 ms 20 36756 36.56 MB/sec execute 85 sec latency 22.185 ms 20 37072 36.75 MB/sec execute 86 sec latency 33.001 ms 20 37350 36.38 MB/sec execute 87 sec latency 25.648 ms 20 37704 36.12 MB/sec execute 88 sec latency 18.698 ms 20 38040 36.14 MB/sec execute 89 sec latency 23.163 ms 20 38563 36.78 MB/sec execute 90 sec latency 30.207 ms 20 39057 37.34 MB/sec execute 91 sec latency 26.547 ms 20 39338 37.31 MB/sec execute 92 sec latency 25.298 ms 20 39587 36.99 MB/sec execute 93 sec latency 62.285 ms 20 39835 36.68 MB/sec execute 94 sec latency 70.739 ms 20 40117 36.53 MB/sec execute 95 sec latency 23.241 ms 20 40447 36.70 MB/sec execute 96 sec latency 31.692 ms 20 40721 36.54 MB/sec execute 97 sec latency 27.066 ms 20 41003 36.22 MB/sec execute 98 sec latency 31.709 ms 20 41361 36.06 MB/sec execute 99 sec latency 26.597 ms 20 41745 36.31 MB/sec execute 100 sec latency 22.835 ms 20 42262 36.77 MB/sec execute 101 sec latency 31.775 ms 20 42685 37.18 MB/sec execute 102 sec latency 25.394 ms 20 42917 37.06 MB/sec execute 103 sec latency 34.789 ms 20 43157 36.76 MB/sec execute 104 sec latency 38.517 ms 20 43445 36.51 MB/sec execute 105 sec latency 47.884 ms 20 43768 36.45 MB/sec execute 106 sec latency 24.102 ms 20 44140 36.65 MB/sec execute 107 sec latency 29.743 ms 20 44491 36.39 MB/sec execute 108 sec latency 21.630 ms 20 44936 36.31 MB/sec execute 109 sec latency 20.260 ms 20 45384 36.69 MB/sec execute 110 sec latency 22.327 ms 20 46017 37.28 MB/sec execute 111 sec latency 24.217 ms 20 46411 37.46 MB/sec execute 112 sec latency 23.861 ms 20 46671 37.21 MB/sec execute 113 sec latency 43.102 ms 20 46958 36.96 MB/sec execute 114 sec latency 53.246 ms 20 47295 36.91 MB/sec execute 115 sec latency 23.389 ms 20 47684 37.11 MB/sec execute 116 sec latency 22.787 ms 20 48020 36.86 MB/sec execute 117 sec latency 24.281 ms 20 48444 36.73 MB/sec execute 118 sec latency 17.751 ms 20 48899 37.06 MB/sec execute 119 sec latency 21.904 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 143504 9.673 71.909 Close 106214 2.256 21.779 Rename 6156 13.479 43.055 Unlink 28349 3.245 27.990 Qpathinfo 130500 2.152 55.099 Qfileinfo 23122 0.070 9.123 Qfsinfo 23820 0.031 6.628 Sfileinfo 11959 7.097 35.336 Find 50697 0.446 36.767 WriteX 71792 1.325 29.656 ReadX 228057 0.012 5.614 LockX 480 2.351 6.543 UnlockX 480 2.375 6.966 Flush 10247 9.807 92.198 Throughput 37.0636 MB/sec 20 clients 20 procs max_latency=92.210 ms stopping dbench on /mnt/lustre/d0.oleg301-client.virtnet at Fri Jul 19 05:40:33 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg301-client.virtnet /mnt/lustre/d0.oleg301-client.virtnet /mnt/lustre/d0.oleg301-client.virtnet removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg301-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 05:40:36 (1721382036) min OST has 3333328kB available, using 4999992kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7448] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4882] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg301-clien 4882M 152513 98 149487 98 260496 56 4480 271 Latency 4505us 52988us 41546us 4777us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg301-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 399 20 3596 20 687 15 508 18 508 17 654 15 Latency 16690us 5222us 21481us 26381us 9222us 53632us 1.97,1.97,oleg301-client.virtnet,1,1721376054,4882M,,,,152513,98,149487,98,,,260496,56,4480,271,10,,,,,399,20,3596,20,687,15,508,18,508,17,654,15,,4505us,52988us,,41546us,4777us,16690us,5222us,21481us,26381us,9222us,53632us debug=0x33f0484 PASS bonnie (194s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 05:43:50 (1721382230) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 5933 -P /tmp -l 5401416 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 5933 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x46ab0 fallocating to largest ever: 0x3b8eec truncating to largest ever: 0x41d456 truncating to largest ever: 0x494755 truncating to largest ever: 0x4b277d truncating to largest ever: 0x4c91b8 fallocating to largest ever: 0x4d27f0 fallocating to largest ever: 0x4e1567 fallocating to largest ever: 0x526b48 002000 1721382235.922487 write 0x37b5af thru 0x37e313 (0x2d65 bytes) 003000 1721382238.265999 punch from 0x201e60 to 0x201f35 (0xd6 bytes) 004000 1721382240.574045 mapread 0x1e619a thru 0x1f5363 (0xf1ca bytes) 005000 1721382242.394822 write 0x0b02bd thru 0x0b78a9 (0x75ed bytes) 010000 1721382252.756849 mapread 0x1c5ee3 thru 0x1c6199 (0x2b7 bytes) 011000 1721382255.230440 read 0x011bc2 thru 0x0161fc (0x463b bytes) 012000 1721382257.995113 fallocate 0x3f79de thru 0x40577b (0xdd9e bytes) 013000 1721382260.449276 punch from 0x1a136d to 0x1b08a1 (0xf535 bytes) 014000 1721382262.529676 trunc from 0x512629 to 0x2ab9c7 (0x266c61 bytes) 015000 1721382264.806618 mapwrite 0x1a5dc8 thru 0x1afcd4 (0x9f0d bytes) 016000 1721382266.899796 mapwrite 0x157a8a thru 0x158827 (0xd9e bytes) 017000 1721382269.180694 write 0x26bdf4 thru 0x26ef7a (0x3187 bytes) 019000 1721382273.580831 write 0x49d400 thru 0x49f2f5 (0x1ef6 bytes) 020000 1721382275.901636 punch from 0x46ba55 to 0x46ff81 (0x452d bytes) 022000 1721382280.107296 write 0x4db2d2 thru 0x4dc22f (0xf5e bytes) 023000 1721382282.616999 mapread 0x04c2a9 thru 0x0514f3 (0x524b bytes) 024000 1721382284.830681 write 0x272792 thru 0x27d314 (0xab83 bytes) skipping zero size write 026000 1721382289.828478 read 0x1be9bb thru 0x1cce25 (0xe46b bytes) 027000 1721382292.442521 write 0x2d0311 thru 0x2dd607 (0xd2f7 bytes) 028000 1721382295.109255 punch from 0x16494e to 0x16c81c (0x7ecf bytes) 030000 1721382299.956806 mapwrite 0x3d055c thru 0x3d6938 (0x63dd bytes) 031000 1721382302.450007 read 0x4ca70c thru 0x4d06c7 (0x5fbc bytes) 033000 1721382306.555448 fallocate 0x1e0458 thru 0x1e6aa2 (0x664b bytes) 034000 1721382308.864973 trunc from 0x22f8c9 to 0x16a7de (0xc50ea bytes) 035000 1721382311.112611 fallocate 0x39b587 thru 0x3a8f6e (0xd9e8 bytes) 036000 1721382313.299214 fallocate 0x0ca272 thru 0x0d3754 (0x94e3 bytes) 037000 1721382315.775655 write 0x052ecf thru 0x059c9e (0x6dd0 bytes) 038000 1721382318.049461 write 0x2d4af6 thru 0x2e3e52 (0xf35d bytes) skipping zero length punch hole 040000 1721382323.513200 fallocate 0x1352e8 thru 0x144a38 (0xf751 bytes) 043000 1721382331.122627 mapread 0x014fa0 thru 0x01c85e (0x78bf bytes) 044000 1721382333.966729 mapwrite 0x1d8aa5 thru 0x1da034 (0x1590 bytes) 045000 1721382336.128434 mapread 0x024a14 thru 0x030e6b (0xc458 bytes) 046000 1721382338.656414 trunc from 0x2b1eca to 0x10274d (0x1af77c bytes) 047000 1721382340.998076 punch from 0x2caa07 to 0x2d08bd (0x5eb7 bytes) 048000 1721382343.382300 fallocate 0x521d54 thru 0x526b47 (0x4df4 bytes) 049000 1721382345.337404 mapwrite 0x20566b thru 0x2116d4 (0xc06a bytes) 050000 1721382347.350481 write 0x2caf80 thru 0x2d3e14 (0x8e95 bytes) 051000 1721382349.210356 fallocate 0x4a40d5 thru 0x4b02c5 (0xc1f1 bytes) 052000 1721382351.157779 write 0x11f348 thru 0x12745d (0x8116 bytes) 053000 1721382353.140516 read 0x2dfb24 thru 0x2e5d4c (0x6229 bytes) 055000 1721382357.479327 mapread 0x308fe0 thru 0x31788f (0xe8b0 bytes) 056000 1721382359.657242 mapwrite 0x2c786b thru 0x2d1b17 (0xa2ad bytes) 057000 1721382361.898451 mapread 0x189540 thru 0x19817b (0xec3c bytes) 058000 1721382364.326009 punch from 0x17e095 to 0x188831 (0xa79d bytes) 059000 1721382366.065216 read 0x20a22f thru 0x20e806 (0x45d8 bytes) 060000 1721382368.070993 punch from 0x086ecb to 0x08a9a4 (0x3ada bytes) 061000 1721382370.101198 punch from 0x3eba45 to 0x3f4f13 (0x94cf bytes) 062000 1721382372.353740 mapwrite 0x1c1c28 thru 0x1c2f73 (0x134c bytes) 064000 1721382376.431535 mapread 0x09ab3d thru 0x0a6fb8 (0xc47c bytes) 065000 1721382378.490205 punch from 0x06988f to 0x06ccfe (0x3470 bytes) 067000 1721382382.325648 read 0x07e4f8 thru 0x0807be (0x22c7 bytes) 069000 1721382386.310804 fallocate 0x15dc6a thru 0x15f5fc (0x1993 bytes) 070000 1721382388.237919 mapwrite 0x3448dc thru 0x349b0e (0x5233 bytes) 072000 1721382392.445378 read 0x09fa99 thru 0x0accd7 (0xd23f bytes) 073000 1721382394.632535 mapwrite 0x39cf39 thru 0x3a1e22 (0x4eea bytes) 074000 1721382396.784311 mapread 0x0169b1 thru 0x01f6c2 (0x8d12 bytes) 075000 1721382398.816310 read 0x25d252 thru 0x265750 (0x84ff bytes) 076000 1721382401.046303 trunc from 0x4adc6f to 0x0a726e (0x406a00 bytes) 077000 1721382403.051541 mapread 0x0d3c2d thru 0x0dc23d (0x8611 bytes) 078000 1721382405.617925 fallocate 0x0ef192 thru 0x0f5a53 (0x68c2 bytes) 079000 1721382407.848248 mapwrite 0x30ad42 thru 0x3177c6 (0xca85 bytes) 083000 1721382416.696453 fallocate 0x14f9a3 thru 0x15ac84 (0xb2e2 bytes) 084000 1721382418.793953 punch from 0x03b7b6 to 0x049be4 (0xe42f bytes) 085000 1721382420.897930 read 0x2ab608 thru 0x2ba88f (0xf288 bytes) 086000 1721382422.964303 fallocate 0x209232 thru 0x210a13 (0x77e2 bytes) 087000 1721382425.424984 mapwrite 0x305d07 thru 0x31433e (0xe638 bytes) 088000 1721382427.582992 punch from 0x0d1c0c to 0x0db37d (0x9772 bytes) 089000 1721382429.665823 write 0x18deae thru 0x198f75 (0xb0c8 bytes) 090000 1721382431.787639 punch from 0x053cdb to 0x056713 (0x2a39 bytes) 092000 1721382435.432346 read 0x35df5b thru 0x36c018 (0xe0be bytes) 093000 1721382437.695273 mapwrite 0x0ebc20 thru 0x0f4e79 (0x925a bytes) 094000 1721382439.610350 mapread 0x0432ce thru 0x048186 (0x4eb9 bytes) 095000 1721382441.554049 punch from 0x4362bb to 0x439603 (0x3349 bytes) 096000 1721382443.516904 mapread 0x09a36e thru 0x0a3ba0 (0x9833 bytes) 099000 1721382449.862228 trunc from 0x4770cd to 0x1a34b1 (0x2d3c1b bytes) 100000 1721382451.881834 write 0x404e2f thru 0x410284 (0xb456 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (222s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 05:47:32 (1721382452) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1721382455.964382 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1721382458.293631 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1721382467.670076 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1721382470.102482 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1721382472.621416 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1721382475.073633 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1721382477.549051 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1721382482.006417 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1721382484.275159 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1721382489.201515 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1721382492.341226 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1721382497.961187 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1721382500.341201 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1721382506.744833 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1721382509.433012 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1721382511.962210 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1721382514.863781 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1721382517.364877 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1721382520.132976 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1721382522.736014 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1721382525.313568 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1721382530.827407 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1721382533.566620 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1721382536.291321 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1721382539.020401 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1721382541.801449 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1721382544.506204 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1721382547.304812 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1721382550.146125 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1721382553.453300 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1721382556.305281 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1721382558.957204 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1721382564.414794 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1721382567.256263 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1721382569.887207 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1721382572.682403 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1721382581.202941 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1721382584.057107 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1721382586.728188 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1721382589.599284 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1721382592.510316 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1721382595.152300 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1721382600.820931 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1721382603.562781 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1721382606.530809 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1721382615.289935 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1721382621.010062 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1721382623.737651 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1721382626.369851 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1721382631.681118 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1721382637.386158 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1721382640.508732 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1721382643.421504 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1721382649.137331 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1721382651.876780 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1721382654.815293 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1721382657.431082 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1721382660.205659 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1721382662.873211 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1721382668.458642 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1721382674.309224 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1721382676.829693 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1721382679.369924 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1721382682.310185 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1721382687.759758 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1721382693.418017 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1721382699.178107 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1721382701.910345 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1721382704.584654 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1721382707.145834 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1721382709.743193 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1721382715.466917 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1721382718.144048 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1721382720.873355 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1721382726.584521 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (275s) == sanity-benchmark test complete, duration 849 sec ====== 05:52:07 (1721382727)