-----============= acceptance-small: sanity-benchmark ============----- Wed May 29 17:14:01 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg254-client.virtnet: executing check_config_client /mnt/lustre oleg254-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg254-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b649b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b649b800.idle_timeout=debug disable quota as required oleg254-server: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 17:14:18 (1717017258) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6864] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg254-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg254-client.virtnet at Wed May 29 17:14:19 EDT 2024 waiting for dbench pid 8800 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 81 72.77 MB/sec warmup 1 sec latency 187.977 ms 20 163 67.59 MB/sec warmup 2 sec latency 192.436 ms 20 249 63.27 MB/sec warmup 3 sec latency 110.338 ms 20 343 61.88 MB/sec warmup 4 sec latency 122.570 ms 20 425 60.06 MB/sec warmup 5 sec latency 200.143 ms 20 498 57.73 MB/sec warmup 6 sec latency 159.631 ms 20 609 58.62 MB/sec warmup 7 sec latency 745.751 ms 20 669 52.89 MB/sec warmup 8 sec latency 1216.627 ms 20 712 47.18 MB/sec warmup 9 sec latency 379.172 ms 20 751 42.70 MB/sec warmup 10 sec latency 226.173 ms 20 794 38.97 MB/sec warmup 11 sec latency 948.107 ms 20 833 35.88 MB/sec warmup 12 sec latency 1948.656 ms 20 868 33.36 MB/sec warmup 13 sec latency 2948.958 ms 20 903 31.25 MB/sec warmup 14 sec latency 3950.211 ms 20 949 29.66 MB/sec warmup 15 sec latency 4950.338 ms 20 981 27.90 MB/sec warmup 16 sec latency 5950.471 ms 20 1023 26.63 MB/sec warmup 17 sec latency 6950.794 ms 20 1062 25.50 MB/sec warmup 18 sec latency 7950.952 ms 20 1096 24.33 MB/sec warmup 19 sec latency 8952.790 ms 20 1129 23.14 MB/sec warmup 20 sec latency 9953.017 ms 20 1157 22.06 MB/sec warmup 21 sec latency 10953.256 ms 20 1182 21.08 MB/sec warmup 22 sec latency 11953.589 ms 20 1207 20.19 MB/sec warmup 23 sec latency 12953.700 ms 20 1272 0.95 MB/sec execute 1 sec latency 14954.018 ms 20 1300 1.95 MB/sec execute 2 sec latency 15954.422 ms 20 1332 2.56 MB/sec execute 3 sec latency 16954.588 ms 20 1361 2.90 MB/sec execute 4 sec latency 17954.729 ms 20 1397 3.33 MB/sec execute 5 sec latency 18955.341 ms 20 1455 4.37 MB/sec execute 6 sec latency 19955.474 ms 20 1518 5.07 MB/sec execute 7 sec latency 20956.129 ms 20 1574 6.09 MB/sec execute 8 sec latency 21958.305 ms 20 1630 6.38 MB/sec execute 9 sec latency 22958.594 ms 20 1672 6.00 MB/sec execute 10 sec latency 23959.177 ms 20 1727 6.46 MB/sec execute 11 sec latency 24959.519 ms 20 1763 6.45 MB/sec execute 12 sec latency 25959.651 ms 20 1789 6.13 MB/sec execute 13 sec latency 26960.011 ms 20 1812 5.78 MB/sec execute 14 sec latency 27960.155 ms 20 1824 5.46 MB/sec execute 15 sec latency 28961.360 ms 20 1840 5.13 MB/sec execute 16 sec latency 29963.764 ms 20 1865 4.88 MB/sec execute 17 sec latency 30963.910 ms 20 1886 4.64 MB/sec execute 18 sec latency 31964.207 ms 20 1911 4.49 MB/sec execute 19 sec latency 32964.493 ms 20 1928 4.30 MB/sec execute 20 sec latency 33965.027 ms 20 1952 4.17 MB/sec execute 21 sec latency 34965.153 ms 20 1972 4.05 MB/sec execute 22 sec latency 35966.584 ms 20 1998 3.91 MB/sec execute 23 sec latency 36967.760 ms 20 2024 3.84 MB/sec execute 24 sec latency 37968.009 ms 20 2052 3.73 MB/sec execute 25 sec latency 38968.379 ms 20 2086 3.83 MB/sec execute 26 sec latency 39968.516 ms 20 2121 3.85 MB/sec execute 27 sec latency 40968.730 ms 20 2146 3.76 MB/sec execute 28 sec latency 41968.898 ms 20 2174 3.73 MB/sec execute 29 sec latency 42969.556 ms 20 2197 3.66 MB/sec execute 30 sec latency 43970.368 ms 20 2225 3.59 MB/sec execute 31 sec latency 44970.611 ms 20 2261 3.71 MB/sec execute 32 sec latency 45970.752 ms 20 2285 3.65 MB/sec execute 33 sec latency 46971.135 ms 20 2318 3.65 MB/sec execute 34 sec latency 47972.089 ms 20 2350 3.63 MB/sec execute 35 sec latency 48974.066 ms 20 2382 3.70 MB/sec execute 36 sec latency 49974.204 ms 20 2410 3.66 MB/sec execute 37 sec latency 50975.629 ms 20 2437 3.60 MB/sec execute 38 sec latency 51976.091 ms 20 2462 3.54 MB/sec execute 39 sec latency 52976.291 ms 20 2498 3.58 MB/sec execute 40 sec latency 53976.760 ms 20 2519 3.61 MB/sec execute 41 sec latency 54977.621 ms 20 2536 3.53 MB/sec execute 42 sec latency 55978.569 ms 20 2563 3.49 MB/sec execute 43 sec latency 56978.749 ms 20 2589 3.47 MB/sec execute 44 sec latency 57980.476 ms 20 2621 3.54 MB/sec execute 45 sec latency 58981.608 ms 20 2651 3.52 MB/sec execute 46 sec latency 59981.723 ms 20 2674 3.48 MB/sec execute 47 sec latency 60981.959 ms 20 2697 3.42 MB/sec execute 48 sec latency 61982.787 ms 20 2728 3.39 MB/sec execute 49 sec latency 62983.300 ms 20 2767 3.39 MB/sec execute 50 sec latency 63983.562 ms 20 2803 3.48 MB/sec execute 51 sec latency 64984.484 ms 20 2832 3.47 MB/sec execute 52 sec latency 65984.883 ms 20 2857 3.49 MB/sec execute 53 sec latency 66986.527 ms 20 2885 3.45 MB/sec execute 54 sec latency 67987.380 ms 20 2915 3.43 MB/sec execute 55 sec latency 68987.515 ms 20 2934 3.38 MB/sec execute 56 sec latency 69987.701 ms 20 2962 3.41 MB/sec execute 57 sec latency 70987.881 ms 20 2993 3.43 MB/sec execute 58 sec latency 71988.626 ms 20 3018 3.40 MB/sec execute 59 sec latency 72988.750 ms 20 3057 3.45 MB/sec execute 60 sec latency 73988.880 ms 20 3090 3.41 MB/sec execute 61 sec latency 74989.016 ms 20 3123 3.41 MB/sec execute 62 sec latency 75989.430 ms 20 3147 3.36 MB/sec execute 63 sec latency 76990.717 ms 20 3175 3.34 MB/sec execute 64 sec latency 77990.904 ms 20 3200 3.33 MB/sec execute 65 sec latency 78991.910 ms 20 3227 3.29 MB/sec execute 66 sec latency 79992.067 ms 20 3261 3.28 MB/sec execute 67 sec latency 80992.393 ms 20 3298 3.32 MB/sec execute 68 sec latency 81992.505 ms 20 3334 3.30 MB/sec execute 69 sec latency 82992.748 ms 20 3378 3.34 MB/sec execute 70 sec latency 83992.887 ms 20 3425 3.43 MB/sec execute 71 sec latency 84993.210 ms 20 3448 3.40 MB/sec execute 72 sec latency 85994.902 ms 20 3481 3.40 MB/sec execute 73 sec latency 86995.093 ms 20 3544 3.53 MB/sec execute 74 sec latency 87995.196 ms 20 3581 3.54 MB/sec execute 75 sec latency 88998.112 ms 20 3630 3.57 MB/sec execute 76 sec latency 89998.256 ms 20 3672 3.65 MB/sec execute 77 sec latency 90999.019 ms 20 3701 3.63 MB/sec execute 78 sec latency 91999.566 ms 20 3725 3.60 MB/sec execute 79 sec latency 92999.697 ms 20 3756 3.63 MB/sec execute 80 sec latency 94001.451 ms 20 3791 3.63 MB/sec execute 81 sec latency 95001.590 ms 20 3819 3.61 MB/sec execute 82 sec latency 96001.797 ms 20 3852 3.59 MB/sec execute 83 sec latency 97002.402 ms 20 3879 3.56 MB/sec execute 84 sec latency 98002.508 ms 20 3907 3.56 MB/sec execute 85 sec latency 99005.204 ms 20 3935 3.52 MB/sec execute 86 sec latency 100005.769 ms 20 3958 3.51 MB/sec execute 87 sec latency 101006.249 ms 20 3980 3.48 MB/sec execute 88 sec latency 102007.964 ms 20 4006 3.47 MB/sec execute 89 sec latency 103008.116 ms 20 4026 3.44 MB/sec execute 90 sec latency 104008.225 ms 20 4052 3.42 MB/sec execute 91 sec latency 105008.511 ms 20 4068 3.39 MB/sec execute 92 sec latency 106010.891 ms 20 4092 3.38 MB/sec execute 93 sec latency 107011.264 ms 20 4119 3.38 MB/sec execute 94 sec latency 108011.900 ms 20 4140 3.37 MB/sec execute 95 sec latency 109012.187 ms 20 4161 3.34 MB/sec execute 96 sec latency 110012.502 ms 20 4196 3.40 MB/sec execute 97 sec latency 111012.617 ms 20 4221 3.38 MB/sec execute 98 sec latency 112013.228 ms 20 4249 3.37 MB/sec execute 99 sec latency 113013.595 ms 20 4279 3.37 MB/sec execute 100 sec latency 114015.873 ms 20 4316 3.36 MB/sec execute 101 sec latency 115015.984 ms 20 4342 3.35 MB/sec execute 102 sec latency 116016.138 ms 20 4381 3.39 MB/sec execute 103 sec latency 117016.665 ms 20 4402 3.36 MB/sec execute 104 sec latency 118017.124 ms 20 4431 3.35 MB/sec execute 105 sec latency 119018.176 ms 20 4460 3.36 MB/sec execute 106 sec latency 120018.305 ms 20 4478 3.35 MB/sec execute 107 sec latency 121018.536 ms 20 4498 3.33 MB/sec execute 108 sec latency 122018.686 ms 20 4516 3.31 MB/sec execute 109 sec latency 123019.187 ms 20 4534 3.29 MB/sec execute 110 sec latency 124019.567 ms 20 4567 3.32 MB/sec execute 111 sec latency 125020.455 ms 20 4591 3.31 MB/sec execute 112 sec latency 126020.574 ms 20 4617 3.28 MB/sec execute 113 sec latency 127022.385 ms 20 4647 3.29 MB/sec execute 114 sec latency 128022.503 ms 20 4678 3.30 MB/sec execute 115 sec latency 129022.754 ms 20 4698 3.28 MB/sec execute 116 sec latency 130023.178 ms 20 4720 3.27 MB/sec execute 117 sec latency 131023.294 ms 20 4745 3.26 MB/sec execute 118 sec latency 132023.392 ms 20 4790 3.30 MB/sec execute 119 sec latency 133023.558 ms 20 cleanup 120 sec 18 cleanup 121 sec 16 cleanup 122 sec 12 cleanup 123 sec 8 cleanup 124 sec 5 cleanup 125 sec 1 cleanup 126 sec 0 cleanup 126 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 12180 121.861 138581.531 Close 8964 77.437 138667.884 Rename 534 73.819 16240.418 Unlink 2456 86.255 137407.388 Qpathinfo 11275 3.384 42.219 Qfileinfo 1984 0.113 9.339 Qfsinfo 2064 0.151 8.398 Sfileinfo 1013 53.067 20754.339 Find 4334 0.831 36.309 WriteX 6159 1.712 45.783 ReadX 19717 0.020 3.809 LockX 44 22.850 336.673 UnlockX 44 18.808 129.578 Flush 847 93.383 1104.922 Throughput 3.29755 MB/sec 20 clients 20 procs max_latency=133023.558 ms stopping dbench on /mnt/lustre/d0.oleg254-client.virtnet at Wed May 29 17:16:50 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg254-client.virtnet /mnt/lustre/d0.oleg254-client.virtnet /mnt/lustre/d0.oleg254-client.virtnet removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg254-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 17:16:55 (1717017415) min OST has 3579904kB available, using 5369856kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6864] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5244] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg254-clien 5244M 91354 66 92945 67 169929 35 957.3 133 Latency 31418us 126ms 101ms 392ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg254-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 175 17 1339 13 198 11 185 17 230 16 289 13 Latency 27777us 17783us 88789us 45588us 21385us 24250us 1.97,1.97,oleg254-client.virtnet,1,1717023569,5244M,,,,91354,66,92945,67,,,169929,35,957.3,133,10,,,,,175,17,1339,13,198,11,185,17,230,16,289,13,,31418us,126ms,,101ms,392ms,27777us,17783us,88789us,45588us,21385us,24250us debug=0x33f0484 PASS bonnie (417s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 17:23:53 (1717017833) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 32049 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 32049 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x53d2a6 truncating to largest ever: 0x543880 truncating to largest ever: 0x558481 truncating to largest ever: 0x55a178 truncating to largest ever: 0x56167c 002000 1717017853.059859 mapread 0x086ae5 thru 0x08c357 (0x5873 bytes) 004000 1717017876.953763 mapwrite 0x1af7f2 thru 0x1b8152 (0x8961 bytes) truncating to largest ever: 0x561d7c 006000 1717017900.179457 read 0x1adce4 thru 0x1baf15 (0xd232 bytes) 007000 1717017910.575395 mapread 0x448ff2 thru 0x4553b0 (0xc3bf bytes) 008000 1717017922.366804 mapwrite 0x0b0655 thru 0x0b6f71 (0x691d bytes) 012000 1717017962.442534 mapread 0x2a32f9 thru 0x2a4225 (0xf2d bytes) 013000 1717017972.415429 write 0x4403f2 thru 0x44db04 (0xd713 bytes) 015000 1717017995.731743 write 0x19235d thru 0x19b695 (0x9339 bytes) 018000 1717018022.178057 trunc from 0x45d009 to 0x46613f (0x9137 bytes) 019000 1717018031.552408 mapread 0x02dbb4 thru 0x02fe41 (0x228e bytes) 020000 1717018040.924887 read 0x030af6 thru 0x031c52 (0x115d bytes) 026000 1717018087.149264 mapread 0x30487e thru 0x30e729 (0x9eac bytes) 028000 1717018105.896388 trunc from 0x4d5012 to 0x0a62c2 (0x42ed4f bytes) 029000 1717018116.477428 read 0x029cc0 thru 0x02e9f8 (0x4d39 bytes) truncating to largest ever: 0x562a18 030000 1717018126.516842 write 0x31c0e0 thru 0x32a11f (0xe040 bytes) 037000 1717018209.514998 mapread 0x1cab0b thru 0x1d0484 (0x597a bytes) 038000 1717018219.665523 write 0x0c9ed1 thru 0x0ca761 (0x891 bytes) 040000 1717018241.871792 trunc from 0x3e14e1 to 0x0a17df (0x33fd01 bytes) 041000 1717018251.123732 mapwrite 0x4d7f45 thru 0x4d8496 (0x552 bytes) 044000 1717018285.375932 mapread 0x0e7c3c thru 0x0edcb2 (0x6077 bytes) 045000 1717018298.506195 read 0x1dae4a thru 0x1dafe5 (0x19c bytes) 046000 1717018312.339876 mapread 0x3cf6b2 thru 0x3d5d9c (0x66eb bytes) 048000 1717018336.991513 write 0x4fc812 thru 0x50c3b2 (0xfba1 bytes) 049000 1717018349.023420 read 0x2b7441 thru 0x2bdcdc (0x689c bytes) 050000 1717018360.803435 trunc from 0x4d52cf to 0x1123de (0x3c2ef0 bytes) 052000 1717018382.306625 write 0x5592f8 thru 0x562dff (0x9b08 bytes) 054000 1717018403.179948 mapwrite 0x53ef58 thru 0x54c53e (0xd5e7 bytes) 057000 1717018437.184059 write 0x1dbb0d thru 0x1dec12 (0x3106 bytes) 059000 1717018456.187268 write 0x0ca994 thru 0x0d8ca7 (0xe314 bytes) 060000 1717018466.006972 trunc from 0x422c52 to 0x1675f5 (0x2bb65c bytes) 061000 1717018473.898141 mapwrite 0x54977b thru 0x55280e (0x9094 bytes) 065000 1717018505.850369 mapwrite 0x124231 thru 0x126ad5 (0x28a5 bytes) 066000 1717018515.440894 mapwrite 0x3011c8 thru 0x303b39 (0x2972 bytes) truncating to largest ever: 0x562b47 067000 1717018524.581083 read 0x17b8db thru 0x18950d (0xdc33 bytes) 068000 1717018534.400143 mapread 0x12224c thru 0x126566 (0x431b bytes) 069000 1717018543.308280 write 0x50eaf7 thru 0x5101e7 (0x16f1 bytes) 070000 1717018552.581440 write 0x3df42d thru 0x3e4818 (0x53ec bytes) 073000 1717018578.871499 trunc from 0x4f0e24 to 0x0846d6 (0x46c74d bytes) 075000 1717018593.601633 write 0x152ee7 thru 0x15812c (0x5246 bytes) 078000 1717018618.214752 write 0x440e10 thru 0x450872 (0xfa63 bytes) 079000 1717018626.674097 trunc from 0x40b905 to 0x3198fd (0xf2007 bytes) 083000 1717018671.958161 mapwrite 0x2525d8 thru 0x255144 (0x2b6d bytes) 084000 1717018683.620560 read 0x35fe7d thru 0x36ae3b (0xafbf bytes) 086000 1717018708.257373 read 0x288b40 thru 0x296c6a (0xe12b bytes) 089000 1717018745.119855 mapread 0x29423c thru 0x295807 (0x15cc bytes) 091000 1717018765.978658 trunc from 0x4b0c96 to 0x31c6d7 (0x1945be bytes) 093000 1717018788.280705 read 0x23458c thru 0x2397fe (0x5273 bytes) 095000 1717018807.326094 mapwrite 0x1ba970 thru 0x1c40d4 (0x9765 bytes) 097000 1717018827.739821 trunc from 0x26108c to 0x0d75a8 (0x189ae3 bytes) 099000 1717018850.096837 read 0x1e91fd thru 0x1f7d2c (0xeb30 bytes) 100000 1717018862.032833 mapread 0x351cff thru 0x3618f6 (0xfbf8 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (1031s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:41:04 (1717018864) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1717018899.058731 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1717018908.136210 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1717018931.091332 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1717018943.987826 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1717018956.180218 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1717019020.094735 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1717019030.922214 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1717019042.002022 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1717019066.970313 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1717019077.723173 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1717019088.362650 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1717019116.073891 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1717019128.792017 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1717019155.022835 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1717019167.657624 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1717019181.011023 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1717019206.138919 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1717019219.227965 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1717019256.761098 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1717019303.793978 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1717019314.520995 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1717019326.643794 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1717019338.888126 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1717019349.881526 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1717019418.350915 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1717019430.622318 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1717019453.993240 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1717019495.545515 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1717019543.709502 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1717019566.338564 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1717019576.320424 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1717019601.407985 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1717019624.160180 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1717019646.468092 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1717019656.586995 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1717019668.233872 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1717019710.692487 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1717019720.077536 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1717019730.917766 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1717019752.564061 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1717019773.668697 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1717019785.889895 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1717019819.056047 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1717019836.945305 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1717019846.229443 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1717019855.075867 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1717019865.829635 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1717019878.957906 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1717019890.366335 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1717019901.679747 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1717019956.513454 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1717019969.288265 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1717019990.229659 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (1136s) == sanity-benchmark test complete, duration 2758 sec ===== 18:00:00 (1717020000)