-----============= acceptance-small: sanity-benchmark ============----- Fri May 31 06:55:14 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg133-client.virtnet: executing check_config_client /mnt/lustre oleg133-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg133-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aa8f7800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aa8f7800.idle_timeout=debug disable quota as required oleg133-server: oleg133-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 06:55:25 (1717152925) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7463] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg133-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg133-client.virtnet at Fri May 31 06:55:25 EDT 2024 waiting for dbench pid 9602 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 226 174.63 MB/sec warmup 1 sec latency 47.210 ms 20 470 164.43 MB/sec warmup 2 sec latency 42.168 ms 20 665 141.01 MB/sec warmup 3 sec latency 567.364 ms 20 902 108.44 MB/sec warmup 4 sec latency 652.632 ms 20 1229 92.28 MB/sec warmup 5 sec latency 25.118 ms 20 1599 87.16 MB/sec warmup 6 sec latency 42.056 ms 20 1938 75.55 MB/sec warmup 7 sec latency 112.037 ms 20 2287 68.31 MB/sec warmup 8 sec latency 154.582 ms 20 2600 66.54 MB/sec warmup 9 sec latency 1086.798 ms 20 3002 66.51 MB/sec warmup 10 sec latency 2087.000 ms 20 3292 63.09 MB/sec warmup 11 sec latency 3087.181 ms 20 3578 60.29 MB/sec warmup 12 sec latency 4087.353 ms 20 3884 59.26 MB/sec warmup 13 sec latency 5087.443 ms 20 4130 55.80 MB/sec warmup 14 sec latency 6087.536 ms 20 4397 53.40 MB/sec warmup 15 sec latency 7087.721 ms 20 4742 53.27 MB/sec warmup 16 sec latency 8087.936 ms 20 5052 52.99 MB/sec warmup 17 sec latency 9088.041 ms 20 5262 50.55 MB/sec warmup 18 sec latency 10088.156 ms 20 5452 48.51 MB/sec warmup 19 sec latency 11088.303 ms 20 5715 47.99 MB/sec warmup 20 sec latency 12088.455 ms 20 5968 46.13 MB/sec warmup 21 sec latency 13088.552 ms 20 6237 45.00 MB/sec warmup 22 sec latency 14088.812 ms 20 6621 45.61 MB/sec warmup 23 sec latency 15088.902 ms 20 7101 5.73 MB/sec execute 1 sec latency 17089.078 ms 20 7334 14.38 MB/sec execute 2 sec latency 18089.391 ms 20 7646 23.22 MB/sec execute 3 sec latency 19089.524 ms 20 7921 21.30 MB/sec execute 4 sec latency 20089.629 ms 20 8216 23.44 MB/sec execute 5 sec latency 21089.715 ms 20 8540 28.24 MB/sec execute 6 sec latency 22090.107 ms 20 8828 31.29 MB/sec execute 7 sec latency 23090.227 ms 20 9014 29.23 MB/sec execute 8 sec latency 24090.370 ms 20 9187 26.79 MB/sec execute 9 sec latency 25090.516 ms 20 9408 26.06 MB/sec execute 10 sec latency 26090.600 ms 20 9659 26.50 MB/sec execute 11 sec latency 27090.673 ms 20 9905 24.98 MB/sec execute 12 sec latency 28090.796 ms 20 10154 25.35 MB/sec execute 13 sec latency 29090.976 ms 20 10505 27.33 MB/sec execute 14 sec latency 30091.088 ms 20 10750 28.23 MB/sec execute 15 sec latency 31091.195 ms 20 10933 26.87 MB/sec execute 16 sec latency 32091.361 ms 20 11100 25.79 MB/sec execute 17 sec latency 33091.454 ms 20 11356 26.47 MB/sec execute 18 sec latency 34091.594 ms 20 11585 25.72 MB/sec execute 19 sec latency 35091.732 ms 20 11830 25.08 MB/sec execute 20 sec latency 36091.847 ms 20 12116 25.88 MB/sec execute 21 sec latency 37091.962 ms 20 12472 27.25 MB/sec execute 22 sec latency 38092.054 ms 20 12686 27.29 MB/sec execute 23 sec latency 39092.240 ms 20 12867 26.60 MB/sec execute 24 sec latency 40092.338 ms 20 13062 26.22 MB/sec execute 25 sec latency 41092.474 ms 20 13280 26.26 MB/sec execute 26 sec latency 42092.598 ms 20 13537 26.04 MB/sec execute 27 sec latency 43092.715 ms 20 13824 25.73 MB/sec execute 28 sec latency 44092.802 ms 20 14183 26.65 MB/sec execute 29 sec latency 45093.090 ms 20 14515 27.50 MB/sec execute 30 sec latency 46093.170 ms 20 14749 27.02 MB/sec execute 31 sec latency 47093.513 ms 20 14965 26.70 MB/sec execute 32 sec latency 48093.722 ms 20 15259 27.06 MB/sec execute 33 sec latency 49093.874 ms 20 15541 26.46 MB/sec execute 34 sec latency 50093.979 ms 20 15905 27.08 MB/sec execute 35 sec latency 51094.128 ms 20 16320 28.04 MB/sec execute 36 sec latency 52094.197 ms 20 16632 28.09 MB/sec execute 37 sec latency 53094.258 ms 20 16931 28.09 MB/sec execute 38 sec latency 54094.332 ms 20 17242 28.51 MB/sec execute 39 sec latency 55094.441 ms 20 17561 28.20 MB/sec execute 40 sec latency 56094.513 ms 20 17906 28.76 MB/sec execute 41 sec latency 57094.611 ms 20 18311 29.42 MB/sec execute 42 sec latency 58094.694 ms 20 18537 28.98 MB/sec execute 43 sec latency 59094.787 ms 20 18784 28.69 MB/sec execute 44 sec latency 60094.873 ms 20 19088 28.83 MB/sec execute 45 sec latency 61094.943 ms 20 19414 28.58 MB/sec execute 46 sec latency 62095.013 ms 20 19782 29.21 MB/sec execute 47 sec latency 63095.102 ms 20 20215 29.86 MB/sec execute 48 sec latency 64095.187 ms 20 20482 29.65 MB/sec execute 49 sec latency 65095.283 ms 20 20762 29.49 MB/sec execute 50 sec latency 66095.352 ms 20 21091 29.65 MB/sec execute 51 sec latency 67095.483 ms 20 21414 29.52 MB/sec execute 52 sec latency 68095.705 ms 20 21822 30.18 MB/sec execute 53 sec latency 69095.806 ms 20 22175 30.58 MB/sec execute 54 sec latency 70096.047 ms 20 22399 30.13 MB/sec execute 55 sec latency 71096.147 ms 20 22656 29.92 MB/sec execute 56 sec latency 72096.243 ms 20 22940 29.95 MB/sec execute 57 sec latency 73096.327 ms 20 23243 29.74 MB/sec execute 58 sec latency 74096.509 ms 20 23618 30.33 MB/sec execute 59 sec latency 75096.842 ms 20 24030 30.83 MB/sec execute 60 sec latency 76096.996 ms 20 24256 30.49 MB/sec execute 61 sec latency 77097.197 ms 20 24502 30.35 MB/sec execute 62 sec latency 78097.440 ms 20 24809 30.48 MB/sec execute 63 sec latency 79097.532 ms 20 25127 30.25 MB/sec execute 64 sec latency 80097.615 ms 20 25521 30.69 MB/sec execute 65 sec latency 81097.771 ms 20 25928 31.17 MB/sec execute 66 sec latency 82097.973 ms 20 26190 30.92 MB/sec execute 67 sec latency 83098.189 ms 20 26462 30.78 MB/sec execute 68 sec latency 84098.259 ms 20 26794 30.85 MB/sec execute 69 sec latency 85098.342 ms 20 27147 30.72 MB/sec execute 70 sec latency 86098.474 ms 20 27594 31.28 MB/sec execute 71 sec latency 87098.552 ms 20 27915 31.45 MB/sec execute 72 sec latency 88098.656 ms 20 28172 31.27 MB/sec execute 73 sec latency 89098.733 ms 20 28482 31.34 MB/sec execute 74 sec latency 90098.827 ms 20 28764 31.14 MB/sec execute 75 sec latency 91099.224 ms 20 29088 31.06 MB/sec execute 76 sec latency 92099.318 ms 20 29528 31.62 MB/sec execute 77 sec latency 93099.401 ms 20 29817 31.74 MB/sec execute 78 sec latency 94099.466 ms 20 30072 31.46 MB/sec execute 79 sec latency 95099.546 ms 20 30346 31.45 MB/sec execute 80 sec latency 96099.642 ms 20 30603 31.32 MB/sec execute 81 sec latency 97099.725 ms 20 30915 31.17 MB/sec execute 82 sec latency 98099.794 ms 20 31346 31.60 MB/sec execute 83 sec latency 99099.856 ms 20 31691 31.86 MB/sec execute 84 sec latency 100100.267 ms 20 31925 31.64 MB/sec execute 85 sec latency 101100.339 ms 20 32241 31.67 MB/sec execute 86 sec latency 102100.433 ms 20 32550 31.59 MB/sec execute 87 sec latency 103100.546 ms 20 32897 31.52 MB/sec execute 88 sec latency 104100.616 ms 20 33372 32.02 MB/sec execute 89 sec latency 105100.693 ms 20 33638 31.93 MB/sec execute 90 sec latency 106100.940 ms 20 33902 31.74 MB/sec execute 91 sec latency 107101.036 ms 20 34248 31.92 MB/sec execute 92 sec latency 108101.116 ms 20 34591 31.81 MB/sec execute 93 sec latency 109101.206 ms 20 34956 32.03 MB/sec execute 94 sec latency 110101.418 ms 20 35349 32.31 MB/sec execute 95 sec latency 111101.545 ms 20 35605 32.24 MB/sec execute 96 sec latency 112101.689 ms 20 35833 32.02 MB/sec execute 97 sec latency 113101.772 ms 20 36115 32.02 MB/sec execute 98 sec latency 114101.838 ms 20 36424 31.85 MB/sec execute 99 sec latency 115101.941 ms 20 36808 32.00 MB/sec execute 100 sec latency 116102.033 ms 20 37268 32.38 MB/sec execute 101 sec latency 117102.110 ms 20 37530 32.26 MB/sec execute 102 sec latency 118102.182 ms 20 37815 32.16 MB/sec execute 103 sec latency 119102.259 ms 20 38143 32.19 MB/sec execute 104 sec latency 120102.320 ms 20 38534 32.16 MB/sec execute 105 sec latency 121102.428 ms 20 39024 32.59 MB/sec execute 106 sec latency 122102.489 ms 20 39308 32.70 MB/sec execute 107 sec latency 123102.571 ms 20 39585 32.59 MB/sec execute 108 sec latency 124102.691 ms 20 39862 32.54 MB/sec execute 109 sec latency 125102.874 ms 20 40154 32.49 MB/sec execute 110 sec latency 126102.960 ms 20 40453 32.33 MB/sec execute 111 sec latency 127103.044 ms 20 40864 32.60 MB/sec execute 112 sec latency 128103.113 ms 20 41207 32.76 MB/sec execute 113 sec latency 129103.188 ms 20 41434 32.56 MB/sec execute 114 sec latency 130103.290 ms 20 41708 32.51 MB/sec execute 115 sec latency 131103.365 ms 20 41995 32.47 MB/sec execute 116 sec latency 132103.437 ms 20 42306 32.35 MB/sec execute 117 sec latency 133103.509 ms 20 42734 32.60 MB/sec execute 118 sec latency 134103.597 ms 20 43086 32.73 MB/sec execute 119 sec latency 135103.687 ms 20 cleanup 120 sec 2 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 126542 9.807 137017.900 Close 92706 7.620 136007.455 Rename 5326 9.831 349.035 Unlink 25755 3.936 2288.107 Qpathinfo 114488 1.345 37.052 Qfileinfo 19882 0.053 4.271 Qfsinfo 20989 0.024 3.316 Sfileinfo 10272 9.256 27330.994 Find 44232 0.298 33.894 WriteX 62184 0.831 27.365 ReadX 197347 0.010 2.715 LockX 410 2.126 65.267 UnlockX 410 4.878 585.925 Flush 8871 6.497 134.620 Throughput 32.7348 MB/sec 20 clients 20 procs max_latency=135103.687 ms stopping dbench on /mnt/lustre/d0.oleg133-client.virtnet at Fri May 31 06:57:51 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg133-client.virtnet /mnt/lustre/d0.oleg133-client.virtnet /mnt/lustre/d0.oleg133-client.virtnet removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg133-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 06:57:53 (1717153073) min OST has 3506928kB available, using 5260392kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7463] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5137] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg133-clien 5137M 162448 98 150597 98 278842 54 2802 187 Latency 4287us 68487us 42080us 25953us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg133-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 506 18 4000 18 795 15 463 17 640 15 825 13 Latency 18911us 4853us 17930us 15095us 8912us 18612us 1.97,1.97,oleg133-client.virtnet,1,1717143485,5137M,,,,162448,98,150597,98,,,278842,54,2802,187,10,,,,,506,18,4000,18,795,15,463,17,640,15,825,13,,4287us,68487us,,42080us,25953us,18911us,4853us,17930us,15095us,8912us,18612us debug=0x33f0484 PASS bonnie (180s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 07:00:54 (1717153254) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 16466 -P /tmp -l 5397960 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 16466 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x3c7ddf fallocating to largest ever: 0x507879 truncating to largest ever: 0x51799d fallocating to largest ever: 0x525dc8 001000 1717153257.550636 punch from 0x153bc8 to 0x15ca78 (0x8eb1 bytes) 002000 1717153259.639811 trunc from 0x2352ea to 0x1f0b25 (0x447c4 bytes) 003000 1717153261.726756 read 0x30bbcd thru 0x316ead (0xb2e1 bytes) 004000 1717153263.929865 fallocate 0x1150f0 thru 0x11d8b3 (0x87c4 bytes) 006000 1717153268.490384 fallocate 0x41332a thru 0x421423 (0xe0fa bytes) 007000 1717153270.806726 fallocate 0x14e2a0 thru 0x1513a9 (0x310a bytes) 009000 1717153275.145971 read 0x118247 thru 0x11f05b (0x6e15 bytes) 010000 1717153277.188647 fallocate 0x05ea5b thru 0x0632c7 (0x486d bytes) 011000 1717153279.467214 mapwrite 0x0e7e42 thru 0x0edf14 (0x60d3 bytes) 012000 1717153281.421936 fallocate 0x428258 thru 0x43802a (0xfdd3 bytes) 013000 1717153283.665087 mapread 0x300879 thru 0x302b74 (0x22fc bytes) 014000 1717153285.944188 mapread 0x19a001 thru 0x1a4011 (0xa011 bytes) 016000 1717153290.314020 fallocate 0x2d035b thru 0x2dc354 (0xbffa bytes) 017000 1717153292.350896 punch from 0x225105 to 0x233417 (0xe313 bytes) 018000 1717153294.654155 mapread 0x465034 thru 0x471559 (0xc526 bytes) 019000 1717153296.701845 punch from 0x02ff61 to 0x03d180 (0xd220 bytes) 021000 1717153301.331111 write 0x2844e4 thru 0x284e10 (0x92d bytes) 022000 1717153303.295990 mapread 0x09a7d9 thru 0x0a40ec (0x9914 bytes) 023000 1717153305.225764 fallocate 0x252433 thru 0x255548 (0x3116 bytes) 024000 1717153307.515032 punch from 0x10ed2e to 0x116ec1 (0x8194 bytes) 025000 1717153310.009939 mapread 0x27a9de thru 0x27c76a (0x1d8d bytes) 026000 1717153312.568060 read 0x270546 thru 0x27791c (0x73d7 bytes) 027000 1717153314.863593 trunc from 0x036180 to 0x2c2739 (0x28c5ba bytes) 028000 1717153317.294939 mapwrite 0x1d07ae thru 0x1d1bef (0x1442 bytes) 029000 1717153319.596916 punch from 0x0b4b1b to 0x0bbc86 (0x716c bytes) 031000 1717153324.435428 mapwrite 0x0ef379 thru 0x0f3e55 (0x4add bytes) 032000 1717153326.719912 write 0x01bac8 thru 0x020e14 (0x534d bytes) 033000 1717153329.031496 trunc from 0x41b6e5 to 0x323c9f (0xf7a45 bytes) 034000 1717153331.378469 punch from 0x08236a to 0x08d584 (0xb21b bytes) 035000 1717153333.779724 fallocate 0x51c602 thru 0x525dc7 (0x97c6 bytes) 036000 1717153335.924372 read 0x0ba2d9 thru 0x0c8992 (0xe6ba bytes) 037000 1717153338.174481 mapread 0x03477f thru 0x037051 (0x28d3 bytes) 038000 1717153340.547210 write 0x0841af thru 0x08495f (0x7b1 bytes) 039000 1717153343.131432 write 0x347c9c thru 0x357c61 (0xffc6 bytes) 040000 1717153345.865829 read 0x0c9924 thru 0x0caeab (0x1588 bytes) 041000 1717153348.470560 read 0x0d9b5a thru 0x0e323b (0x96e2 bytes) 042000 1717153350.812100 mapwrite 0x28b25b thru 0x28f3c6 (0x416c bytes) 045000 1717153357.750466 punch from 0x30ff5d to 0x3145ab (0x464f bytes) 046000 1717153360.137093 punch from 0x06568b to 0x073810 (0xe186 bytes) 047000 1717153362.574254 trunc from 0x4ddbf0 to 0x4a2812 (0x3b3dd bytes) 048000 1717153365.016695 trunc from 0x4ca7bd to 0x2926a1 (0x23811b bytes) 049000 1717153367.259256 punch from 0x3c745e to 0x3d45ec (0xd18f bytes) 050000 1717153369.535211 fallocate 0x44e48e thru 0x453ff5 (0x5b68 bytes) 051000 1717153371.556023 fallocate 0x09ebe0 thru 0x0ad6d1 (0xeaf2 bytes) 052000 1717153373.941183 write 0x19bd39 thru 0x1a99c1 (0xdc89 bytes) 053000 1717153376.193769 mapread 0x478ba7 thru 0x4802e3 (0x773d bytes) 054000 1717153378.668016 write 0x25b712 thru 0x25e999 (0x3288 bytes) 056000 1717153383.113010 write 0x01056b thru 0x017ee8 (0x797e bytes) 057000 1717153385.455006 trunc from 0x4b1995 to 0x23029c (0x2816f8 bytes) 058000 1717153387.676642 mapwrite 0x42ac46 thru 0x4358a4 (0xac5f bytes) 059000 1717153389.810966 write 0x3cbe6d thru 0x3d32ca (0x745e bytes) 060000 1717153392.303121 trunc from 0x4de82e to 0x320daa (0x1bda83 bytes) 062000 1717153396.671697 read 0x4b128c thru 0x4c0bb1 (0xf926 bytes) 063000 1717153399.155006 fallocate 0x3ccf0f thru 0x3dc6c3 (0xf7b5 bytes) 064000 1717153401.635013 write 0x2ccbde thru 0x2cec8e (0x20b1 bytes) 066000 1717153406.419665 write 0x1e06a6 thru 0x1e4772 (0x40cd bytes) 067000 1717153408.410830 write 0x21d9ef thru 0x22b544 (0xdb56 bytes) 068000 1717153410.625027 trunc from 0x4d1ba5 to 0x4a2683 (0x2f521 bytes) 070000 1717153415.404740 fallocate 0x237bb0 thru 0x23da65 (0x5eb6 bytes) 071000 1717153417.755255 write 0x0de7f6 thru 0x0ed705 (0xef10 bytes) 072000 1717153420.362698 read 0x26913a thru 0x275e2f (0xccf6 bytes) 073000 1717153422.692480 trunc from 0x42a507 to 0x39639f (0x94167 bytes) 074000 1717153424.892744 read 0x4859af thru 0x48799e (0x1ff0 bytes) 076000 1717153429.251226 punch from 0x0fcdd1 to 0x10ade3 (0xe013 bytes) 077000 1717153431.744970 punch from 0x08c3d1 to 0x08faa9 (0x36d9 bytes) 078000 1717153434.694599 write 0x08f0bf thru 0x09687d (0x77bf bytes) 079000 1717153437.214008 mapread 0x04e912 thru 0x054cb2 (0x63a1 bytes) 080000 1717153439.615355 write 0x2c8aa1 thru 0x2cb9f5 (0x2f55 bytes) 081000 1717153441.768893 fallocate 0x3511c8 thru 0x35e53a (0xd373 bytes) 082000 1717153444.070000 mapwrite 0x0d3e06 thru 0x0e1339 (0xd534 bytes) 083000 1717153446.297754 trunc from 0x4e8be1 to 0x1dd8f8 (0x30b2e8 bytes) 084000 1717153448.866237 mapwrite 0x0cac45 thru 0x0da48e (0xf84a bytes) 085000 1717153451.222586 mapread 0x0d997a thru 0x0dae7e (0x1505 bytes) 086000 1717153453.577843 trunc from 0x28bf5b to 0x2ffc61 (0x73d07 bytes) 087000 1717153455.821003 fallocate 0x3099a0 thru 0x314159 (0xa7ba bytes) 088000 1717153457.857571 fallocate 0x4f222d thru 0x4f4aa9 (0x287d bytes) 089000 1717153460.317642 read 0x132cbe thru 0x13e57d (0xb8c0 bytes) 090000 1717153462.679590 write 0x328c54 thru 0x335611 (0xc9be bytes) 091000 1717153465.741795 trunc from 0x4fa889 to 0x260262 (0x29a626 bytes) 092000 1717153467.976846 punch from 0x01e8f7 to 0x02bf25 (0xd62f bytes) 093000 1717153470.361749 mapread 0x1c0227 thru 0x1cf9b3 (0xf78d bytes) 094000 1717153472.871288 mapwrite 0x3cdb52 thru 0x3dd7e4 (0xfc93 bytes) 095000 1717153475.068495 write 0x0df6aa thru 0x0e280e (0x3165 bytes) 096000 1717153477.345299 trunc from 0x461b39 to 0x0783f4 (0x3e9744 bytes) 097000 1717153479.559697 mapread 0x03e1da thru 0x046c24 (0x8a4b bytes) 098000 1717153481.828394 write 0x1fa41e thru 0x209e00 (0xf9e3 bytes) 099000 1717153484.019259 mapwrite 0x3ba6fe thru 0x3bff43 (0x5846 bytes) 100000 1717153486.561179 write 0x2074b5 thru 0x20a306 (0x2e52 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (233s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 07:04:47 (1717153487) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1717153490.883839 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1717153493.246815 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1717153504.375650 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1717153507.361538 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1717153510.287307 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1717153513.227979 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1717153516.058245 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1717153521.610965 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1717153524.294119 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1717153529.861087 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1717153534.156154 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1717153540.754237 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1717153543.105432 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1717153549.014969 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1717153551.687570 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1717153554.345846 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1717153557.193563 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1717153559.639420 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1717153562.544462 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1717153565.177919 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1717153567.852072 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1717153573.281814 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1717153576.048271 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1717153578.791667 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1717153581.479978 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1717153584.095131 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1717153586.961820 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1717153589.593862 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1717153592.244497 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1717153595.288461 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1717153598.140857 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1717153600.680771 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1717153605.683086 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1717153608.480569 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1717153610.948218 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1717153613.584384 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1717153622.378556 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1717153625.104536 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1717153627.622843 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1717153630.255229 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1717153632.713741 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1717153635.479345 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1717153640.784771 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1717153643.415894 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1717153646.269011 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1717153654.912910 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1717153660.596869 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1717153663.225089 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1717153665.855321 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1717153671.290229 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1717153676.942123 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1717153680.007851 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1717153683.030235 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1717153688.738816 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1717153691.308217 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1717153694.201414 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1717153696.711882 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1717153699.356720 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1717153701.956076 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1717153707.423193 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1717153713.068496 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1717153715.584419 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1717153717.990770 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1717153720.837615 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1717153725.983148 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1717153731.446277 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1717153737.004033 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1717153739.603300 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1717153743.376312 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1717153747.396630 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1717153751.204045 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1717153756.840645 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1717153759.595737 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1717153762.503104 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1717153768.537952 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (282s) == sanity-benchmark test complete, duration 855 sec ====== 07:09:29 (1717153769)