-----============= acceptance-small: sanity-benchmark ============----- Tue Nov 5 10:48:38 EST 2024 excepting tests: skipping tests SLOW=no: iozone oleg211-client.virtnet: executing check_config_client /mnt/lustre oleg211-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg211-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b59a4000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b59a4000.idle_timeout=debug disable quota as required oleg211-server: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 10:48:48 (1730821728) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6877] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg211-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg211-client.virtnet at Tue Nov 5 10:48:49 EST 2024 waiting for dbench pid 8810 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 241 183.68 MB/sec warmup 1 sec latency 61.269 ms 20 473 165.58 MB/sec warmup 2 sec latency 47.170 ms 20 710 141.54 MB/sec warmup 3 sec latency 202.457 ms 20 806 107.40 MB/sec warmup 4 sec latency 276.233 ms 20 897 86.77 MB/sec warmup 5 sec latency 917.265 ms 20 938 72.76 MB/sec warmup 6 sec latency 1917.504 ms 20 978 63.17 MB/sec warmup 7 sec latency 2917.856 ms 20 1022 55.84 MB/sec warmup 8 sec latency 3917.973 ms 20 1064 50.33 MB/sec warmup 9 sec latency 4918.435 ms 20 1111 46.20 MB/sec warmup 10 sec latency 5918.552 ms 20 1151 42.07 MB/sec warmup 11 sec latency 6918.818 ms 20 1193 38.85 MB/sec warmup 12 sec latency 7918.959 ms 20 1226 35.91 MB/sec warmup 13 sec latency 8919.075 ms 20 1270 33.41 MB/sec warmup 14 sec latency 9919.254 ms 20 1320 31.26 MB/sec warmup 15 sec latency 10919.370 ms 20 1391 29.71 MB/sec warmup 16 sec latency 11919.751 ms 20 1460 28.34 MB/sec warmup 17 sec latency 12920.102 ms 20 1547 27.61 MB/sec warmup 18 sec latency 13920.531 ms 20 1621 26.82 MB/sec warmup 19 sec latency 14921.029 ms 20 1726 26.23 MB/sec warmup 20 sec latency 15921.144 ms 20 1828 25.51 MB/sec warmup 21 sec latency 16921.216 ms 20 1917 24.90 MB/sec warmup 22 sec latency 17921.340 ms 20 1998 24.28 MB/sec warmup 23 sec latency 18921.719 ms 20 2142 10.23 MB/sec execute 1 sec latency 20921.937 ms 20 2184 6.15 MB/sec execute 2 sec latency 21922.113 ms 20 2242 5.87 MB/sec execute 3 sec latency 22922.295 ms 20 2291 5.41 MB/sec execute 4 sec latency 23922.671 ms 20 2328 4.90 MB/sec execute 5 sec latency 24922.855 ms 20 2379 4.94 MB/sec execute 6 sec latency 25923.184 ms 20 2429 4.73 MB/sec execute 7 sec latency 26923.306 ms 20 2480 4.97 MB/sec execute 8 sec latency 27923.560 ms 20 2520 4.73 MB/sec execute 9 sec latency 28923.687 ms 20 2559 4.46 MB/sec execute 10 sec latency 29923.835 ms 20 2592 4.37 MB/sec execute 11 sec latency 30923.957 ms 20 2637 4.26 MB/sec execute 12 sec latency 31924.484 ms 20 2675 4.13 MB/sec execute 13 sec latency 32924.794 ms 20 2720 4.12 MB/sec execute 14 sec latency 33925.280 ms 20 2763 4.14 MB/sec execute 15 sec latency 34925.380 ms 20 2835 4.39 MB/sec execute 16 sec latency 35925.978 ms 20 2880 4.33 MB/sec execute 17 sec latency 36926.087 ms 20 2910 4.18 MB/sec execute 18 sec latency 37927.111 ms 20 2946 4.04 MB/sec execute 19 sec latency 38927.228 ms 20 2994 4.10 MB/sec execute 20 sec latency 39927.671 ms 20 3058 4.28 MB/sec execute 21 sec latency 40928.271 ms 20 3123 4.49 MB/sec execute 22 sec latency 41928.754 ms 20 3180 4.69 MB/sec execute 23 sec latency 42929.087 ms 20 3239 4.93 MB/sec execute 24 sec latency 43929.425 ms 20 3299 5.21 MB/sec execute 25 sec latency 44930.716 ms 20 3355 5.27 MB/sec execute 26 sec latency 45930.835 ms 20 3403 5.28 MB/sec execute 27 sec latency 46930.956 ms 20 3445 5.18 MB/sec execute 28 sec latency 47931.096 ms 20 3481 5.12 MB/sec execute 29 sec latency 48931.230 ms 20 3512 5.01 MB/sec execute 30 sec latency 49931.367 ms 20 3549 4.91 MB/sec execute 31 sec latency 50931.468 ms 20 3586 4.88 MB/sec execute 32 sec latency 51932.674 ms 20 3621 4.81 MB/sec execute 33 sec latency 52933.630 ms 20 3652 4.75 MB/sec execute 34 sec latency 53933.765 ms 20 3682 4.68 MB/sec execute 35 sec latency 54933.869 ms 20 3720 4.60 MB/sec execute 36 sec latency 55933.999 ms 20 3768 4.69 MB/sec execute 37 sec latency 56934.329 ms 20 3816 4.70 MB/sec execute 38 sec latency 57934.692 ms 20 3875 4.79 MB/sec execute 39 sec latency 58934.900 ms 20 3914 4.76 MB/sec execute 40 sec latency 59935.431 ms 20 3950 4.66 MB/sec execute 41 sec latency 60935.911 ms 20 3983 4.57 MB/sec execute 42 sec latency 61936.153 ms 20 4022 4.55 MB/sec execute 43 sec latency 62936.472 ms 20 4054 4.48 MB/sec execute 44 sec latency 63937.857 ms 20 4092 4.48 MB/sec execute 45 sec latency 64938.290 ms 20 4140 4.55 MB/sec execute 46 sec latency 65938.465 ms 20 4199 4.61 MB/sec execute 47 sec latency 66939.417 ms 20 4246 4.63 MB/sec execute 48 sec latency 67940.960 ms 20 4298 4.70 MB/sec execute 49 sec latency 68941.123 ms 20 4344 4.77 MB/sec execute 50 sec latency 69941.240 ms 20 4389 4.72 MB/sec execute 51 sec latency 70941.536 ms 20 4433 4.79 MB/sec execute 52 sec latency 71941.692 ms 20 4475 4.80 MB/sec execute 53 sec latency 72941.875 ms 20 4508 4.79 MB/sec execute 54 sec latency 73942.403 ms 20 4539 4.73 MB/sec execute 55 sec latency 74942.549 ms 20 4570 4.70 MB/sec execute 56 sec latency 75943.330 ms 20 4604 4.73 MB/sec execute 57 sec latency 76943.656 ms 20 4636 4.70 MB/sec execute 58 sec latency 77946.542 ms 20 4665 4.67 MB/sec execute 59 sec latency 78946.944 ms 20 4699 4.64 MB/sec execute 60 sec latency 79947.181 ms 20 4726 4.58 MB/sec execute 61 sec latency 80948.152 ms 20 4756 4.57 MB/sec execute 62 sec latency 81948.858 ms 20 4789 4.54 MB/sec execute 63 sec latency 82949.060 ms 20 4826 4.55 MB/sec execute 64 sec latency 83949.522 ms 20 4859 4.54 MB/sec execute 65 sec latency 84951.328 ms 20 4879 4.49 MB/sec execute 66 sec latency 85951.459 ms 20 4906 4.43 MB/sec execute 67 sec latency 86951.760 ms 20 4932 4.40 MB/sec execute 68 sec latency 87954.039 ms 20 4964 4.37 MB/sec execute 69 sec latency 88954.933 ms 20 5008 4.39 MB/sec execute 70 sec latency 89955.047 ms 20 5043 4.41 MB/sec execute 71 sec latency 90955.974 ms 20 5081 4.38 MB/sec execute 72 sec latency 91956.081 ms 20 5126 4.37 MB/sec execute 73 sec latency 92956.223 ms 20 5199 4.43 MB/sec execute 74 sec latency 93956.556 ms 20 5274 4.48 MB/sec execute 75 sec latency 94956.876 ms 20 5357 4.61 MB/sec execute 76 sec latency 95957.112 ms 20 5425 4.65 MB/sec execute 77 sec latency 96958.552 ms 20 5483 4.68 MB/sec execute 78 sec latency 97958.662 ms 20 5540 4.72 MB/sec execute 79 sec latency 98958.822 ms 20 5585 4.71 MB/sec execute 80 sec latency 99958.937 ms 20 5635 4.69 MB/sec execute 81 sec latency 100959.153 ms 20 5682 4.69 MB/sec execute 82 sec latency 101959.284 ms 20 5720 4.67 MB/sec execute 83 sec latency 102959.523 ms 20 5761 4.65 MB/sec execute 84 sec latency 103959.635 ms 20 5810 4.66 MB/sec execute 85 sec latency 104960.084 ms 20 5859 4.65 MB/sec execute 86 sec latency 105960.366 ms 20 5915 4.66 MB/sec execute 87 sec latency 106960.536 ms 20 5962 4.68 MB/sec execute 88 sec latency 107960.663 ms 20 6015 4.71 MB/sec execute 89 sec latency 108960.795 ms 20 6090 4.80 MB/sec execute 90 sec latency 109960.923 ms 20 6140 4.81 MB/sec execute 91 sec latency 110961.187 ms 20 6188 4.81 MB/sec execute 92 sec latency 111961.624 ms 20 6234 4.83 MB/sec execute 93 sec latency 112961.779 ms 20 6279 4.85 MB/sec execute 94 sec latency 113961.926 ms 20 6322 4.84 MB/sec execute 95 sec latency 114962.060 ms 20 6371 4.82 MB/sec execute 96 sec latency 115962.378 ms 20 6410 4.83 MB/sec execute 97 sec latency 116962.579 ms 20 6454 4.80 MB/sec execute 98 sec latency 117962.720 ms 20 6495 4.78 MB/sec execute 99 sec latency 118962.976 ms 20 6525 4.74 MB/sec execute 100 sec latency 119963.504 ms 20 6552 4.70 MB/sec execute 101 sec latency 120963.901 ms 20 6585 4.68 MB/sec execute 102 sec latency 121964.036 ms 20 6615 4.66 MB/sec execute 103 sec latency 122964.206 ms 20 6661 4.64 MB/sec execute 104 sec latency 123964.317 ms 20 6717 4.67 MB/sec execute 105 sec latency 124965.119 ms 20 6768 4.70 MB/sec execute 106 sec latency 125965.264 ms 20 6820 4.72 MB/sec execute 107 sec latency 126965.655 ms 20 6876 4.72 MB/sec execute 108 sec latency 127966.911 ms 20 6927 4.74 MB/sec execute 109 sec latency 128967.056 ms 20 6983 4.75 MB/sec execute 110 sec latency 129967.140 ms 20 7026 4.73 MB/sec execute 111 sec latency 130967.497 ms 20 7078 4.73 MB/sec execute 112 sec latency 131967.668 ms 20 7131 4.77 MB/sec execute 113 sec latency 132967.826 ms 20 7168 4.74 MB/sec execute 114 sec latency 133967.971 ms 20 7218 4.76 MB/sec execute 115 sec latency 134968.122 ms 20 7270 4.78 MB/sec execute 116 sec latency 135968.260 ms 20 7322 4.78 MB/sec execute 117 sec latency 136969.050 ms 20 7363 4.76 MB/sec execute 118 sec latency 137969.249 ms 20 7413 4.77 MB/sec execute 119 sec latency 138969.375 ms 20 cleanup 120 sec 17 cleanup 121 sec 15 cleanup 122 sec 10 cleanup 123 sec 5 cleanup 124 sec 0 cleanup 125 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 18789 89.700 143347.331 Close 13735 3.313 41.579 Rename 795 46.644 3909.119 Unlink 3825 27.122 12276.329 Qpathinfo 17054 2.728 72.989 Qfileinfo 2922 0.101 7.867 Qfsinfo 3083 0.093 6.988 Sfileinfo 1572 399.646 143712.430 Find 6499 0.682 34.445 WriteX 9232 1.325 32.808 ReadX 28615 0.018 2.554 LockX 60 41.646 675.455 UnlockX 60 36.047 952.924 Flush 1331 58.424 309.230 Throughput 4.77221 MB/sec 20 clients 20 procs max_latency=138969.375 ms stopping dbench on /mnt/lustre/d0.oleg211-client.virtnet at Tue Nov 5 10:51:18 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg211-client.virtnet /mnt/lustre/d0.oleg211-client.virtnet /mnt/lustre/d0.oleg211-client.virtnet removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg211-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:51:22 (1730821882) min OST has 3392512kB available, using 5088768kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6877] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4969] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg211-clien 4969M 122807 88 115649 91 227175 58 888.9 137 Latency 49116us 83248us 109ms 304ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg211-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 222 18 2087 16 387 14 264 18 376 15 478 14 Latency 16865us 22789us 64460us 17154us 9927us 10229us 1.97,1.97,oleg211-client.virtnet,1,1730811620,4969M,,,,122807,88,115649,91,,,227175,58,888.9,137,10,,,,,222,18,2087,16,387,14,264,18,376,15,478,14,,49116us,83248us,,109ms,304ms,16865us,22789us,64460us,17154us,9927us,10229us debug=0x33f0484 PASS bonnie (288s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 10:56:10 (1730822170) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 1011 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 1011 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2017a7 truncating to largest ever: 0x225a6f truncating to largest ever: 0x497288 truncating to largest ever: 0x54e5e9 truncating to largest ever: 0x55559b truncating to largest ever: 0x56290a 002000 1730822179.447402 mapread 0x02d0bf thru 0x035c2e (0x8b70 bytes) 003000 1730822183.484989 read 0x1681dc thru 0x176f9e (0xedc3 bytes) 004000 1730822187.287656 mapread 0x137e8c thru 0x13b382 (0x34f7 bytes) 005000 1730822191.701816 read 0x0507f0 thru 0x05ad6a (0xa57b bytes) 007000 1730822200.375869 mapwrite 0x4d2e49 thru 0x4d3e1a (0xfd2 bytes) 008000 1730822205.389969 trunc from 0x3ef37b to 0x55fc80 (0x170906 bytes) 009000 1730822208.831982 write 0x0bb872 thru 0x0c2477 (0x6c06 bytes) 010000 1730822211.770971 mapread 0x15a70a thru 0x167667 (0xcf5e bytes) 013000 1730822221.919400 mapread 0x2cee7d thru 0x2d25d9 (0x375d bytes) 016000 1730822231.199257 write 0x173c5e thru 0x173f1f (0x2c2 bytes) 017000 1730822234.722969 write 0x02fa81 thru 0x03abc2 (0xb142 bytes) 018000 1730822238.159632 mapread 0x0e2304 thru 0x0e9cc5 (0x79c2 bytes) 019000 1730822241.189546 trunc from 0x3a2dc8 to 0x18e6da (0x2146ed bytes) 020000 1730822244.903151 trunc from 0x380573 to 0x4d37cf (0x15325d bytes) 022000 1730822251.810310 read 0x12142f thru 0x1271b9 (0x5d8b bytes) 023000 1730822254.755421 mapwrite 0x0a037f thru 0x0aa92b (0xa5ad bytes) 024000 1730822257.550694 mapread 0x0c8fa4 thru 0x0cdcf5 (0x4d52 bytes) skipping zero size write 025000 1730822260.150923 read 0x1be211 thru 0x1be276 (0x66 bytes) 026000 1730822263.088150 read 0x19c1c7 thru 0x1a6749 (0xa583 bytes) 028000 1730822269.613881 read 0x41015e thru 0x41c106 (0xbfa9 bytes) 029000 1730822272.975590 mapwrite 0x3b7d96 thru 0x3c54ed (0xd758 bytes) truncating to largest ever: 0x562be2 031000 1730822278.939042 trunc from 0x23bae6 to 0x05dffc (0x1ddae9 bytes) 032000 1730822281.765695 read 0x351e90 thru 0x352830 (0x9a1 bytes) 034000 1730822287.870526 mapread 0x428dc2 thru 0x42d763 (0x49a2 bytes) 035000 1730822291.154222 read 0x15c489 thru 0x1606a2 (0x421a bytes) 036000 1730822294.047446 write 0x42ca9b thru 0x43b365 (0xe8cb bytes) 038000 1730822300.704796 mapwrite 0x313761 thru 0x3209a2 (0xd242 bytes) 039000 1730822304.626585 read 0x01c460 thru 0x01e4bf (0x2060 bytes) 040000 1730822307.907882 write 0x3a7c32 thru 0x3b2122 (0xa4f1 bytes) 041000 1730822311.346798 mapwrite 0x4dddf0 thru 0x4e0652 (0x2863 bytes) 044000 1730822319.563372 mapread 0x004433 thru 0x0057cf (0x139d bytes) 046000 1730822325.472354 write 0x4007cb thru 0x4069c9 (0x61ff bytes) 047000 1730822329.158065 mapwrite 0x4105b1 thru 0x4192f8 (0x8d48 bytes) 048000 1730822332.879275 mapread 0x147376 thru 0x153577 (0xc202 bytes) 049000 1730822336.185559 trunc from 0x473a0d to 0x316b55 (0x15ceb7 bytes) 050000 1730822340.093281 trunc from 0x317658 to 0x53f1da (0x227b83 bytes) 051000 1730822343.748519 read 0x42d8af thru 0x43c7cf (0xef21 bytes) 052000 1730822347.478293 mapwrite 0x0b2c30 thru 0x0b8347 (0x5718 bytes) 054000 1730822353.992665 mapwrite 0x08ee70 thru 0x098ef5 (0xa086 bytes) 055000 1730822356.906830 mapread 0x052f9a thru 0x05e23b (0xb2a2 bytes) 056000 1730822360.204742 mapwrite 0x3c06cb thru 0x3c657f (0x5eb5 bytes) truncating to largest ever: 0x562c93 059000 1730822369.562099 mapread 0x2f0156 thru 0x2ff508 (0xf3b3 bytes) 060000 1730822372.635769 trunc from 0x545c74 to 0x5344f5 (0x1177e bytes) 061000 1730822375.434846 mapread 0x1793d7 thru 0x1807be (0x73e8 bytes) 062000 1730822378.127647 mapwrite 0x264a70 thru 0x266400 (0x1991 bytes) 063000 1730822380.848303 write 0x138ab1 thru 0x13cd1f (0x426f bytes) 064000 1730822384.144735 mapread 0x0b1171 thru 0x0be6fb (0xd58b bytes) skipping zero size read 066000 1730822390.663250 write 0x1fec41 thru 0x202d15 (0x40d5 bytes) 067000 1730822394.518696 write 0x02f70a thru 0x039219 (0x9b10 bytes) 069000 1730822400.082676 mapread 0x2233f9 thru 0x225792 (0x239a bytes) 070000 1730822403.208476 trunc from 0x304244 to 0x357b60 (0x5391d bytes) 071000 1730822405.838695 mapwrite 0x412977 thru 0x41aec6 (0x8550 bytes) 077000 1730822424.486623 write 0x08001f thru 0x0849d5 (0x49b7 bytes) 078000 1730822428.019523 mapread 0x3e5833 thru 0x3ef90d (0xa0db bytes) 079000 1730822430.833217 trunc from 0x0dcb99 to 0x0477c4 (0x953d4 bytes) 081000 1730822437.417891 write 0x14822c thru 0x14a342 (0x2117 bytes) 084000 1730822448.114862 write 0x491a68 thru 0x492acc (0x1065 bytes) 085000 1730822450.730606 mapread 0x21df65 thru 0x2229e9 (0x4a85 bytes) 088000 1730822461.034445 trunc from 0x2b35d4 to 0x2d90ab (0x25ad8 bytes) 089000 1730822464.061634 mapread 0x1e1acc thru 0x1e9386 (0x78bb bytes) 091000 1730822470.883139 trunc from 0x0c3c82 to 0x3ec24c (0x3285cb bytes) 092000 1730822474.243089 write 0x2b8bb7 thru 0x2c1613 (0x8a5d bytes) 093000 1730822478.063379 trunc from 0x160d03 to 0x2ac3c8 (0x14b6c6 bytes) 095000 1730822485.481452 mapwrite 0x1f3477 thru 0x1fa3a5 (0x6f2f bytes) 096000 1730822488.793412 write 0x1d29d5 thru 0x1d4b07 (0x2133 bytes) 100000 1730822502.217900 trunc from 0x1b85b2 to 0x1245ac (0x94005 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (333s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 11:01:43 (1730822503) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1730822514.644077 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1730822517.714938 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1730822524.559318 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1730822528.471054 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1730822532.211569 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1730822553.527857 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1730822556.732941 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1730822560.108435 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1730822567.386344 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1730822570.742862 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1730822574.125003 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1730822581.564004 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1730822585.341050 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1730822592.919257 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1730822596.451747 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1730822599.654202 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1730822606.060605 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1730822609.578230 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1730822619.934899 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1730822633.704944 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1730822637.145875 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1730822640.990154 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1730822645.078389 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1730822648.705645 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1730822669.377210 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1730822672.750886 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1730822679.574162 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1730822694.715899 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1730822709.003959 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1730822716.330077 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1730822719.829913 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1730822727.129495 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1730822734.043111 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1730822740.861042 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1730822744.156959 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1730822747.767548 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1730822762.200707 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1730822765.509853 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1730822768.883521 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1730822775.978199 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1730822782.873019 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1730822786.611831 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1730822797.575648 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1730822804.410156 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1730822807.896356 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1730822811.700379 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1730822815.009211 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1730822818.670926 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1730822822.211064 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1730822825.621129 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1730822843.085664 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1730822846.909178 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1730822854.074927 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (355s) == sanity-benchmark test complete, duration 1139 sec ===== 11:07:38 (1730822858)