-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:47 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:52 (1734015832) === oleg312-client.virtnet: executing check_config_client /mnt/lustre oleg312-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg312-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6e36800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6e36800.idle_timeout=debug disable quota as required oleg312-server: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:04 (1734015844) === == sanity-benchmark test dbench: dbench ================== 10:04:05 (1734015845) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7729] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg312-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg312-client.virtnet at Thu Dec 12 10:04:07 EST 2024 waiting for dbench pid 10313 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 1 8 2.09 MB/sec warmup 1 sec latency 903.621 ms 20 87 39.08 MB/sec warmup 2 sec latency 185.014 ms 20 148 42.08 MB/sec warmup 3 sec latency 203.827 ms 20 209 40.92 MB/sec warmup 4 sec latency 138.764 ms 20 276 41.33 MB/sec warmup 5 sec latency 139.079 ms 20 349 41.79 MB/sec warmup 6 sec latency 106.198 ms 20 418 42.17 MB/sec warmup 7 sec latency 113.278 ms 20 494 43.08 MB/sec warmup 8 sec latency 113.691 ms 20 602 45.19 MB/sec warmup 9 sec latency 147.666 ms 20 668 42.30 MB/sec warmup 10 sec latency 593.693 ms 20 715 38.60 MB/sec warmup 11 sec latency 250.120 ms 20 754 35.54 MB/sec warmup 12 sec latency 280.505 ms 20 797 33.01 MB/sec warmup 13 sec latency 273.055 ms 20 865 30.86 MB/sec warmup 14 sec latency 203.651 ms 20 905 28.92 MB/sec warmup 15 sec latency 344.871 ms 20 959 27.25 MB/sec warmup 16 sec latency 253.532 ms 20 1015 26.31 MB/sec warmup 17 sec latency 281.893 ms 20 1106 25.49 MB/sec warmup 18 sec latency 86.377 ms 20 1174 24.21 MB/sec warmup 19 sec latency 95.890 ms 20 1239 23.06 MB/sec warmup 20 sec latency 82.617 ms 20 1395 24.63 MB/sec warmup 21 sec latency 92.178 ms 20 1460 23.65 MB/sec warmup 22 sec latency 274.307 ms 20 1515 22.66 MB/sec warmup 23 sec latency 335.093 ms 20 1657 0.96 MB/sec execute 1 sec latency 250.140 ms 20 1716 0.88 MB/sec execute 2 sec latency 125.758 ms 20 1811 1.18 MB/sec execute 3 sec latency 84.696 ms 20 1866 1.02 MB/sec execute 4 sec latency 325.194 ms 20 1930 1.17 MB/sec execute 5 sec latency 274.305 ms 20 2002 1.15 MB/sec execute 6 sec latency 83.017 ms 20 2077 1.36 MB/sec execute 7 sec latency 83.951 ms 20 2143 1.33 MB/sec execute 8 sec latency 94.789 ms 20 2205 1.56 MB/sec execute 9 sec latency 80.748 ms 20 2295 2.56 MB/sec execute 10 sec latency 499.175 ms 20 2358 3.18 MB/sec execute 11 sec latency 406.819 ms 20 2398 3.07 MB/sec execute 12 sec latency 387.748 ms 20 2433 3.08 MB/sec execute 13 sec latency 450.171 ms 20 2476 3.40 MB/sec execute 14 sec latency 424.269 ms 20 2545 3.60 MB/sec execute 15 sec latency 697.924 ms 20 2655 4.82 MB/sec execute 16 sec latency 325.456 ms 20 2819 7.12 MB/sec execute 17 sec latency 316.831 ms 20 2928 7.99 MB/sec execute 18 sec latency 417.407 ms 20 2986 7.74 MB/sec execute 19 sec latency 409.326 ms 20 3027 7.44 MB/sec execute 20 sec latency 853.334 ms 20 3203 7.79 MB/sec execute 21 sec latency 398.168 ms 20 3306 8.33 MB/sec execute 22 sec latency 431.082 ms 20 3395 8.44 MB/sec execute 23 sec latency 228.263 ms 20 3556 10.21 MB/sec execute 24 sec latency 74.081 ms 20 3653 10.01 MB/sec execute 25 sec latency 64.666 ms 20 3724 9.88 MB/sec execute 26 sec latency 77.696 ms 20 3794 10.07 MB/sec execute 27 sec latency 147.720 ms 20 3840 9.72 MB/sec execute 28 sec latency 101.002 ms 20 3895 9.47 MB/sec execute 29 sec latency 91.195 ms 20 3952 9.26 MB/sec execute 30 sec latency 94.838 ms 20 3997 8.96 MB/sec execute 31 sec latency 103.200 ms 20 4029 8.68 MB/sec execute 32 sec latency 159.478 ms 20 4080 8.43 MB/sec execute 33 sec latency 130.846 ms 20 4151 8.20 MB/sec execute 34 sec latency 323.334 ms 20 4224 8.03 MB/sec execute 35 sec latency 366.676 ms 20 4251 7.85 MB/sec execute 36 sec latency 435.803 ms 20 4296 7.69 MB/sec execute 37 sec latency 198.904 ms 20 4330 7.53 MB/sec execute 38 sec latency 244.634 ms 20 4372 7.40 MB/sec execute 39 sec latency 299.716 ms 20 4419 7.26 MB/sec execute 40 sec latency 230.779 ms 20 4470 7.15 MB/sec execute 41 sec latency 271.359 ms 20 4511 7.04 MB/sec execute 42 sec latency 347.982 ms 20 4573 7.02 MB/sec execute 43 sec latency 216.566 ms 20 4664 7.22 MB/sec execute 44 sec latency 171.967 ms 20 4735 7.09 MB/sec execute 45 sec latency 127.840 ms 20 4802 7.09 MB/sec execute 46 sec latency 138.844 ms 20 4881 7.27 MB/sec execute 47 sec latency 110.319 ms 20 4986 7.90 MB/sec execute 48 sec latency 253.647 ms 20 5031 7.74 MB/sec execute 49 sec latency 247.742 ms 20 5077 7.60 MB/sec execute 50 sec latency 626.913 ms 20 5135 7.47 MB/sec execute 51 sec latency 235.590 ms 20 5177 7.35 MB/sec execute 52 sec latency 216.474 ms 20 5225 7.22 MB/sec execute 53 sec latency 346.416 ms 20 5280 7.10 MB/sec execute 54 sec latency 249.495 ms 20 5345 6.99 MB/sec execute 55 sec latency 95.080 ms 20 5395 6.89 MB/sec execute 56 sec latency 175.895 ms 20 5448 6.78 MB/sec execute 57 sec latency 318.079 ms 20 5528 6.69 MB/sec execute 58 sec latency 376.273 ms 20 5596 6.61 MB/sec execute 59 sec latency 73.810 ms 20 5677 6.55 MB/sec execute 60 sec latency 82.193 ms 20 5750 6.49 MB/sec execute 61 sec latency 180.978 ms 20 5828 6.47 MB/sec execute 62 sec latency 256.755 ms 20 5915 6.62 MB/sec execute 63 sec latency 328.434 ms 20 5960 6.56 MB/sec execute 64 sec latency 421.445 ms 20 6006 6.51 MB/sec execute 65 sec latency 310.589 ms 20 6074 6.61 MB/sec execute 66 sec latency 287.006 ms 20 6182 6.70 MB/sec execute 67 sec latency 308.400 ms 20 6321 7.24 MB/sec execute 68 sec latency 266.828 ms 20 6466 7.48 MB/sec execute 69 sec latency 299.690 ms 20 6550 7.58 MB/sec execute 70 sec latency 374.020 ms 20 6614 7.53 MB/sec execute 71 sec latency 357.443 ms 20 6781 7.63 MB/sec execute 72 sec latency 450.500 ms 20 6901 7.84 MB/sec execute 73 sec latency 451.083 ms 20 6993 7.95 MB/sec execute 74 sec latency 203.431 ms 20 7125 8.38 MB/sec execute 75 sec latency 88.702 ms 20 7195 8.33 MB/sec execute 76 sec latency 81.791 ms 20 7262 8.28 MB/sec execute 77 sec latency 90.623 ms 20 7320 8.32 MB/sec execute 78 sec latency 151.939 ms 20 7373 8.28 MB/sec execute 79 sec latency 131.545 ms 20 7419 8.19 MB/sec execute 80 sec latency 104.531 ms 20 7475 8.14 MB/sec execute 81 sec latency 107.716 ms 20 7526 8.05 MB/sec execute 82 sec latency 90.542 ms 20 7564 7.95 MB/sec execute 83 sec latency 128.552 ms 20 7610 7.86 MB/sec execute 84 sec latency 270.452 ms 20 7664 7.77 MB/sec execute 85 sec latency 312.556 ms 20 7747 7.70 MB/sec execute 86 sec latency 315.946 ms 20 7792 7.64 MB/sec execute 87 sec latency 450.792 ms 20 7833 7.57 MB/sec execute 88 sec latency 218.928 ms 20 7868 7.51 MB/sec execute 89 sec latency 279.646 ms 20 7915 7.45 MB/sec execute 90 sec latency 305.051 ms 20 7953 7.39 MB/sec execute 91 sec latency 300.777 ms 20 8012 7.35 MB/sec execute 92 sec latency 282.966 ms 20 8054 7.29 MB/sec execute 93 sec latency 282.831 ms 20 8095 7.24 MB/sec execute 94 sec latency 417.053 ms 20 8157 7.26 MB/sec execute 95 sec latency 320.627 ms 20 8249 7.33 MB/sec execute 96 sec latency 237.819 ms 20 8325 7.30 MB/sec execute 97 sec latency 168.499 ms 20 8407 7.33 MB/sec execute 98 sec latency 237.680 ms 20 8513 7.58 MB/sec execute 99 sec latency 247.478 ms 20 8588 7.62 MB/sec execute 100 sec latency 258.252 ms 20 8647 7.55 MB/sec execute 101 sec latency 268.996 ms 20 8710 7.49 MB/sec execute 102 sec latency 174.680 ms 20 8763 7.43 MB/sec execute 103 sec latency 207.422 ms 20 8823 7.36 MB/sec execute 104 sec latency 211.452 ms 20 8881 7.30 MB/sec execute 105 sec latency 157.465 ms 20 8942 7.24 MB/sec execute 106 sec latency 176.161 ms 20 9004 7.19 MB/sec execute 107 sec latency 200.169 ms 20 9083 7.13 MB/sec execute 108 sec latency 296.611 ms 20 9164 7.10 MB/sec execute 109 sec latency 244.774 ms 20 9250 7.06 MB/sec execute 110 sec latency 243.053 ms 20 9335 7.03 MB/sec execute 111 sec latency 304.902 ms 20 9435 7.09 MB/sec execute 112 sec latency 209.796 ms 20 9530 7.14 MB/sec execute 113 sec latency 237.390 ms 20 9613 7.18 MB/sec execute 114 sec latency 269.652 ms 20 9729 7.28 MB/sec execute 115 sec latency 203.077 ms 20 9899 7.56 MB/sec execute 116 sec latency 263.164 ms 20 10065 7.76 MB/sec execute 117 sec latency 246.772 ms 20 10204 7.83 MB/sec execute 118 sec latency 231.339 ms 20 10375 7.93 MB/sec execute 119 sec latency 263.794 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 29627 40.398 181.633 Close 22324 10.012 75.031 Rename 1285 61.123 191.578 Unlink 5589 13.437 71.437 Qpathinfo 28080 9.853 174.168 Qfileinfo 5163 0.159 15.012 Qfsinfo 4946 0.176 28.144 Sfileinfo 2320 39.033 122.862 Find 11059 2.174 133.294 WriteX 15421 4.312 97.398 ReadX 50306 0.026 8.480 LockX 120 10.042 25.648 UnlockX 120 10.395 32.707 Flush 2072 175.261 853.324 Throughput 7.92726 MB/sec 20 clients 20 procs max_latency=853.334 ms stopping dbench on /mnt/lustre/d0.oleg312-client.virtnet at Thu Dec 12 10:06:33 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg312-client.virtnet /mnt/lustre/d0.oleg312-client.virtnet /mnt/lustre/d0.oleg312-client.virtnet removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg312-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:40 (1734016000) min OST has 3219456kB available, using 4829184kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7729] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4716] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg312-clien 4716M 87640 65 61580 49 137367 32 577.4 114 Latency 17040us 164ms 106ms 390ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg312-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 224 17 7044 31 369 12 332 17 846 12 460 12 Latency 26358us 15830us 53798us 16951us 6700us 27292us 1.97,1.97,oleg312-client.virtnet,1,1734004868,4716M,,,,87640,65,61580,49,,,137367,32,577.4,114,10,,,,,224,17,7044,31,369,12,332,17,846,12,460,12,,17040us,164ms,,106ms,390ms,26358us,15830us,53798us,16951us,6700us,27292us debug=0x33f0484 PASS bonnie (331s) == sanity-benchmark test iozone: iozone ================== 10:12:11 (1734016331) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7729] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:34 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 176679 158852 150340 176515 72701 120765 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:33 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 26015 24498 111642 114663 96754 32297 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1124s) == sanity-benchmark test fsx: fsx ======================== 10:30:55 (1734017455) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 4885 -P /tmp -l 5642496 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 4885 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x526b86 truncating to largest ever: 0x539760 truncating to largest ever: 0x5446f4 truncating to largest ever: 0x55ac4c truncating to largest ever: 0x56094a 003000 1734017462.740242 write 0x244af0 thru 0x24af80 (0x6491 bytes) 004000 1734017465.239464 write 0x2e6be5 thru 0x2eb4cb (0x48e7 bytes) truncating to largest ever: 0x5618aa 007000 1734017472.313158 read 0x37e4e1 thru 0x38b351 (0xce71 bytes) 009000 1734017477.330864 mapwrite 0x34c994 thru 0x358746 (0xbdb3 bytes) 010000 1734017480.001637 write 0x0089fe thru 0x00be40 (0x3443 bytes) 012000 1734017485.247260 trunc from 0x43abed to 0x30ff71 (0x12ac7b bytes) 013000 1734017487.840594 read 0x1ff173 thru 0x2004fa (0x1388 bytes) 014000 1734017490.157114 trunc from 0x30885a to 0x30dd36 (0x54dd bytes) 015000 1734017492.962391 write 0x206e99 thru 0x2073c6 (0x52e bytes) 016000 1734017495.523499 write 0x5419f0 thru 0x547332 (0x5943 bytes) 017000 1734017498.311371 mapread 0x458e61 thru 0x45c6d8 (0x3878 bytes) 019000 1734017503.560219 trunc from 0x2159a7 to 0x3c7159 (0x1b17b3 bytes) 021000 1734017509.192649 write 0x17ec15 thru 0x180113 (0x14ff bytes) 023000 1734017515.751498 read 0x04932b thru 0x04b0d0 (0x1da6 bytes) 025000 1734017522.160049 mapread 0x050037 thru 0x052484 (0x244e bytes) 026000 1734017525.082779 mapread 0x1a3cef thru 0x1abb3f (0x7e51 bytes) 027000 1734017528.397936 read 0x012440 thru 0x01e357 (0xbf18 bytes) 029000 1734017534.230632 write 0x04a868 thru 0x04de7a (0x3613 bytes) 030000 1734017537.096036 mapwrite 0x3e0482 thru 0x3e4340 (0x3ebf bytes) skipping zero size read 031000 1734017540.159733 mapread 0x50c602 thru 0x51acbc (0xe6bb bytes) 032000 1734017543.301580 write 0x1b2097 thru 0x1bf9d2 (0xd93c bytes) 033000 1734017545.894098 write 0x2fdeaf thru 0x3022ca (0x441c bytes) 034000 1734017548.991163 trunc from 0x2651e1 to 0x3c94e1 (0x164301 bytes) 035000 1734017551.619549 read 0x3572ad thru 0x358981 (0x16d5 bytes) 036000 1734017555.024615 mapread 0x129814 thru 0x12d774 (0x3f61 bytes) 039000 1734017563.354711 read 0x0a9eba thru 0x0b1e65 (0x7fac bytes) 040000 1734017566.054739 trunc from 0x2b15c4 to 0x26ec40 (0x42983 bytes) 042000 1734017571.608581 mapread 0x330faf thru 0x33d4a7 (0xc4f9 bytes) 044000 1734017577.222898 write 0x510ceb thru 0x515b49 (0x4e5f bytes) 045000 1734017580.450895 read 0x271648 thru 0x27877d (0x7136 bytes) 046000 1734017583.082263 mapread 0x13195f thru 0x134de6 (0x3488 bytes) 048000 1734017588.781653 mapread 0x4391b1 thru 0x445cf6 (0xcb46 bytes) 049000 1734017591.519411 mapread 0x23b93c thru 0x240429 (0x4aee bytes) 051000 1734017597.365410 trunc from 0x4f48af to 0x55c55e (0x67cb0 bytes) 052000 1734017600.311187 trunc from 0x4d9f04 to 0x262f1f (0x276fe4 bytes) 057000 1734017614.524270 mapread 0x0214c5 thru 0x0279d7 (0x6513 bytes) 058000 1734017617.445906 mapread 0x416c0f thru 0x425664 (0xea56 bytes) 059000 1734017620.214915 mapread 0x07e0ed thru 0x08949b (0xb3af bytes) 061000 1734017625.771603 mapread 0x1dac1a thru 0x1e342f (0x8816 bytes) 062000 1734017628.280969 mapwrite 0x0de379 thru 0x0ec1ee (0xde76 bytes) 063000 1734017631.095516 read 0x12c97b thru 0x12d2df (0x965 bytes) 065000 1734017636.475882 write 0x411ebe thru 0x41be3c (0x9f7f bytes) 066000 1734017639.347396 mapwrite 0x5034bc thru 0x50867c (0x51c1 bytes) 067000 1734017641.815709 mapwrite 0x1cc2ab thru 0x1d2db3 (0x6b09 bytes) 068000 1734017644.539774 trunc from 0x4382a1 to 0x3d6c74 (0x6162c bytes) 070000 1734017650.148286 write 0x2ba56c thru 0x2c2117 (0x7bac bytes) 080000 1734017676.291748 read 0x29b710 thru 0x29ca8e (0x137f bytes) 082000 1734017681.278090 mapread 0x193665 thru 0x199026 (0x59c2 bytes) 083000 1734017683.743398 mapwrite 0x39853f thru 0x3995bd (0x107f bytes) 085000 1734017688.921538 mapwrite 0x227990 thru 0x2279b5 (0x26 bytes) 086000 1734017691.522367 mapwrite 0x53c8a4 thru 0x543911 (0x706e bytes) 087000 1734017693.753112 trunc from 0x4e37b2 to 0x428a30 (0xbad81 bytes) 088000 1734017696.325959 write 0x2d6972 thru 0x2db1eb (0x487a bytes) 093000 1734017709.057695 mapwrite 0x17ec7a thru 0x183b2b (0x4eb2 bytes) 094000 1734017711.782532 write 0x2e376e thru 0x2e9ff0 (0x6883 bytes) 095000 1734017714.069035 trunc from 0x3b1d3b to 0x3ca8b4 (0x18b7a bytes) 096000 1734017716.430876 mapread 0x0f47ff thru 0x0fccf7 (0x84f9 bytes) 099000 1734017723.884346 trunc from 0x4923a2 to 0x51d9d6 (0x8b635 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5043190 (4992 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (272s) == sanity-benchmark test complete, duration 1900 sec ===== 10:35:27 (1734017727) === sanity-benchmark: start cleanup 10:35:27 (1734017727) === === sanity-benchmark: finish cleanup 10:35:28 (1734017728) ===