-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:56 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:00 (1734015840) === oleg229-client.virtnet: executing check_config_client /mnt/lustre oleg229-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg229-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012b2fe800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012b2fe800.idle_timeout=debug disable quota as required oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:09 (1734015849) === == sanity-benchmark test dbench: dbench ================== 10:04:10 (1734015850) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6995] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg229-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg229-client.virtnet at Thu Dec 12 10:04:12 EST 2024 waiting for dbench pid 9463 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 15 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 16 49 40.09 MB/sec warmup 1 sec latency 120.446 ms 20 126 56.68 MB/sec warmup 2 sec latency 215.495 ms 20 181 48.71 MB/sec warmup 3 sec latency 169.225 ms 20 238 45.57 MB/sec warmup 4 sec latency 173.447 ms 20 304 44.68 MB/sec warmup 5 sec latency 148.984 ms 20 371 44.11 MB/sec warmup 6 sec latency 128.968 ms 20 446 44.76 MB/sec warmup 7 sec latency 120.894 ms 20 523 45.33 MB/sec warmup 8 sec latency 113.724 ms 20 640 46.75 MB/sec warmup 9 sec latency 439.891 ms 20 681 42.34 MB/sec warmup 10 sec latency 224.710 ms 20 724 38.70 MB/sec warmup 11 sec latency 289.886 ms 20 767 35.58 MB/sec warmup 12 sec latency 179.543 ms 20 804 33.03 MB/sec warmup 13 sec latency 207.682 ms 20 849 30.80 MB/sec warmup 14 sec latency 319.290 ms 20 889 28.90 MB/sec warmup 15 sec latency 316.505 ms 20 923 27.25 MB/sec warmup 16 sec latency 306.208 ms 20 964 25.72 MB/sec warmup 17 sec latency 301.084 ms 20 1013 24.64 MB/sec warmup 18 sec latency 284.190 ms 20 1101 24.14 MB/sec warmup 19 sec latency 210.470 ms 20 1161 23.00 MB/sec warmup 20 sec latency 113.809 ms 20 1220 22.09 MB/sec warmup 21 sec latency 117.745 ms 20 1292 21.65 MB/sec warmup 22 sec latency 95.411 ms 20 1412 22.61 MB/sec warmup 23 sec latency 283.297 ms 20 1510 0.66 MB/sec execute 1 sec latency 228.214 ms 20 1559 0.86 MB/sec execute 2 sec latency 214.527 ms 20 1621 0.94 MB/sec execute 3 sec latency 166.977 ms 20 1666 0.88 MB/sec execute 4 sec latency 249.790 ms 20 1724 0.88 MB/sec execute 5 sec latency 199.239 ms 20 1778 0.89 MB/sec execute 6 sec latency 273.146 ms 20 1831 0.89 MB/sec execute 7 sec latency 196.662 ms 20 1882 0.88 MB/sec execute 8 sec latency 166.542 ms 20 1937 0.92 MB/sec execute 9 sec latency 214.377 ms 20 2001 0.96 MB/sec execute 10 sec latency 261.842 ms 20 2044 0.97 MB/sec execute 11 sec latency 114.810 ms 20 2092 1.02 MB/sec execute 12 sec latency 123.134 ms 20 2159 1.15 MB/sec execute 13 sec latency 131.155 ms 20 2208 1.39 MB/sec execute 14 sec latency 279.276 ms 20 2238 1.35 MB/sec execute 15 sec latency 887.786 ms 20 2295 1.76 MB/sec execute 16 sec latency 477.518 ms 20 2362 2.24 MB/sec execute 17 sec latency 436.647 ms 20 2407 2.27 MB/sec execute 18 sec latency 474.031 ms 20 2445 2.35 MB/sec execute 19 sec latency 382.892 ms 20 2481 2.54 MB/sec execute 20 sec latency 798.046 ms 20 2539 2.83 MB/sec execute 21 sec latency 504.413 ms 20 2605 3.25 MB/sec execute 22 sec latency 403.573 ms 20 2689 3.81 MB/sec execute 23 sec latency 409.897 ms 20 2794 4.70 MB/sec execute 24 sec latency 358.304 ms 20 2906 5.46 MB/sec execute 25 sec latency 354.599 ms 20 2980 5.69 MB/sec execute 26 sec latency 633.448 ms 20 3033 5.73 MB/sec execute 27 sec latency 428.717 ms 20 3109 5.70 MB/sec execute 28 sec latency 476.940 ms 20 3193 5.87 MB/sec execute 29 sec latency 485.857 ms 20 3285 6.05 MB/sec execute 30 sec latency 609.896 ms 20 3365 6.31 MB/sec execute 31 sec latency 463.878 ms 20 3451 6.72 MB/sec execute 32 sec latency 342.107 ms 20 3524 7.10 MB/sec execute 33 sec latency 249.709 ms 20 3596 7.38 MB/sec execute 34 sec latency 122.779 ms 20 3651 7.27 MB/sec execute 35 sec latency 111.745 ms 20 3686 7.11 MB/sec execute 36 sec latency 173.115 ms 20 3731 7.11 MB/sec execute 37 sec latency 148.885 ms 20 3769 7.04 MB/sec execute 38 sec latency 147.687 ms 20 3812 7.03 MB/sec execute 39 sec latency 147.266 ms 20 3845 6.88 MB/sec execute 40 sec latency 155.470 ms 20 3868 6.72 MB/sec execute 41 sec latency 173.025 ms 20 3901 6.60 MB/sec execute 42 sec latency 123.277 ms 20 3940 6.49 MB/sec execute 43 sec latency 141.219 ms 20 3977 6.37 MB/sec execute 44 sec latency 122.596 ms 20 4017 6.23 MB/sec execute 45 sec latency 130.651 ms 20 4041 6.10 MB/sec execute 46 sec latency 254.135 ms 20 4080 5.98 MB/sec execute 47 sec latency 342.123 ms 20 4116 5.86 MB/sec execute 48 sec latency 289.421 ms 20 4169 5.76 MB/sec execute 49 sec latency 342.320 ms 20 4205 5.66 MB/sec execute 50 sec latency 639.262 ms 20 4247 5.59 MB/sec execute 51 sec latency 647.150 ms 20 4276 5.50 MB/sec execute 52 sec latency 413.184 ms 20 4305 5.43 MB/sec execute 53 sec latency 504.932 ms 20 4323 5.34 MB/sec execute 54 sec latency 389.123 ms 20 4352 5.27 MB/sec execute 55 sec latency 375.010 ms 20 4386 5.21 MB/sec execute 56 sec latency 364.602 ms 20 4416 5.15 MB/sec execute 57 sec latency 297.490 ms 20 4459 5.10 MB/sec execute 58 sec latency 267.234 ms 20 4499 5.07 MB/sec execute 59 sec latency 267.982 ms 20 4536 5.01 MB/sec execute 60 sec latency 317.608 ms 20 4571 4.97 MB/sec execute 61 sec latency 401.790 ms 20 4610 4.96 MB/sec execute 62 sec latency 359.351 ms 20 4672 5.09 MB/sec execute 63 sec latency 343.704 ms 20 4738 5.16 MB/sec execute 64 sec latency 106.361 ms 20 4788 5.09 MB/sec execute 65 sec latency 365.755 ms 20 4833 5.07 MB/sec execute 66 sec latency 275.906 ms 20 4893 5.14 MB/sec execute 67 sec latency 349.273 ms 20 4980 5.47 MB/sec execute 68 sec latency 133.348 ms 20 5030 5.54 MB/sec execute 69 sec latency 277.328 ms 20 5070 5.47 MB/sec execute 70 sec latency 249.508 ms 20 5103 5.40 MB/sec execute 71 sec latency 244.925 ms 20 5147 5.33 MB/sec execute 72 sec latency 243.357 ms 20 5182 5.27 MB/sec execute 73 sec latency 172.200 ms 20 5217 5.21 MB/sec execute 74 sec latency 194.540 ms 20 5258 5.15 MB/sec execute 75 sec latency 265.896 ms 20 5296 5.09 MB/sec execute 76 sec latency 351.286 ms 20 5329 5.03 MB/sec execute 77 sec latency 176.795 ms 20 5375 4.97 MB/sec execute 78 sec latency 217.510 ms 20 5413 4.92 MB/sec execute 79 sec latency 155.711 ms 20 5445 4.87 MB/sec execute 80 sec latency 240.464 ms 20 5488 4.82 MB/sec execute 81 sec latency 336.542 ms 20 5549 4.77 MB/sec execute 82 sec latency 221.517 ms 20 5611 4.74 MB/sec execute 83 sec latency 177.119 ms 20 5658 4.72 MB/sec execute 84 sec latency 190.468 ms 20 5710 4.69 MB/sec execute 85 sec latency 267.256 ms 20 5764 4.66 MB/sec execute 86 sec latency 257.991 ms 20 5810 4.64 MB/sec execute 87 sec latency 239.061 ms 20 5872 4.67 MB/sec execute 88 sec latency 268.605 ms 20 5945 4.75 MB/sec execute 89 sec latency 347.380 ms 20 6000 4.79 MB/sec execute 90 sec latency 459.468 ms 20 6060 4.84 MB/sec execute 91 sec latency 306.273 ms 20 6139 4.90 MB/sec execute 92 sec latency 301.958 ms 20 6230 5.04 MB/sec execute 93 sec latency 276.368 ms 20 6340 5.15 MB/sec execute 94 sec latency 272.691 ms 20 6465 5.48 MB/sec execute 95 sec latency 324.244 ms 20 6573 5.57 MB/sec execute 96 sec latency 331.308 ms 20 6687 5.66 MB/sec execute 97 sec latency 367.092 ms 20 6767 5.72 MB/sec execute 98 sec latency 335.863 ms 20 6893 5.77 MB/sec execute 99 sec latency 402.983 ms 20 6981 5.93 MB/sec execute 100 sec latency 347.940 ms 20 7056 5.97 MB/sec execute 101 sec latency 344.673 ms 20 7164 6.23 MB/sec execute 102 sec latency 86.206 ms 20 7222 6.19 MB/sec execute 103 sec latency 82.059 ms 20 7289 6.21 MB/sec execute 104 sec latency 95.256 ms 20 7326 6.17 MB/sec execute 105 sec latency 169.175 ms 20 7382 6.20 MB/sec execute 106 sec latency 102.629 ms 20 7427 6.16 MB/sec execute 107 sec latency 100.390 ms 20 7469 6.11 MB/sec execute 108 sec latency 93.778 ms 20 7517 6.08 MB/sec execute 109 sec latency 91.454 ms 20 7545 6.03 MB/sec execute 110 sec latency 408.636 ms 20 7586 5.97 MB/sec execute 111 sec latency 390.734 ms 20 7621 5.92 MB/sec execute 112 sec latency 260.998 ms 20 7667 5.88 MB/sec execute 113 sec latency 309.487 ms 20 7712 5.83 MB/sec execute 114 sec latency 254.960 ms 20 7760 5.79 MB/sec execute 115 sec latency 348.914 ms 20 7809 5.76 MB/sec execute 116 sec latency 412.270 ms 20 7838 5.72 MB/sec execute 117 sec latency 380.965 ms 20 7871 5.68 MB/sec execute 118 sec latency 249.468 ms 20 7904 5.66 MB/sec execute 119 sec latency 367.903 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 22657 55.059 226.680 Close 16345 13.762 70.019 Rename 884 84.097 208.387 Unlink 4694 18.760 84.878 Qpathinfo 20863 12.929 167.891 Qfileinfo 3584 0.199 25.803 Qfsinfo 3698 0.205 19.795 Sfileinfo 1510 50.454 209.692 Find 7871 3.984 166.188 WriteX 10955 4.319 76.441 ReadX 34896 0.029 6.832 LockX 80 17.813 43.644 UnlockX 80 17.526 40.510 Flush 1560 215.678 887.778 Throughput 5.65933 MB/sec 20 clients 20 procs max_latency=887.786 ms stopping dbench on /mnt/lustre/d0.oleg229-client.virtnet at Thu Dec 12 10:06:39 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg229-client.virtnet /mnt/lustre/d0.oleg229-client.virtnet /mnt/lustre/d0.oleg229-client.virtnet removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg229-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:46 (1734016006) min OST has 3621888kB available, using 5432832kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6995] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5305] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg229-clien 5305M 78481 59 54359 47 122731 32 497.4 113 Latency 31276us 159ms 80403us 434ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg229-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 273 18 7693 33 383 13 344 18 908 12 500 12 Latency 17467us 15830us 57919us 14208us 4894us 17060us 1.97,1.97,oleg229-client.virtnet,1,1734006053,5305M,,,,78481,59,54359,47,,,122731,32,497.4,113,10,,,,,273,18,7693,33,383,13,344,18,908,12,500,12,,31276us,159ms,,80403us,434ms,17467us,15830us,57919us,14208us,4894us,17060us debug=0x33f0484 PASS bonnie (364s) == sanity-benchmark test iozone: iozone ================== 10:12:50 (1734016370) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6995] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:10 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 115360 103323 103731 133254 64190 90098 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:39 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 27462 27593 108080 105877 93446 35262 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1167s) == sanity-benchmark test fsx: fsx ======================== 10:32:17 (1734017537) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 4191 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 4191 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x25e77c truncating to largest ever: 0x472d81 truncating to largest ever: 0x4e97e7 truncating to largest ever: 0x534645 truncating to largest ever: 0x55fd74 002000 1734017542.870749 write 0x3400e2 thru 0x348875 (0x8794 bytes) 003000 1734017545.216783 write 0x4f2bbc thru 0x4f58f6 (0x2d3b bytes) 004000 1734017547.806045 mapread 0x1d6bc8 thru 0x1dfc3f (0x9078 bytes) 009000 1734017561.853035 read 0x125624 thru 0x12a00a (0x49e7 bytes) 010000 1734017564.255268 read 0x345a7d thru 0x34d873 (0x7df7 bytes) 011000 1734017567.033554 read 0x36f0f5 thru 0x37a70e (0xb61a bytes) 013000 1734017572.496473 mapwrite 0x1cfa3e thru 0x1d03e3 (0x9a6 bytes) 014000 1734017574.890804 mapread 0x04af5b thru 0x05ae49 (0xfeef bytes) truncating to largest ever: 0x56120c 015000 1734017577.620784 read 0x1cade9 thru 0x1d1bb1 (0x6dc9 bytes) 021000 1734017594.326598 mapwrite 0x16dc09 thru 0x16e9ee (0xde6 bytes) 025000 1734017606.309350 trunc from 0x559017 to 0x14755b (0x411abb bytes) 026000 1734017609.275175 mapwrite 0x2483a0 thru 0x248cea (0x94b bytes) 027000 1734017612.416806 mapwrite 0x491410 thru 0x49fb30 (0xe721 bytes) 028000 1734017614.960026 read 0x15d5a9 thru 0x167b2b (0xa583 bytes) 030000 1734017620.497445 mapread 0x19b030 thru 0x1a581b (0xa7ec bytes) 031000 1734017623.186966 write 0x10d893 thru 0x112918 (0x5086 bytes) 033000 1734017628.672896 read 0x1dac09 thru 0x1e0939 (0x5d31 bytes) 035000 1734017634.071631 write 0x36db66 thru 0x36ed0d (0x11a8 bytes) 037000 1734017639.531860 mapread 0x443050 thru 0x4512ff (0xe2b0 bytes) 038000 1734017642.154027 mapread 0x4578dc thru 0x457e94 (0x5b9 bytes) 039000 1734017644.923193 read 0x059965 thru 0x060378 (0x6a14 bytes) 040000 1734017647.618027 write 0x0f7a4e thru 0x101ef2 (0xa4a5 bytes) truncating to largest ever: 0x561403 truncating to largest ever: 0x561982 049000 1734017673.008847 mapwrite 0x4e4de7 thru 0x4f0559 (0xb773 bytes) truncating to largest ever: 0x561b40 051000 1734017678.996066 mapwrite 0x248eb9 thru 0x24fad6 (0x6c1e bytes) 052000 1734017682.026828 mapwrite 0x31d16a thru 0x326d4c (0x9be3 bytes) 054000 1734017687.109711 read 0x17d957 thru 0x18298c (0x5036 bytes) 056000 1734017692.432631 mapwrite 0x4dc9bd thru 0x4ec6a4 (0xfce8 bytes) 058000 1734017697.673831 mapwrite 0x46ef45 thru 0x46efd2 (0x8e bytes) 059000 1734017700.470208 read 0x311f78 thru 0x320ba5 (0xec2e bytes) 062000 1734017708.829504 mapwrite 0x174fe2 thru 0x175ae2 (0xb01 bytes) 063000 1734017711.972935 read 0x25adc7 thru 0x2655ea (0xa824 bytes) 064000 1734017714.729781 mapread 0x3d66f5 thru 0x3d7b8e (0x149a bytes) 065000 1734017717.070647 trunc from 0x435496 to 0x2689e5 (0x1ccab0 bytes) 066000 1734017719.944648 mapread 0x25fc98 thru 0x265e9c (0x6205 bytes) 068000 1734017725.737784 trunc from 0x46e6a9 to 0x4f1fc1 (0x83919 bytes) 069000 1734017728.552099 read 0x008f8e thru 0x015394 (0xc407 bytes) 070000 1734017731.094540 mapread 0x251ffd thru 0x25b1d0 (0x91d4 bytes) 071000 1734017733.889740 trunc from 0x52cb1e to 0x0fd53b (0x42f5e2 bytes) 075000 1734017745.266711 mapread 0x1acf4c thru 0x1b2069 (0x511e bytes) 078000 1734017753.546993 trunc from 0x55b860 to 0x454056 (0x107809 bytes) 079000 1734017756.282138 write 0x416e65 thru 0x42289d (0xba39 bytes) 080000 1734017759.020798 mapwrite 0x3b37d7 thru 0x3b4d57 (0x1581 bytes) 082000 1734017764.425550 trunc from 0x1289f5 to 0x39a790 (0x271d9c bytes) 083000 1734017767.186264 read 0x0a65ef thru 0x0aa97a (0x438c bytes) 085000 1734017772.742364 write 0x429167 thru 0x42b9fe (0x2898 bytes) 088000 1734017780.755872 write 0x4d1ae1 thru 0x4d2c34 (0x1154 bytes) 089000 1734017783.230661 write 0x1840c6 thru 0x18f8c1 (0xb7fc bytes) 091000 1734017788.273009 write 0x3575b3 thru 0x367276 (0xfcc4 bytes) 092000 1734017790.916160 mapread 0x243f89 thru 0x24af89 (0x7001 bytes) 095000 1734017798.913500 write 0x48b427 thru 0x48d657 (0x2231 bytes) 096000 1734017801.357963 mapread 0x0407e6 thru 0x04cd4f (0xc56a bytes) 097000 1734017804.295900 write 0x279cbc thru 0x288909 (0xec4e bytes) 098000 1734017806.752468 mapread 0x1c843f thru 0x1d234b (0x9f0d bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5234540 (5120 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (278s) == sanity-benchmark test complete, duration 1979 sec ===== 10:36:55 (1734017815) === sanity-benchmark: start cleanup 10:36:56 (1734017816) === === sanity-benchmark: finish cleanup 10:36:57 (1734017817) ===