-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:06 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:14 (1734015854) === oleg204-client.virtnet: executing check_config_client /mnt/lustre oleg204-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg204-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b62b2000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b62b2000.idle_timeout=debug disable quota as required oleg204-server: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:32 (1734015872) === == sanity-benchmark test dbench: dbench ================== 10:04:33 (1734015873) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7729] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg204-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg204-client.virtnet at Thu Dec 12 10:04:35 EST 2024 waiting for dbench pid 10320 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 1 11 6.01 MB/sec warmup 1 sec latency 932.764 ms 7 43 16.33 MB/sec warmup 2 sec latency 725.951 ms 20 119 35.04 MB/sec warmup 3 sec latency 283.218 ms 20 167 34.42 MB/sec warmup 4 sec latency 238.027 ms 20 215 33.51 MB/sec warmup 5 sec latency 174.176 ms 20 270 33.70 MB/sec warmup 6 sec latency 198.079 ms 20 321 33.46 MB/sec warmup 7 sec latency 131.741 ms 20 374 33.41 MB/sec warmup 8 sec latency 149.904 ms 20 429 33.42 MB/sec warmup 9 sec latency 150.204 ms 20 495 34.32 MB/sec warmup 10 sec latency 362.714 ms 20 544 33.74 MB/sec warmup 11 sec latency 215.031 ms 20 622 34.54 MB/sec warmup 12 sec latency 404.036 ms 20 675 32.54 MB/sec warmup 13 sec latency 372.003 ms 20 708 30.29 MB/sec warmup 14 sec latency 253.474 ms 20 738 28.41 MB/sec warmup 15 sec latency 396.044 ms 20 770 26.69 MB/sec warmup 16 sec latency 284.202 ms 20 795 25.22 MB/sec warmup 17 sec latency 452.513 ms 20 812 23.87 MB/sec warmup 18 sec latency 509.063 ms 20 841 22.65 MB/sec warmup 19 sec latency 258.223 ms 20 884 21.65 MB/sec warmup 20 sec latency 335.278 ms 20 920 20.73 MB/sec warmup 21 sec latency 317.678 ms 20 954 19.89 MB/sec warmup 22 sec latency 475.080 ms 20 995 19.16 MB/sec warmup 23 sec latency 395.997 ms 20 1090 13.58 MB/sec execute 1 sec latency 572.005 ms 20 1154 8.98 MB/sec execute 2 sec latency 111.319 ms 20 1206 7.16 MB/sec execute 3 sec latency 124.436 ms 20 1252 6.31 MB/sec execute 4 sec latency 487.936 ms 20 1290 5.71 MB/sec execute 5 sec latency 180.387 ms 20 1394 11.58 MB/sec execute 6 sec latency 326.449 ms 20 1441 10.79 MB/sec execute 7 sec latency 424.856 ms 20 1489 9.50 MB/sec execute 8 sec latency 330.457 ms 20 1518 8.48 MB/sec execute 9 sec latency 630.075 ms 20 1557 7.72 MB/sec execute 10 sec latency 215.021 ms 20 1608 7.10 MB/sec execute 11 sec latency 377.125 ms 20 1650 6.55 MB/sec execute 12 sec latency 320.298 ms 20 1685 6.11 MB/sec execute 13 sec latency 394.808 ms 20 1720 5.70 MB/sec execute 14 sec latency 381.190 ms 20 1770 5.38 MB/sec execute 15 sec latency 227.170 ms 20 1821 5.10 MB/sec execute 16 sec latency 252.318 ms 20 1862 4.85 MB/sec execute 17 sec latency 242.332 ms 20 1903 4.60 MB/sec execute 18 sec latency 329.607 ms 20 1939 4.41 MB/sec execute 19 sec latency 444.892 ms 20 1968 4.23 MB/sec execute 20 sec latency 1133.664 ms 20 2039 4.10 MB/sec execute 21 sec latency 468.970 ms 20 2098 4.04 MB/sec execute 22 sec latency 114.728 ms 20 2155 3.96 MB/sec execute 23 sec latency 329.949 ms 20 2208 3.92 MB/sec execute 24 sec latency 403.353 ms 20 2261 3.93 MB/sec execute 25 sec latency 356.116 ms 20 2332 4.17 MB/sec execute 26 sec latency 443.242 ms 20 2389 4.28 MB/sec execute 27 sec latency 412.085 ms 20 2432 4.33 MB/sec execute 28 sec latency 470.793 ms 20 2480 4.31 MB/sec execute 29 sec latency 404.975 ms 20 2536 4.56 MB/sec execute 30 sec latency 548.979 ms 20 2613 4.75 MB/sec execute 31 sec latency 355.600 ms 20 2696 5.21 MB/sec execute 32 sec latency 516.533 ms 20 2819 5.95 MB/sec execute 33 sec latency 479.421 ms 20 2922 6.37 MB/sec execute 34 sec latency 422.515 ms 20 3010 6.50 MB/sec execute 35 sec latency 466.928 ms 20 3066 6.45 MB/sec execute 36 sec latency 514.991 ms 20 3193 6.60 MB/sec execute 37 sec latency 507.746 ms 20 3301 6.87 MB/sec execute 38 sec latency 378.245 ms 20 3381 7.03 MB/sec execute 39 sec latency 526.176 ms 20 3461 7.20 MB/sec execute 40 sec latency 290.598 ms 20 3586 7.94 MB/sec execute 41 sec latency 106.566 ms 20 3666 7.88 MB/sec execute 42 sec latency 80.937 ms 20 3726 7.81 MB/sec execute 43 sec latency 120.069 ms 20 3784 7.84 MB/sec execute 44 sec latency 137.325 ms 20 3828 7.80 MB/sec execute 45 sec latency 187.348 ms 20 3871 7.63 MB/sec execute 46 sec latency 120.391 ms 20 3919 7.53 MB/sec execute 47 sec latency 106.689 ms 20 3961 7.41 MB/sec execute 48 sec latency 163.715 ms 20 3998 7.27 MB/sec execute 49 sec latency 189.966 ms 20 4032 7.12 MB/sec execute 50 sec latency 511.067 ms 20 4088 6.99 MB/sec execute 51 sec latency 548.153 ms 20 4137 6.87 MB/sec execute 52 sec latency 393.021 ms 20 4203 6.76 MB/sec execute 53 sec latency 275.934 ms 20 4244 6.67 MB/sec execute 54 sec latency 590.434 ms 20 4267 6.57 MB/sec execute 55 sec latency 611.451 ms 20 4304 6.48 MB/sec execute 56 sec latency 320.288 ms 20 4332 6.39 MB/sec execute 57 sec latency 333.012 ms 20 4378 6.32 MB/sec execute 58 sec latency 333.040 ms 20 4409 6.24 MB/sec execute 59 sec latency 319.240 ms 20 4463 6.19 MB/sec execute 60 sec latency 361.797 ms 20 4498 6.12 MB/sec execute 61 sec latency 370.554 ms 20 4545 6.09 MB/sec execute 62 sec latency 376.770 ms 20 4597 6.06 MB/sec execute 63 sec latency 302.252 ms 20 4671 6.22 MB/sec execute 64 sec latency 396.272 ms 20 4744 6.16 MB/sec execute 65 sec latency 96.670 ms 20 4802 6.20 MB/sec execute 66 sec latency 354.449 ms 20 4866 6.19 MB/sec execute 67 sec latency 89.126 ms 20 4953 6.43 MB/sec execute 68 sec latency 257.424 ms 20 5039 6.64 MB/sec execute 69 sec latency 252.143 ms 20 5098 6.55 MB/sec execute 70 sec latency 277.075 ms 20 5152 6.47 MB/sec execute 71 sec latency 239.514 ms 20 5195 6.40 MB/sec execute 72 sec latency 209.646 ms 20 5251 6.32 MB/sec execute 73 sec latency 249.643 ms 20 5311 6.25 MB/sec execute 74 sec latency 220.675 ms 20 5370 6.18 MB/sec execute 75 sec latency 199.961 ms 20 5425 6.11 MB/sec execute 76 sec latency 200.982 ms 20 5477 6.04 MB/sec execute 77 sec latency 320.974 ms 20 5553 5.99 MB/sec execute 78 sec latency 248.320 ms 20 5622 5.94 MB/sec execute 79 sec latency 213.607 ms 20 5694 5.91 MB/sec execute 80 sec latency 309.092 ms 20 5765 5.88 MB/sec execute 81 sec latency 283.558 ms 20 5823 5.86 MB/sec execute 82 sec latency 347.835 ms 20 5887 5.89 MB/sec execute 83 sec latency 303.563 ms 20 5957 5.94 MB/sec execute 84 sec latency 332.533 ms 20 6014 5.94 MB/sec execute 85 sec latency 380.147 ms 20 6092 6.05 MB/sec execute 86 sec latency 311.805 ms 20 6161 6.11 MB/sec execute 87 sec latency 468.922 ms 20 6263 6.22 MB/sec execute 88 sec latency 361.433 ms 20 6382 6.50 MB/sec execute 89 sec latency 347.125 ms 20 6523 6.68 MB/sec execute 90 sec latency 389.800 ms 20 6602 6.76 MB/sec execute 91 sec latency 387.740 ms 20 6701 6.77 MB/sec execute 92 sec latency 425.666 ms 20 6841 6.90 MB/sec execute 93 sec latency 342.233 ms 20 6927 6.99 MB/sec execute 94 sec latency 395.560 ms 20 7013 7.05 MB/sec execute 95 sec latency 258.845 ms 20 7090 7.16 MB/sec execute 96 sec latency 393.283 ms 20 7193 7.35 MB/sec execute 97 sec latency 90.400 ms 20 7258 7.32 MB/sec execute 98 sec latency 100.073 ms 20 7306 7.31 MB/sec execute 99 sec latency 148.648 ms 20 7367 7.31 MB/sec execute 100 sec latency 112.920 ms 20 7418 7.27 MB/sec execute 101 sec latency 117.466 ms 20 7483 7.22 MB/sec execute 102 sec latency 67.983 ms 20 7545 7.17 MB/sec execute 103 sec latency 93.005 ms 20 7584 7.10 MB/sec execute 104 sec latency 637.363 ms 20 7650 7.04 MB/sec execute 105 sec latency 236.238 ms 20 7722 6.98 MB/sec execute 106 sec latency 265.974 ms 20 7790 6.94 MB/sec execute 107 sec latency 301.429 ms 20 7834 6.90 MB/sec execute 108 sec latency 219.871 ms 20 7873 6.85 MB/sec execute 109 sec latency 285.432 ms 20 7919 6.81 MB/sec execute 110 sec latency 456.772 ms 20 7964 6.77 MB/sec execute 111 sec latency 305.800 ms 20 8019 6.74 MB/sec execute 112 sec latency 348.404 ms 20 8082 6.73 MB/sec execute 113 sec latency 266.497 ms 20 8140 6.70 MB/sec execute 114 sec latency 462.142 ms 20 8216 6.74 MB/sec execute 115 sec latency 253.541 ms 20 8317 6.82 MB/sec execute 116 sec latency 249.038 ms 20 8392 6.80 MB/sec execute 117 sec latency 202.761 ms 20 8481 6.89 MB/sec execute 118 sec latency 306.897 ms 20 8582 7.06 MB/sec execute 119 sec latency 209.085 ms 20 cleanup 120 sec 20 cleanup 121 sec 3 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 26085 44.324 222.783 Close 19309 11.850 64.520 Rename 1153 68.234 184.580 Unlink 5159 14.487 122.207 Qpathinfo 24373 11.584 147.515 Qfileinfo 4169 0.269 25.809 Qfsinfo 4359 0.203 34.937 Sfileinfo 2311 43.463 145.953 Find 9159 4.151 137.959 WriteX 12951 5.204 108.418 ReadX 41435 0.032 7.328 LockX 80 13.232 26.544 UnlockX 80 12.212 27.081 Flush 1745 211.521 1133.650 Throughput 7.05923 MB/sec 20 clients 20 procs max_latency=1133.664 ms stopping dbench on /mnt/lustre/d0.oleg204-client.virtnet at Thu Dec 12 10:07:02 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg204-client.virtnet /mnt/lustre/d0.oleg204-client.virtnet /mnt/lustre/d0.oleg204-client.virtnet removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg204-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:09 (1734016029) min OST has 3512320kB available, using 5268480kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7729] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5145] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg204-clien 5145M 79984 62 55565 47 129146 33 895.4 147 Latency 36249us 164ms 92734us 299ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg204-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 284 18 6270 28 378 12 335 17 892 12 457 12 Latency 19870us 29190us 73038us 17196us 6433us 19870us 1.97,1.97,oleg204-client.virtnet,1,1734004873,5145M,,,,79984,62,55565,47,,,129146,33,895.4,147,10,,,,,284,18,6270,28,378,12,335,17,892,12,457,12,,36249us,164ms,,92734us,299ms,19870us,29190us,73038us,17196us,6433us,19870us debug=0x33f0484 PASS bonnie (349s) == sanity-benchmark test iozone: iozone ================== 10:12:58 (1734016378) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7729] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:15 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 108126 102283 107877 145411 77395 83266 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:29 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 27767 27639 108984 105301 94690 35545 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1141s) == sanity-benchmark test fsx: fsx ======================== 10:31:59 (1734017519) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 9383 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 9383 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x5473c7 truncating to largest ever: 0x556999 truncating to largest ever: 0x560be4 001000 1734017522.174180 mapread 0x29d1c9 thru 0x2a03b4 (0x31ec bytes) 002000 1734017525.070877 mapwrite 0x213691 thru 0x21d92d (0xa29d bytes) 004000 1734017530.295980 write 0x388b7f thru 0x393ad0 (0xaf52 bytes) 005000 1734017533.165331 trunc from 0x1d696a to 0x55be86 (0x38551d bytes) 006000 1734017535.873233 mapread 0x0540a1 thru 0x059d09 (0x5c69 bytes) 008000 1734017542.020817 mapwrite 0x387def thru 0x39667d (0xe88f bytes) truncating to largest ever: 0x56109f truncating to largest ever: 0x56140b 013000 1734017555.794749 mapread 0x2fada1 thru 0x302eb9 (0x8119 bytes) 014000 1734017558.451700 read 0x012c82 thru 0x01dcc5 (0xb044 bytes) 015000 1734017561.236674 mapread 0x13d623 thru 0x14c0a9 (0xea87 bytes) truncating to largest ever: 0x5618d9 017000 1734017566.522948 read 0x0472cb thru 0x04bdc4 (0x4afa bytes) truncating to largest ever: 0x561b55 020000 1734017574.434595 mapwrite 0x06a329 thru 0x070d59 (0x6a31 bytes) 022000 1734017580.874200 trunc from 0x35e0ce to 0x4b8bb6 (0x15aae9 bytes) 024000 1734017586.449744 trunc from 0x42327d to 0x1b5dbd (0x26d4bf bytes) 025000 1734017589.146512 write 0x19ddb4 thru 0x1a3c53 (0x5ea0 bytes) 027000 1734017595.065097 write 0x53d543 thru 0x546722 (0x91e0 bytes) 028000 1734017597.760772 mapread 0x259d05 thru 0x262052 (0x834e bytes) 029000 1734017600.800515 mapread 0x03ef50 thru 0x0443ca (0x547b bytes) 032000 1734017609.279949 read 0x2cf418 thru 0x2d8bc8 (0x97b1 bytes) 037000 1734017623.965293 write 0x4a90c0 thru 0x4ae001 (0x4f42 bytes) 040000 1734017632.213290 mapwrite 0x18b12c thru 0x18e368 (0x323d bytes) 041000 1734017635.031230 trunc from 0x355dce to 0x304ff7 (0x50dd6 bytes) truncating to largest ever: 0x561bd2 045000 1734017645.831899 read 0x05c7e3 thru 0x069e56 (0xd674 bytes) 046000 1734017648.744682 read 0x041a20 thru 0x0474ed (0x5ace bytes) 047000 1734017651.408778 read 0x1ce08b thru 0x1d62e5 (0x825b bytes) 048000 1734017654.522199 read 0x42a459 thru 0x432570 (0x8118 bytes) 049000 1734017657.377647 read 0x1192fa thru 0x11d5b8 (0x42bf bytes) 050000 1734017660.462459 write 0x0d9ee3 thru 0x0e2da8 (0x8ec6 bytes) 051000 1734017663.472059 read 0x1e4d64 thru 0x1e6eb2 (0x214f bytes) 052000 1734017666.422939 read 0x012c67 thru 0x016d2f (0x40c9 bytes) 053000 1734017669.545990 write 0x12e52b thru 0x130afe (0x25d4 bytes) 054000 1734017672.848627 write 0x06232e thru 0x06780b (0x54de bytes) 055000 1734017675.866091 trunc from 0x53b966 to 0x3590d3 (0x1e2892 bytes) 056000 1734017678.997670 read 0x3a37a5 thru 0x3b24d7 (0xed33 bytes) 060000 1734017689.891357 read 0x0c8d10 thru 0x0cd3be (0x46af bytes) 061000 1734017693.034339 read 0x23c1c8 thru 0x245ec9 (0x9d02 bytes) 063000 1734017698.467490 mapread 0x2963d4 thru 0x296741 (0x36e bytes) 067000 1734017709.976178 read 0x1d5d5b thru 0x1e3abd (0xdd63 bytes) 071000 1734017720.769204 read 0x547813 thru 0x553966 (0xc154 bytes) 076000 1734017735.395136 trunc from 0x45da18 to 0x05768d (0x40638a bytes) 077000 1734017738.454063 write 0x1dd6ba thru 0x1e044d (0x2d94 bytes) 081000 1734017749.691826 write 0x317de0 thru 0x319950 (0x1b71 bytes) 085000 1734017760.731666 mapwrite 0x4e3d9c thru 0x4f2084 (0xe2e9 bytes) 088000 1734017768.955280 read 0x0c5ee7 thru 0x0d0a71 (0xab8b bytes) 089000 1734017771.857238 read 0x2a1a74 thru 0x2ae077 (0xc604 bytes) 090000 1734017774.664948 write 0x4cc56a thru 0x4dc44a (0xfee1 bytes) 093000 1734017782.837361 mapwrite 0x4277f3 thru 0x435119 (0xd927 bytes) 095000 1734017789.220013 mapread 0x2d2584 thru 0x2d50c8 (0x2b45 bytes) 098000 1734017798.455063 write 0x232592 thru 0x23d48d (0xaefc bytes) 099000 1734017801.260357 write 0x505b3e thru 0x515831 (0xfcf4 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4002449 (3968 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (286s) == sanity-benchmark test complete, duration 1958 sec ===== 10:36:45 (1734017805) === sanity-benchmark: start cleanup 10:36:45 (1734017805) === === sanity-benchmark: finish cleanup 10:36:46 (1734017806) ===