-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:52 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:57 (1734015837) === oleg458-client.virtnet: executing check_config_client /mnt/lustre oleg458-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg458-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b62e9800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b62e9800.idle_timeout=debug disable quota as required oleg458-server: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:09 (1734015849) === == sanity-benchmark test dbench: dbench ================== 10:04:09 (1734015849) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7703] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg458-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg458-client.virtnet at Thu Dec 12 10:04:11 EST 2024 waiting for dbench pid 10287 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 2 17 9.65 MB/sec warmup 1 sec latency 405.177 ms 20 114 52.74 MB/sec warmup 2 sec latency 236.864 ms 20 186 49.78 MB/sec warmup 3 sec latency 151.218 ms 20 258 48.73 MB/sec warmup 4 sec latency 132.353 ms 20 331 48.06 MB/sec warmup 5 sec latency 123.156 ms 20 400 47.22 MB/sec warmup 6 sec latency 119.734 ms 20 460 46.06 MB/sec warmup 7 sec latency 163.915 ms 20 521 44.94 MB/sec warmup 8 sec latency 151.302 ms 20 623 46.34 MB/sec warmup 9 sec latency 520.887 ms 20 667 42.27 MB/sec warmup 10 sec latency 504.703 ms 20 701 38.51 MB/sec warmup 11 sec latency 356.175 ms 20 728 35.47 MB/sec warmup 12 sec latency 420.354 ms 20 764 32.83 MB/sec warmup 13 sec latency 208.042 ms 20 797 30.64 MB/sec warmup 14 sec latency 483.118 ms 20 841 28.69 MB/sec warmup 15 sec latency 176.986 ms 20 882 27.06 MB/sec warmup 16 sec latency 380.068 ms 20 917 25.58 MB/sec warmup 17 sec latency 265.792 ms 20 958 24.31 MB/sec warmup 18 sec latency 392.079 ms 20 993 23.14 MB/sec warmup 19 sec latency 432.446 ms 20 1056 22.85 MB/sec warmup 20 sec latency 432.963 ms 20 1109 21.84 MB/sec warmup 21 sec latency 101.579 ms 20 1166 20.90 MB/sec warmup 22 sec latency 115.813 ms 20 1223 20.28 MB/sec warmup 23 sec latency 124.240 ms 20 1379 44.21 MB/sec execute 1 sec latency 300.417 ms 20 1452 26.45 MB/sec execute 2 sec latency 247.260 ms 20 1496 17.82 MB/sec execute 3 sec latency 393.407 ms 20 1531 13.55 MB/sec execute 4 sec latency 492.152 ms 20 1601 11.10 MB/sec execute 5 sec latency 243.917 ms 20 1640 9.31 MB/sec execute 6 sec latency 366.608 ms 20 1676 8.11 MB/sec execute 7 sec latency 488.981 ms 20 1725 7.17 MB/sec execute 8 sec latency 121.467 ms 20 1783 6.47 MB/sec execute 9 sec latency 431.667 ms 20 1827 5.92 MB/sec execute 10 sec latency 322.184 ms 20 1873 5.43 MB/sec execute 11 sec latency 212.292 ms 20 1912 5.07 MB/sec execute 12 sec latency 418.623 ms 20 1994 4.76 MB/sec execute 13 sec latency 267.364 ms 20 2033 4.53 MB/sec execute 14 sec latency 124.774 ms 20 2078 4.35 MB/sec execute 15 sec latency 144.345 ms 20 2142 4.19 MB/sec execute 16 sec latency 397.059 ms 20 2185 4.07 MB/sec execute 17 sec latency 487.448 ms 20 2243 3.91 MB/sec execute 18 sec latency 500.261 ms 20 2351 4.74 MB/sec execute 19 sec latency 362.283 ms 20 2382 4.59 MB/sec execute 20 sec latency 486.708 ms 20 2424 4.53 MB/sec execute 21 sec latency 486.952 ms 20 2462 4.50 MB/sec execute 22 sec latency 502.253 ms 20 2508 4.92 MB/sec execute 23 sec latency 579.314 ms 20 2608 4.96 MB/sec execute 24 sec latency 413.102 ms 20 2718 6.21 MB/sec execute 25 sec latency 349.537 ms 20 2824 6.76 MB/sec execute 26 sec latency 495.250 ms 20 2949 7.53 MB/sec execute 27 sec latency 385.300 ms 20 3008 7.32 MB/sec execute 28 sec latency 539.183 ms 20 3043 7.14 MB/sec execute 29 sec latency 669.923 ms 20 3191 7.25 MB/sec execute 30 sec latency 531.196 ms 20 3271 7.47 MB/sec execute 31 sec latency 499.784 ms 20 3375 7.70 MB/sec execute 32 sec latency 272.000 ms 20 3452 8.08 MB/sec execute 33 sec latency 253.931 ms 20 3565 8.86 MB/sec execute 34 sec latency 136.806 ms 20 3638 8.73 MB/sec execute 35 sec latency 95.160 ms 20 3693 8.57 MB/sec execute 36 sec latency 124.008 ms 20 3755 8.57 MB/sec execute 37 sec latency 112.953 ms 20 3816 8.63 MB/sec execute 38 sec latency 135.946 ms 20 3855 8.41 MB/sec execute 39 sec latency 113.570 ms 20 3893 8.24 MB/sec execute 40 sec latency 118.811 ms 20 3927 8.13 MB/sec execute 41 sec latency 212.341 ms 20 3964 7.94 MB/sec execute 42 sec latency 210.476 ms 20 4002 7.75 MB/sec execute 43 sec latency 147.176 ms 20 4044 7.58 MB/sec execute 44 sec latency 115.639 ms 20 4077 7.42 MB/sec execute 45 sec latency 554.851 ms 20 4119 7.27 MB/sec execute 46 sec latency 595.142 ms 20 4191 7.13 MB/sec execute 47 sec latency 328.934 ms 20 4233 7.02 MB/sec execute 48 sec latency 608.750 ms 20 4256 6.90 MB/sec execute 49 sec latency 630.120 ms 20 4289 6.79 MB/sec execute 50 sec latency 411.430 ms 20 4307 6.69 MB/sec execute 51 sec latency 561.123 ms 20 4357 6.59 MB/sec execute 52 sec latency 198.571 ms 20 4381 6.50 MB/sec execute 53 sec latency 450.553 ms 20 4438 6.42 MB/sec execute 54 sec latency 303.078 ms 20 4467 6.33 MB/sec execute 55 sec latency 589.493 ms 20 4502 6.29 MB/sec execute 56 sec latency 596.872 ms 20 4555 6.20 MB/sec execute 57 sec latency 315.625 ms 20 4598 6.21 MB/sec execute 58 sec latency 350.301 ms 20 4678 6.33 MB/sec execute 59 sec latency 94.273 ms 20 4747 6.34 MB/sec execute 60 sec latency 95.414 ms 20 4803 6.25 MB/sec execute 61 sec latency 90.321 ms 20 4855 6.21 MB/sec execute 62 sec latency 371.188 ms 20 4979 6.90 MB/sec execute 63 sec latency 123.364 ms 20 5025 6.80 MB/sec execute 64 sec latency 284.725 ms 20 5065 6.70 MB/sec execute 65 sec latency 258.724 ms 20 5111 6.61 MB/sec execute 66 sec latency 320.979 ms 20 5156 6.53 MB/sec execute 67 sec latency 109.745 ms 20 5196 6.44 MB/sec execute 68 sec latency 237.651 ms 20 5236 6.36 MB/sec execute 69 sec latency 413.408 ms 20 5282 6.27 MB/sec execute 70 sec latency 359.037 ms 20 5320 6.20 MB/sec execute 71 sec latency 261.746 ms 20 5377 6.12 MB/sec execute 72 sec latency 212.877 ms 20 5415 6.05 MB/sec execute 73 sec latency 249.808 ms 20 5459 5.98 MB/sec execute 74 sec latency 180.375 ms 20 5504 5.91 MB/sec execute 75 sec latency 467.245 ms 20 5567 5.85 MB/sec execute 76 sec latency 392.985 ms 20 5615 5.79 MB/sec execute 77 sec latency 98.276 ms 20 5687 5.77 MB/sec execute 78 sec latency 239.024 ms 20 5747 5.72 MB/sec execute 79 sec latency 362.935 ms 20 5787 5.67 MB/sec execute 80 sec latency 253.145 ms 20 5868 5.73 MB/sec execute 81 sec latency 383.050 ms 20 5933 5.78 MB/sec execute 82 sec latency 366.593 ms 20 5980 5.75 MB/sec execute 83 sec latency 381.095 ms 20 6034 5.79 MB/sec execute 84 sec latency 486.517 ms 20 6088 5.83 MB/sec execute 85 sec latency 452.926 ms 20 6176 5.87 MB/sec execute 86 sec latency 510.149 ms 20 6258 6.01 MB/sec execute 87 sec latency 348.068 ms 20 6411 6.40 MB/sec execute 88 sec latency 308.251 ms 20 6530 6.59 MB/sec execute 89 sec latency 448.767 ms 20 6588 6.54 MB/sec execute 90 sec latency 397.437 ms 20 6671 6.54 MB/sec execute 91 sec latency 433.850 ms 20 6811 6.66 MB/sec execute 92 sec latency 391.975 ms 20 6919 6.79 MB/sec execute 93 sec latency 460.348 ms 20 6991 6.84 MB/sec execute 94 sec latency 311.585 ms 20 7086 7.09 MB/sec execute 95 sec latency 116.310 ms 20 7167 7.17 MB/sec execute 96 sec latency 108.228 ms 20 7225 7.12 MB/sec execute 97 sec latency 119.032 ms 20 7276 7.10 MB/sec execute 98 sec latency 122.951 ms 20 7333 7.12 MB/sec execute 99 sec latency 136.492 ms 20 7385 7.10 MB/sec execute 100 sec latency 111.678 ms 20 7430 7.04 MB/sec execute 101 sec latency 100.633 ms 20 7486 7.01 MB/sec execute 102 sec latency 89.300 ms 20 7519 6.94 MB/sec execute 103 sec latency 183.107 ms 20 7565 6.88 MB/sec execute 104 sec latency 118.639 ms 20 7604 6.82 MB/sec execute 105 sec latency 347.607 ms 20 7648 6.76 MB/sec execute 106 sec latency 292.194 ms 20 7716 6.70 MB/sec execute 107 sec latency 280.057 ms 20 7773 6.66 MB/sec execute 108 sec latency 523.059 ms 20 7801 6.61 MB/sec execute 109 sec latency 461.872 ms 20 7834 6.56 MB/sec execute 110 sec latency 426.052 ms 20 7863 6.52 MB/sec execute 111 sec latency 273.660 ms 20 7911 6.48 MB/sec execute 112 sec latency 230.373 ms 20 7939 6.43 MB/sec execute 113 sec latency 372.578 ms 20 7984 6.40 MB/sec execute 114 sec latency 272.417 ms 20 8026 6.37 MB/sec execute 115 sec latency 414.550 ms 20 8071 6.34 MB/sec execute 116 sec latency 420.521 ms 20 8124 6.32 MB/sec execute 117 sec latency 355.527 ms 20 8178 6.34 MB/sec execute 118 sec latency 419.556 ms 20 8275 6.40 MB/sec execute 119 sec latency 86.079 ms 20 cleanup 120 sec 20 cleanup 121 sec 14 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 24411 48.557 212.333 Close 17884 12.587 68.265 Rename 1006 72.793 191.454 Unlink 4950 15.834 79.729 Qpathinfo 22390 11.949 143.867 Qfileinfo 3861 0.227 31.787 Qfsinfo 4071 0.229 36.317 Sfileinfo 1945 45.322 141.339 Find 8589 4.033 155.857 WriteX 12060 5.350 83.665 ReadX 38500 0.029 13.081 LockX 80 13.341 34.118 UnlockX 80 12.246 37.224 Flush 1721 220.278 669.919 Throughput 6.4048 MB/sec 20 clients 20 procs max_latency=669.923 ms stopping dbench on /mnt/lustre/d0.oleg458-client.virtnet at Thu Dec 12 10:06:38 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg458-client.virtnet /mnt/lustre/d0.oleg458-client.virtnet /mnt/lustre/d0.oleg458-client.virtnet removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg458-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:45 (1734016005) min OST has 3606528kB available, using 5409792kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7703] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5283] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg458-clien 5283M 80396 62 49766 43 107493 26 487.6 110 Latency 32793us 223ms 88904us 896ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg458-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 226 18 5749 25 292 12 279 18 792 12 355 13 Latency 17874us 21560us 65875us 38547us 6025us 25374us 1.97,1.97,oleg458-client.virtnet,1,1734004879,5283M,,,,80396,62,49766,43,,,107493,26,487.6,110,10,,,,,226,18,5749,25,292,12,279,18,792,12,355,13,,32793us,223ms,,88904us,896ms,17874us,21560us,65875us,38547us,6025us,25374us debug=0x33f0484 PASS bonnie (413s) == sanity-benchmark test iozone: iozone ================== 10:13:38 (1734016418) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7703] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:57 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 116155 100882 98860 127343 59899 78475 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:43 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23485 23840 94120 94279 93778 30437 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1290s) == sanity-benchmark test fsx: fsx ======================== 10:35:08 (1734017708) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 26892 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 26892 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x360fdd truncating to largest ever: 0x4a5ac4 truncating to largest ever: 0x4e789b truncating to largest ever: 0x5158c3 truncating to largest ever: 0x53f5b5 truncating to largest ever: 0x548a11 001000 1734017712.051291 mapwrite 0x5009ee thru 0x50c9d8 (0xbfeb bytes) truncating to largest ever: 0x55039d truncating to largest ever: 0x55d188 skipping zero size read truncating to largest ever: 0x55f627 truncating to largest ever: 0x560021 005000 1734017724.758867 mapwrite 0x543ad3 thru 0x551859 (0xdd87 bytes) 006000 1734017727.756559 mapwrite 0x2db377 thru 0x2e1cad (0x6937 bytes) 016000 1734017760.517965 write 0x31d9c2 thru 0x32b8ce (0xdf0d bytes) 020000 1734017773.274348 trunc from 0x2ff7a4 to 0x1562ab (0x1a94f8 bytes) 021000 1734017776.746784 write 0x05ffdb thru 0x069f25 (0x9f4b bytes) 023000 1734017783.468248 mapwrite 0x27b982 thru 0x2856b4 (0x9d33 bytes) 024000 1734017786.802059 trunc from 0x49621d to 0x23c943 (0x2598d9 bytes) 025000 1734017790.196904 write 0x25bbee thru 0x26850e (0xc921 bytes) truncating to largest ever: 0x5608c3 027000 1734017797.043329 mapwrite 0x0b7a94 thru 0x0be49e (0x6a0b bytes) 029000 1734017804.060718 mapwrite 0x2ddd86 thru 0x2ed46a (0xf6e5 bytes) 030000 1734017807.430978 mapwrite 0x30cc0f thru 0x3155a9 (0x899b bytes) 031000 1734017810.733671 mapread 0x22f8d8 thru 0x23b93e (0xc067 bytes) 032000 1734017813.976294 trunc from 0x032b19 to 0x13eede (0x10c3c6 bytes) 033000 1734017817.371938 read 0x1c34ab thru 0x1d103d (0xdb93 bytes) 034000 1734017821.004967 write 0x187f8e thru 0x1965c6 (0xe639 bytes) 035000 1734017823.985791 mapread 0x05d658 thru 0x06cf35 (0xf8de bytes) 036000 1734017827.498348 write 0x1cb751 thru 0x1cfbce (0x447e bytes) 038000 1734017834.739775 write 0x1f4933 thru 0x201e19 (0xd4e7 bytes) 039000 1734017838.207362 read 0x1bde97 thru 0x1c7f8d (0xa0f7 bytes) 041000 1734017845.134497 write 0x0056ce thru 0x014f9c (0xf8cf bytes) 042000 1734017848.789928 read 0x2b3b67 thru 0x2b4919 (0xdb3 bytes) 044000 1734017855.075606 mapread 0x275718 thru 0x27e9e3 (0x92cc bytes) 046000 1734017862.020413 mapread 0x006edd thru 0x012498 (0xb5bc bytes) 047000 1734017865.301346 write 0x148c7e thru 0x1588d6 (0xfc59 bytes) 049000 1734017872.222920 trunc from 0x50665e to 0x334d1f (0x1d193e bytes) 050000 1734017875.453224 write 0x3e3a9b thru 0x3e9653 (0x5bb9 bytes) 052000 1734017882.415175 mapread 0x134dbe thru 0x1399cd (0x4c10 bytes) 053000 1734017885.757031 write 0x4320b8 thru 0x43ae28 (0x8d71 bytes) 054000 1734017889.107783 mapwrite 0x43a445 thru 0x43a85c (0x418 bytes) 056000 1734017895.948286 mapwrite 0x2adecf thru 0x2bb1e8 (0xd31a bytes) 057000 1734017899.128527 mapwrite 0x1f11b3 thru 0x1f20cf (0xf1d bytes) 058000 1734017902.485740 mapwrite 0x3cb8d7 thru 0x3cc3e0 (0xb0a bytes) 059000 1734017906.006558 mapread 0x1a5142 thru 0x1b1932 (0xc7f1 bytes) 062000 1734017916.621025 mapwrite 0x245b66 thru 0x24a768 (0x4c03 bytes) 063000 1734017919.902840 mapwrite 0x29fec4 thru 0x2a4c28 (0x4d65 bytes) 066000 1734017931.154672 read 0x114979 thru 0x11d4af (0x8b37 bytes) 067000 1734017934.455016 mapwrite 0x0a010e thru 0x0a0ef2 (0xde5 bytes) 069000 1734017941.071449 write 0x0c8b39 thru 0x0cb704 (0x2bcc bytes) 071000 1734017947.405475 mapread 0x29662e thru 0x29df83 (0x7956 bytes) 073000 1734017953.298521 write 0x205872 thru 0x20dde2 (0x8571 bytes) 074000 1734017956.438528 read 0x07d4a1 thru 0x083789 (0x62e9 bytes) 076000 1734017963.087253 mapread 0x37b778 thru 0x38631f (0xaba8 bytes) 077000 1734017966.345678 trunc from 0x441228 to 0x06be84 (0x3d53a3 bytes) 082000 1734017983.860464 read 0x1cee77 thru 0x1d1794 (0x291e bytes) 086000 1734017996.447427 read 0x186b97 thru 0x18f1bd (0x8627 bytes) 088000 1734018002.709851 mapwrite 0x2a74cc thru 0x2a8f04 (0x1a39 bytes) 089000 1734018005.617049 write 0x2801bc thru 0x282050 (0x1e95 bytes) 091000 1734018012.401977 mapread 0x485ca2 thru 0x48701a (0x1379 bytes) 092000 1734018015.186448 read 0x1d561c thru 0x1e424f (0xec34 bytes) 093000 1734018018.539447 read 0x3fef6e thru 0x401b15 (0x2ba8 bytes) 095000 1734018024.260517 mapread 0x048522 thru 0x051893 (0x9372 bytes) 096000 1734018027.421055 mapread 0x0fb4df thru 0x0ff06d (0x3b8f bytes) truncating to largest ever: 0x5615c0 099000 1734018041.869667 mapwrite 0x215cf5 thru 0x2231ea (0xd4f6 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5352972 (5248 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (339s) == sanity-benchmark test complete, duration 2215 sec ===== 10:40:47 (1734018047) === sanity-benchmark: start cleanup 10:40:47 (1734018047) === === sanity-benchmark: finish cleanup 10:40:48 (1734018048) ===