-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:55 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:00 (1734015840) === oleg428-client.virtnet: executing check_config_client /mnt/lustre oleg428-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg428-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aab66000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aab66000.idle_timeout=debug disable quota as required oleg428-server: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:13 (1734015853) === == sanity-benchmark test dbench: dbench ================== 10:04:14 (1734015854) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7724] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg428-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg428-client.virtnet at Thu Dec 12 10:04:16 EST 2024 waiting for dbench pid 10309 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 10 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 1 8 2.09 MB/sec warmup 1 sec latency 913.665 ms 18 70 30.48 MB/sec warmup 2 sec latency 193.437 ms 20 130 38.41 MB/sec warmup 3 sec latency 327.711 ms 20 186 37.32 MB/sec warmup 4 sec latency 176.115 ms 20 240 36.62 MB/sec warmup 5 sec latency 170.700 ms 20 299 36.80 MB/sec warmup 6 sec latency 129.825 ms 20 350 35.96 MB/sec warmup 7 sec latency 136.247 ms 20 403 35.63 MB/sec warmup 8 sec latency 178.900 ms 20 458 35.71 MB/sec warmup 9 sec latency 139.090 ms 20 524 36.18 MB/sec warmup 10 sec latency 190.802 ms 20 612 37.68 MB/sec warmup 11 sec latency 492.282 ms 20 671 35.23 MB/sec warmup 12 sec latency 460.593 ms 20 708 32.62 MB/sec warmup 13 sec latency 309.142 ms 20 738 30.42 MB/sec warmup 14 sec latency 339.829 ms 20 787 28.53 MB/sec warmup 15 sec latency 291.586 ms 20 821 26.86 MB/sec warmup 16 sec latency 348.659 ms 20 874 25.44 MB/sec warmup 17 sec latency 526.035 ms 20 911 24.12 MB/sec warmup 18 sec latency 323.100 ms 20 952 22.97 MB/sec warmup 19 sec latency 489.176 ms 20 994 22.02 MB/sec warmup 20 sec latency 469.803 ms 20 1056 21.65 MB/sec warmup 21 sec latency 423.465 ms 20 1130 20.87 MB/sec warmup 22 sec latency 94.331 ms 20 1180 20.00 MB/sec warmup 23 sec latency 118.688 ms 20 1311 16.84 MB/sec execute 1 sec latency 128.033 ms 20 1417 27.67 MB/sec execute 2 sec latency 511.056 ms 20 1475 18.62 MB/sec execute 3 sec latency 380.913 ms 20 1516 14.12 MB/sec execute 4 sec latency 559.178 ms 20 1586 11.58 MB/sec execute 5 sec latency 267.744 ms 20 1641 9.79 MB/sec execute 6 sec latency 259.836 ms 20 1685 8.52 MB/sec execute 7 sec latency 374.226 ms 20 1752 7.58 MB/sec execute 8 sec latency 110.658 ms 20 1813 6.86 MB/sec execute 9 sec latency 324.082 ms 20 1866 6.25 MB/sec execute 10 sec latency 221.684 ms 20 1918 5.77 MB/sec execute 11 sec latency 302.056 ms 20 1991 5.41 MB/sec execute 12 sec latency 287.505 ms 20 2046 5.13 MB/sec execute 13 sec latency 98.437 ms 20 2100 4.88 MB/sec execute 14 sec latency 135.317 ms 20 2162 4.69 MB/sec execute 15 sec latency 134.050 ms 20 2208 4.64 MB/sec execute 16 sec latency 497.710 ms 20 2275 4.68 MB/sec execute 17 sec latency 431.686 ms 20 2363 5.20 MB/sec execute 18 sec latency 342.331 ms 20 2395 5.03 MB/sec execute 19 sec latency 412.265 ms 20 2413 4.85 MB/sec execute 20 sec latency 1117.156 ms 20 2451 4.78 MB/sec execute 21 sec latency 1267.515 ms 20 2503 4.97 MB/sec execute 22 sec latency 414.477 ms 20 2594 5.44 MB/sec execute 23 sec latency 452.700 ms 20 2689 5.90 MB/sec execute 24 sec latency 504.443 ms 20 2810 7.06 MB/sec execute 25 sec latency 409.653 ms 20 2921 7.66 MB/sec execute 26 sec latency 457.912 ms 20 2990 7.62 MB/sec execute 27 sec latency 581.739 ms 20 3054 7.52 MB/sec execute 28 sec latency 566.006 ms 20 3186 7.66 MB/sec execute 29 sec latency 504.814 ms 20 3285 7.97 MB/sec execute 30 sec latency 446.676 ms 20 3389 8.31 MB/sec execute 31 sec latency 282.497 ms 20 3466 8.50 MB/sec execute 32 sec latency 301.131 ms 20 3587 9.23 MB/sec execute 33 sec latency 81.433 ms 20 3664 9.19 MB/sec execute 34 sec latency 86.427 ms 20 3718 8.99 MB/sec execute 35 sec latency 131.590 ms 20 3773 9.01 MB/sec execute 36 sec latency 126.682 ms 20 3820 8.93 MB/sec execute 37 sec latency 143.781 ms 20 3864 8.72 MB/sec execute 38 sec latency 111.334 ms 20 3908 8.55 MB/sec execute 39 sec latency 114.235 ms 20 3949 8.40 MB/sec execute 40 sec latency 149.081 ms 20 3989 8.19 MB/sec execute 41 sec latency 153.354 ms 20 4032 8.00 MB/sec execute 42 sec latency 121.903 ms 20 4091 7.83 MB/sec execute 43 sec latency 106.378 ms 20 4131 7.67 MB/sec execute 44 sec latency 432.818 ms 20 4186 7.50 MB/sec execute 45 sec latency 472.586 ms 20 4231 7.38 MB/sec execute 46 sec latency 580.360 ms 20 4255 7.26 MB/sec execute 47 sec latency 517.629 ms 20 4286 7.13 MB/sec execute 48 sec latency 276.319 ms 20 4316 7.02 MB/sec execute 49 sec latency 323.399 ms 20 4343 6.90 MB/sec execute 50 sec latency 618.650 ms 20 4382 6.81 MB/sec execute 51 sec latency 320.738 ms 20 4415 6.70 MB/sec execute 52 sec latency 274.246 ms 20 4461 6.62 MB/sec execute 53 sec latency 375.982 ms 20 4498 6.54 MB/sec execute 54 sec latency 421.009 ms 20 4533 6.50 MB/sec execute 55 sec latency 395.115 ms 20 4591 6.46 MB/sec execute 56 sec latency 346.163 ms 20 4664 6.57 MB/sec execute 57 sec latency 318.182 ms 20 4732 6.55 MB/sec execute 58 sec latency 96.189 ms 20 4795 6.56 MB/sec execute 59 sec latency 123.534 ms 20 4859 6.60 MB/sec execute 60 sec latency 113.909 ms 20 4935 6.81 MB/sec execute 61 sec latency 373.241 ms 20 5012 7.06 MB/sec execute 62 sec latency 448.543 ms 20 5061 6.95 MB/sec execute 63 sec latency 278.332 ms 20 5112 6.86 MB/sec execute 64 sec latency 394.695 ms 20 5161 6.77 MB/sec execute 65 sec latency 327.792 ms 20 5210 6.68 MB/sec execute 66 sec latency 242.636 ms 20 5255 6.59 MB/sec execute 67 sec latency 347.851 ms 20 5305 6.51 MB/sec execute 68 sec latency 315.870 ms 20 5349 6.42 MB/sec execute 69 sec latency 316.461 ms 20 5399 6.34 MB/sec execute 70 sec latency 225.677 ms 20 5457 6.27 MB/sec execute 71 sec latency 219.013 ms 20 5496 6.19 MB/sec execute 72 sec latency 418.582 ms 20 5580 6.13 MB/sec execute 73 sec latency 335.814 ms 20 5633 6.07 MB/sec execute 74 sec latency 99.286 ms 20 5718 6.03 MB/sec execute 75 sec latency 105.129 ms 20 5786 6.03 MB/sec execute 76 sec latency 305.818 ms 20 5856 6.03 MB/sec execute 77 sec latency 363.406 ms 20 5925 6.09 MB/sec execute 78 sec latency 353.207 ms 20 5968 6.07 MB/sec execute 79 sec latency 464.549 ms 20 6008 6.03 MB/sec execute 80 sec latency 633.767 ms 20 6063 6.06 MB/sec execute 81 sec latency 389.194 ms 20 6144 6.21 MB/sec execute 82 sec latency 460.106 ms 20 6235 6.27 MB/sec execute 83 sec latency 396.914 ms 20 6339 6.57 MB/sec execute 84 sec latency 546.666 ms 20 6421 6.67 MB/sec execute 85 sec latency 646.394 ms 20 6524 6.79 MB/sec execute 86 sec latency 444.985 ms 20 6606 6.83 MB/sec execute 87 sec latency 521.843 ms 20 6700 6.84 MB/sec execute 88 sec latency 394.788 ms 20 6821 6.92 MB/sec execute 89 sec latency 366.470 ms 20 6935 7.12 MB/sec execute 90 sec latency 374.233 ms 20 7022 7.21 MB/sec execute 91 sec latency 245.543 ms 20 7125 7.41 MB/sec execute 92 sec latency 160.124 ms 20 7196 7.44 MB/sec execute 93 sec latency 94.884 ms 20 7256 7.42 MB/sec execute 94 sec latency 100.484 ms 20 7311 7.40 MB/sec execute 95 sec latency 142.956 ms 20 7365 7.42 MB/sec execute 96 sec latency 140.685 ms 20 7413 7.36 MB/sec execute 97 sec latency 111.534 ms 20 7458 7.30 MB/sec execute 98 sec latency 108.547 ms 20 7506 7.25 MB/sec execute 99 sec latency 145.361 ms 20 7543 7.18 MB/sec execute 100 sec latency 154.168 ms 20 7588 7.11 MB/sec execute 101 sec latency 129.245 ms 20 7634 7.05 MB/sec execute 102 sec latency 377.952 ms 20 7677 6.98 MB/sec execute 103 sec latency 422.629 ms 20 7738 6.93 MB/sec execute 104 sec latency 405.098 ms 20 7776 6.87 MB/sec execute 105 sec latency 512.479 ms 20 7805 6.82 MB/sec execute 106 sec latency 493.053 ms 20 7840 6.77 MB/sec execute 107 sec latency 320.048 ms 20 7873 6.73 MB/sec execute 108 sec latency 303.208 ms 20 7917 6.68 MB/sec execute 109 sec latency 325.920 ms 20 7947 6.64 MB/sec execute 110 sec latency 592.565 ms 20 7994 6.60 MB/sec execute 111 sec latency 266.427 ms 20 8033 6.56 MB/sec execute 112 sec latency 306.252 ms 20 8088 6.56 MB/sec execute 113 sec latency 409.308 ms 20 8147 6.54 MB/sec execute 114 sec latency 277.037 ms 20 8223 6.59 MB/sec execute 115 sec latency 286.548 ms 20 8298 6.58 MB/sec execute 116 sec latency 98.439 ms 20 8390 6.65 MB/sec execute 117 sec latency 78.255 ms 20 8478 6.75 MB/sec execute 118 sec latency 308.176 ms 20 8573 6.89 MB/sec execute 119 sec latency 220.163 ms 20 cleanup 120 sec 20 cleanup 121 sec 1 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25498 45.564 251.257 Close 18716 11.835 193.695 Rename 1072 70.135 268.517 Unlink 5072 15.474 93.640 Qpathinfo 23399 11.426 227.204 Qfileinfo 4049 0.262 24.330 Qfsinfo 4168 0.235 28.766 Sfileinfo 2102 45.168 195.327 Find 8898 3.631 115.639 WriteX 12456 5.185 219.617 ReadX 40584 0.029 10.180 LockX 80 12.088 36.685 UnlockX 80 13.268 28.528 Flush 1735 230.727 1267.504 Throughput 6.88984 MB/sec 20 clients 20 procs max_latency=1267.515 ms stopping dbench on /mnt/lustre/d0.oleg428-client.virtnet at Thu Dec 12 10:06:42 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg428-client.virtnet /mnt/lustre/d0.oleg428-client.virtnet /mnt/lustre/d0.oleg428-client.virtnet removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg428-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:49 (1734016009) min OST has 3412992kB available, using 5119488kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7724] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4999] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg428-clien 4999M 79787 61 49628 43 105067 26 438.8 104 Latency 21328us 363ms 106ms 693ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg428-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 211 17 6881 30 305 12 271 18 803 12 301 13 Latency 29299us 20005us 75120us 17060us 5286us 22356us 1.97,1.97,oleg428-client.virtnet,1,1734004877,4999M,,,,79787,61,49628,43,,,105067,26,438.8,104,10,,,,,211,17,6881,30,305,12,271,18,803,12,301,13,,21328us,363ms,,106ms,693ms,29299us,20005us,75120us,17060us,5286us,22356us debug=0x33f0484 PASS bonnie (412s) == sanity-benchmark test iozone: iozone ================== 10:13:41 (1734016421) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7724] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:01 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 122750 114221 109312 137461 55839 86773 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:35 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23270 23788 91359 92508 93951 31556 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1276s) == sanity-benchmark test fsx: fsx ======================== 10:34:57 (1734017697) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 20862 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 20862 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x3ef4f3 truncating to largest ever: 0x3f29a9 truncating to largest ever: 0x5202bf truncating to largest ever: 0x55635f truncating to largest ever: 0x55e7a1 truncating to largest ever: 0x55f241 003000 1734017706.405696 trunc from 0x0fcde9 to 0x069169 (0x93c7f bytes) 004000 1734017709.420058 write 0x08b7d1 thru 0x096804 (0xb034 bytes) 005000 1734017712.895232 mapread 0x38c3b2 thru 0x397d92 (0xb9e1 bytes) 007000 1734017719.293596 mapwrite 0x071aaa thru 0x0780ee (0x6645 bytes) 009000 1734017724.715719 read 0x18f438 thru 0x19aa8c (0xb655 bytes) truncating to largest ever: 0x5607b0 013000 1734017736.769265 mapwrite 0x13e852 thru 0x14d5b6 (0xed65 bytes) 015000 1734017742.838193 trunc from 0x3df3c0 to 0x312eb9 (0xcc506 bytes) skipping zero size read 019000 1734017755.306051 read 0x2b4a8f thru 0x2beac4 (0xa036 bytes) 020000 1734017758.134163 trunc from 0x55eee0 to 0x36d9f8 (0x1f14e7 bytes) 022000 1734017764.155635 trunc from 0x1eed08 to 0x4592b3 (0x26a5ac bytes) 023000 1734017766.958585 write 0x3f6374 thru 0x405ae7 (0xf774 bytes) 024000 1734017769.725123 trunc from 0x54b701 to 0x3f0527 (0x15b1d9 bytes) 029000 1734017785.081381 mapread 0x0d0e15 thru 0x0dad02 (0x9eee bytes) 032000 1734017794.973620 read 0x4359fd thru 0x444e3f (0xf443 bytes) 036000 1734017807.494080 write 0x25d133 thru 0x262881 (0x574f bytes) 037000 1734017810.237434 mapread 0x42d163 thru 0x43b4e0 (0xe37e bytes) 038000 1734017813.450023 write 0x0d7eda thru 0x0e6555 (0xe67c bytes) 039000 1734017816.600363 trunc from 0x24d13c to 0x118062 (0x1350d9 bytes) 041000 1734017823.121429 mapread 0x2dacb0 thru 0x2e6e40 (0xc191 bytes) 042000 1734017826.340832 read 0x368e1c thru 0x3775a0 (0xe785 bytes) 043000 1734017829.315555 mapwrite 0x38e9e0 thru 0x38f3a4 (0x9c5 bytes) 044000 1734017832.661775 write 0x2a332d thru 0x2abcbb (0x898f bytes) 045000 1734017835.708605 read 0x1b4a3a thru 0x1bcc4c (0x8213 bytes) truncating to largest ever: 0x5609c9 050000 1734017851.985963 write 0x07e37e thru 0x080950 (0x25d3 bytes) 051000 1734017854.989567 trunc from 0x257c00 to 0x2ef827 (0x97c28 bytes) 052000 1734017858.001374 trunc from 0x410a82 to 0x1d3516 (0x23d56b bytes) 053000 1734017861.413770 mapread 0x2058ea thru 0x20a727 (0x4e3e bytes) 054000 1734017864.957250 mapwrite 0x01b8de thru 0x028c99 (0xd3bc bytes) 061000 1734017887.953143 read 0x1440c5 thru 0x14e5f9 (0xa535 bytes) 062000 1734017891.035404 trunc from 0x52f7e7 to 0x1b3d76 (0x37ba70 bytes) 064000 1734017897.331985 mapwrite 0x0f95b8 thru 0x0fcfeb (0x3a34 bytes) 067000 1734017906.677644 mapread 0x1dd384 thru 0x1e7263 (0x9ee0 bytes) 070000 1734017917.206287 mapwrite 0x2a3d22 thru 0x2a586c (0x1b4b bytes) skipping zero size read 071000 1734017920.628739 read 0x14692a thru 0x14d79a (0x6e71 bytes) 072000 1734017924.047767 read 0x096b70 thru 0x0a55a8 (0xea39 bytes) 073000 1734017927.649599 mapread 0x020503 thru 0x02f782 (0xf280 bytes) 075000 1734017933.765394 write 0x51a13a thru 0x5252d2 (0xb199 bytes) 076000 1734017936.919165 trunc from 0x434a6f to 0x555a29 (0x120fbb bytes) 077000 1734017939.805878 read 0x210c4e thru 0x218722 (0x7ad5 bytes) 079000 1734017945.975513 trunc from 0x12cd7c to 0x13ca73 (0xfcf8 bytes) 081000 1734017951.919782 mapread 0x3732e0 thru 0x37cd2a (0x9a4b bytes) 082000 1734017955.064370 trunc from 0x4b0d61 to 0x4b1d01 (0xfa1 bytes) 083000 1734017958.215426 read 0x242b70 thru 0x24d5cb (0xaa5c bytes) 085000 1734017964.049067 trunc from 0x54c389 to 0x4686aa (0xe3cde bytes) 086000 1734017967.461443 write 0x1dd78e thru 0x1e42d4 (0x6b47 bytes) 089000 1734017977.153337 mapread 0x38ed43 thru 0x394e77 (0x6135 bytes) 093000 1734017989.175947 read 0x209b21 thru 0x2168ef (0xcdcf bytes) 096000 1734017998.559148 trunc from 0x083e36 to 0x317452 (0x29361d bytes) 097000 1734018001.698656 trunc from 0x53b808 to 0x4c5df7 (0x75a10 bytes) 099000 1734018006.956202 mapwrite 0x14eba0 thru 0x15b05e (0xc4bf bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5435821 (5376 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (314s) == sanity-benchmark test complete, duration 2176 sec ===== 10:40:11 (1734018011) === sanity-benchmark: start cleanup 10:40:11 (1734018011) === === sanity-benchmark: finish cleanup 10:40:12 (1734018012) ===