-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:06 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:14 (1734015854) === oleg235-client.virtnet: executing check_config_client /mnt/lustre oleg235-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg235-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012abb7000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012abb7000.idle_timeout=debug disable quota as required oleg235-server: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:32 (1734015872) === == sanity-benchmark test dbench: dbench ================== 10:04:33 (1734015873) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7741] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg235-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg235-client.virtnet at Thu Dec 12 10:04:35 EST 2024 waiting for dbench pid 10332 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 2 10 4.18 MB/sec warmup 1 sec latency 884.938 ms 11 62 25.75 MB/sec warmup 2 sec latency 621.623 ms 20 121 35.65 MB/sec warmup 3 sec latency 226.843 ms 20 162 33.76 MB/sec warmup 4 sec latency 264.601 ms 20 208 32.68 MB/sec warmup 5 sec latency 198.726 ms 20 254 31.98 MB/sec warmup 6 sec latency 190.828 ms 20 293 31.02 MB/sec warmup 7 sec latency 181.184 ms 20 340 30.71 MB/sec warmup 8 sec latency 185.313 ms 20 389 30.71 MB/sec warmup 9 sec latency 187.834 ms 20 443 31.12 MB/sec warmup 10 sec latency 150.629 ms 20 511 32.08 MB/sec warmup 11 sec latency 150.140 ms 20 562 31.77 MB/sec warmup 12 sec latency 504.464 ms 20 621 31.51 MB/sec warmup 13 sec latency 859.345 ms 20 677 30.22 MB/sec warmup 14 sec latency 347.372 ms 20 704 28.29 MB/sec warmup 15 sec latency 417.485 ms 20 738 26.62 MB/sec warmup 16 sec latency 314.267 ms 20 760 25.11 MB/sec warmup 17 sec latency 351.617 ms 20 790 23.77 MB/sec warmup 18 sec latency 366.726 ms 20 813 22.61 MB/sec warmup 19 sec latency 509.185 ms 20 843 21.54 MB/sec warmup 20 sec latency 413.721 ms 20 880 20.59 MB/sec warmup 21 sec latency 495.545 ms 20 912 19.72 MB/sec warmup 22 sec latency 374.189 ms 20 947 18.98 MB/sec warmup 23 sec latency 397.456 ms 20 1038 6.24 MB/sec execute 1 sec latency 464.136 ms 20 1091 8.31 MB/sec execute 2 sec latency 303.338 ms 20 1137 5.86 MB/sec execute 3 sec latency 162.113 ms 20 1181 4.61 MB/sec execute 4 sec latency 128.039 ms 20 1233 5.55 MB/sec execute 5 sec latency 162.313 ms 20 1279 5.69 MB/sec execute 6 sec latency 151.486 ms 20 1331 6.97 MB/sec execute 7 sec latency 267.883 ms 20 1393 7.98 MB/sec execute 8 sec latency 473.786 ms 20 1447 8.71 MB/sec execute 9 sec latency 590.578 ms 20 1486 7.88 MB/sec execute 10 sec latency 517.049 ms 20 1523 7.22 MB/sec execute 11 sec latency 543.027 ms 20 1568 6.68 MB/sec execute 12 sec latency 354.356 ms 20 1611 6.23 MB/sec execute 13 sec latency 399.537 ms 20 1651 5.83 MB/sec execute 14 sec latency 389.665 ms 20 1693 5.49 MB/sec execute 15 sec latency 420.283 ms 20 1747 5.20 MB/sec execute 16 sec latency 316.302 ms 20 1801 4.95 MB/sec execute 17 sec latency 157.547 ms 20 1849 4.72 MB/sec execute 18 sec latency 417.447 ms 20 1899 4.51 MB/sec execute 19 sec latency 294.465 ms 20 1922 4.30 MB/sec execute 20 sec latency 1295.556 ms 20 1952 4.14 MB/sec execute 21 sec latency 1356.251 ms 20 2022 4.03 MB/sec execute 22 sec latency 326.231 ms 20 2072 3.90 MB/sec execute 23 sec latency 147.305 ms 20 2112 3.80 MB/sec execute 24 sec latency 186.955 ms 20 2160 3.68 MB/sec execute 25 sec latency 134.234 ms 20 2221 3.81 MB/sec execute 26 sec latency 233.007 ms 20 2271 3.83 MB/sec execute 27 sec latency 497.329 ms 20 2335 3.99 MB/sec execute 28 sec latency 403.841 ms 20 2384 4.05 MB/sec execute 29 sec latency 484.420 ms 20 2424 4.06 MB/sec execute 30 sec latency 419.808 ms 20 2472 4.07 MB/sec execute 31 sec latency 427.627 ms 20 2522 4.11 MB/sec execute 32 sec latency 420.019 ms 20 2597 4.63 MB/sec execute 33 sec latency 481.840 ms 20 2703 4.95 MB/sec execute 34 sec latency 366.481 ms 20 2764 5.20 MB/sec execute 35 sec latency 460.675 ms 20 2858 5.86 MB/sec execute 36 sec latency 670.689 ms 20 2945 5.94 MB/sec execute 37 sec latency 544.444 ms 20 3035 6.11 MB/sec execute 38 sec latency 431.918 ms 20 3116 6.17 MB/sec execute 39 sec latency 498.974 ms 20 3243 6.29 MB/sec execute 40 sec latency 357.644 ms 20 3319 6.42 MB/sec execute 41 sec latency 379.998 ms 20 3437 6.97 MB/sec execute 42 sec latency 256.673 ms 20 3519 7.13 MB/sec execute 43 sec latency 261.201 ms 20 3609 7.47 MB/sec execute 44 sec latency 107.328 ms 20 3679 7.45 MB/sec execute 45 sec latency 109.890 ms 20 3726 7.42 MB/sec execute 46 sec latency 169.981 ms 20 3773 7.36 MB/sec execute 47 sec latency 122.040 ms 20 3816 7.35 MB/sec execute 48 sec latency 147.412 ms 20 3854 7.23 MB/sec execute 49 sec latency 136.693 ms 20 3892 7.11 MB/sec execute 50 sec latency 217.559 ms 20 3924 6.99 MB/sec execute 51 sec latency 184.283 ms 20 3958 6.89 MB/sec execute 52 sec latency 168.041 ms 20 3995 6.77 MB/sec execute 53 sec latency 198.840 ms 20 4037 6.65 MB/sec execute 54 sec latency 109.695 ms 20 4093 6.53 MB/sec execute 55 sec latency 112.347 ms 20 4138 6.43 MB/sec execute 56 sec latency 475.339 ms 20 4181 6.33 MB/sec execute 57 sec latency 539.545 ms 20 4236 6.25 MB/sec execute 58 sec latency 418.181 ms 20 4264 6.17 MB/sec execute 59 sec latency 353.963 ms 20 4293 6.09 MB/sec execute 60 sec latency 395.166 ms 20 4327 6.02 MB/sec execute 61 sec latency 356.672 ms 20 4354 5.94 MB/sec execute 62 sec latency 340.994 ms 20 4402 5.88 MB/sec execute 63 sec latency 336.362 ms 20 4442 5.82 MB/sec execute 64 sec latency 395.639 ms 20 4491 5.77 MB/sec execute 65 sec latency 278.397 ms 20 4537 5.74 MB/sec execute 66 sec latency 293.137 ms 20 4607 5.81 MB/sec execute 67 sec latency 222.441 ms 20 4678 5.84 MB/sec execute 68 sec latency 284.079 ms 20 4756 5.85 MB/sec execute 69 sec latency 89.238 ms 20 4828 5.89 MB/sec execute 70 sec latency 98.100 ms 20 4919 6.16 MB/sec execute 71 sec latency 232.682 ms 20 4990 6.31 MB/sec execute 72 sec latency 323.352 ms 20 5047 6.31 MB/sec execute 73 sec latency 279.269 ms 20 5099 6.24 MB/sec execute 74 sec latency 276.864 ms 20 5149 6.17 MB/sec execute 75 sec latency 245.446 ms 20 5201 6.10 MB/sec execute 76 sec latency 253.981 ms 20 5257 6.03 MB/sec execute 77 sec latency 214.475 ms 20 5317 5.96 MB/sec execute 78 sec latency 186.384 ms 20 5368 5.90 MB/sec execute 79 sec latency 207.614 ms 20 5421 5.84 MB/sec execute 80 sec latency 265.397 ms 20 5484 5.78 MB/sec execute 81 sec latency 229.145 ms 20 5549 5.73 MB/sec execute 82 sec latency 224.054 ms 20 5619 5.68 MB/sec execute 83 sec latency 183.339 ms 20 5687 5.63 MB/sec execute 84 sec latency 97.848 ms 20 5761 5.61 MB/sec execute 85 sec latency 314.184 ms 20 5840 5.66 MB/sec execute 86 sec latency 303.027 ms 20 5902 5.68 MB/sec execute 87 sec latency 513.288 ms 20 5950 5.69 MB/sec execute 88 sec latency 449.952 ms 20 5994 5.66 MB/sec execute 89 sec latency 487.001 ms 20 6037 5.66 MB/sec execute 90 sec latency 389.844 ms 20 6106 5.72 MB/sec execute 91 sec latency 306.931 ms 20 6211 5.93 MB/sec execute 92 sec latency 376.557 ms 20 6334 6.11 MB/sec execute 93 sec latency 422.922 ms 20 6428 6.29 MB/sec execute 94 sec latency 473.785 ms 20 6516 6.37 MB/sec execute 95 sec latency 370.900 ms 20 6644 6.45 MB/sec execute 96 sec latency 329.314 ms 20 6734 6.48 MB/sec execute 97 sec latency 373.502 ms 20 6866 6.60 MB/sec execute 98 sec latency 314.721 ms 20 6991 6.84 MB/sec execute 99 sec latency 211.820 ms 20 7100 6.98 MB/sec execute 100 sec latency 208.066 ms 20 7208 7.07 MB/sec execute 101 sec latency 75.846 ms 20 7290 7.11 MB/sec execute 102 sec latency 91.488 ms 20 7362 7.13 MB/sec execute 103 sec latency 80.790 ms 20 7418 7.09 MB/sec execute 104 sec latency 103.053 ms 20 7484 7.05 MB/sec execute 105 sec latency 86.989 ms 20 7543 6.99 MB/sec execute 106 sec latency 79.359 ms 20 7606 6.93 MB/sec execute 107 sec latency 78.277 ms 20 7672 6.87 MB/sec execute 108 sec latency 333.522 ms 20 7740 6.82 MB/sec execute 109 sec latency 309.890 ms 20 7796 6.78 MB/sec execute 110 sec latency 396.902 ms 20 7837 6.74 MB/sec execute 111 sec latency 265.386 ms 20 7886 6.70 MB/sec execute 112 sec latency 244.732 ms 20 7933 6.66 MB/sec execute 113 sec latency 204.988 ms 20 7992 6.62 MB/sec execute 114 sec latency 216.250 ms 20 8051 6.60 MB/sec execute 115 sec latency 253.331 ms 20 8105 6.59 MB/sec execute 116 sec latency 206.651 ms 20 8186 6.64 MB/sec execute 117 sec latency 267.441 ms 20 8272 6.63 MB/sec execute 118 sec latency 214.035 ms 20 8357 6.63 MB/sec execute 119 sec latency 82.420 ms 20 cleanup 120 sec 20 cleanup 121 sec 1 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25480 45.416 265.661 Close 18875 12.260 85.655 Rename 1164 71.737 266.086 Unlink 5109 14.787 79.870 Qpathinfo 23866 12.085 193.538 Qfileinfo 4046 0.308 41.851 Qfsinfo 4351 0.215 28.235 Sfileinfo 2330 46.241 193.562 Find 8985 4.326 151.679 WriteX 12771 5.490 178.329 ReadX 40419 0.041 19.954 LockX 80 14.400 37.421 UnlockX 80 12.675 26.615 Flush 1744 195.803 1356.235 Throughput 6.63257 MB/sec 20 clients 20 procs max_latency=1356.251 ms stopping dbench on /mnt/lustre/d0.oleg235-client.virtnet at Thu Dec 12 10:07:02 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg235-client.virtnet /mnt/lustre/d0.oleg235-client.virtnet /mnt/lustre/d0.oleg235-client.virtnet removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg235-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:10 (1734016030) min OST has 3602432kB available, using 5403648kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7741] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5277] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg235-clien 5277M 74333 58 52225 45 168782 43 1185 150 Latency 26668us 304ms 77593us 256ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg235-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 238 16 6566 28 380 12 309 17 935 12 112 9 Latency 16438us 20320us 56180us 25924us 7964us 125ms 1.97,1.97,oleg235-client.virtnet,1,1734004864,5277M,,,,74333,58,52225,45,,,168782,43,1185,150,10,,,,,238,16,6566,28,380,12,309,17,935,12,112,9,,26668us,304ms,,77593us,256ms,16438us,20320us,56180us,25924us,7964us,125ms debug=0x33f0484 PASS bonnie (433s) == sanity-benchmark test iozone: iozone ================== 10:14:23 (1734016463) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7741] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:41 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 117343 138523 185396 275653 45436 203179 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:08 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 24775 27641 97975 103735 91207 40445 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1110s) == sanity-benchmark test fsx: fsx ======================== 10:32:53 (1734017573) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 6301 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 6301 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2dcf13 truncating to largest ever: 0x4db3f4 truncating to largest ever: 0x4dfb7b truncating to largest ever: 0x539115 truncating to largest ever: 0x53ca18 truncating to largest ever: 0x545f0d truncating to largest ever: 0x5587e8 truncating to largest ever: 0x55d4ed 005000 1734017587.981094 mapwrite 0x198e26 thru 0x19f493 (0x666e bytes) 007000 1734017593.909743 mapwrite 0x361ed9 thru 0x364072 (0x219a bytes) 008000 1734017597.009123 mapread 0x1b1867 thru 0x1b8361 (0x6afb bytes) 009000 1734017599.869105 mapread 0x014259 thru 0x02113d (0xcee5 bytes) 010000 1734017602.364862 read 0x13faa0 thru 0x146e0e (0x736f bytes) truncating to largest ever: 0x560157 011000 1734017605.003930 mapread 0x36ef23 thru 0x378a1f (0x9afd bytes) 012000 1734017607.565137 write 0x0271a1 thru 0x032161 (0xafc1 bytes) 017000 1734017621.808576 mapwrite 0x1c8407 thru 0x1cb008 (0x2c02 bytes) 018000 1734017624.631292 trunc from 0x3c66b9 to 0x31098b (0xb5d2d bytes) 019000 1734017627.490879 read 0x341b6f thru 0x343bcb (0x205d bytes) 020000 1734017629.959513 read 0x1233dc thru 0x12adc5 (0x79ea bytes) truncating to largest ever: 0x5613b9 022000 1734017634.950244 trunc from 0x3b26d9 to 0x511288 (0x15ebb0 bytes) 024000 1734017640.628629 read 0x1622bb thru 0x16513a (0x2e80 bytes) 025000 1734017643.681019 write 0x26025c thru 0x2681bd (0x7f62 bytes) 029000 1734017656.225355 write 0x197da3 thru 0x1a4648 (0xc8a6 bytes) 031000 1734017661.469805 mapwrite 0x38d2db thru 0x392a31 (0x5757 bytes) 033000 1734017667.127916 read 0x1fb2dd thru 0x20665d (0xb381 bytes) 034000 1734017669.670477 mapwrite 0x284a61 thru 0x2882a8 (0x3848 bytes) truncating to largest ever: 0x5614de 038000 1734017680.557503 mapwrite 0x485687 thru 0x4905ce (0xaf48 bytes) 040000 1734017686.935258 mapwrite 0x191562 thru 0x191f69 (0xa08 bytes) 042000 1734017692.337363 mapwrite 0x46b2a8 thru 0x46cb11 (0x186a bytes) 045000 1734017700.431407 write 0x05c0e1 thru 0x0687e4 (0xc704 bytes) 049000 1734017712.300048 mapwrite 0x004458 thru 0x01103f (0xcbe8 bytes) 051000 1734017717.448647 read 0x0e20bf thru 0x0e3b2e (0x1a70 bytes) 053000 1734017723.670477 mapread 0x468b1d thru 0x4736c6 (0xabaa bytes) 057000 1734017734.670626 mapread 0x218c56 thru 0x221a09 (0x8db4 bytes) 059000 1734017739.866737 trunc from 0x0dd499 to 0x3d325d (0x2f5dc5 bytes) 062000 1734017748.622310 mapwrite 0x2852c6 thru 0x28f4ea (0xa225 bytes) 063000 1734017751.352585 read 0x3035c1 thru 0x30bbcb (0x860b bytes) 066000 1734017759.097111 mapwrite 0x2a4bef thru 0x2a4fe3 (0x3f5 bytes) 070000 1734017770.499269 read 0x0b2f3e thru 0x0c0e67 (0xdf2a bytes) 071000 1734017773.497151 read 0x37b41b thru 0x387d89 (0xc96f bytes) 072000 1734017776.205099 mapread 0x438712 thru 0x4478fd (0xf1ec bytes) 074000 1734017781.637913 read 0x1d17d7 thru 0x1d3bdb (0x2405 bytes) 075000 1734017784.771797 trunc from 0x4565e2 to 0x3e608a (0x70557 bytes) 076000 1734017787.374368 mapread 0x09d225 thru 0x0a09c8 (0x37a4 bytes) 077000 1734017790.117318 trunc from 0x5238fa to 0x465870 (0xbe089 bytes) 078000 1734017792.549089 read 0x178f35 thru 0x1884f2 (0xf5be bytes) 081000 1734017800.814368 read 0x04a95d thru 0x058d6d (0xe411 bytes) 082000 1734017803.520580 trunc from 0x4a6609 to 0x4101b7 (0x96451 bytes) 083000 1734017806.248863 write 0x39b2f1 thru 0x3a570e (0xa41e bytes) 084000 1734017810.681897 trunc from 0x4544ec to 0x3c45b4 (0x8ff37 bytes) 086000 1734017816.902517 write 0x062244 thru 0x06e2c6 (0xc083 bytes) 087000 1734017820.624263 mapwrite 0x13ac35 thru 0x1414f1 (0x68bd bytes) 089000 1734017829.545309 write 0x3ee303 thru 0x3f3648 (0x5346 bytes) 092000 1734017843.527195 mapwrite 0x0b9f75 thru 0x0c7904 (0xd990 bytes) 095000 1734017855.682663 mapwrite 0x3598ea thru 0x3687e0 (0xeef7 bytes) 096000 1734017861.504801 mapwrite 0x42be67 thru 0x43b9e4 (0xfb7e bytes) 098000 1734017871.916621 read 0x1d6bf8 thru 0x1e32fc (0xc705 bytes) 100000 1734017881.678447 mapread 0x0d0f33 thru 0x0e0db7 (0xfe85 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4775980 (4736 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (310s) == sanity-benchmark test complete, duration 2037 sec ===== 10:38:03 (1734017883) === sanity-benchmark: start cleanup 10:38:03 (1734017883) === === sanity-benchmark: finish cleanup 10:38:04 (1734017884) ===