-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:54 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:58 (1734015838) === oleg435-client.virtnet: executing check_config_client /mnt/lustre oleg435-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg435-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ae4f3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ae4f3000.idle_timeout=debug disable quota as required oleg435-server: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:11 (1734015851) === == sanity-benchmark test dbench: dbench ================== 10:04:12 (1734015852) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7713] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg435-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg435-client.virtnet at Thu Dec 12 10:04:14 EST 2024 waiting for dbench pid 10297 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 20 of 20 processes prepared for launch 0 sec releasing clients 3 19 12.72 MB/sec warmup 1 sec latency 919.969 ms 20 110 49.68 MB/sec warmup 2 sec latency 178.520 ms 20 181 48.89 MB/sec warmup 3 sec latency 180.340 ms 20 248 47.17 MB/sec warmup 4 sec latency 117.412 ms 20 307 45.07 MB/sec warmup 5 sec latency 167.141 ms 20 361 43.04 MB/sec warmup 6 sec latency 144.073 ms 20 426 42.96 MB/sec warmup 7 sec latency 131.813 ms 20 482 41.91 MB/sec warmup 8 sec latency 148.180 ms 20 547 41.50 MB/sec warmup 9 sec latency 386.388 ms 20 627 41.64 MB/sec warmup 10 sec latency 460.264 ms 20 674 38.46 MB/sec warmup 11 sec latency 478.894 ms 20 711 35.34 MB/sec warmup 12 sec latency 316.290 ms 20 738 32.78 MB/sec warmup 13 sec latency 339.883 ms 20 780 30.53 MB/sec warmup 14 sec latency 275.766 ms 20 807 28.63 MB/sec warmup 15 sec latency 513.137 ms 20 859 26.96 MB/sec warmup 16 sec latency 276.360 ms 20 897 25.50 MB/sec warmup 17 sec latency 309.032 ms 20 932 24.24 MB/sec warmup 18 sec latency 354.182 ms 20 980 23.13 MB/sec warmup 19 sec latency 362.097 ms 20 1027 22.34 MB/sec warmup 20 sec latency 380.760 ms 20 1111 21.85 MB/sec warmup 21 sec latency 322.760 ms 20 1179 21.04 MB/sec warmup 22 sec latency 107.525 ms 20 1236 20.29 MB/sec warmup 23 sec latency 128.711 ms 20 1419 35.22 MB/sec execute 1 sec latency 386.646 ms 20 1468 19.21 MB/sec execute 2 sec latency 414.603 ms 20 1513 12.99 MB/sec execute 3 sec latency 480.590 ms 20 1575 10.05 MB/sec execute 4 sec latency 230.817 ms 20 1631 8.23 MB/sec execute 5 sec latency 263.324 ms 20 1675 7.00 MB/sec execute 6 sec latency 426.523 ms 20 1723 6.09 MB/sec execute 7 sec latency 262.700 ms 20 1801 5.50 MB/sec execute 8 sec latency 302.817 ms 20 1860 4.99 MB/sec execute 9 sec latency 309.605 ms 20 1905 4.56 MB/sec execute 10 sec latency 369.825 ms 20 1980 4.30 MB/sec execute 11 sec latency 265.891 ms 20 2036 4.06 MB/sec execute 12 sec latency 123.160 ms 20 2105 3.98 MB/sec execute 13 sec latency 95.138 ms 20 2172 3.85 MB/sec execute 14 sec latency 292.564 ms 20 2209 3.79 MB/sec execute 15 sec latency 531.374 ms 20 2269 3.75 MB/sec execute 16 sec latency 429.650 ms 20 2359 4.48 MB/sec execute 17 sec latency 317.296 ms 20 2395 4.36 MB/sec execute 18 sec latency 465.705 ms 20 2435 4.29 MB/sec execute 19 sec latency 505.045 ms 20 2462 4.31 MB/sec execute 20 sec latency 816.495 ms 20 2515 4.57 MB/sec execute 21 sec latency 1316.585 ms 20 2608 5.02 MB/sec execute 22 sec latency 425.104 ms 20 2681 5.21 MB/sec execute 23 sec latency 414.795 ms 20 2789 6.45 MB/sec execute 24 sec latency 439.423 ms 20 2910 6.89 MB/sec execute 25 sec latency 537.114 ms 20 2973 7.25 MB/sec execute 26 sec latency 498.105 ms 20 3045 7.14 MB/sec execute 27 sec latency 352.903 ms 20 3150 7.15 MB/sec execute 28 sec latency 448.862 ms 20 3269 7.55 MB/sec execute 29 sec latency 362.804 ms 20 3359 7.71 MB/sec execute 30 sec latency 358.897 ms 20 3433 7.89 MB/sec execute 31 sec latency 236.078 ms 20 3565 8.89 MB/sec execute 32 sec latency 98.355 ms 20 3641 8.82 MB/sec execute 33 sec latency 114.210 ms 20 3704 8.69 MB/sec execute 34 sec latency 114.066 ms 20 3758 8.68 MB/sec execute 35 sec latency 181.912 ms 20 3814 8.70 MB/sec execute 36 sec latency 115.930 ms 20 3853 8.47 MB/sec execute 37 sec latency 126.725 ms 20 3896 8.29 MB/sec execute 38 sec latency 113.211 ms 20 3938 8.17 MB/sec execute 39 sec latency 148.852 ms 20 3969 7.96 MB/sec execute 40 sec latency 166.802 ms 20 4012 7.77 MB/sec execute 41 sec latency 126.661 ms 20 4060 7.60 MB/sec execute 42 sec latency 383.369 ms 20 4103 7.42 MB/sec execute 43 sec latency 399.193 ms 20 4158 7.27 MB/sec execute 44 sec latency 356.909 ms 20 4192 7.12 MB/sec execute 45 sec latency 519.183 ms 20 4230 7.00 MB/sec execute 46 sec latency 668.559 ms 20 4259 6.89 MB/sec execute 47 sec latency 500.756 ms 20 4294 6.77 MB/sec execute 48 sec latency 381.530 ms 20 4320 6.66 MB/sec execute 49 sec latency 312.926 ms 20 4355 6.56 MB/sec execute 50 sec latency 538.811 ms 20 4388 6.47 MB/sec execute 51 sec latency 291.027 ms 20 4435 6.38 MB/sec execute 52 sec latency 242.102 ms 20 4473 6.30 MB/sec execute 53 sec latency 419.503 ms 20 4510 6.25 MB/sec execute 54 sec latency 306.519 ms 20 4562 6.21 MB/sec execute 55 sec latency 377.686 ms 20 4604 6.18 MB/sec execute 56 sec latency 414.380 ms 20 4680 6.29 MB/sec execute 57 sec latency 197.078 ms 20 4752 6.31 MB/sec execute 58 sec latency 96.574 ms 20 4814 6.26 MB/sec execute 59 sec latency 127.162 ms 20 4877 6.29 MB/sec execute 60 sec latency 292.683 ms 20 4986 6.88 MB/sec execute 61 sec latency 125.184 ms 20 5024 6.78 MB/sec execute 62 sec latency 359.045 ms 20 5076 6.68 MB/sec execute 63 sec latency 262.222 ms 20 5132 6.59 MB/sec execute 64 sec latency 268.839 ms 20 5172 6.50 MB/sec execute 65 sec latency 285.916 ms 20 5219 6.41 MB/sec execute 66 sec latency 287.911 ms 20 5269 6.33 MB/sec execute 67 sec latency 359.394 ms 20 5319 6.25 MB/sec execute 68 sec latency 225.004 ms 20 5371 6.17 MB/sec execute 69 sec latency 252.408 ms 20 5407 6.09 MB/sec execute 70 sec latency 236.555 ms 20 5462 6.02 MB/sec execute 71 sec latency 244.181 ms 20 5517 5.95 MB/sec execute 72 sec latency 335.636 ms 20 5596 5.90 MB/sec execute 73 sec latency 262.681 ms 20 5655 5.87 MB/sec execute 74 sec latency 103.875 ms 20 5720 5.81 MB/sec execute 75 sec latency 239.906 ms 20 5786 5.79 MB/sec execute 76 sec latency 292.501 ms 20 5858 5.82 MB/sec execute 77 sec latency 292.722 ms 20 5923 5.87 MB/sec execute 78 sec latency 515.971 ms 20 5977 5.86 MB/sec execute 79 sec latency 535.091 ms 20 6025 5.88 MB/sec execute 80 sec latency 675.444 ms 20 6076 5.89 MB/sec execute 81 sec latency 699.261 ms 20 6154 6.02 MB/sec execute 82 sec latency 323.714 ms 20 6252 6.15 MB/sec execute 83 sec latency 430.828 ms 20 6371 6.34 MB/sec execute 84 sec latency 313.549 ms 20 6475 6.57 MB/sec execute 85 sec latency 412.072 ms 20 6577 6.65 MB/sec execute 86 sec latency 334.825 ms 20 6646 6.68 MB/sec execute 87 sec latency 428.347 ms 20 6753 6.74 MB/sec execute 88 sec latency 479.276 ms 20 6877 6.88 MB/sec execute 89 sec latency 401.246 ms 20 6945 6.90 MB/sec execute 90 sec latency 529.723 ms 20 7035 7.02 MB/sec execute 91 sec latency 262.495 ms 20 7131 7.18 MB/sec execute 92 sec latency 238.550 ms 20 7212 7.28 MB/sec execute 93 sec latency 112.596 ms 20 7264 7.24 MB/sec execute 94 sec latency 171.644 ms 20 7319 7.23 MB/sec execute 95 sec latency 147.773 ms 20 7376 7.23 MB/sec execute 96 sec latency 111.841 ms 20 7425 7.18 MB/sec execute 97 sec latency 107.738 ms 20 7474 7.13 MB/sec execute 98 sec latency 106.807 ms 20 7513 7.07 MB/sec execute 99 sec latency 175.497 ms 20 7555 7.01 MB/sec execute 100 sec latency 135.670 ms 20 7600 6.94 MB/sec execute 101 sec latency 498.146 ms 20 7651 6.88 MB/sec execute 102 sec latency 273.589 ms 20 7700 6.82 MB/sec execute 103 sec latency 432.938 ms 20 7747 6.76 MB/sec execute 104 sec latency 423.830 ms 20 7784 6.71 MB/sec execute 105 sec latency 489.143 ms 20 7818 6.66 MB/sec execute 106 sec latency 623.589 ms 20 7850 6.62 MB/sec execute 107 sec latency 298.703 ms 20 7884 6.57 MB/sec execute 108 sec latency 316.666 ms 20 7922 6.53 MB/sec execute 109 sec latency 325.259 ms 20 7953 6.48 MB/sec execute 110 sec latency 584.220 ms 20 7991 6.45 MB/sec execute 111 sec latency 294.116 ms 20 8045 6.42 MB/sec execute 112 sec latency 317.100 ms 20 8091 6.40 MB/sec execute 113 sec latency 361.309 ms 20 8146 6.38 MB/sec execute 114 sec latency 342.898 ms 20 8213 6.43 MB/sec execute 115 sec latency 262.228 ms 20 8300 6.49 MB/sec execute 116 sec latency 140.466 ms 20 8366 6.47 MB/sec execute 117 sec latency 280.528 ms 20 8438 6.50 MB/sec execute 118 sec latency 296.918 ms 20 8519 6.58 MB/sec execute 119 sec latency 213.016 ms 20 cleanup 120 sec 20 cleanup 121 sec 14 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25141 46.125 222.338 Close 18423 12.023 100.170 Rename 1042 70.825 248.155 Unlink 5027 16.133 90.791 Qpathinfo 23105 11.551 166.298 Qfileinfo 4002 0.261 25.231 Qfsinfo 4123 0.239 32.350 Sfileinfo 2043 45.637 161.528 Find 8809 3.809 189.506 WriteX 12350 5.186 123.178 ReadX 39902 0.029 6.002 LockX 80 12.577 30.744 UnlockX 80 12.518 28.975 Flush 1732 232.827 1316.578 Throughput 6.5763 MB/sec 20 clients 20 procs max_latency=1316.585 ms stopping dbench on /mnt/lustre/d0.oleg435-client.virtnet at Thu Dec 12 10:06:40 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg435-client.virtnet /mnt/lustre/d0.oleg435-client.virtnet /mnt/lustre/d0.oleg435-client.virtnet removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg435-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:47 (1734016007) min OST has 3619840kB available, using 5429760kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7713] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5302] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg435-clien 5302M 75141 58 48751 42 109719 28 574.0 116 Latency 28456us 270ms 88953us 696ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg435-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 234 17 6540 29 296 12 280 17 720 12 239 12 Latency 19093us 18120us 61437us 25507us 14041us 28907us 1.97,1.97,oleg435-client.virtnet,1,1734004853,5302M,,,,75141,58,48751,42,,,109719,28,574.0,116,10,,,,,234,17,6540,29,296,12,280,17,720,12,239,12,,28456us,270ms,,88953us,696ms,19093us,18120us,61437us,25507us,14041us,28907us debug=0x33f0484 PASS bonnie (430s) == sanity-benchmark test iozone: iozone ================== 10:13:57 (1734016437) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7713] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:16 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 114075 118361 120167 150709 56865 99175 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:34 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23019 23320 92686 100663 99200 31582 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1259s) == sanity-benchmark test fsx: fsx ======================== 10:34:56 (1734017696) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 18035 -P /tmp -l 5642496 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 18035 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1c39ec truncating to largest ever: 0x3136d4 truncating to largest ever: 0x329635 truncating to largest ever: 0x37b358 truncating to largest ever: 0x4867ec truncating to largest ever: 0x50ea86 truncating to largest ever: 0x54cefb truncating to largest ever: 0x5554a8 003000 1734017704.879741 write 0x2e9f51 thru 0x2f2fa6 (0x9056 bytes) truncating to largest ever: 0x55551d 006000 1734017713.132943 read 0x1faf01 thru 0x203ef5 (0x8ff5 bytes) truncating to largest ever: 0x55b391 truncating to largest ever: 0x55fc3d 008000 1734017719.150243 read 0x0196cc thru 0x01e6a5 (0x4fda bytes) skipping zero size read 010000 1734017724.842288 write 0x3fbc8e thru 0x4092b1 (0xd624 bytes) 011000 1734017727.386425 write 0x1a855c thru 0x1b1419 (0x8ebe bytes) 012000 1734017730.502708 read 0x1f96e4 thru 0x1fb92b (0x2248 bytes) truncating to largest ever: 0x5606b1 013000 1734017733.619822 trunc from 0x3c18e5 to 0x25e997 (0x162f4d bytes) 018000 1734017747.892581 mapread 0x0481ba thru 0x056e19 (0xec60 bytes) 019000 1734017751.520816 mapread 0x21f467 thru 0x224333 (0x4ecd bytes) 021000 1734017758.299458 write 0x283403 thru 0x2878c5 (0x44c3 bytes) 024000 1734017767.101822 read 0x3a6f45 thru 0x3afd4a (0x8e06 bytes) 025000 1734017770.177621 read 0x3b2551 thru 0x3b931c (0x6dcc bytes) 026000 1734017773.398548 trunc from 0x44941f to 0x506648 (0xbd22a bytes) 027000 1734017775.852410 trunc from 0x135895 to 0x4120b9 (0x2dc825 bytes) 028000 1734017779.070371 trunc from 0x338573 to 0x22d6ce (0x10aea4 bytes) 029000 1734017782.533017 mapread 0x026aa5 thru 0x031c76 (0xb1d2 bytes) 033000 1734017795.811676 mapread 0x10cae3 thru 0x11388e (0x6dac bytes) 034000 1734017799.150107 mapread 0x002112 thru 0x002f77 (0xe66 bytes) 037000 1734017808.059633 mapread 0x2041f8 thru 0x212316 (0xe11f bytes) truncating to largest ever: 0x5615f9 042000 1734017823.547104 write 0x1bbbb4 thru 0x1c68be (0xad0b bytes) 043000 1734017826.420405 read 0x268224 thru 0x26912b (0xf08 bytes) 044000 1734017829.876359 trunc from 0x521c5c to 0x17bf18 (0x3a5d43 bytes) 046000 1734017836.366843 trunc from 0x3d2d9b to 0x1d8bc7 (0x1fa1d3 bytes) 047000 1734017839.709623 mapread 0x3b68e9 thru 0x3c0135 (0x984d bytes) 048000 1734017842.995055 read 0x026768 thru 0x02f4d2 (0x8d6b bytes) 053000 1734017857.926908 trunc from 0x4787bd to 0x046d51 (0x431a6b bytes) 054000 1734017861.665075 write 0x09df76 thru 0x0a125c (0x32e7 bytes) 055000 1734017864.305036 read 0x14e4d1 thru 0x158e30 (0xa960 bytes) 056000 1734017867.384810 read 0x0e97d5 thru 0x0ed2f2 (0x3b1e bytes) 059000 1734017876.510881 mapwrite 0x492702 thru 0x49305e (0x95d bytes) 061000 1734017883.220456 write 0x50cb8c thru 0x511f6a (0x53df bytes) 062000 1734017886.067541 trunc from 0x2d34d9 to 0x40ab13 (0x13763b bytes) 065000 1734017895.891845 read 0x34151c thru 0x35130c (0xfdf1 bytes) 067000 1734017902.035360 mapwrite 0x247836 thru 0x24b273 (0x3a3e bytes) 068000 1734017905.364967 mapread 0x2cee1e thru 0x2dae9f (0xc082 bytes) 070000 1734017911.752472 mapwrite 0x0b65c7 thru 0x0bac87 (0x46c1 bytes) 071000 1734017914.741000 mapread 0x0a1747 thru 0x0a3ae8 (0x23a2 bytes) 072000 1734017917.367316 trunc from 0x55d6af to 0x142bf9 (0x41aab5 bytes) 073000 1734017920.718936 read 0x3afc9d thru 0x3baf79 (0xb2dd bytes) 074000 1734017924.022151 mapwrite 0x4f305d thru 0x4f5fea (0x2f8e bytes) 075000 1734017926.997696 write 0x4d8bb1 thru 0x4e704c (0xe49c bytes) 076000 1734017930.131415 write 0x4c36b3 thru 0x4d06f1 (0xd03f bytes) 077000 1734017933.624858 mapwrite 0x2ebeda thru 0x2eff3d (0x4064 bytes) 082000 1734017948.160615 write 0x1d8e15 thru 0x1da957 (0x1b43 bytes) 085000 1734017957.777661 write 0x166b11 thru 0x16bcc3 (0x51b3 bytes) 087000 1734017964.537521 write 0x3a7b26 thru 0x3b560b (0xdae6 bytes) 089000 1734017970.892042 mapwrite 0x3620e7 thru 0x365012 (0x2f2c bytes) truncating to largest ever: 0x5618ea 092000 1734017981.090081 mapwrite 0x42b184 thru 0x4389ef (0xd86c bytes) 096000 1734017992.575154 mapwrite 0x4e83c9 thru 0x4f1ef1 (0x9b29 bytes) 097000 1734017995.581926 mapread 0x3f9b4d thru 0x3fd879 (0x3d2d bytes) 098000 1734017998.091024 mapwrite 0x4b07a5 thru 0x4bf7ac (0xf008 bytes) 099000 1734018000.958590 mapwrite 0x343487 thru 0x3507ec (0xd366 bytes) 100000 1734018003.500676 write 0x1a8c5c thru 0x1ae34a (0x56ef bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 1773357 (1792 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (308s) == sanity-benchmark test complete, duration 2170 sec ===== 10:40:04 (1734018004) === sanity-benchmark: start cleanup 10:40:04 (1734018004) === === sanity-benchmark: finish cleanup 10:40:05 (1734018005) ===