-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:43 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:48 (1734015828) === oleg337-client.virtnet: executing check_config_client /mnt/lustre oleg337-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg337-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b3dad000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3dad000.idle_timeout=debug disable quota as required oleg337-server: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:03:57 (1734015837) === == sanity-benchmark test dbench: dbench ================== 10:03:58 (1734015838) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6980] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg337-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg337-client.virtnet at Thu Dec 12 10:03:59 EST 2024 waiting for dbench pid 9448 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 71 62.58 MB/sec warmup 1 sec latency 120.832 ms 20 153 64.51 MB/sec warmup 2 sec latency 183.755 ms 20 241 61.36 MB/sec warmup 3 sec latency 104.202 ms 20 331 59.94 MB/sec warmup 4 sec latency 123.276 ms 20 421 59.41 MB/sec warmup 5 sec latency 93.076 ms 20 515 59.63 MB/sec warmup 6 sec latency 94.025 ms 20 648 60.15 MB/sec warmup 7 sec latency 151.163 ms 20 695 52.93 MB/sec warmup 8 sec latency 355.148 ms 20 730 47.31 MB/sec warmup 9 sec latency 386.369 ms 20 775 42.71 MB/sec warmup 10 sec latency 178.743 ms 20 813 39.05 MB/sec warmup 11 sec latency 261.983 ms 20 875 36.05 MB/sec warmup 12 sec latency 196.375 ms 20 910 33.37 MB/sec warmup 13 sec latency 217.650 ms 20 961 31.15 MB/sec warmup 14 sec latency 239.214 ms 20 1020 29.69 MB/sec warmup 15 sec latency 226.543 ms 20 1110 28.67 MB/sec warmup 16 sec latency 106.979 ms 20 1174 27.06 MB/sec warmup 17 sec latency 97.808 ms 20 1242 25.79 MB/sec warmup 18 sec latency 86.864 ms 20 1328 25.56 MB/sec warmup 19 sec latency 128.376 ms 20 1427 26.00 MB/sec warmup 20 sec latency 167.545 ms 20 1478 24.78 MB/sec warmup 21 sec latency 199.084 ms 20 1526 23.69 MB/sec warmup 22 sec latency 269.516 ms 20 1585 22.70 MB/sec warmup 23 sec latency 268.638 ms 20 1688 0.99 MB/sec execute 1 sec latency 273.550 ms 20 1747 0.94 MB/sec execute 2 sec latency 115.626 ms 20 1811 0.94 MB/sec execute 3 sec latency 104.935 ms 20 1861 0.95 MB/sec execute 4 sec latency 265.056 ms 20 1918 0.93 MB/sec execute 5 sec latency 168.102 ms 20 1984 1.04 MB/sec execute 6 sec latency 203.089 ms 20 2038 1.09 MB/sec execute 7 sec latency 99.393 ms 20 2092 1.16 MB/sec execute 8 sec latency 107.672 ms 20 2144 1.16 MB/sec execute 9 sec latency 117.714 ms 20 2194 1.26 MB/sec execute 10 sec latency 268.021 ms 20 2255 1.85 MB/sec execute 11 sec latency 288.387 ms 20 2333 2.50 MB/sec execute 12 sec latency 316.422 ms 20 2383 2.76 MB/sec execute 13 sec latency 343.605 ms 20 2427 2.77 MB/sec execute 14 sec latency 376.423 ms 20 2458 2.90 MB/sec execute 15 sec latency 648.744 ms 20 2493 3.21 MB/sec execute 16 sec latency 1616.849 ms 20 2578 3.62 MB/sec execute 17 sec latency 229.729 ms 20 2690 4.90 MB/sec execute 18 sec latency 366.191 ms 20 2783 5.73 MB/sec execute 19 sec latency 425.398 ms 20 2899 6.92 MB/sec execute 20 sec latency 403.586 ms 20 2983 6.98 MB/sec execute 21 sec latency 342.307 ms 20 3044 6.86 MB/sec execute 22 sec latency 461.424 ms 20 3169 7.04 MB/sec execute 23 sec latency 438.879 ms 20 3277 7.53 MB/sec execute 24 sec latency 379.210 ms 20 3374 7.83 MB/sec execute 25 sec latency 348.590 ms 20 3455 8.16 MB/sec execute 26 sec latency 298.304 ms 20 3566 9.02 MB/sec execute 27 sec latency 109.444 ms 20 3635 8.90 MB/sec execute 28 sec latency 112.241 ms 20 3695 8.78 MB/sec execute 29 sec latency 98.861 ms 20 3735 8.60 MB/sec execute 30 sec latency 186.298 ms 20 3791 8.68 MB/sec execute 31 sec latency 127.150 ms 20 3836 8.50 MB/sec execute 32 sec latency 118.359 ms 20 3876 8.26 MB/sec execute 33 sec latency 106.890 ms 20 3917 8.12 MB/sec execute 34 sec latency 102.619 ms 20 3943 7.93 MB/sec execute 35 sec latency 189.992 ms 20 3979 7.71 MB/sec execute 36 sec latency 136.466 ms 20 4018 7.50 MB/sec execute 37 sec latency 112.692 ms 20 4065 7.31 MB/sec execute 38 sec latency 89.606 ms 20 4098 7.13 MB/sec execute 39 sec latency 285.574 ms 20 4153 6.97 MB/sec execute 40 sec latency 345.759 ms 20 4210 6.82 MB/sec execute 41 sec latency 337.699 ms 20 4249 6.72 MB/sec execute 42 sec latency 435.597 ms 20 4280 6.59 MB/sec execute 43 sec latency 252.189 ms 20 4315 6.49 MB/sec execute 44 sec latency 305.511 ms 20 4347 6.37 MB/sec execute 45 sec latency 544.699 ms 20 4385 6.28 MB/sec execute 46 sec latency 735.723 ms 20 4424 6.18 MB/sec execute 47 sec latency 309.335 ms 20 4475 6.11 MB/sec execute 48 sec latency 322.881 ms 20 4516 6.06 MB/sec execute 49 sec latency 317.156 ms 20 4555 5.99 MB/sec execute 50 sec latency 365.156 ms 20 4603 5.98 MB/sec execute 51 sec latency 376.375 ms 20 4658 6.06 MB/sec execute 52 sec latency 358.806 ms 20 4725 6.06 MB/sec execute 53 sec latency 102.034 ms 20 4785 6.06 MB/sec execute 54 sec latency 122.069 ms 20 4844 6.05 MB/sec execute 55 sec latency 262.149 ms 20 4919 6.30 MB/sec execute 56 sec latency 131.578 ms 20 4998 6.65 MB/sec execute 57 sec latency 251.131 ms 20 5043 6.54 MB/sec execute 58 sec latency 202.078 ms 20 5086 6.44 MB/sec execute 59 sec latency 253.772 ms 20 5131 6.35 MB/sec execute 60 sec latency 257.782 ms 20 5175 6.26 MB/sec execute 61 sec latency 171.999 ms 20 5212 6.17 MB/sec execute 62 sec latency 178.519 ms 20 5263 6.08 MB/sec execute 63 sec latency 188.044 ms 20 5305 6.00 MB/sec execute 64 sec latency 131.948 ms 20 5347 5.92 MB/sec execute 65 sec latency 191.773 ms 20 5387 5.84 MB/sec execute 66 sec latency 205.377 ms 20 5431 5.76 MB/sec execute 67 sec latency 171.225 ms 20 5480 5.69 MB/sec execute 68 sec latency 155.919 ms 20 5542 5.63 MB/sec execute 69 sec latency 191.110 ms 20 5605 5.57 MB/sec execute 70 sec latency 194.837 ms 20 5651 5.52 MB/sec execute 71 sec latency 135.477 ms 20 5715 5.48 MB/sec execute 72 sec latency 213.354 ms 20 5776 5.46 MB/sec execute 73 sec latency 245.022 ms 20 5830 5.44 MB/sec execute 74 sec latency 227.862 ms 20 5885 5.47 MB/sec execute 75 sec latency 320.212 ms 20 5955 5.52 MB/sec execute 76 sec latency 331.801 ms 20 6002 5.53 MB/sec execute 77 sec latency 335.939 ms 20 6061 5.55 MB/sec execute 78 sec latency 329.732 ms 20 6130 5.65 MB/sec execute 79 sec latency 286.900 ms 20 6206 5.74 MB/sec execute 80 sec latency 377.211 ms 20 6314 5.98 MB/sec execute 81 sec latency 375.402 ms 20 6409 6.13 MB/sec execute 82 sec latency 438.556 ms 20 6511 6.32 MB/sec execute 83 sec latency 340.017 ms 20 6604 6.37 MB/sec execute 84 sec latency 318.713 ms 20 6702 6.41 MB/sec execute 85 sec latency 378.349 ms 20 6806 6.50 MB/sec execute 86 sec latency 401.639 ms 20 6915 6.64 MB/sec execute 87 sec latency 345.623 ms 20 6996 6.75 MB/sec execute 88 sec latency 446.236 ms 20 7080 6.88 MB/sec execute 89 sec latency 164.379 ms 20 7158 7.01 MB/sec execute 90 sec latency 143.170 ms 20 7216 6.98 MB/sec execute 91 sec latency 107.920 ms 20 7272 6.96 MB/sec execute 92 sec latency 93.281 ms 20 7317 6.94 MB/sec execute 93 sec latency 167.504 ms 20 7368 6.96 MB/sec execute 94 sec latency 121.889 ms 20 7407 6.90 MB/sec execute 95 sec latency 126.947 ms 20 7450 6.84 MB/sec execute 96 sec latency 92.466 ms 20 7499 6.79 MB/sec execute 97 sec latency 98.575 ms 20 7527 6.73 MB/sec execute 98 sec latency 212.516 ms 20 7571 6.67 MB/sec execute 99 sec latency 99.143 ms 20 7606 6.60 MB/sec execute 100 sec latency 331.688 ms 20 7648 6.54 MB/sec execute 101 sec latency 325.839 ms 20 7690 6.48 MB/sec execute 102 sec latency 326.850 ms 20 7746 6.43 MB/sec execute 103 sec latency 326.749 ms 20 7798 6.39 MB/sec execute 104 sec latency 388.940 ms 20 7825 6.34 MB/sec execute 105 sec latency 474.869 ms 20 7859 6.30 MB/sec execute 106 sec latency 596.343 ms 20 7895 6.25 MB/sec execute 107 sec latency 317.260 ms 20 7935 6.21 MB/sec execute 108 sec latency 323.598 ms 20 7975 6.18 MB/sec execute 109 sec latency 286.688 ms 20 8021 6.14 MB/sec execute 110 sec latency 286.526 ms 20 8067 6.13 MB/sec execute 111 sec latency 244.840 ms 20 8108 6.11 MB/sec execute 112 sec latency 440.722 ms 20 8171 6.12 MB/sec execute 113 sec latency 219.742 ms 20 8220 6.11 MB/sec execute 114 sec latency 369.195 ms 20 8301 6.20 MB/sec execute 115 sec latency 206.112 ms 20 8366 6.18 MB/sec execute 116 sec latency 111.453 ms 20 8431 6.24 MB/sec execute 117 sec latency 213.888 ms 20 8491 6.23 MB/sec execute 118 sec latency 210.465 ms 20 8578 6.40 MB/sec execute 119 sec latency 173.697 ms 20 cleanup 120 sec 20 cleanup 121 sec 15 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23884 51.744 212.503 Close 17672 12.461 67.037 Rename 1041 77.203 176.068 Unlink 4935 17.532 67.377 Qpathinfo 22161 12.551 136.452 Qfileinfo 3772 0.288 31.146 Qfsinfo 4080 0.206 23.443 Sfileinfo 2000 45.934 144.571 Find 8474 3.215 104.761 WriteX 11914 4.020 84.039 ReadX 38141 0.037 10.884 LockX 80 18.563 36.696 UnlockX 80 16.614 47.530 Flush 1702 191.599 1616.841 Throughput 6.4009 MB/sec 20 clients 20 procs max_latency=1616.849 ms stopping dbench on /mnt/lustre/d0.oleg337-client.virtnet at Thu Dec 12 10:06:26 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg337-client.virtnet /mnt/lustre/d0.oleg337-client.virtnet /mnt/lustre/d0.oleg337-client.virtnet removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg337-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:33 (1734015993) min OST has 3354624kB available, using 5031936kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6980] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4914] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg337-clien 4914M 87109 67 58927 49 136709 31 618.9 121 Latency 18278us 226ms 94151us 530ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg337-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 252 19 8016 34 395 13 331 19 949 12 468 13 Latency 18503us 12706us 62671us 20116us 3916us 15357us 1.97,1.97,oleg337-client.virtnet,1,1734005473,4914M,,,,87109,67,58927,49,,,136709,31,618.9,121,10,,,,,252,19,8016,34,395,13,331,19,949,12,468,13,,18278us,226ms,,94151us,530ms,18503us,12706us,62671us,20116us,3916us,15357us debug=0x33f0484 PASS bonnie (333s) == sanity-benchmark test iozone: iozone ================== 10:12:06 (1734016326) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6980] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:25 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 195170 164444 137691 167943 69505 121093 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:30 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 26649 24814 107869 110742 95578 32555 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1121s) == sanity-benchmark test fsx: fsx ======================== 10:30:47 (1734017447) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 13872 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 13872 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x50345 truncating to largest ever: 0x1864fb truncating to largest ever: 0x4fcdbb truncating to largest ever: 0x5445d6 truncating to largest ever: 0x55df8c 001000 1734017451.011849 read 0x0bd820 thru 0x0cc72c (0xef0d bytes) 002000 1734017453.950318 write 0x073fc2 thru 0x07e519 (0xa558 bytes) 003000 1734017456.376120 mapwrite 0x4f747d thru 0x5029c5 (0xb549 bytes) 004000 1734017459.232314 trunc from 0x253b4f to 0x29cdca (0x4927c bytes) truncating to largest ever: 0x5611b0 009000 1734017471.540801 write 0x4c2c39 thru 0x4cbd1a (0x90e2 bytes) 011000 1734017476.559822 write 0x2599fa thru 0x25b561 (0x1b68 bytes) 012000 1734017479.447600 mapwrite 0x2243b2 thru 0x22be49 (0x7a98 bytes) 014000 1734017485.004598 mapread 0x0eafc3 thru 0x0f929c (0xe2da bytes) 015000 1734017487.531294 write 0x449896 thru 0x44fa09 (0x6174 bytes) 016000 1734017490.128365 mapwrite 0x373278 thru 0x378f14 (0x5c9d bytes) 017000 1734017493.131334 read 0x164842 thru 0x173a94 (0xf253 bytes) 021000 1734017503.966275 mapread 0x10b64a thru 0x10dd3f (0x26f6 bytes) 022000 1734017506.659467 mapread 0x31e931 thru 0x3239b6 (0x5086 bytes) 023000 1734017509.404654 trunc from 0x402454 to 0x061e8f (0x3a05c4 bytes) 024000 1734017512.273404 trunc from 0x520a7e to 0x0a7278 (0x479805 bytes) truncating to largest ever: 0x561589 truncating to largest ever: 0x5616e8 025000 1734017515.356326 mapwrite 0x41355d thru 0x41b461 (0x7f05 bytes) 028000 1734017524.877572 read 0x0212e8 thru 0x0277ca (0x64e3 bytes) 029000 1734017527.981305 trunc from 0x323651 to 0x3755a7 (0x51f57 bytes) 034000 1734017542.832359 read 0x1b7699 thru 0x1b9bbe (0x2526 bytes) 039000 1734017558.552850 read 0x02e15a thru 0x033805 (0x56ac bytes) 040000 1734017561.357978 mapwrite 0x01ebc0 thru 0x029899 (0xacda bytes) 041000 1734017564.223219 trunc from 0x1aa392 to 0x45b5cb (0x2b123a bytes) 042000 1734017566.924177 read 0x1e591e thru 0x1f4df9 (0xf4dc bytes) 043000 1734017569.655972 write 0x009f0c thru 0x00efee (0x50e3 bytes) 045000 1734017575.242430 write 0x46d47c thru 0x471d90 (0x4915 bytes) 046000 1734017578.022969 mapwrite 0x03e8b1 thru 0x0468da (0x802a bytes) 047000 1734017581.207318 read 0x1faa04 thru 0x2091ad (0xe7aa bytes) 050000 1734017589.278585 mapread 0x0997ba thru 0x0a3de2 (0xa629 bytes) 051000 1734017592.007013 mapwrite 0x0a46de thru 0x0aa39a (0x5cbd bytes) 052000 1734017594.797175 mapread 0x086db0 thru 0x091a09 (0xac5a bytes) 054000 1734017600.777850 write 0x1df6dc thru 0x1ee713 (0xf038 bytes) 056000 1734017605.749848 mapwrite 0x439bca thru 0x446cd3 (0xd10a bytes) 057000 1734017608.557107 trunc from 0x54a829 to 0x094c6c (0x4b5bbc bytes) 059000 1734017614.168022 write 0x2a2bce thru 0x2a8e8b (0x62be bytes) 062000 1734017621.982291 trunc from 0x468fbe to 0x4ace38 (0x43e7b bytes) 064000 1734017627.290058 write 0x1465bc thru 0x148f94 (0x29d9 bytes) 068000 1734017637.873521 trunc from 0x543c01 to 0x1b104c (0x392bb4 bytes) 069000 1734017640.867874 mapread 0x27e461 thru 0x28c076 (0xdc16 bytes) truncating to largest ever: 0x561724 070000 1734017643.437669 mapwrite 0x1f47e8 thru 0x1f5d2c (0x1545 bytes) 071000 1734017645.916932 mapwrite 0x42f659 thru 0x434fbd (0x5965 bytes) 072000 1734017648.584426 mapwrite 0x367a19 thru 0x3746ac (0xcc94 bytes) 073000 1734017651.166732 read 0x15a8be thru 0x15f494 (0x4bd7 bytes) 075000 1734017656.533484 mapwrite 0x1d6588 thru 0x1d8e87 (0x2900 bytes) 076000 1734017659.430675 write 0x3637bd thru 0x36e058 (0xa89c bytes) 077000 1734017661.891340 mapwrite 0x07f316 thru 0x08ccc4 (0xd9af bytes) 078000 1734017664.627382 mapread 0x10afec thru 0x10bd5f (0xd74 bytes) 079000 1734017667.234560 read 0x044b22 thru 0x0471a7 (0x2686 bytes) 080000 1734017669.973014 mapread 0x16fe42 thru 0x1739e1 (0x3ba0 bytes) 081000 1734017672.606054 mapwrite 0x32e0fd thru 0x330355 (0x2259 bytes) 084000 1734017680.837960 mapwrite 0x29aa89 thru 0x2a040f (0x5987 bytes) 087000 1734017689.379627 mapwrite 0x426b11 thru 0x42f263 (0x8753 bytes) truncating to largest ever: 0x561764 091000 1734017699.595565 mapread 0x3f2484 thru 0x3f896f (0x64ec bytes) 093000 1734017704.272610 mapread 0x2d79f6 thru 0x2d9a9d (0x20a8 bytes) 095000 1734017709.463797 trunc from 0x55b40b to 0x0c3015 (0x4983f5 bytes) 098000 1734017717.145483 mapwrite 0x2978ca thru 0x29bd76 (0x44ad bytes) 100000 1734017721.881583 read 0x42f35e thru 0x4335b2 (0x4255 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5410536 (5376 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (275s) == sanity-benchmark test complete, duration 1898 sec ===== 10:35:22 (1734017722) === sanity-benchmark: start cleanup 10:35:23 (1734017723) === === sanity-benchmark: finish cleanup 10:35:23 (1734017723) ===