-----============= acceptance-small: sanity-benchmark ============----- Wed May 29 15:59:20 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 15:59:27 (1717012767) === oleg339-client.virtnet: executing check_config_client /mnt/lustre oleg339-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg339-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b62aa000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b62aa000.idle_timeout=debug disable quota as required oleg339-server: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 15:59:38 (1717012778) === == sanity-benchmark test dbench: dbench ================== 15:59:38 (1717012778) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6944] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg339-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg339-client.virtnet at Wed May 29 15:59:39 EDT 2024 waiting for dbench pid 8936 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 74 65.22 MB/sec warmup 1 sec latency 134.784 ms 20 167 69.05 MB/sec warmup 2 sec latency 180.626 ms 20 272 68.05 MB/sec warmup 3 sec latency 87.463 ms 20 355 63.70 MB/sec warmup 4 sec latency 124.220 ms 20 456 64.03 MB/sec warmup 5 sec latency 90.199 ms 20 614 68.49 MB/sec warmup 6 sec latency 306.791 ms 20 722 60.83 MB/sec warmup 7 sec latency 219.238 ms 20 802 53.68 MB/sec warmup 8 sec latency 199.117 ms 20 965 48.56 MB/sec warmup 9 sec latency 181.240 ms 20 1181 46.04 MB/sec warmup 10 sec latency 214.247 ms 20 1477 47.34 MB/sec warmup 11 sec latency 192.489 ms 20 1653 43.64 MB/sec warmup 12 sec latency 214.721 ms 20 1852 40.55 MB/sec warmup 13 sec latency 196.317 ms 20 2084 38.27 MB/sec warmup 14 sec latency 226.658 ms 20 2339 36.98 MB/sec warmup 15 sec latency 159.701 ms 20 2456 35.34 MB/sec warmup 16 sec latency 226.039 ms 20 2584 34.85 MB/sec warmup 17 sec latency 341.171 ms 20 2808 35.65 MB/sec warmup 18 sec latency 301.716 ms 20 3058 35.61 MB/sec warmup 19 sec latency 246.238 ms 20 3334 35.61 MB/sec warmup 20 sec latency 223.219 ms 20 3572 36.59 MB/sec warmup 21 sec latency 169.414 ms 20 3786 36.00 MB/sec warmup 22 sec latency 52.085 ms 20 3892 34.66 MB/sec warmup 23 sec latency 47.811 ms 20 4118 1.07 MB/sec execute 1 sec latency 214.503 ms 20 4242 2.02 MB/sec execute 2 sec latency 351.005 ms 20 4309 2.56 MB/sec execute 3 sec latency 263.130 ms 20 4392 2.92 MB/sec execute 4 sec latency 183.105 ms 20 4480 3.11 MB/sec execute 5 sec latency 348.120 ms 20 4593 4.09 MB/sec execute 6 sec latency 255.236 ms 20 4767 7.58 MB/sec execute 7 sec latency 331.746 ms 20 4883 7.58 MB/sec execute 8 sec latency 331.176 ms 20 5088 11.40 MB/sec execute 9 sec latency 205.054 ms 20 5251 10.54 MB/sec execute 10 sec latency 307.547 ms 20 5456 9.93 MB/sec execute 11 sec latency 240.838 ms 20 5659 9.89 MB/sec execute 12 sec latency 313.172 ms 20 5892 10.37 MB/sec execute 13 sec latency 311.417 ms 20 6003 10.45 MB/sec execute 14 sec latency 336.328 ms 20 6144 11.54 MB/sec execute 15 sec latency 407.866 ms 20 6448 14.91 MB/sec execute 16 sec latency 412.419 ms 20 6692 15.58 MB/sec execute 17 sec latency 236.642 ms 20 6945 16.89 MB/sec execute 18 sec latency 212.667 ms 20 7183 18.81 MB/sec execute 19 sec latency 169.760 ms 20 7338 18.66 MB/sec execute 20 sec latency 82.571 ms 20 7429 18.00 MB/sec execute 21 sec latency 52.375 ms 20 7508 17.37 MB/sec execute 22 sec latency 69.278 ms 20 7588 16.62 MB/sec execute 23 sec latency 91.168 ms 20 7691 15.99 MB/sec execute 24 sec latency 205.387 ms 20 7799 15.50 MB/sec execute 25 sec latency 263.080 ms 20 7929 15.14 MB/sec execute 26 sec latency 144.558 ms 20 8096 15.04 MB/sec execute 27 sec latency 156.020 ms 20 8343 15.67 MB/sec execute 28 sec latency 176.283 ms 20 8613 16.72 MB/sec execute 29 sec latency 254.005 ms 20 8850 16.29 MB/sec execute 30 sec latency 182.107 ms 20 9160 16.12 MB/sec execute 31 sec latency 232.886 ms 20 9511 16.42 MB/sec execute 32 sec latency 171.572 ms 20 9666 16.67 MB/sec execute 33 sec latency 197.009 ms 20 9981 18.17 MB/sec execute 34 sec latency 190.178 ms 20 10333 18.88 MB/sec execute 35 sec latency 186.258 ms 20 10630 19.70 MB/sec execute 36 sec latency 185.534 ms 20 10930 20.54 MB/sec execute 37 sec latency 34.569 ms 20 11043 20.07 MB/sec execute 38 sec latency 47.962 ms 20 11157 19.63 MB/sec execute 39 sec latency 196.576 ms 20 11312 19.20 MB/sec execute 40 sec latency 179.152 ms 20 11404 18.83 MB/sec execute 41 sec latency 216.403 ms 20 11518 18.56 MB/sec execute 42 sec latency 160.013 ms 20 11670 18.47 MB/sec execute 43 sec latency 240.523 ms 20 11838 18.48 MB/sec execute 44 sec latency 246.488 ms 20 12034 18.54 MB/sec execute 45 sec latency 203.805 ms 20 12303 18.94 MB/sec execute 46 sec latency 263.942 ms 20 12574 18.66 MB/sec execute 47 sec latency 209.580 ms 20 12874 18.59 MB/sec execute 48 sec latency 212.089 ms 20 13119 18.76 MB/sec execute 49 sec latency 194.842 ms 20 13311 18.98 MB/sec execute 50 sec latency 185.564 ms 20 13668 20.04 MB/sec execute 51 sec latency 183.480 ms 20 13886 20.08 MB/sec execute 52 sec latency 188.556 ms 20 14105 20.44 MB/sec execute 53 sec latency 215.264 ms 20 14278 20.64 MB/sec execute 54 sec latency 233.523 ms 20 14479 20.75 MB/sec execute 55 sec latency 53.460 ms 20 14606 20.46 MB/sec execute 56 sec latency 200.562 ms 20 14704 20.14 MB/sec execute 57 sec latency 205.985 ms 20 14792 19.82 MB/sec execute 58 sec latency 350.156 ms 20 14891 19.52 MB/sec execute 59 sec latency 325.221 ms 20 14944 19.24 MB/sec execute 60 sec latency 302.060 ms 20 15034 19.02 MB/sec execute 61 sec latency 238.144 ms 20 15141 18.88 MB/sec execute 62 sec latency 215.500 ms 20 15272 18.74 MB/sec execute 63 sec latency 287.620 ms 20 15483 18.85 MB/sec execute 64 sec latency 190.171 ms 20 15682 18.91 MB/sec execute 65 sec latency 233.692 ms 20 15917 19.02 MB/sec execute 66 sec latency 255.954 ms 20 16186 18.89 MB/sec execute 67 sec latency 200.544 ms 20 16515 18.94 MB/sec execute 68 sec latency 171.017 ms 20 16741 19.05 MB/sec execute 69 sec latency 263.070 ms 20 16985 19.37 MB/sec execute 70 sec latency 176.392 ms 20 17251 19.83 MB/sec execute 71 sec latency 213.399 ms 20 17470 19.92 MB/sec execute 72 sec latency 281.682 ms 20 17697 20.17 MB/sec execute 73 sec latency 209.536 ms 20 17854 20.23 MB/sec execute 74 sec latency 233.792 ms 20 18029 20.28 MB/sec execute 75 sec latency 73.995 ms 20 18161 20.10 MB/sec execute 76 sec latency 246.779 ms 20 18258 19.88 MB/sec execute 77 sec latency 285.895 ms 20 18395 19.65 MB/sec execute 78 sec latency 213.710 ms 20 18542 19.50 MB/sec execute 79 sec latency 182.961 ms 20 18688 19.40 MB/sec execute 80 sec latency 201.055 ms 20 18910 19.38 MB/sec execute 81 sec latency 166.422 ms 20 19253 19.65 MB/sec execute 82 sec latency 187.945 ms 20 19539 19.77 MB/sec execute 83 sec latency 146.500 ms 20 19889 19.76 MB/sec execute 84 sec latency 183.915 ms 20 20246 19.83 MB/sec execute 85 sec latency 190.537 ms 20 20416 19.87 MB/sec execute 86 sec latency 238.048 ms 20 20599 20.06 MB/sec execute 87 sec latency 298.929 ms 20 20766 20.16 MB/sec execute 88 sec latency 341.473 ms 20 20923 20.25 MB/sec execute 89 sec latency 358.500 ms 20 21032 20.16 MB/sec execute 90 sec latency 402.626 ms 20 21230 20.24 MB/sec execute 91 sec latency 314.415 ms 20 21389 20.30 MB/sec execute 92 sec latency 260.623 ms 20 21543 20.40 MB/sec execute 93 sec latency 274.918 ms 20 21648 20.27 MB/sec execute 94 sec latency 357.432 ms 20 21717 20.11 MB/sec execute 95 sec latency 258.630 ms 20 21778 19.92 MB/sec execute 96 sec latency 172.618 ms 20 21855 19.74 MB/sec execute 97 sec latency 309.434 ms 20 21925 19.55 MB/sec execute 98 sec latency 265.869 ms 20 21989 19.37 MB/sec execute 99 sec latency 609.265 ms 20 22098 19.22 MB/sec execute 100 sec latency 434.601 ms 20 22204 19.14 MB/sec execute 101 sec latency 264.273 ms 20 22360 19.06 MB/sec execute 102 sec latency 188.504 ms 20 22592 19.06 MB/sec execute 103 sec latency 160.577 ms 20 22839 19.17 MB/sec execute 104 sec latency 241.107 ms 20 23124 19.31 MB/sec execute 105 sec latency 234.876 ms 20 23498 19.33 MB/sec execute 106 sec latency 158.433 ms 20 23837 19.40 MB/sec execute 107 sec latency 195.019 ms 20 24042 19.52 MB/sec execute 108 sec latency 206.301 ms 20 24237 19.64 MB/sec execute 109 sec latency 245.745 ms 20 24471 19.86 MB/sec execute 110 sec latency 265.337 ms 20 24665 19.92 MB/sec execute 111 sec latency 201.141 ms 20 24895 20.05 MB/sec execute 112 sec latency 202.396 ms 20 25057 20.07 MB/sec execute 113 sec latency 295.436 ms 20 25210 20.07 MB/sec execute 114 sec latency 183.035 ms 20 25313 19.95 MB/sec execute 115 sec latency 219.043 ms 20 25431 19.82 MB/sec execute 116 sec latency 163.199 ms 20 25582 19.71 MB/sec execute 117 sec latency 201.870 ms 20 25729 19.61 MB/sec execute 118 sec latency 217.015 ms 20 25870 19.51 MB/sec execute 119 sec latency 251.106 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 76440 10.765 110.630 Close 56086 1.653 44.845 Rename 3211 28.605 99.479 Unlink 15741 10.088 82.929 Qpathinfo 69105 5.038 78.295 Qfileinfo 11931 0.130 30.868 Qfsinfo 12683 0.061 14.782 Sfileinfo 6332 18.338 90.890 Find 26700 0.958 84.960 WriteX 37550 2.086 44.912 ReadX 118101 0.015 11.576 LockX 240 6.074 24.242 UnlockX 240 5.837 24.612 Flush 5584 117.604 609.259 Throughput 19.5103 MB/sec 20 clients 20 procs max_latency=609.265 ms stopping dbench on /mnt/lustre/d0.oleg339-client.virtnet at Wed May 29 16:02:05 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg339-client.virtnet /mnt/lustre/d0.oleg339-client.virtnet /mnt/lustre/d0.oleg339-client.virtnet removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg339-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (151s) == sanity-benchmark test bonnie: bonnie++ ================ 16:02:09 (1717012929) min OST has 3315712kB available, using 4973568kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6944] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4857] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg339-clien 4857M 118697 79 108478 71 321787 56 1158 138 Latency 88208us 35390us 37432us 395ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg339-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 232 18 6110 26 281 12 197 17 511 11 232 12 Latency 17796us 21809us 87958us 28385us 14384us 33515us 1.97,1.97,oleg339-client.virtnet,1,1717022451,4857M,,,,118697,79,108478,71,,,321787,56,1158,138,10,,,,,232,18,6110,26,281,12,197,17,511,11,232,12,,88208us,35390us,,37432us,395ms,17796us,21809us,87958us,28385us,14384us,33515us debug=0x33f0484 PASS bonnie (316s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 16:07:26 (1717013246) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 31668 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 31668 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0xf223a truncating to largest ever: 0x559365 truncating to largest ever: 0x55d3aa truncating to largest ever: 0x5610bb truncating to largest ever: 0x561353 001000 1717013254.553292 mapread 0x06400f thru 0x0722b8 (0xe2aa bytes) 002000 1717013262.477530 trunc from 0x418563 to 0x3406e6 (0xd7e7c bytes) truncating to largest ever: 0x562cfa 004000 1717013280.063321 trunc from 0x4a9716 to 0x165602 (0x344113 bytes) 007000 1717013299.328744 mapwrite 0x4effb7 thru 0x4f2b06 (0x2b50 bytes) 010000 1717013318.392707 trunc from 0x141c32 to 0x4acfb2 (0x36b381 bytes) 011000 1717013323.609897 mapread 0x04ed92 thru 0x05ce99 (0xe108 bytes) 012000 1717013329.524732 write 0x20ce3a thru 0x2146ca (0x7891 bytes) 013000 1717013335.857181 mapread 0x13fd62 thru 0x14909a (0x9339 bytes) 014000 1717013344.380013 trunc from 0x46bb3c to 0x534992 (0xc8e57 bytes) 016000 1717013361.823294 trunc from 0x3f6a1b to 0x4b88eb (0xc1ed1 bytes) 017000 1717013369.426470 read 0x360a8b thru 0x36674d (0x5cc3 bytes) 020000 1717013394.142690 mapread 0x19aa71 thru 0x1a5ae2 (0xb072 bytes) 021000 1717013401.985460 write 0x50a28f thru 0x519a13 (0xf785 bytes) 022000 1717013410.106766 trunc from 0x263127 to 0x0854fb (0x1ddc2b bytes) 023000 1717013418.094936 write 0x5230a6 thru 0x52d5ad (0xa508 bytes) 025000 1717013435.972550 mapwrite 0x35cfd1 thru 0x366670 (0x96a0 bytes) 026000 1717013445.686830 mapwrite 0x39c589 thru 0x3aa891 (0xe309 bytes) 027000 1717013454.181329 read 0x3572a1 thru 0x35c8c8 (0x5628 bytes) 028000 1717013462.859238 trunc from 0x4b317a to 0x0c93a1 (0x3e9dd8 bytes) 029000 1717013471.982005 mapwrite 0x26692b thru 0x268e46 (0x251c bytes) 035000 1717013528.279374 write 0x381c4d thru 0x38612e (0x44e2 bytes) 038000 1717013554.769204 mapread 0x255f5d thru 0x2562b5 (0x359 bytes) 039000 1717013563.522731 write 0x3530a7 thru 0x357169 (0x40c3 bytes) 040000 1717013570.416088 mapwrite 0x2eb860 thru 0x2eb8b4 (0x55 bytes) 047000 1717013632.134691 trunc from 0x4862f1 to 0x03eff5 (0x4472fb bytes) 048000 1717013640.825027 read 0x0aa574 thru 0x0b247a (0x7f07 bytes) 049000 1717013651.519042 write 0x230aec thru 0x23bcb3 (0xb1c8 bytes) 050000 1717013661.035994 read 0x47d6a6 thru 0x485a38 (0x8393 bytes) 051000 1717013671.052379 trunc from 0x273623 to 0x3b6f9b (0x143979 bytes) 053000 1717013687.784998 trunc from 0x562e00 to 0x416ba6 (0x14c259 bytes) 055000 1717013708.194639 write 0x423c90 thru 0x426374 (0x26e5 bytes) 059000 1717013745.794415 read 0x1d7311 thru 0x1e2b45 (0xb835 bytes) 062000 1717013773.300317 trunc from 0x4fe736 to 0x4f2082 (0xc6b3 bytes) 063000 1717013781.435721 read 0x12e864 thru 0x137f83 (0x9720 bytes) 067000 1717013818.133965 mapwrite 0x201329 thru 0x203c25 (0x28fd bytes) 068000 1717013826.405617 mapwrite 0x1f45fb thru 0x1f849e (0x3ea4 bytes) 069000 1717013833.889657 mapread 0x2d381c thru 0x2dc983 (0x9168 bytes) 070000 1717013842.067808 trunc from 0x4b6539 to 0x305e76 (0x1b06c2 bytes) 073000 1717013870.314779 write 0x12d279 thru 0x13aee0 (0xdc68 bytes) 075000 1717013890.374754 mapread 0x3e42c6 thru 0x3e99a2 (0x56dd bytes) 077000 1717013908.417442 mapwrite 0x3c0495 thru 0x3c6fee (0x6b5a bytes) 078000 1717013918.499428 mapwrite 0x23908f thru 0x247bdf (0xeb51 bytes) 079000 1717013927.381199 read 0x3141c1 thru 0x3179aa (0x37ea bytes) 080000 1717013938.364777 read 0x3966bf thru 0x399c2f (0x3571 bytes) 081000 1717013949.509724 mapread 0x0db516 thru 0x0e28be (0x73a9 bytes) 083000 1717013968.361572 write 0x501162 thru 0x50cf89 (0xbe28 bytes) 085000 1717013987.286460 mapwrite 0x0a4eea thru 0x0a8c14 (0x3d2b bytes) 086000 1717013997.237510 read 0x2427c5 thru 0x24d8ea (0xb126 bytes) 088000 1717014016.494553 read 0x16e307 thru 0x17c5cc (0xe2c6 bytes) skipping zero size write 092000 1717014056.988640 mapwrite 0x41a15c thru 0x41ba35 (0x18da bytes) 095000 1717014085.465618 write 0x32f63b thru 0x33184d (0x2213 bytes) 096000 1717014095.373715 mapwrite 0x32483c thru 0x32b096 (0x685b bytes) 097000 1717014105.368449 trunc from 0x2c2806 to 0x42ae2d (0x168628 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (892s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 16:22:18 (1717014138) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1717014168.470490 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1717014190.180850 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1717014201.344004 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1717014242.209079 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1717014251.438800 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1717014289.781406 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1717014299.065445 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1717014316.685149 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1717014341.599489 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1717014352.765663 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1717014373.898300 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1717014385.895361 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1717014431.012556 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1717014455.367858 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1717014492.327301 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1717014527.007797 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1717014537.203042 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1717014583.212591 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1717014595.779784 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1717014630.103125 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1717014639.364648 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1717014649.193292 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1717014679.854441 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1717014700.299053 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1717014721.758851 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1717014732.729759 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1717014834.231672 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1717014864.386145 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1717014876.158981 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1717014884.923753 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1717014894.602028 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1717014925.727523 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1717014935.456048 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1717014967.580886 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1717014978.240201 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1717015004.934811 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1717015034.072557 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1717015045.007329 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1717015075.291503 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1717015128.617447 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1717015137.474966 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1717015156.667394 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1717015176.810165 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (1050s) == sanity-benchmark test complete, duration 2428 sec ===== 16:39:48 (1717015188) === sanity-benchmark: start cleanup 16:39:49 (1717015189) === === sanity-benchmark: finish cleanup 16:39:49 (1717015189) ===