-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:44 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:49 (1734015829) === oleg446-client.virtnet: executing check_config_client /mnt/lustre oleg446-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg446-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b591b000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b591b000.idle_timeout=debug disable quota as required oleg446-server: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:03:56 (1734015836) === == sanity-benchmark test dbench: dbench ================== 10:03:56 (1734015836) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6967] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg446-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg446-client.virtnet at Thu Dec 12 10:03:57 EST 2024 waiting for dbench pid 9433 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 160 133.55 MB/sec warmup 1 sec latency 111.122 ms 20 292 108.12 MB/sec warmup 2 sec latency 91.956 ms 20 411 96.86 MB/sec warmup 3 sec latency 72.145 ms 20 538 93.68 MB/sec warmup 4 sec latency 82.078 ms 20 665 84.58 MB/sec warmup 5 sec latency 254.285 ms 20 722 70.96 MB/sec warmup 6 sec latency 160.664 ms 20 789 61.28 MB/sec warmup 7 sec latency 168.371 ms 20 866 53.99 MB/sec warmup 8 sec latency 162.949 ms 20 923 48.36 MB/sec warmup 9 sec latency 185.597 ms 20 991 43.88 MB/sec warmup 10 sec latency 186.323 ms 20 1127 41.76 MB/sec warmup 11 sec latency 61.767 ms 20 1212 38.40 MB/sec warmup 12 sec latency 74.223 ms 20 1385 39.97 MB/sec warmup 13 sec latency 70.555 ms 20 1464 37.16 MB/sec warmup 14 sec latency 134.939 ms 20 1517 34.74 MB/sec warmup 15 sec latency 282.481 ms 20 1603 32.68 MB/sec warmup 16 sec latency 72.982 ms 20 1662 30.82 MB/sec warmup 17 sec latency 204.572 ms 20 1736 29.16 MB/sec warmup 18 sec latency 113.205 ms 20 1806 27.69 MB/sec warmup 19 sec latency 107.478 ms 20 1848 26.34 MB/sec warmup 20 sec latency 252.805 ms 20 1888 25.12 MB/sec warmup 21 sec latency 359.309 ms 20 1959 24.04 MB/sec warmup 22 sec latency 205.493 ms 20 2016 23.06 MB/sec warmup 23 sec latency 93.395 ms 20 2130 1.39 MB/sec execute 1 sec latency 118.288 ms 20 2166 1.08 MB/sec execute 2 sec latency 126.422 ms 20 2199 1.29 MB/sec execute 3 sec latency 157.653 ms 20 2260 3.01 MB/sec execute 4 sec latency 230.864 ms 20 2326 4.19 MB/sec execute 5 sec latency 328.566 ms 20 2378 4.48 MB/sec execute 6 sec latency 346.462 ms 20 2416 4.17 MB/sec execute 7 sec latency 401.155 ms 20 2456 4.33 MB/sec execute 8 sec latency 328.351 ms 20 2509 4.55 MB/sec execute 9 sec latency 303.765 ms 20 2578 5.53 MB/sec execute 10 sec latency 407.227 ms 20 2634 5.67 MB/sec execute 11 sec latency 671.034 ms 20 2736 7.31 MB/sec execute 12 sec latency 744.965 ms 20 2858 9.31 MB/sec execute 13 sec latency 483.247 ms 20 2947 9.45 MB/sec execute 14 sec latency 424.126 ms 20 2995 9.23 MB/sec execute 15 sec latency 448.837 ms 20 3076 8.98 MB/sec execute 16 sec latency 744.006 ms 20 3165 9.06 MB/sec execute 17 sec latency 454.420 ms 20 3288 9.30 MB/sec execute 18 sec latency 373.734 ms 20 3375 9.86 MB/sec execute 19 sec latency 276.874 ms 20 3475 10.65 MB/sec execute 20 sec latency 275.385 ms 20 3563 11.19 MB/sec execute 21 sec latency 99.956 ms 20 3631 10.88 MB/sec execute 22 sec latency 98.794 ms 20 3679 10.65 MB/sec execute 23 sec latency 172.281 ms 20 3733 10.49 MB/sec execute 24 sec latency 186.938 ms 20 3773 10.27 MB/sec execute 25 sec latency 141.663 ms 20 3815 10.10 MB/sec execute 26 sec latency 145.069 ms 20 3842 9.74 MB/sec execute 27 sec latency 136.841 ms 20 3874 9.46 MB/sec execute 28 sec latency 176.485 ms 20 3902 9.18 MB/sec execute 29 sec latency 194.717 ms 20 3940 8.94 MB/sec execute 30 sec latency 128.585 ms 20 3972 8.67 MB/sec execute 31 sec latency 126.534 ms 20 3999 8.40 MB/sec execute 32 sec latency 143.648 ms 20 4027 8.14 MB/sec execute 33 sec latency 127.232 ms 20 4066 7.91 MB/sec execute 34 sec latency 144.762 ms 20 4116 7.70 MB/sec execute 35 sec latency 179.090 ms 20 4150 7.50 MB/sec execute 36 sec latency 427.501 ms 20 4192 7.32 MB/sec execute 37 sec latency 591.207 ms 20 4236 7.17 MB/sec execute 38 sec latency 484.170 ms 20 4265 7.03 MB/sec execute 39 sec latency 534.569 ms 20 4293 6.88 MB/sec execute 40 sec latency 435.494 ms 20 4311 6.74 MB/sec execute 41 sec latency 465.600 ms 20 4339 6.61 MB/sec execute 42 sec latency 398.986 ms 20 4373 6.50 MB/sec execute 43 sec latency 401.362 ms 20 4412 6.39 MB/sec execute 44 sec latency 308.530 ms 20 4451 6.28 MB/sec execute 45 sec latency 430.831 ms 20 4481 6.18 MB/sec execute 46 sec latency 353.380 ms 20 4519 6.12 MB/sec execute 47 sec latency 300.560 ms 20 4559 6.07 MB/sec execute 48 sec latency 328.838 ms 20 4606 6.12 MB/sec execute 49 sec latency 317.962 ms 20 4664 6.14 MB/sec execute 50 sec latency 331.824 ms 20 4713 6.07 MB/sec execute 51 sec latency 152.912 ms 20 4764 6.03 MB/sec execute 52 sec latency 122.995 ms 20 4811 5.98 MB/sec execute 53 sec latency 131.730 ms 20 4887 6.23 MB/sec execute 54 sec latency 127.013 ms 20 4946 6.46 MB/sec execute 55 sec latency 227.435 ms 20 5007 6.61 MB/sec execute 56 sec latency 264.577 ms 20 5040 6.50 MB/sec execute 57 sec latency 437.377 ms 20 5073 6.40 MB/sec execute 58 sec latency 337.528 ms 20 5115 6.30 MB/sec execute 59 sec latency 253.882 ms 20 5149 6.21 MB/sec execute 60 sec latency 259.121 ms 20 5183 6.12 MB/sec execute 61 sec latency 186.122 ms 20 5228 6.03 MB/sec execute 62 sec latency 242.860 ms 20 5269 5.94 MB/sec execute 63 sec latency 273.381 ms 20 5315 5.86 MB/sec execute 64 sec latency 114.746 ms 20 5357 5.78 MB/sec execute 65 sec latency 107.528 ms 20 5389 5.71 MB/sec execute 66 sec latency 242.623 ms 20 5426 5.63 MB/sec execute 67 sec latency 264.747 ms 20 5478 5.56 MB/sec execute 68 sec latency 219.799 ms 20 5539 5.50 MB/sec execute 69 sec latency 241.470 ms 20 5589 5.44 MB/sec execute 70 sec latency 119.713 ms 20 5623 5.37 MB/sec execute 71 sec latency 148.400 ms 20 5667 5.32 MB/sec execute 72 sec latency 130.007 ms 20 5723 5.29 MB/sec execute 73 sec latency 129.307 ms 20 5776 5.24 MB/sec execute 74 sec latency 279.422 ms 20 5845 5.28 MB/sec execute 75 sec latency 267.512 ms 20 5904 5.32 MB/sec execute 76 sec latency 337.200 ms 20 5949 5.33 MB/sec execute 77 sec latency 398.225 ms 20 5992 5.30 MB/sec execute 78 sec latency 426.876 ms 20 6040 5.31 MB/sec execute 79 sec latency 341.248 ms 20 6099 5.37 MB/sec execute 80 sec latency 381.851 ms 20 6170 5.49 MB/sec execute 81 sec latency 420.607 ms 20 6257 5.64 MB/sec execute 82 sec latency 323.454 ms 20 6353 5.85 MB/sec execute 83 sec latency 460.619 ms 20 6469 6.06 MB/sec execute 84 sec latency 481.425 ms 20 6552 6.14 MB/sec execute 85 sec latency 390.302 ms 20 6635 6.13 MB/sec execute 86 sec latency 441.606 ms 20 6731 6.18 MB/sec execute 87 sec latency 391.915 ms 20 6838 6.28 MB/sec execute 88 sec latency 392.348 ms 20 6912 6.36 MB/sec execute 89 sec latency 507.200 ms 20 7012 6.52 MB/sec execute 90 sec latency 243.402 ms 20 7092 6.65 MB/sec execute 91 sec latency 197.146 ms 20 7170 6.77 MB/sec execute 92 sec latency 101.566 ms 20 7223 6.75 MB/sec execute 93 sec latency 120.531 ms 20 7261 6.71 MB/sec execute 94 sec latency 220.553 ms 20 7316 6.72 MB/sec execute 95 sec latency 128.131 ms 20 7359 6.71 MB/sec execute 96 sec latency 146.985 ms 20 7397 6.66 MB/sec execute 97 sec latency 112.507 ms 20 7439 6.61 MB/sec execute 98 sec latency 93.311 ms 20 7470 6.55 MB/sec execute 99 sec latency 192.226 ms 20 7507 6.51 MB/sec execute 100 sec latency 196.201 ms 20 7540 6.44 MB/sec execute 101 sec latency 174.100 ms 20 7582 6.38 MB/sec execute 102 sec latency 113.160 ms 20 7617 6.32 MB/sec execute 103 sec latency 408.622 ms 20 7655 6.27 MB/sec execute 104 sec latency 342.912 ms 20 7698 6.21 MB/sec execute 105 sec latency 363.691 ms 20 7744 6.17 MB/sec execute 106 sec latency 661.968 ms 20 7789 6.12 MB/sec execute 107 sec latency 445.145 ms 20 7820 6.08 MB/sec execute 108 sec latency 351.914 ms 20 7859 6.04 MB/sec execute 109 sec latency 393.051 ms 20 7888 6.00 MB/sec execute 110 sec latency 352.110 ms 20 7931 5.96 MB/sec execute 111 sec latency 338.644 ms 20 7968 5.93 MB/sec execute 112 sec latency 381.817 ms 20 8006 5.90 MB/sec execute 113 sec latency 310.908 ms 20 8039 5.87 MB/sec execute 114 sec latency 358.748 ms 20 8072 5.83 MB/sec execute 115 sec latency 306.703 ms 20 8124 5.84 MB/sec execute 116 sec latency 414.316 ms 20 8181 5.84 MB/sec execute 117 sec latency 224.348 ms 20 8240 5.87 MB/sec execute 118 sec latency 400.329 ms 20 8306 5.87 MB/sec execute 119 sec latency 124.895 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 2 cleanup 123 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 21064 57.233 220.547 Close 15379 13.915 76.650 Rename 994 83.496 231.371 Unlink 4712 19.370 113.526 Qpathinfo 19305 14.193 169.622 Qfileinfo 3296 0.246 36.255 Qfsinfo 4016 0.223 27.736 Sfileinfo 1912 49.859 178.187 Find 7757 2.756 149.062 WriteX 10912 4.438 77.270 ReadX 35135 0.029 10.098 LockX 80 18.386 39.785 UnlockX 80 18.108 40.101 Flush 1601 226.717 744.950 Throughput 5.86642 MB/sec 20 clients 20 procs max_latency=744.965 ms stopping dbench on /mnt/lustre/d0.oleg446-client.virtnet at Thu Dec 12 10:06:25 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg446-client.virtnet /mnt/lustre/d0.oleg446-client.virtnet /mnt/lustre/d0.oleg446-client.virtnet removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg446-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:33 (1734015993) min OST has 3508224kB available, using 5262336kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6967] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5139] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg446-clien 5139M 79926 62 51816 44 106626 27 371.9 95 Latency 27930us 118ms 134ms 978ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg446-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 193 18 6359 29 335 13 250 18 922 12 430 13 Latency 31225us 19120us 55747us 23643us 6659us 20319us 1.97,1.97,oleg446-client.virtnet,1,1734005488,5139M,,,,79926,62,51816,44,,,106626,27,371.9,95,10,,,,,193,18,6359,29,335,13,250,18,922,12,430,13,,27930us,118ms,,134ms,978ms,31225us,19120us,55747us,23643us,6659us,20319us debug=0x33f0484 PASS bonnie (410s) == sanity-benchmark test iozone: iozone ================== 10:13:23 (1734016403) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6967] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:41 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 203581 95205 92715 110509 55899 88580 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:20:24 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 24819 24543 96442 91569 88544 30755 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1265s) == sanity-benchmark test fsx: fsx ======================== 10:34:28 (1734017668) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 30668 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 30668 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x18b584 truncating to largest ever: 0x320473 truncating to largest ever: 0x39bef4 truncating to largest ever: 0x531685 truncating to largest ever: 0x5372ed truncating to largest ever: 0x553878 001000 1734017671.839684 write 0x0ad0e9 thru 0x0bcfb6 (0xfece bytes) truncating to largest ever: 0x55419c 002000 1734017674.573136 mapwrite 0x26db65 thru 0x270bef (0x308b bytes) 003000 1734017677.082038 mapwrite 0x00a64b thru 0x0148a3 (0xa259 bytes) truncating to largest ever: 0x559d5f truncating to largest ever: 0x55e9a1 006000 1734017685.020803 read 0x0e1ce7 thru 0x0ea589 (0x88a3 bytes) truncating to largest ever: 0x56138a 007000 1734017687.478366 read 0x268ca8 thru 0x278127 (0xf480 bytes) 010000 1734017695.432176 mapwrite 0x4df948 thru 0x4e4185 (0x483e bytes) 011000 1734017698.265477 mapread 0x0ad020 thru 0x0b70ff (0xa0e0 bytes) 016000 1734017713.421520 write 0x218c10 thru 0x228459 (0xf84a bytes) 017000 1734017716.438094 write 0x02d9a2 thru 0x0357b4 (0x7e13 bytes) 019000 1734017722.079241 read 0x14dbf1 thru 0x155c88 (0x8098 bytes) 020000 1734017725.252754 read 0x04f320 thru 0x0584db (0x91bc bytes) truncating to largest ever: 0x561b26 024000 1734017737.730781 trunc from 0x257891 to 0x2fee7c (0xa75ec bytes) 026000 1734017744.036864 trunc from 0x44a37f to 0x246cd7 (0x2036a7 bytes) 027000 1734017747.274935 mapread 0x0491ef thru 0x052c02 (0x9a14 bytes) 029000 1734017753.494428 mapread 0x08c3df thru 0x08e6a4 (0x22c6 bytes) 030000 1734017756.866095 mapwrite 0x23cf6d thru 0x248c7a (0xbd0e bytes) 031000 1734017759.914807 write 0x0e8024 thru 0x0ec2f7 (0x42d4 bytes) 032000 1734017763.068435 mapwrite 0x10674e thru 0x10b448 (0x4cfb bytes) 033000 1734017766.215820 write 0x1300a6 thru 0x136fa5 (0x6f00 bytes) 034000 1734017768.712775 mapread 0x28eee3 thru 0x28ef21 (0x3f bytes) 035000 1734017771.657961 read 0x018c15 thru 0x01e518 (0x5904 bytes) 036000 1734017774.870820 write 0x0d0551 thru 0x0d23b7 (0x1e67 bytes) 037000 1734017778.109701 read 0x1a194b thru 0x1a7b7a (0x6230 bytes) 038000 1734017781.012633 mapwrite 0x0ca84b thru 0x0d90b8 (0xe86e bytes) 042000 1734017793.871438 write 0x0e9904 thru 0x0f312a (0x9827 bytes) 046000 1734017805.951730 write 0x3c8b9b thru 0x3ce501 (0x5967 bytes) 049000 1734017815.882112 read 0x086cd5 thru 0x08a87b (0x3ba7 bytes) 053000 1734017829.111640 write 0x4394fe thru 0x44401a (0xab1d bytes) 054000 1734017832.682824 write 0x14a095 thru 0x15180b (0x7777 bytes) 055000 1734017836.040186 mapread 0x0d88fc thru 0x0daccf (0x23d4 bytes) 056000 1734017839.453992 mapread 0x1bbda5 thru 0x1cb77e (0xf9da bytes) 057000 1734017842.611843 mapwrite 0x140777 thru 0x147edc (0x7766 bytes) 058000 1734017845.690448 trunc from 0x322b15 to 0x079b79 (0x2a8f9b bytes) 061000 1734017855.684820 read 0x2c5cbc thru 0x2cae42 (0x5187 bytes) 062000 1734017858.843193 mapwrite 0x43ec8b thru 0x4462e2 (0x7658 bytes) 064000 1734017865.286873 read 0x0e7e4e thru 0x0ebb0d (0x3cc0 bytes) 066000 1734017871.325510 trunc from 0x4a8283 to 0x4e4bf9 (0x3c977 bytes) 067000 1734017874.062265 write 0x27178d thru 0x278126 (0x699a bytes) 068000 1734017877.342208 mapread 0x069ba3 thru 0x06bac3 (0x1f21 bytes) 069000 1734017880.476028 write 0x4f0adf thru 0x4f9c38 (0x915a bytes) 073000 1734017893.441291 trunc from 0x3fb521 to 0x03d249 (0x3be2d7 bytes) 077000 1734017906.459791 read 0x50d2a7 thru 0x50e839 (0x1593 bytes) 078000 1734017909.651471 mapread 0x0043ab thru 0x012c76 (0xe8cc bytes) 079000 1734017912.354646 trunc from 0x4d0f17 to 0x4250f7 (0xabe1f bytes) 081000 1734017918.936066 write 0x1e19e3 thru 0x1e6183 (0x47a1 bytes) 085000 1734017931.832479 mapwrite 0x42fd7a thru 0x43ced7 (0xd15e bytes) 087000 1734017937.756371 write 0x544084 thru 0x545d97 (0x1d14 bytes) 088000 1734017940.717780 write 0x144747 thru 0x14b515 (0x6dcf bytes) 090000 1734017946.731734 write 0x0b6954 thru 0x0bad8c (0x4439 bytes) 092000 1734017952.122634 trunc from 0x393c28 to 0x075045 (0x31ebe2 bytes) 093000 1734017954.852859 mapread 0x2676ce thru 0x27248d (0xadc0 bytes) 097000 1734017967.802593 mapwrite 0x223ce5 thru 0x227dc0 (0x40dc bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 3920536 (3840 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (311s) == sanity-benchmark test complete, duration 2155 sec ===== 10:39:39 (1734017979) === sanity-benchmark: start cleanup 10:39:39 (1734017979) === === sanity-benchmark: finish cleanup 10:39:40 (1734017980) ===