-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:58 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:03 (1734015843) === oleg237-client.virtnet: executing check_config_client /mnt/lustre oleg237-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg237-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012db63800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012db63800.idle_timeout=debug disable quota as required oleg237-server: oleg237-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:15 (1734015855) === == sanity-benchmark test dbench: dbench ================== 10:04:16 (1734015856) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6870] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg237-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg237-client.virtnet at Thu Dec 12 10:04:18 EST 2024 waiting for dbench pid 9435 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 14 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 16 42 32.36 MB/sec warmup 1 sec latency 136.398 ms 20 146 62.48 MB/sec warmup 2 sec latency 144.390 ms 20 214 55.60 MB/sec warmup 3 sec latency 136.297 ms 20 293 54.23 MB/sec warmup 4 sec latency 108.620 ms 20 365 52.23 MB/sec warmup 5 sec latency 120.748 ms 20 444 52.02 MB/sec warmup 6 sec latency 131.904 ms 20 517 51.04 MB/sec warmup 7 sec latency 102.487 ms 20 648 52.63 MB/sec warmup 8 sec latency 120.239 ms 20 703 47.08 MB/sec warmup 9 sec latency 105.835 ms 20 757 42.66 MB/sec warmup 10 sec latency 108.628 ms 20 821 39.08 MB/sec warmup 11 sec latency 88.452 ms 20 889 36.10 MB/sec warmup 12 sec latency 101.013 ms 20 936 33.50 MB/sec warmup 13 sec latency 111.560 ms 20 986 31.32 MB/sec warmup 14 sec latency 124.144 ms 20 1072 30.53 MB/sec warmup 15 sec latency 92.439 ms 20 1143 28.72 MB/sec warmup 16 sec latency 87.584 ms 20 1203 27.09 MB/sec warmup 17 sec latency 97.661 ms 20 1260 25.81 MB/sec warmup 18 sec latency 123.701 ms 20 1406 27.36 MB/sec warmup 19 sec latency 102.813 ms 20 1461 26.01 MB/sec warmup 20 sec latency 118.287 ms 20 1504 24.80 MB/sec warmup 21 sec latency 99.068 ms 20 1562 23.72 MB/sec warmup 22 sec latency 103.478 ms 20 1626 22.74 MB/sec warmup 23 sec latency 89.690 ms 20 1734 0.78 MB/sec execute 1 sec latency 127.302 ms 20 1807 1.04 MB/sec execute 2 sec latency 82.168 ms 20 1865 1.04 MB/sec execute 3 sec latency 86.560 ms 20 1918 0.97 MB/sec execute 4 sec latency 120.421 ms 20 1984 1.06 MB/sec execute 5 sec latency 102.594 ms 20 2033 1.15 MB/sec execute 6 sec latency 101.188 ms 20 2081 1.19 MB/sec execute 7 sec latency 109.136 ms 20 2141 1.19 MB/sec execute 8 sec latency 103.423 ms 20 2191 1.29 MB/sec execute 9 sec latency 104.103 ms 20 2254 1.88 MB/sec execute 10 sec latency 152.163 ms 20 2327 2.53 MB/sec execute 11 sec latency 110.967 ms 20 2384 2.95 MB/sec execute 12 sec latency 146.886 ms 20 2424 2.88 MB/sec execute 13 sec latency 161.959 ms 20 2462 3.13 MB/sec execute 14 sec latency 157.114 ms 20 2526 3.46 MB/sec execute 15 sec latency 151.530 ms 20 2601 4.05 MB/sec execute 16 sec latency 177.415 ms 20 2741 5.68 MB/sec execute 17 sec latency 122.542 ms 20 2839 6.74 MB/sec execute 18 sec latency 195.075 ms 20 2873 7.08 MB/sec execute 19 sec latency 1128.020 ms 20 2920 6.80 MB/sec execute 20 sec latency 1575.690 ms 20 2987 6.97 MB/sec execute 21 sec latency 143.273 ms 20 3116 7.04 MB/sec execute 22 sec latency 146.217 ms 20 3197 7.17 MB/sec execute 23 sec latency 155.348 ms 20 3311 7.44 MB/sec execute 24 sec latency 151.803 ms 20 3343 7.39 MB/sec execute 25 sec latency 679.997 ms 20 3462 8.55 MB/sec execute 26 sec latency 253.748 ms 20 3522 8.50 MB/sec execute 27 sec latency 111.685 ms 20 3607 8.80 MB/sec execute 28 sec latency 108.668 ms 20 3669 8.63 MB/sec execute 29 sec latency 98.568 ms 20 3717 8.51 MB/sec execute 30 sec latency 187.417 ms 20 3770 8.52 MB/sec execute 31 sec latency 200.257 ms 20 3814 8.47 MB/sec execute 32 sec latency 135.903 ms 20 3844 8.21 MB/sec execute 33 sec latency 146.856 ms 20 3883 8.04 MB/sec execute 34 sec latency 117.133 ms 20 3924 7.86 MB/sec execute 35 sec latency 165.476 ms 20 3959 7.68 MB/sec execute 36 sec latency 144.786 ms 20 3992 7.48 MB/sec execute 37 sec latency 126.713 ms 20 4028 7.28 MB/sec execute 38 sec latency 124.761 ms 20 4072 7.10 MB/sec execute 39 sec latency 104.358 ms 20 4119 6.93 MB/sec execute 40 sec latency 153.037 ms 20 4173 6.79 MB/sec execute 41 sec latency 165.758 ms 20 4222 6.66 MB/sec execute 42 sec latency 179.271 ms 20 4273 6.56 MB/sec execute 43 sec latency 134.484 ms 20 4316 6.45 MB/sec execute 44 sec latency 162.227 ms 20 4359 6.37 MB/sec execute 45 sec latency 143.910 ms 20 4407 6.27 MB/sec execute 46 sec latency 161.933 ms 20 4447 6.18 MB/sec execute 47 sec latency 123.935 ms 20 4485 6.10 MB/sec execute 48 sec latency 142.899 ms 20 4527 6.03 MB/sec execute 49 sec latency 131.375 ms 20 4575 6.06 MB/sec execute 50 sec latency 178.965 ms 20 4625 6.07 MB/sec execute 51 sec latency 141.415 ms 20 4681 6.08 MB/sec execute 52 sec latency 135.101 ms 20 4743 6.00 MB/sec execute 53 sec latency 126.321 ms 20 4790 5.96 MB/sec execute 54 sec latency 147.998 ms 20 4844 6.01 MB/sec execute 55 sec latency 176.406 ms 20 4927 6.39 MB/sec execute 56 sec latency 148.091 ms 20 5003 6.63 MB/sec execute 57 sec latency 157.838 ms 20 5046 6.53 MB/sec execute 58 sec latency 105.054 ms 20 5095 6.43 MB/sec execute 59 sec latency 100.483 ms 20 5133 6.34 MB/sec execute 60 sec latency 106.997 ms 20 5171 6.24 MB/sec execute 61 sec latency 130.068 ms 20 5219 6.16 MB/sec execute 62 sec latency 122.403 ms 20 5265 6.07 MB/sec execute 63 sec latency 125.576 ms 20 5294 5.98 MB/sec execute 64 sec latency 180.472 ms 20 5328 5.90 MB/sec execute 65 sec latency 143.845 ms 20 5357 5.82 MB/sec execute 66 sec latency 136.788 ms 20 5390 5.74 MB/sec execute 67 sec latency 160.645 ms 20 5424 5.66 MB/sec execute 68 sec latency 152.189 ms 20 5479 5.60 MB/sec execute 69 sec latency 114.445 ms 20 5537 5.53 MB/sec execute 70 sec latency 112.758 ms 20 5589 5.47 MB/sec execute 71 sec latency 102.681 ms 20 5630 5.42 MB/sec execute 72 sec latency 136.454 ms 20 5691 5.36 MB/sec execute 73 sec latency 116.893 ms 20 5745 5.33 MB/sec execute 74 sec latency 103.549 ms 20 5795 5.31 MB/sec execute 75 sec latency 124.341 ms 20 5862 5.34 MB/sec execute 76 sec latency 127.851 ms 20 5932 5.41 MB/sec execute 77 sec latency 125.251 ms 20 5982 5.39 MB/sec execute 78 sec latency 119.309 ms 20 6037 5.39 MB/sec execute 79 sec latency 120.610 ms 20 6107 5.49 MB/sec execute 80 sec latency 149.766 ms 20 6224 5.69 MB/sec execute 81 sec latency 108.782 ms 20 6347 6.01 MB/sec execute 82 sec latency 116.916 ms 20 6501 6.27 MB/sec execute 83 sec latency 108.094 ms 20 6607 6.35 MB/sec execute 84 sec latency 107.996 ms 20 6741 6.42 MB/sec execute 85 sec latency 174.502 ms 20 6890 6.59 MB/sec execute 86 sec latency 114.329 ms 20 7018 6.85 MB/sec execute 87 sec latency 81.383 ms 20 7134 7.13 MB/sec execute 88 sec latency 77.514 ms 20 7207 7.11 MB/sec execute 89 sec latency 84.127 ms 20 7268 7.09 MB/sec execute 90 sec latency 124.841 ms 20 7327 7.13 MB/sec execute 91 sec latency 97.287 ms 20 7370 7.10 MB/sec execute 92 sec latency 143.305 ms 20 7409 7.03 MB/sec execute 93 sec latency 153.095 ms 20 7459 6.99 MB/sec execute 94 sec latency 83.331 ms 20 7506 6.93 MB/sec execute 95 sec latency 83.305 ms 20 7551 6.86 MB/sec execute 96 sec latency 83.730 ms 20 7587 6.79 MB/sec execute 97 sec latency 143.004 ms 20 7630 6.73 MB/sec execute 98 sec latency 140.202 ms 20 7688 6.67 MB/sec execute 99 sec latency 135.855 ms 20 7757 6.62 MB/sec execute 100 sec latency 125.744 ms 20 7821 6.58 MB/sec execute 101 sec latency 113.818 ms 20 7875 6.54 MB/sec execute 102 sec latency 104.254 ms 20 7932 6.50 MB/sec execute 103 sec latency 106.883 ms 20 7989 6.47 MB/sec execute 104 sec latency 124.063 ms 20 8038 6.44 MB/sec execute 105 sec latency 130.979 ms 20 8088 6.41 MB/sec execute 106 sec latency 122.563 ms 20 8142 6.43 MB/sec execute 107 sec latency 127.300 ms 20 8213 6.47 MB/sec execute 108 sec latency 120.180 ms 20 8277 6.42 MB/sec execute 109 sec latency 119.716 ms 20 8334 6.43 MB/sec execute 110 sec latency 149.161 ms 20 8409 6.50 MB/sec execute 111 sec latency 114.622 ms 20 8490 6.64 MB/sec execute 112 sec latency 138.540 ms 20 8563 6.73 MB/sec execute 113 sec latency 93.563 ms 20 8605 6.67 MB/sec execute 114 sec latency 119.597 ms 20 8652 6.62 MB/sec execute 115 sec latency 128.390 ms 20 8703 6.57 MB/sec execute 116 sec latency 100.214 ms 20 8756 6.53 MB/sec execute 117 sec latency 102.664 ms 20 8813 6.48 MB/sec execute 118 sec latency 107.888 ms 20 8865 6.43 MB/sec execute 119 sec latency 102.171 ms 20 cleanup 120 sec 20 cleanup 121 sec 3 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25189 55.251 252.135 Close 18653 13.004 77.110 Rename 1053 84.279 275.920 Unlink 5009 17.498 78.001 Qpathinfo 23124 12.900 166.389 Qfileinfo 3961 0.294 55.259 Qfsinfo 4080 0.194 38.844 Sfileinfo 2000 52.722 157.107 Find 8683 3.028 129.789 WriteX 12202 5.421 132.563 ReadX 38950 0.026 6.364 LockX 80 23.893 69.219 UnlockX 80 23.448 83.231 Flush 1723 50.679 1575.675 Throughput 6.4309 MB/sec 20 clients 20 procs max_latency=1575.690 ms stopping dbench on /mnt/lustre/d0.oleg237-client.virtnet at Thu Dec 12 10:06:44 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg237-client.virtnet /mnt/lustre/d0.oleg237-client.virtnet /mnt/lustre/d0.oleg237-client.virtnet removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg237-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:51 (1734016011) min OST has 3602532kB available, using 5403798kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6870] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5277] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg237-clien 5277M 89084 64 57524 50 126992 31 1092 169 Latency 28296us 172ms 131ms 24150us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg237-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 222 18 7626 33 422 14 316 18 1002 12 544 13 Latency 30501us 13607us 25125us 15365us 2959us 15795us 1.97,1.97,oleg237-client.virtnet,1,1734006065,5277M,,,,89084,64,57524,50,,,126992,31,1092,169,10,,,,,222,18,7626,33,422,14,316,18,1002,12,544,13,,28296us,172ms,,131ms,24150us,30501us,13607us,25125us,15365us,2959us,15795us debug=0x33f0484 PASS bonnie (346s) == sanity-benchmark test iozone: iozone ================== 10:12:37 (1734016357) Waiting for MDT destroys to complete oleg237-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg237-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6870] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:48 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 242865 130119 111308 116573 54494 77835 iozone test complete. Waiting for MDT destroys to complete oleg237-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg237-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg237-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg237-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:38 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 76131 75675 88025 87674 88410 77947 iozone test complete. Waiting for MDT destroys to complete oleg237-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg237-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (767s) == sanity-benchmark test fsx: fsx ======================== 10:25:24 (1734017124) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7847 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7847 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x1b4969 truncating to largest ever: 0x51fe78 fallocating to largest ever: 0x5286ae 002000 1734017130.589052 read 0x2eb909 thru 0x2faa70 (0xf168 bytes) 003000 1734017133.432407 mapwrite 0x20fc2c thru 0x21dfc9 (0xe39e bytes) 004000 1734017136.160142 read 0x2f1d61 thru 0x2f9840 (0x7ae0 bytes) 005000 1734017139.256436 mapread 0x3a1a78 thru 0x3a7f16 (0x649f bytes) 006000 1734017142.752589 read 0x063fbf thru 0x0681b0 (0x41f2 bytes) 009000 1734017151.043368 write 0x2041db thru 0x20aa91 (0x68b7 bytes) 010000 1734017153.792079 read 0x004a36 thru 0x0113c6 (0xc991 bytes) skipping zero length fallocate 014000 1734017165.458588 punch from 0x3a847e to 0x3b3765 (0xb2e8 bytes) 016000 1734017171.258245 punch from 0x47ef61 to 0x48b5de (0xc67e bytes) 017000 1734017173.864542 trunc from 0x40b290 to 0x23b3a8 (0x1cfee7 bytes) 018000 1734017176.871074 punch from 0x1d68c3 to 0x1ddd31 (0x746f bytes) 019000 1734017179.883104 write 0x365f9b thru 0x37443e (0xe4a4 bytes) 020000 1734017183.098452 mapread 0x06aab5 thru 0x076690 (0xbbdc bytes) 021000 1734017185.980997 fallocate 0x23b215 thru 0x23c8af (0x169b bytes) 023000 1734017192.048646 mapwrite 0x397e5e thru 0x39c15c (0x42ff bytes) 024000 1734017195.087161 punch from 0x00d768 to 0x019744 (0xbfdd bytes) 025000 1734017197.769258 mapread 0x0812a7 thru 0x087943 (0x669d bytes) 026000 1734017200.234460 fallocate 0x509057 thru 0x516a35 (0xd9df bytes) 027000 1734017202.939352 write 0x03e244 thru 0x03f13c (0xef9 bytes) 029000 1734017208.143978 write 0x1b1b88 thru 0x1b2986 (0xdff bytes) 030000 1734017211.124440 punch from 0x1ce8f9 to 0x1d75ab (0x8cb3 bytes) 031000 1734017213.687825 trunc from 0x0e9ef6 to 0x381ebf (0x297fca bytes) 032000 1734017216.538736 mapread 0x09b1d5 thru 0x0a4c54 (0x9a80 bytes) 033000 1734017219.285949 punch from 0x304495 to 0x307c17 (0x3783 bytes) 034000 1734017221.570451 trunc from 0x49e769 to 0x04d95a (0x450e0e bytes) 036000 1734017227.046102 fallocate 0x3cd390 thru 0x3ceac6 (0x1737 bytes) 037000 1734017229.905701 punch from 0x44e1df to 0x45a4b5 (0xc2d7 bytes) 038000 1734017232.994490 mapread 0x1eac56 thru 0x1f36ee (0x8a99 bytes) 040000 1734017238.925207 fallocate 0x266292 thru 0x272df2 (0xcb61 bytes) 041000 1734017241.902844 read 0x382f3e thru 0x387c7d (0x4d40 bytes) 042000 1734017244.899577 trunc from 0x02b3c2 to 0x43b21b (0x40fe5a bytes) 043000 1734017247.570670 fallocate 0x1ab043 thru 0x1b93d4 (0xe392 bytes) 044000 1734017250.585502 trunc from 0x4d07c0 to 0x0f0ac0 (0x3dfcff bytes) 045000 1734017253.575729 mapwrite 0x0c1483 thru 0x0c40f8 (0x2c76 bytes) 046000 1734017256.551734 write 0x48af94 thru 0x49a921 (0xf98e bytes) 048000 1734017262.314695 trunc from 0x2340c6 to 0x487ad4 (0x253a0f bytes) 050000 1734017267.760975 mapread 0x43ac90 thru 0x446bc6 (0xbf37 bytes) 051000 1734017270.303164 mapread 0x1421e0 thru 0x1496d4 (0x74f5 bytes) 055000 1734017280.583709 mapwrite 0x0f9e49 thru 0x10220b (0x83c3 bytes) 057000 1734017286.049287 write 0x1e2467 thru 0x1eacd5 (0x886f bytes) 058000 1734017288.488089 mapread 0x027cbe thru 0x0287d5 (0xb18 bytes) 060000 1734017293.888919 read 0x0cf53a thru 0x0dbbd3 (0xc69a bytes) 062000 1734017299.131117 write 0x48d36c thru 0x490caa (0x393f bytes) 063000 1734017301.863286 mapread 0x1d4d42 thru 0x1dfc6c (0xaf2b bytes) 064000 1734017304.798420 mapread 0x0bd4cd thru 0x0c7ca8 (0xa7dc bytes) 065000 1734017307.167979 trunc from 0x390375 to 0x2b9b74 (0xd6800 bytes) 068000 1734017314.589071 fallocate 0x200a2e thru 0x21084b (0xfe1e bytes) 069000 1734017317.228974 mapwrite 0x3f7594 thru 0x40384b (0xc2b8 bytes) 071000 1734017322.048977 mapread 0x041a90 thru 0x0436f0 (0x1c61 bytes) 072000 1734017324.497336 trunc from 0x408dd1 to 0x4b9db4 (0xb0fe4 bytes) 073000 1734017326.816098 trunc from 0x458568 to 0x2a018e (0x1b83d9 bytes) 076000 1734017334.584861 punch from 0x136d95 to 0x1380f9 (0x1365 bytes) 077000 1734017337.402330 fallocate 0x1c28ac thru 0x1c58e5 (0x303a bytes) 078000 1734017339.775936 mapread 0x19c57b thru 0x1a1145 (0x4bcb bytes) 079000 1734017342.291680 punch from 0x0ede6f to 0x0f3147 (0x52d9 bytes) 080000 1734017344.957519 fallocate 0x22b1b2 thru 0x233367 (0x81b6 bytes) 081000 1734017347.477221 read 0x256af7 thru 0x263507 (0xca11 bytes) 083000 1734017353.090625 punch from 0x009cb5 to 0x0130c2 (0x940e bytes) 084000 1734017355.755685 mapread 0x20cd67 thru 0x211cb1 (0x4f4b bytes) 085000 1734017358.484964 punch from 0x147e97 to 0x14c45b (0x45c5 bytes) 086000 1734017361.301216 trunc from 0x26b2c0 to 0x004eb5 (0x26640a bytes) 088000 1734017367.110186 write 0x28d989 thru 0x28fa4c (0x20c4 bytes) 089000 1734017369.953513 write 0x03c69b thru 0x04753f (0xaea5 bytes) 090000 1734017372.465438 write 0x1aa3d6 thru 0x1ae40d (0x4038 bytes) 091000 1734017375.201387 read 0x35e931 thru 0x36c04f (0xd71f bytes) 094000 1734017382.641664 trunc from 0x4210dd to 0x157f56 (0x2c9186 bytes) 095000 1734017385.404171 mapread 0x272273 thru 0x2755bd (0x334b bytes) 096000 1734017387.879115 fallocate 0x141b0c thru 0x14babf (0x9fb4 bytes) 097000 1734017390.703726 trunc from 0x5286ae to 0x1459d7 (0x3e2cd6 bytes) 098000 1734017393.072930 punch from 0x209155 to 0x20da1b (0x48c7 bytes) 099000 1734017395.930018 mapwrite 0x015936 thru 0x01b76d (0x5e38 bytes) 100000 1734017398.747112 punch from 0x138876 to 0x13a1b1 (0x193c bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4702805 (4596 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3936256.. 3936259: 4: 0001: net 1: 4.. 7: 4065496.. 4065499: 4: 0001: net 2: 8.. 11: 3938780.. 3938783: 4: 0001: net 3: 52.. 59: 3933456.. 3933463: 8: 0001: net 4: 60.. 75: 4063744.. 4063759: 16: 0001: net 5: 152.. 159: 3933540.. 3933547: 8: 0001: net 6: 168.. 171: 3954684.. 3954687: 4: 0001: net 7: 172.. 187: 4063764.. 4063779: 16: 0001: net 8: 188.. 203: 3938964.. 3938979: 16: 0001: net 9: 216.. 247: 3933476.. 3933507: 32: 0001: net 10: 328.. 331: 3955712.. 3955715: 4: 0001: last,unwritten,net /mnt/lustre/f0.fsxfile: 11 extents found debug=0x33f0484 PASS fsx (275s) == sanity-benchmark test complete, duration 1560 sec ===== 10:29:59 (1734017399) === sanity-benchmark: start cleanup 10:30:00 (1734017400) === === sanity-benchmark: finish cleanup 10:30:01 (1734017401) ===