-----============= acceptance-small: sanity-benchmark ============----- Fri May 10 08:07:34 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 08:07:38 (1715342858) === oleg231-client.virtnet: executing check_config_client /mnt/lustre oleg231-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg231-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8801373cf000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8801373cf000.idle_timeout=debug disable quota as required oleg231-server: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 08:07:45 (1715342865) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 08:07:46 (1715342866) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6856] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg231-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg231-client.virtnet at Fri May 10 08:07:47 EDT 2024 waiting for dbench pid 8909 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 209 163.30 MB/sec warmup 1 sec latency 85.219 ms 20 441 155.12 MB/sec warmup 2 sec latency 38.717 ms 20 676 141.08 MB/sec warmup 3 sec latency 289.586 ms 20 843 107.68 MB/sec warmup 4 sec latency 145.616 ms 20 1049 91.52 MB/sec warmup 5 sec latency 110.177 ms 20 1392 86.35 MB/sec warmup 6 sec latency 25.710 ms 20 1610 74.71 MB/sec warmup 7 sec latency 136.323 ms 20 1852 65.87 MB/sec warmup 8 sec latency 118.958 ms 20 2140 59.29 MB/sec warmup 9 sec latency 115.561 ms 20 2413 56.08 MB/sec warmup 10 sec latency 123.823 ms 20 2776 58.10 MB/sec warmup 11 sec latency 128.804 ms 20 3180 57.16 MB/sec warmup 12 sec latency 154.101 ms 20 3632 59.43 MB/sec warmup 13 sec latency 130.345 ms 20 3882 56.90 MB/sec warmup 14 sec latency 30.837 ms 20 4087 53.44 MB/sec warmup 15 sec latency 147.290 ms 20 4287 50.45 MB/sec warmup 16 sec latency 226.402 ms 20 4432 47.90 MB/sec warmup 17 sec latency 192.250 ms 20 4663 46.63 MB/sec warmup 18 sec latency 121.590 ms 20 5022 47.52 MB/sec warmup 19 sec latency 83.127 ms 20 5248 45.33 MB/sec warmup 20 sec latency 104.518 ms 20 5506 43.39 MB/sec warmup 21 sec latency 80.409 ms 20 5841 42.25 MB/sec warmup 22 sec latency 67.714 ms 20 6093 41.94 MB/sec warmup 23 sec latency 151.023 ms 20 6893 45.71 MB/sec execute 1 sec latency 147.971 ms 20 7239 55.99 MB/sec execute 2 sec latency 132.464 ms 20 7455 43.72 MB/sec execute 3 sec latency 27.566 ms 20 7618 33.68 MB/sec execute 4 sec latency 176.035 ms 20 7813 27.93 MB/sec execute 5 sec latency 190.572 ms 20 7946 24.48 MB/sec execute 6 sec latency 174.298 ms 20 8136 23.34 MB/sec execute 7 sec latency 156.622 ms 20 8448 25.88 MB/sec execute 8 sec latency 123.394 ms 20 8691 26.40 MB/sec execute 9 sec latency 143.170 ms 20 8917 24.16 MB/sec execute 10 sec latency 78.516 ms 20 9178 22.64 MB/sec execute 11 sec latency 84.464 ms 20 9467 22.90 MB/sec execute 12 sec latency 105.475 ms 20 9746 24.22 MB/sec execute 13 sec latency 133.467 ms 20 10134 28.24 MB/sec execute 14 sec latency 187.811 ms 20 10526 29.46 MB/sec execute 15 sec latency 189.160 ms 20 10853 31.23 MB/sec execute 16 sec latency 127.543 ms 20 11055 30.37 MB/sec execute 17 sec latency 246.179 ms 20 11239 28.78 MB/sec execute 18 sec latency 285.150 ms 20 11409 27.60 MB/sec execute 19 sec latency 240.898 ms 20 11581 26.70 MB/sec execute 20 sec latency 121.429 ms 20 11812 26.80 MB/sec execute 21 sec latency 136.465 ms 20 12113 27.86 MB/sec execute 22 sec latency 92.571 ms 20 12327 27.02 MB/sec execute 23 sec latency 108.755 ms 20 12554 26.07 MB/sec execute 24 sec latency 79.895 ms 20 12809 25.46 MB/sec execute 25 sec latency 97.801 ms 20 13085 25.64 MB/sec execute 26 sec latency 140.786 ms 20 13346 26.15 MB/sec execute 27 sec latency 152.907 ms 20 13748 28.01 MB/sec execute 28 sec latency 198.430 ms 20 14109 28.72 MB/sec execute 29 sec latency 176.906 ms 20 14391 29.37 MB/sec execute 30 sec latency 90.592 ms 20 14590 28.95 MB/sec execute 31 sec latency 100.358 ms 20 14732 28.13 MB/sec execute 32 sec latency 195.798 ms 20 14913 27.41 MB/sec execute 33 sec latency 214.683 ms 20 15050 26.85 MB/sec execute 34 sec latency 133.015 ms 20 15243 26.57 MB/sec execute 35 sec latency 133.562 ms 20 15508 26.72 MB/sec execute 36 sec latency 112.298 ms 20 15797 27.09 MB/sec execute 37 sec latency 167.005 ms 20 16026 26.52 MB/sec execute 38 sec latency 73.479 ms 20 16264 26.03 MB/sec execute 39 sec latency 104.410 ms 20 16577 26.09 MB/sec execute 40 sec latency 94.614 ms 20 16882 26.60 MB/sec execute 41 sec latency 168.053 ms 20 17315 27.82 MB/sec execute 42 sec latency 170.081 ms 20 17692 28.40 MB/sec execute 43 sec latency 178.482 ms 20 17992 28.82 MB/sec execute 44 sec latency 68.404 ms 20 18175 28.46 MB/sec execute 45 sec latency 225.273 ms 20 18391 27.92 MB/sec execute 46 sec latency 247.415 ms 20 18538 27.46 MB/sec execute 47 sec latency 188.417 ms 20 18740 27.23 MB/sec execute 48 sec latency 108.788 ms 20 19027 27.36 MB/sec execute 49 sec latency 111.849 ms 20 19335 27.69 MB/sec execute 50 sec latency 111.726 ms 20 19590 27.26 MB/sec execute 51 sec latency 69.341 ms 20 19873 26.92 MB/sec execute 52 sec latency 83.503 ms 20 20208 27.02 MB/sec execute 53 sec latency 115.923 ms 20 20577 27.60 MB/sec execute 54 sec latency 149.041 ms 20 21005 28.45 MB/sec execute 55 sec latency 161.988 ms 20 21420 29.18 MB/sec execute 56 sec latency 147.678 ms 20 21700 29.16 MB/sec execute 57 sec latency 145.464 ms 20 21915 28.74 MB/sec execute 58 sec latency 103.070 ms 20 22105 28.39 MB/sec execute 59 sec latency 146.330 ms 20 22289 28.15 MB/sec execute 60 sec latency 131.458 ms 20 22531 28.04 MB/sec execute 61 sec latency 152.936 ms 20 22863 28.42 MB/sec execute 62 sec latency 128.636 ms 20 23120 28.16 MB/sec execute 63 sec latency 73.365 ms 20 23396 27.93 MB/sec execute 64 sec latency 76.610 ms 20 23721 27.85 MB/sec execute 65 sec latency 107.333 ms 20 23999 28.06 MB/sec execute 66 sec latency 172.362 ms 20 24401 28.78 MB/sec execute 67 sec latency 159.869 ms 20 24802 29.20 MB/sec execute 68 sec latency 147.067 ms 20 25105 29.46 MB/sec execute 69 sec latency 122.753 ms 20 25303 29.24 MB/sec execute 70 sec latency 161.652 ms 20 25502 28.90 MB/sec execute 71 sec latency 111.697 ms 20 25693 28.66 MB/sec execute 72 sec latency 187.842 ms 20 25858 28.37 MB/sec execute 73 sec latency 111.968 ms 20 26068 28.28 MB/sec execute 74 sec latency 155.231 ms 20 26422 28.70 MB/sec execute 75 sec latency 97.578 ms 20 26642 28.39 MB/sec execute 76 sec latency 99.062 ms 20 26914 28.21 MB/sec execute 77 sec latency 87.521 ms 20 27250 28.15 MB/sec execute 78 sec latency 80.008 ms 20 27504 28.17 MB/sec execute 79 sec latency 132.296 ms 20 27876 28.74 MB/sec execute 80 sec latency 152.285 ms 20 28270 28.94 MB/sec execute 81 sec latency 127.714 ms 20 28603 29.36 MB/sec execute 82 sec latency 96.298 ms 20 28824 29.25 MB/sec execute 83 sec latency 142.456 ms 20 29030 28.98 MB/sec execute 84 sec latency 169.918 ms 20 29251 28.78 MB/sec execute 85 sec latency 285.455 ms 20 29433 28.57 MB/sec execute 86 sec latency 143.209 ms 20 29681 28.52 MB/sec execute 87 sec latency 153.943 ms 20 30022 28.84 MB/sec execute 88 sec latency 95.066 ms 20 30290 28.67 MB/sec execute 89 sec latency 87.823 ms 20 30575 28.52 MB/sec execute 90 sec latency 79.712 ms 20 30902 28.45 MB/sec execute 91 sec latency 108.891 ms 20 31143 28.47 MB/sec execute 92 sec latency 164.494 ms 20 31543 29.00 MB/sec execute 93 sec latency 220.674 ms 20 31909 29.15 MB/sec execute 94 sec latency 132.664 ms 20 32229 29.44 MB/sec execute 95 sec latency 103.558 ms 20 32439 29.34 MB/sec execute 96 sec latency 116.608 ms 20 32630 29.11 MB/sec execute 97 sec latency 119.891 ms 20 32823 28.88 MB/sec execute 98 sec latency 194.680 ms 20 32987 28.68 MB/sec execute 99 sec latency 119.576 ms 20 33189 28.59 MB/sec execute 100 sec latency 127.446 ms 20 33508 28.75 MB/sec execute 101 sec latency 113.800 ms 20 33774 28.77 MB/sec execute 102 sec latency 89.242 ms 20 34024 28.64 MB/sec execute 103 sec latency 94.206 ms 20 34289 28.47 MB/sec execute 104 sec latency 96.320 ms 20 34576 28.46 MB/sec execute 105 sec latency 141.878 ms 20 34848 28.62 MB/sec execute 106 sec latency 146.840 ms 20 35223 28.91 MB/sec execute 107 sec latency 116.441 ms 20 35580 29.12 MB/sec execute 108 sec latency 165.066 ms 20 35862 29.24 MB/sec execute 109 sec latency 155.044 ms 20 36077 29.14 MB/sec execute 110 sec latency 134.482 ms 20 36303 28.94 MB/sec execute 111 sec latency 171.678 ms 20 36507 28.77 MB/sec execute 112 sec latency 172.882 ms 20 36723 28.65 MB/sec execute 113 sec latency 97.403 ms 20 37079 28.86 MB/sec execute 114 sec latency 126.678 ms 20 37393 28.95 MB/sec execute 115 sec latency 79.211 ms 20 37650 28.79 MB/sec execute 116 sec latency 97.450 ms 20 37988 28.69 MB/sec execute 117 sec latency 69.391 ms 20 38258 28.68 MB/sec execute 118 sec latency 136.608 ms 20 38626 29.03 MB/sec execute 119 sec latency 147.169 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 112118 10.367 57.983 Close 82246 2.456 23.274 Rename 4768 13.744 46.725 Unlink 22710 4.246 32.026 Qpathinfo 101478 2.410 42.911 Qfileinfo 17716 0.072 7.570 Qfsinfo 18821 0.031 9.445 Sfileinfo 9045 6.719 29.388 Find 39703 0.424 28.380 WriteX 55463 0.848 23.541 ReadX 177719 0.014 3.780 LockX 366 3.150 13.706 UnlockX 366 3.209 13.385 Flush 7918 62.421 285.448 Throughput 29.0299 MB/sec 20 clients 20 procs max_latency=285.455 ms stopping dbench on /mnt/lustre/d0.oleg231-client.virtnet at Fri May 10 08:10:12 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg231-client.virtnet /mnt/lustre/d0.oleg231-client.virtnet /mnt/lustre/d0.oleg231-client.virtnet removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg231-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 08:10:16 (1715343016) min OST has 3063808kB available, using 4595712kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6856] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4488] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg231-clien 4488M 158117 98 133078 95 383666 86 1768 123 Latency 2105us 28416us 27507us 388ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg231-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 441 15 7998 32 594 11 445 15 1079 13 555 11 Latency 15510us 13818us 89969us 15300us 7315us 10711us 1.97,1.97,oleg231-client.virtnet,1,1715349959,4488M,,,,158117,98,133078,95,,,383666,86,1768,123,10,,,,,441,15,7998,32,594,11,445,15,1079,13,555,11,,2105us,28416us,,27507us,388ms,15510us,13818us,89969us,15300us,7315us,10711us debug=0x33f0484 PASS bonnie (178s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 08:13:16 (1715343196) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 3466 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 3466 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x3119e9 truncating to largest ever: 0x4d3e1a truncating to largest ever: 0x5305af truncating to largest ever: 0x53b5ac 001000 1715343200.253515 mapwrite 0x0576f7 thru 0x057a75 (0x37f bytes) truncating to largest ever: 0x554b0a 002000 1715343203.648466 trunc from 0x212750 to 0x4637e4 (0x251095 bytes) truncating to largest ever: 0x5629f1 006000 1715343216.298100 mapread 0x12d1e9 thru 0x12ecf6 (0x1b0e bytes) 007000 1715343219.366384 mapread 0x1a805a thru 0x1b348e (0xb435 bytes) 010000 1715343228.959878 write 0x0dce8e thru 0x0e9c5b (0xcdce bytes) 012000 1715343235.058229 trunc from 0x4e3cb0 to 0x0cdfdf (0x415cd0 bytes) 013000 1715343237.932531 mapread 0x1a95b0 thru 0x1b68ac (0xd2fd bytes) 015000 1715343243.682722 trunc from 0x082e38 to 0x0f6438 (0x73601 bytes) 018000 1715343252.347730 mapwrite 0x27621b thru 0x276ca7 (0xa8d bytes) 019000 1715343255.368018 write 0x3840a9 thru 0x38ff78 (0xbed0 bytes) 021000 1715343261.828116 read 0x0011f4 thru 0x009824 (0x8631 bytes) skipping zero size read 022000 1715343264.550667 write 0x3f0553 thru 0x3fc23d (0xbceb bytes) 026000 1715343277.488217 trunc from 0x21334e to 0x1d4103 (0x3f24a bytes) 029000 1715343286.328718 trunc from 0x11f750 to 0x1cd72d (0xadfde bytes) 030000 1715343289.329289 trunc from 0x42ee8f to 0x544b34 (0x115ca6 bytes) 031000 1715343292.126542 mapread 0x2b6c49 thru 0x2beb67 (0x7f1f bytes) 033000 1715343298.133425 read 0x0f9f7f thru 0x0fc8a6 (0x2928 bytes) 035000 1715343304.001471 write 0x2c640d thru 0x2c76d9 (0x12cd bytes) 040000 1715343318.249194 write 0x551fed thru 0x5587ca (0x67de bytes) 044000 1715343331.756592 mapwrite 0x374387 thru 0x37bb20 (0x779a bytes) 046000 1715343338.337195 trunc from 0x4fc1fe to 0x0c838e (0x433e6f bytes) 048000 1715343344.311070 trunc from 0x4a8b80 to 0x112388 (0x3967f7 bytes) 060000 1715343379.603824 write 0x3f9630 thru 0x40626a (0xcc3b bytes) 061000 1715343382.750084 trunc from 0x2b465e to 0x4558f6 (0x1a1299 bytes) truncating to largest ever: 0x562b3f 067000 1715343400.660761 read 0x009574 thru 0x015c71 (0xc6fe bytes) 069000 1715343406.625526 trunc from 0x39a94a to 0x4082df (0x6d996 bytes) 073000 1715343417.798131 mapread 0x3b82ef thru 0x3c3bb9 (0xb8cb bytes) 074000 1715343420.887294 write 0x558f3d thru 0x55fea9 (0x6f6d bytes) 076000 1715343426.641458 write 0x1b6c4f thru 0x1c2fb3 (0xc365 bytes) 078000 1715343432.780828 mapread 0x2228e7 thru 0x23109e (0xe7b8 bytes) 079000 1715343435.532135 trunc from 0x4be3dd to 0x081d6b (0x43c671 bytes) 085000 1715343454.964628 trunc from 0x51e0ec to 0x3a14d5 (0x17cc16 bytes) 086000 1715343457.750898 mapread 0x245240 thru 0x2509c3 (0xb784 bytes) 087000 1715343460.911893 mapread 0x2b8484 thru 0x2b87bc (0x339 bytes) 090000 1715343470.061441 trunc from 0x0a26f1 to 0x43f0d8 (0x39c9e8 bytes) 091000 1715343473.273953 trunc from 0x1e2776 to 0x4c572a (0x2e2fb5 bytes) 093000 1715343479.576772 trunc from 0x32e4aa to 0x48fc4c (0x1617a3 bytes) 095000 1715343485.443612 write 0x1441ad thru 0x14565f (0x14b3 bytes) 097000 1715343490.912349 mapread 0x4e4625 thru 0x4ea4f6 (0x5ed2 bytes) skipping zero size write All operations completed A-OK! debug=0x33f0484 PASS fsx (304s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 08:18:22 (1715343502) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1715343511.934056 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1715343519.312560 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1715343522.965326 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1715343537.298981 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1715343540.393231 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1715343552.672095 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1715343555.777519 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1715343562.641353 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1715343569.288623 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1715343572.926628 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1715343581.250844 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1715343585.658845 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1715343603.386969 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1715343611.468883 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1715343627.381873 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1715343644.643508 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1715343649.555768 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1715343672.198023 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1715343679.118179 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1715343697.177142 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1715343701.619802 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1715343705.644285 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1715343718.759601 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1715343729.162337 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1715343739.541436 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1715343744.805302 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1715343796.234068 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1715343812.909793 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1715343819.057296 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1715343822.981559 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1715343828.298378 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1715343845.288143 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1715343850.742581 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1715343868.790698 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1715343874.688143 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1715343887.265559 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1715343899.078294 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1715343902.187547 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1715343910.845136 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1715343925.511590 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1715343928.665461 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1715343939.229870 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1715343948.940354 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (453s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1101 sec ===== 08:25:56 (1715343956) === sanity-benchmark: start cleanup 08:25:56 (1715343956) === === sanity-benchmark: finish cleanup 08:25:56 (1715343956) ===