-----============= acceptance-small: sanity-benchmark ============----- Sun Aug 4 14:09:45 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 14:09:49 (1722794989) === oleg311-client.virtnet: executing check_config_client /mnt/lustre oleg311-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg311-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b63ac800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b63ac800.idle_timeout=debug disable quota as required oleg311-server: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 14:09:55 (1722794995) === == sanity-benchmark test dbench: dbench ================== 14:09:55 (1722794995) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6942] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg311-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg311-client.virtnet at Sun Aug 4 14:09:56 EDT 2024 waiting for dbench pid 8931 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 195 154.60 MB/sec warmup 1 sec latency 111.478 ms 20 394 139.99 MB/sec warmup 2 sec latency 72.800 ms 20 646 140.46 MB/sec warmup 3 sec latency 154.231 ms 20 762 106.72 MB/sec warmup 4 sec latency 211.991 ms 20 878 86.63 MB/sec warmup 5 sec latency 108.286 ms 20 1048 76.30 MB/sec warmup 6 sec latency 112.810 ms 20 1296 67.51 MB/sec warmup 7 sec latency 32.611 ms 20 1618 65.40 MB/sec warmup 8 sec latency 133.468 ms 20 1873 58.60 MB/sec warmup 9 sec latency 95.839 ms 20 2193 53.72 MB/sec warmup 10 sec latency 68.555 ms 20 2465 51.70 MB/sec warmup 11 sec latency 126.701 ms 20 2916 55.06 MB/sec warmup 12 sec latency 133.417 ms 20 3372 55.36 MB/sec warmup 13 sec latency 127.508 ms 20 3784 56.53 MB/sec warmup 14 sec latency 60.988 ms 20 4019 53.42 MB/sec warmup 15 sec latency 24.256 ms 20 4238 50.33 MB/sec warmup 16 sec latency 370.337 ms 20 4354 47.69 MB/sec warmup 17 sec latency 154.179 ms 20 4499 45.44 MB/sec warmup 18 sec latency 114.456 ms 20 4719 44.33 MB/sec warmup 19 sec latency 95.079 ms 20 5001 45.14 MB/sec warmup 20 sec latency 98.337 ms 20 5184 43.13 MB/sec warmup 21 sec latency 63.413 ms 20 5379 41.31 MB/sec warmup 22 sec latency 68.431 ms 20 5614 39.73 MB/sec warmup 23 sec latency 71.017 ms 20 6133 40.44 MB/sec execute 1 sec latency 118.295 ms 20 6586 61.70 MB/sec execute 2 sec latency 138.571 ms 20 7039 64.70 MB/sec execute 3 sec latency 157.873 ms 20 7349 60.07 MB/sec execute 4 sec latency 48.920 ms 20 7560 50.01 MB/sec execute 5 sec latency 22.909 ms 20 7754 42.17 MB/sec execute 6 sec latency 250.134 ms 20 7896 37.08 MB/sec execute 7 sec latency 152.551 ms 20 8071 33.87 MB/sec execute 8 sec latency 91.014 ms 20 8307 32.44 MB/sec execute 9 sec latency 89.649 ms 20 8610 35.23 MB/sec execute 10 sec latency 117.242 ms 20 8801 32.34 MB/sec execute 11 sec latency 116.035 ms 20 9020 29.93 MB/sec execute 12 sec latency 72.575 ms 20 9314 28.38 MB/sec execute 13 sec latency 67.621 ms 20 9540 28.37 MB/sec execute 14 sec latency 113.617 ms 20 9903 31.41 MB/sec execute 15 sec latency 121.284 ms 20 10331 32.84 MB/sec execute 16 sec latency 127.197 ms 20 10700 35.40 MB/sec execute 17 sec latency 113.096 ms 20 10921 34.81 MB/sec execute 18 sec latency 30.524 ms 20 11089 33.28 MB/sec execute 19 sec latency 30.426 ms 20 11274 31.72 MB/sec execute 20 sec latency 176.556 ms 20 11422 30.50 MB/sec execute 21 sec latency 244.976 ms 20 11566 29.43 MB/sec execute 22 sec latency 135.472 ms 20 11772 29.25 MB/sec execute 23 sec latency 104.107 ms 20 12081 30.58 MB/sec execute 24 sec latency 93.275 ms 20 12263 29.47 MB/sec execute 25 sec latency 72.206 ms 20 12440 28.44 MB/sec execute 26 sec latency 75.992 ms 20 12647 27.53 MB/sec execute 27 sec latency 66.988 ms 20 12841 26.83 MB/sec execute 28 sec latency 67.815 ms 20 13053 26.73 MB/sec execute 29 sec latency 92.509 ms 20 13289 27.05 MB/sec execute 30 sec latency 120.675 ms 20 13694 28.71 MB/sec execute 31 sec latency 116.228 ms 20 14119 29.87 MB/sec execute 32 sec latency 103.297 ms 20 14425 30.38 MB/sec execute 33 sec latency 36.526 ms 20 14650 29.85 MB/sec execute 34 sec latency 23.421 ms 20 14842 29.08 MB/sec execute 35 sec latency 328.839 ms 20 14982 28.44 MB/sec execute 36 sec latency 167.745 ms 20 15145 27.95 MB/sec execute 37 sec latency 98.626 ms 20 15383 27.97 MB/sec execute 38 sec latency 81.508 ms 20 15632 28.33 MB/sec execute 39 sec latency 82.765 ms 20 15829 27.98 MB/sec execute 40 sec latency 76.605 ms 20 15995 27.37 MB/sec execute 41 sec latency 119.351 ms 20 16208 26.82 MB/sec execute 42 sec latency 59.110 ms 20 16479 26.60 MB/sec execute 43 sec latency 81.586 ms 20 16725 26.74 MB/sec execute 44 sec latency 106.134 ms 20 17123 27.85 MB/sec execute 45 sec latency 129.126 ms 20 17547 28.54 MB/sec execute 46 sec latency 121.100 ms 20 17864 29.23 MB/sec execute 47 sec latency 164.509 ms 20 18105 29.06 MB/sec execute 48 sec latency 23.251 ms 20 18303 28.54 MB/sec execute 49 sec latency 173.591 ms 20 18475 28.07 MB/sec execute 50 sec latency 215.288 ms 20 18635 27.68 MB/sec execute 51 sec latency 119.074 ms 20 18876 27.63 MB/sec execute 52 sec latency 89.529 ms 20 19223 28.25 MB/sec execute 53 sec latency 70.476 ms 20 19458 27.83 MB/sec execute 54 sec latency 90.528 ms 20 19695 27.40 MB/sec execute 55 sec latency 45.383 ms 20 19977 27.09 MB/sec execute 56 sec latency 75.217 ms 20 20250 27.19 MB/sec execute 57 sec latency 115.180 ms 20 20654 28.14 MB/sec execute 58 sec latency 128.421 ms 20 21084 28.63 MB/sec execute 59 sec latency 124.588 ms 20 21418 29.24 MB/sec execute 60 sec latency 138.694 ms 20 21636 29.13 MB/sec execute 61 sec latency 24.944 ms 20 21822 28.72 MB/sec execute 62 sec latency 131.910 ms 20 22002 28.32 MB/sec execute 63 sec latency 179.031 ms 20 22135 27.98 MB/sec execute 64 sec latency 146.982 ms 20 22291 27.72 MB/sec execute 65 sec latency 108.649 ms 20 22498 27.64 MB/sec execute 66 sec latency 95.122 ms 20 22757 27.89 MB/sec execute 67 sec latency 98.319 ms 20 22986 27.73 MB/sec execute 68 sec latency 66.703 ms 20 23186 27.38 MB/sec execute 69 sec latency 72.965 ms 20 23416 27.07 MB/sec execute 70 sec latency 62.605 ms 20 23654 26.96 MB/sec execute 71 sec latency 135.431 ms 20 23954 27.26 MB/sec execute 72 sec latency 110.289 ms 20 24411 27.96 MB/sec execute 73 sec latency 161.915 ms 20 24831 28.56 MB/sec execute 74 sec latency 148.001 ms 20 25117 28.72 MB/sec execute 75 sec latency 25.986 ms 20 25324 28.46 MB/sec execute 76 sec latency 23.357 ms 20 25519 28.13 MB/sec execute 77 sec latency 213.303 ms 20 25648 27.84 MB/sec execute 78 sec latency 146.490 ms 20 25798 27.59 MB/sec execute 79 sec latency 107.623 ms 20 26018 27.58 MB/sec execute 80 sec latency 103.856 ms 20 26323 27.90 MB/sec execute 81 sec latency 77.303 ms 20 26523 27.66 MB/sec execute 82 sec latency 66.138 ms 20 26716 27.36 MB/sec execute 83 sec latency 62.209 ms 20 26948 27.11 MB/sec execute 84 sec latency 65.588 ms 20 27224 27.05 MB/sec execute 85 sec latency 66.227 ms 20 27509 27.25 MB/sec execute 86 sec latency 133.518 ms 20 27941 27.89 MB/sec execute 87 sec latency 129.478 ms 20 28366 28.24 MB/sec execute 88 sec latency 116.522 ms 20 28653 28.44 MB/sec execute 89 sec latency 23.494 ms 20 28845 28.28 MB/sec execute 90 sec latency 168.904 ms 20 29030 28.00 MB/sec execute 91 sec latency 223.490 ms 20 29195 27.77 MB/sec execute 92 sec latency 121.866 ms 20 29361 27.57 MB/sec execute 93 sec latency 111.760 ms 20 29570 27.56 MB/sec execute 94 sec latency 105.073 ms 20 29801 27.59 MB/sec execute 95 sec latency 79.581 ms 20 30026 27.60 MB/sec execute 96 sec latency 67.699 ms 20 30241 27.35 MB/sec execute 97 sec latency 65.035 ms 20 30471 27.13 MB/sec execute 98 sec latency 75.767 ms 20 30727 27.03 MB/sec execute 99 sec latency 78.439 ms 20 31021 27.24 MB/sec execute 100 sec latency 113.706 ms 20 31401 27.65 MB/sec execute 101 sec latency 181.191 ms 20 31802 27.95 MB/sec execute 102 sec latency 114.074 ms 20 32120 28.23 MB/sec execute 103 sec latency 82.550 ms 20 32331 28.12 MB/sec execute 104 sec latency 23.213 ms 20 32498 27.89 MB/sec execute 105 sec latency 139.010 ms 20 32676 27.67 MB/sec execute 106 sec latency 195.331 ms 20 32805 27.48 MB/sec execute 107 sec latency 101.997 ms 20 32965 27.33 MB/sec execute 108 sec latency 102.328 ms 20 33196 27.35 MB/sec execute 109 sec latency 99.060 ms 20 33449 27.54 MB/sec execute 110 sec latency 98.879 ms 20 33644 27.32 MB/sec execute 111 sec latency 71.757 ms 20 33827 27.11 MB/sec execute 112 sec latency 84.987 ms 20 34026 26.92 MB/sec execute 113 sec latency 72.086 ms 20 34298 26.88 MB/sec execute 114 sec latency 109.034 ms 20 34572 26.96 MB/sec execute 115 sec latency 110.579 ms 20 34949 27.39 MB/sec execute 116 sec latency 124.246 ms 20 35320 27.55 MB/sec execute 117 sec latency 101.167 ms 20 35622 27.84 MB/sec execute 118 sec latency 116.745 ms 20 35846 27.79 MB/sec execute 119 sec latency 24.429 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 103866 12.030 59.227 Close 75681 2.277 15.514 Rename 4450 17.653 60.062 Unlink 21220 3.905 43.393 Qpathinfo 93430 2.956 37.367 Qfileinfo 16398 0.073 8.338 Qfsinfo 17644 0.025 4.244 Sfileinfo 8279 10.087 34.446 Find 36539 0.434 55.303 WriteX 51324 0.843 13.628 ReadX 166151 0.011 2.033 LockX 360 3.156 7.971 UnlockX 360 3.089 14.702 Flush 7145 54.432 328.832 Throughput 27.7914 MB/sec 20 clients 20 procs max_latency=328.839 ms stopping dbench on /mnt/lustre/d0.oleg311-client.virtnet at Sun Aug 4 14:12:21 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg311-client.virtnet /mnt/lustre/d0.oleg311-client.virtnet /mnt/lustre/d0.oleg311-client.virtnet removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg311-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 14:12:23 (1722795143) min OST has 3128320kB available, using 4692480kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6942] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4582] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg311-clien 4582M 156109 98 156672 96 419518 80 2337 143 Latency 3178us 27402us 28573us 123ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg311-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 527 17 8715 32 677 11 492 16 1322 12 627 11 Latency 15338us 11415us 50832us 17047us 4364us 9828us 1.97,1.97,oleg311-client.virtnet,1,1722803101,4582M,,,,156109,98,156672,96,,,419518,80,2337,143,10,,,,,527,17,8715,32,677,11,492,16,1322,12,627,11,,3178us,27402us,,28573us,123ms,15338us,11415us,50832us,17047us,4364us,9828us debug=0x33f0484 PASS bonnie (162s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 14:15:05 (1722795305) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 26177 -P /tmp -l 5644800 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 26177 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x99302 truncating to largest ever: 0x21896d truncating to largest ever: 0x41682a truncating to largest ever: 0x42d069 truncating to largest ever: 0x4e3b4e truncating to largest ever: 0x53a4c7 truncating to largest ever: 0x55b3b2 truncating to largest ever: 0x561a8d 003000 1722795315.141107 mapwrite 0x29dc1c thru 0x2a7600 (0x99e5 bytes) 008000 1722795330.692456 write 0x3a2da7 thru 0x3a502f (0x2289 bytes) 009000 1722795333.944645 mapread 0x284e8a thru 0x288a2c (0x3ba3 bytes) 010000 1722795337.233435 trunc from 0x3e075f to 0x36f224 (0x7153a bytes) 013000 1722795346.753040 trunc from 0x433300 to 0x533d9f (0x100aa0 bytes) 014000 1722795349.911286 write 0x20fd8d thru 0x21983f (0x9ab3 bytes) 015000 1722795353.006078 trunc from 0x48f2d4 to 0x511c0f (0x8293c bytes) 016000 1722795355.952257 mapread 0x1d95e1 thru 0x1e0b27 (0x7547 bytes) 018000 1722795361.812067 write 0x48a672 thru 0x494d70 (0xa6ff bytes) 020000 1722795368.531473 mapread 0x3959a6 thru 0x39be56 (0x64b1 bytes) 026000 1722795387.988239 mapwrite 0x148bc9 thru 0x15712f (0xe567 bytes) 028000 1722795394.277424 trunc from 0x2a45e1 to 0x328dc2 (0x847e2 bytes) 029000 1722795396.915911 write 0x4ae07f thru 0x4b4f79 (0x6efb bytes) 031000 1722795403.173931 read 0x49edb7 thru 0x49f508 (0x752 bytes) 038000 1722795424.831423 read 0x35bbfb thru 0x35f8e5 (0x3ceb bytes) 039000 1722795427.829275 mapread 0x00f44b thru 0x013b20 (0x46d6 bytes) 040000 1722795430.605783 write 0x0bff80 thru 0x0cb572 (0xb5f3 bytes) 045000 1722795444.360089 trunc from 0x50db68 to 0x17f596 (0x38e5d1 bytes) 048000 1722795453.777338 mapwrite 0x142d14 thru 0x14e721 (0xba0e bytes) 049000 1722795456.785547 mapwrite 0x248552 thru 0x251d79 (0x9828 bytes) 050000 1722795459.841383 trunc from 0x4100e6 to 0x1de404 (0x231ce1 bytes) 055000 1722795475.079680 trunc from 0x4f530c to 0x469173 (0x8c198 bytes) 057000 1722795480.921433 mapwrite 0x43d0dd thru 0x4427df (0x5703 bytes) 058000 1722795483.895151 write 0x4d50fe thru 0x4dc718 (0x761b bytes) 060000 1722795490.330061 trunc from 0x280439 to 0x1fd0a6 (0x83392 bytes) 062000 1722795496.296026 mapread 0x026a8c thru 0x0298b9 (0x2e2e bytes) 063000 1722795499.103104 mapwrite 0x0fe9e4 thru 0x0ff156 (0x773 bytes) 065000 1722795505.203469 read 0x018dd4 thru 0x028be4 (0xfe11 bytes) 067000 1722795511.050342 mapread 0x0386b8 thru 0x03ebef (0x6538 bytes) 070000 1722795520.572550 mapwrite 0x25afe5 thru 0x2678d8 (0xc8f4 bytes) 071000 1722795523.547258 read 0x03f793 thru 0x046386 (0x6bf4 bytes) truncating to largest ever: 0x561d42 074000 1722795533.368632 mapread 0x07b0db thru 0x082106 (0x702c bytes) 075000 1722795536.465893 read 0x074a16 thru 0x082818 (0xde03 bytes) 076000 1722795539.590294 mapwrite 0x464a3f thru 0x46d629 (0x8beb bytes) 077000 1722795542.684340 read 0x3fe457 thru 0x3ffc69 (0x1813 bytes) truncating to largest ever: 0x562110 080000 1722795552.124641 mapwrite 0x36c794 thru 0x37256e (0x5ddb bytes) 083000 1722795561.159508 trunc from 0x3dc991 to 0x1f7f6d (0x1e4a23 bytes) 085000 1722795566.898140 mapwrite 0x50e368 thru 0x5109f5 (0x268e bytes) 090000 1722795584.207432 write 0x32fb5e thru 0x33a408 (0xa8ab bytes) 096000 1722795605.518330 trunc from 0x246a76 to 0x44b23f (0x2047ca bytes) 097000 1722795609.580658 write 0x46787d thru 0x46940f (0x1b93 bytes) 100000 1722795621.271032 mapwrite 0x273120 thru 0x281505 (0xe3e6 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (317s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 14:20:22 (1722795622) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1722795634.336931 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1722795643.306794 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1722795647.362884 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1722795665.624819 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1722795669.293133 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1722795682.272237 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1722795685.462843 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1722795692.478971 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1722795699.718351 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1722795704.031063 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1722795713.812773 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1722795717.591223 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1722795734.555225 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1722795741.763430 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1722795755.009907 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1722795769.061466 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1722795772.386727 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1722795790.535355 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1722795795.235351 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1722795809.629561 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1722795813.923805 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1722795818.576671 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1722795829.799445 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1722795838.002425 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1722795846.955706 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1722795851.673776 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1722795899.206715 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1722795915.267092 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1722795921.536195 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1722795926.986255 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1722795933.218103 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1722795952.469104 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1722795958.591203 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1722795975.438718 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1722795981.019280 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1722795997.957092 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1722796011.881955 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1722796017.474945 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1722796032.849289 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1722796056.049498 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1722796060.814115 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1722796070.602023 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1722796081.349781 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (465s) == sanity-benchmark test complete, duration 1102 sec ===== 14:28:07 (1722796087) === sanity-benchmark: start cleanup 14:28:08 (1722796088) === === sanity-benchmark: finish cleanup 14:28:08 (1722796088) ===