-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:47 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:52 (1734015832) === oleg344-client.virtnet: executing check_config_client /mnt/lustre oleg344-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg344-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ad87a800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ad87a800.idle_timeout=debug disable quota as required oleg344-server: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:03 (1734015843) === == sanity-benchmark test dbench: dbench ================== 10:04:04 (1734015844) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6868] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg344-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg344-client.virtnet at Thu Dec 12 10:04:05 EST 2024 waiting for dbench pid 9431 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 20 of 20 processes prepared for launch 0 sec releasing clients 20 67 59.37 MB/sec warmup 1 sec latency 108.769 ms 20 161 66.84 MB/sec warmup 2 sec latency 128.136 ms 20 238 60.61 MB/sec warmup 3 sec latency 114.145 ms 20 310 56.75 MB/sec warmup 4 sec latency 110.064 ms 20 373 53.13 MB/sec warmup 5 sec latency 123.947 ms 20 442 51.81 MB/sec warmup 6 sec latency 128.214 ms 20 516 51.02 MB/sec warmup 7 sec latency 112.493 ms 20 644 52.58 MB/sec warmup 8 sec latency 142.111 ms 20 704 47.07 MB/sec warmup 9 sec latency 103.020 ms 20 768 42.67 MB/sec warmup 10 sec latency 104.725 ms 20 826 39.07 MB/sec warmup 11 sec latency 114.442 ms 20 885 36.09 MB/sec warmup 12 sec latency 102.954 ms 20 926 33.47 MB/sec warmup 13 sec latency 107.733 ms 20 977 31.25 MB/sec warmup 14 sec latency 112.132 ms 20 1065 30.51 MB/sec warmup 15 sec latency 99.967 ms 20 1139 28.72 MB/sec warmup 16 sec latency 87.837 ms 20 1201 27.10 MB/sec warmup 17 sec latency 98.574 ms 20 1252 25.79 MB/sec warmup 18 sec latency 106.856 ms 20 1391 27.35 MB/sec warmup 19 sec latency 95.099 ms 20 1441 26.00 MB/sec warmup 20 sec latency 149.953 ms 20 1491 24.79 MB/sec warmup 21 sec latency 120.209 ms 20 1554 23.72 MB/sec warmup 22 sec latency 78.579 ms 20 1613 22.74 MB/sec warmup 23 sec latency 89.354 ms 20 1731 0.87 MB/sec execute 1 sec latency 121.556 ms 20 1801 1.01 MB/sec execute 2 sec latency 87.176 ms 20 1856 1.00 MB/sec execute 3 sec latency 102.216 ms 20 1921 1.01 MB/sec execute 4 sec latency 122.110 ms 20 1985 1.08 MB/sec execute 5 sec latency 106.678 ms 20 2029 1.15 MB/sec execute 6 sec latency 111.091 ms 20 2072 1.17 MB/sec execute 7 sec latency 137.322 ms 20 2127 1.16 MB/sec execute 8 sec latency 123.839 ms 20 2174 1.25 MB/sec execute 9 sec latency 106.462 ms 20 2215 1.30 MB/sec execute 10 sec latency 146.515 ms 20 2288 2.18 MB/sec execute 11 sec latency 109.597 ms 20 2364 2.83 MB/sec execute 12 sec latency 169.721 ms 20 2413 2.86 MB/sec execute 13 sec latency 120.045 ms 20 2458 3.09 MB/sec execute 14 sec latency 329.098 ms 20 2487 3.15 MB/sec execute 15 sec latency 1221.371 ms 20 2546 3.36 MB/sec execute 16 sec latency 1378.726 ms 20 2632 4.20 MB/sec execute 17 sec latency 155.737 ms 20 2766 5.83 MB/sec execute 18 sec latency 132.581 ms 20 2864 6.55 MB/sec execute 19 sec latency 313.517 ms 20 2949 6.94 MB/sec execute 20 sec latency 319.192 ms 20 3055 7.20 MB/sec execute 21 sec latency 156.066 ms 20 3204 7.61 MB/sec execute 22 sec latency 139.725 ms 20 3349 8.38 MB/sec execute 23 sec latency 114.168 ms 20 3419 8.53 MB/sec execute 24 sec latency 183.541 ms 20 3500 9.06 MB/sec execute 25 sec latency 784.754 ms 20 3585 9.25 MB/sec execute 26 sec latency 86.742 ms 20 3669 9.34 MB/sec execute 27 sec latency 78.010 ms 20 3734 9.24 MB/sec execute 28 sec latency 86.332 ms 20 3781 9.17 MB/sec execute 29 sec latency 142.584 ms 20 3830 9.04 MB/sec execute 30 sec latency 96.952 ms 20 3874 8.78 MB/sec execute 31 sec latency 86.438 ms 20 3922 8.60 MB/sec execute 32 sec latency 95.229 ms 20 3970 8.39 MB/sec execute 33 sec latency 88.449 ms 20 4001 8.14 MB/sec execute 34 sec latency 155.689 ms 20 4037 7.91 MB/sec execute 35 sec latency 111.440 ms 20 4081 7.70 MB/sec execute 36 sec latency 126.936 ms 20 4131 7.51 MB/sec execute 37 sec latency 166.033 ms 20 4203 7.35 MB/sec execute 38 sec latency 113.887 ms 20 4259 7.22 MB/sec execute 39 sec latency 145.026 ms 20 4319 7.11 MB/sec execute 40 sec latency 132.797 ms 20 4373 7.01 MB/sec execute 41 sec latency 107.674 ms 20 4426 6.90 MB/sec execute 42 sec latency 114.051 ms 20 4476 6.81 MB/sec execute 43 sec latency 121.401 ms 20 4529 6.76 MB/sec execute 44 sec latency 145.225 ms 20 4586 6.78 MB/sec execute 45 sec latency 142.236 ms 20 4660 6.80 MB/sec execute 46 sec latency 114.952 ms 20 4729 6.79 MB/sec execute 47 sec latency 98.535 ms 20 4805 6.84 MB/sec execute 48 sec latency 92.321 ms 20 4869 6.87 MB/sec execute 49 sec latency 105.534 ms 20 4960 7.33 MB/sec execute 50 sec latency 112.634 ms 20 5028 7.42 MB/sec execute 51 sec latency 131.362 ms 20 5073 7.29 MB/sec execute 52 sec latency 108.404 ms 20 5124 7.17 MB/sec execute 53 sec latency 99.913 ms 20 5165 7.05 MB/sec execute 54 sec latency 126.560 ms 20 5212 6.94 MB/sec execute 55 sec latency 121.311 ms 20 5262 6.83 MB/sec execute 56 sec latency 125.869 ms 20 5308 6.72 MB/sec execute 57 sec latency 119.069 ms 20 5354 6.62 MB/sec execute 58 sec latency 107.743 ms 20 5404 6.52 MB/sec execute 59 sec latency 101.710 ms 20 5451 6.43 MB/sec execute 60 sec latency 112.472 ms 20 5527 6.35 MB/sec execute 61 sec latency 81.102 ms 20 5596 6.27 MB/sec execute 62 sec latency 79.497 ms 20 5645 6.20 MB/sec execute 63 sec latency 98.001 ms 20 5708 6.14 MB/sec execute 64 sec latency 121.125 ms 20 5769 6.12 MB/sec execute 65 sec latency 101.482 ms 20 5844 6.11 MB/sec execute 66 sec latency 77.834 ms 20 5931 6.20 MB/sec execute 67 sec latency 94.315 ms 20 5991 6.20 MB/sec execute 68 sec latency 105.582 ms 20 6066 6.26 MB/sec execute 69 sec latency 117.749 ms 20 6170 6.45 MB/sec execute 70 sec latency 113.157 ms 20 6279 6.68 MB/sec execute 71 sec latency 110.859 ms 20 6409 6.97 MB/sec execute 72 sec latency 124.498 ms 20 6542 7.22 MB/sec execute 73 sec latency 123.291 ms 20 6632 7.25 MB/sec execute 74 sec latency 222.581 ms 20 6771 7.34 MB/sec execute 75 sec latency 132.146 ms 20 6901 7.56 MB/sec execute 76 sec latency 136.936 ms 20 7009 7.75 MB/sec execute 77 sec latency 102.337 ms 20 7110 7.93 MB/sec execute 78 sec latency 76.898 ms 20 7185 7.98 MB/sec execute 79 sec latency 93.059 ms 20 7249 7.96 MB/sec execute 80 sec latency 96.508 ms 20 7307 7.96 MB/sec execute 81 sec latency 90.373 ms 20 7343 7.93 MB/sec execute 82 sec latency 180.621 ms 20 7396 7.88 MB/sec execute 83 sec latency 86.208 ms 20 7442 7.81 MB/sec execute 84 sec latency 101.376 ms 20 7485 7.74 MB/sec execute 85 sec latency 126.917 ms 20 7534 7.66 MB/sec execute 86 sec latency 84.631 ms 20 7565 7.57 MB/sec execute 87 sec latency 140.184 ms 20 7615 7.49 MB/sec execute 88 sec latency 96.607 ms 20 7662 7.42 MB/sec execute 89 sec latency 152.587 ms 20 7733 7.35 MB/sec execute 90 sec latency 165.274 ms 20 7802 7.29 MB/sec execute 91 sec latency 110.290 ms 20 7862 7.25 MB/sec execute 92 sec latency 149.963 ms 20 7915 7.19 MB/sec execute 93 sec latency 103.684 ms 20 7970 7.15 MB/sec execute 94 sec latency 116.941 ms 20 8018 7.11 MB/sec execute 95 sec latency 134.292 ms 20 8068 7.08 MB/sec execute 96 sec latency 140.226 ms 20 8126 7.06 MB/sec execute 97 sec latency 106.259 ms 20 8190 7.08 MB/sec execute 98 sec latency 123.329 ms 20 8266 7.08 MB/sec execute 99 sec latency 97.790 ms 20 8343 7.13 MB/sec execute 100 sec latency 95.863 ms 20 8408 7.13 MB/sec execute 101 sec latency 112.039 ms 20 8497 7.31 MB/sec execute 102 sec latency 146.420 ms 20 8567 7.39 MB/sec execute 103 sec latency 101.844 ms 20 8611 7.32 MB/sec execute 104 sec latency 137.094 ms 20 8659 7.26 MB/sec execute 105 sec latency 144.695 ms 20 8705 7.20 MB/sec execute 106 sec latency 103.470 ms 20 8753 7.14 MB/sec execute 107 sec latency 122.434 ms 20 8802 7.08 MB/sec execute 108 sec latency 118.643 ms 20 8850 7.02 MB/sec execute 109 sec latency 114.223 ms 20 8897 6.96 MB/sec execute 110 sec latency 108.319 ms 20 8950 6.91 MB/sec execute 111 sec latency 92.897 ms 20 9003 6.86 MB/sec execute 112 sec latency 94.551 ms 20 9080 6.81 MB/sec execute 113 sec latency 83.957 ms 20 9149 6.76 MB/sec execute 114 sec latency 101.900 ms 20 9213 6.72 MB/sec execute 115 sec latency 107.965 ms 20 9303 6.71 MB/sec execute 116 sec latency 78.089 ms 20 9377 6.70 MB/sec execute 117 sec latency 90.116 ms 20 9487 6.78 MB/sec execute 118 sec latency 74.957 ms 20 9560 6.78 MB/sec execute 119 sec latency 82.570 ms 20 cleanup 120 sec 20 cleanup 121 sec 3 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 27761 50.704 319.163 Close 20934 11.459 149.796 Rename 1141 74.493 222.571 Unlink 5285 15.307 159.297 Qpathinfo 26215 11.720 300.407 Qfileinfo 4543 0.237 27.976 Qfsinfo 4290 0.153 22.121 Sfileinfo 2261 45.458 164.822 Find 9666 2.619 112.255 WriteX 13811 4.792 190.351 ReadX 41825 0.033 16.916 LockX 82 18.394 33.806 UnlockX 82 18.262 61.627 Flush 1856 42.467 1378.710 Throughput 6.77799 MB/sec 20 clients 20 procs max_latency=1378.726 ms stopping dbench on /mnt/lustre/d0.oleg344-client.virtnet at Thu Dec 12 10:06:32 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg344-client.virtnet /mnt/lustre/d0.oleg344-client.virtnet /mnt/lustre/d0.oleg344-client.virtnet removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg344-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:38 (1734015998) min OST has 3560032kB available, using 5340048kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6868] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5214] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg344-clien 5214M 93992 64 58262 50 140028 34 1246 186 Latency 14991us 305ms 143ms 49557us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg344-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 269 18 7704 32 430 14 345 18 939 12 525 14 Latency 19162us 14837us 30189us 16458us 3671us 19319us 1.97,1.97,oleg344-client.virtnet,1,1734006030,5214M,,,,93992,64,58262,50,,,140028,34,1246,186,10,,,,,269,18,7704,32,430,14,345,18,939,12,525,14,,14991us,305ms,,143ms,49557us,19162us,14837us,30189us,16458us,3671us,19319us debug=0x33f0484 PASS bonnie (324s) == sanity-benchmark test iozone: iozone ================== 10:12:02 (1734016322) Waiting for MDT destroys to complete oleg344-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg344-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6868] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:10 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 368718 200797 139095 146644 54529 158959 iozone test complete. Waiting for MDT destroys to complete oleg344-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg344-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg344-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 oleg344-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:16:43 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 75969 78087 79781 80413 83410 73926 iozone test complete. Waiting for MDT destroys to complete oleg344-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg344-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (705s) == sanity-benchmark test fsx: fsx ======================== 10:23:48 (1734017028) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 13254 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 13254 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x1bbf22 truncating to largest ever: 0x2c298d truncating to largest ever: 0x4ce5fa fallocating to largest ever: 0x4d2df4 truncating to largest ever: 0x4f2ca9 truncating to largest ever: 0x4f86ec truncating to largest ever: 0x513351 001000 1734017031.953234 write 0x036b14 thru 0x03faa4 (0x8f91 bytes) fallocating to largest ever: 0x521e8b 003000 1734017037.401131 mapread 0x33cb7c thru 0x343ab3 (0x6f38 bytes) fallocating to largest ever: 0x5286ae 005000 1734017043.028468 mapwrite 0x526b16 thru 0x5286ad (0x1b98 bytes) 006000 1734017046.233458 write 0x30d776 thru 0x313c1b (0x64a6 bytes) 007000 1734017049.416118 mapwrite 0x3712eb thru 0x377669 (0x637f bytes) 008000 1734017052.688601 mapread 0x29550f thru 0x29d097 (0x7b89 bytes) 009000 1734017055.213368 write 0x1e04aa thru 0x1e6b71 (0x66c8 bytes) 010000 1734017058.251941 mapwrite 0x4fdbe3 thru 0x50857c (0xa99a bytes) 012000 1734017063.969640 trunc from 0x350bfb to 0x01a839 (0x3363c1 bytes) 014000 1734017069.682481 trunc from 0x4de7e2 to 0x45c32f (0x824b2 bytes) 016000 1734017075.887375 trunc from 0x39c131 to 0x07a3f7 (0x321d39 bytes) 017000 1734017078.802295 mapwrite 0x36af4c thru 0x379a84 (0xeb39 bytes) 019000 1734017084.816193 write 0x1dd335 thru 0x1ec683 (0xf34f bytes) 022000 1734017093.385196 read 0x3436eb thru 0x34c449 (0x8d5f bytes) 023000 1734017096.456261 fallocate 0x501657 thru 0x50a670 (0x901a bytes) 024000 1734017099.219225 fallocate 0x079043 thru 0x0884a2 (0xf460 bytes) 025000 1734017102.539357 mapread 0x159b4a thru 0x164e1f (0xb2d6 bytes) 026000 1734017105.722326 fallocate 0x518796 thru 0x524942 (0xc1ad bytes) 027000 1734017108.399589 mapwrite 0x372db3 thru 0x378453 (0x56a1 bytes) 028000 1734017111.348726 fallocate 0x42f264 thru 0x43c5fa (0xd397 bytes) 030000 1734017116.856821 mapwrite 0x339c83 thru 0x33cb10 (0x2e8e bytes) 031000 1734017119.972482 fallocate 0x055971 thru 0x0619db (0xc06b bytes) 033000 1734017125.070501 write 0x3d98a2 thru 0x3e8c2d (0xf38c bytes) 034000 1734017127.955332 punch from 0x040cd8 to 0x04ab8f (0x9eb8 bytes) 036000 1734017133.681716 read 0x1c69af thru 0x1d3b11 (0xd163 bytes) 038000 1734017139.262501 trunc from 0x2dbb4d to 0x458ae3 (0x17cf97 bytes) 040000 1734017144.961426 fallocate 0x2462bd thru 0x249f94 (0x3cd8 bytes) 041000 1734017147.921448 read 0x2ebe3e thru 0x2ed382 (0x1545 bytes) 042000 1734017150.660984 mapwrite 0x150751 thru 0x15f51a (0xedca bytes) 043000 1734017153.639937 mapwrite 0x38050b thru 0x387932 (0x7428 bytes) 045000 1734017159.893829 mapwrite 0x043c2a thru 0x050aab (0xce82 bytes) 046000 1734017162.800588 fallocate 0x3b0911 thru 0x3b9a06 (0x90f6 bytes) 052000 1734017179.566265 punch from 0x0e422c to 0x0e814b (0x3f20 bytes) 053000 1734017182.212999 mapread 0x0542bb thru 0x0597a5 (0x54eb bytes) 055000 1734017187.844664 mapwrite 0x3d592e thru 0x3e4dfe (0xf4d1 bytes) 056000 1734017190.369803 fallocate 0x151eb7 thru 0x158a80 (0x6bca bytes) 057000 1734017193.013592 read 0x13f49a thru 0x1437ae (0x4315 bytes) 059000 1734017198.547743 trunc from 0x488692 to 0x237897 (0x250dfa bytes) 060000 1734017201.061827 trunc from 0x2f2b35 to 0x4b9774 (0x1c6c40 bytes) 061000 1734017203.804688 trunc from 0x4a10ad to 0x328a5e (0x17864e bytes) 062000 1734017206.193505 read 0x02289e thru 0x025fd9 (0x373c bytes) 064000 1734017211.599230 fallocate 0x3ffad8 thru 0x3ffcb6 (0x1df bytes) 066000 1734017217.556488 trunc from 0x0d1aad to 0x033f1b (0x9db91 bytes) 067000 1734017220.556518 mapread 0x0f4903 thru 0x104442 (0xfb40 bytes) 068000 1734017223.338457 write 0x1f6e15 thru 0x1feaf0 (0x7cdc bytes) 070000 1734017229.143424 fallocate 0x251b35 thru 0x25ad63 (0x922f bytes) 071000 1734017231.911892 fallocate 0x504e65 thru 0x5081ee (0x338a bytes) 073000 1734017237.862161 punch from 0x117e81 to 0x11aa56 (0x2bd6 bytes) 075000 1734017243.315211 trunc from 0x4c351e to 0x31509a (0x1ae483 bytes) 076000 1734017246.288947 punch from 0x0fd82b to 0x10d21c (0xf9f2 bytes) 077000 1734017249.099565 mapwrite 0x08240e thru 0x08afa0 (0x8b93 bytes) 078000 1734017252.001571 punch from 0x18ede2 to 0x197910 (0x8b2f bytes) 079000 1734017254.900334 read 0x1022fd thru 0x10f4c6 (0xd1ca bytes) 080000 1734017257.773000 fallocate 0x2deb05 thru 0x2e8982 (0x9e7e bytes) 081000 1734017260.591957 fallocate 0x2a0e76 thru 0x2a17ae (0x939 bytes) 084000 1734017269.767994 mapwrite 0x3d9f30 thru 0x3e647b (0xc54c bytes) 088000 1734017281.666290 write 0x0c885e thru 0x0d80ee (0xf891 bytes) 089000 1734017284.595193 mapwrite 0x45bde5 thru 0x45eb24 (0x2d40 bytes) 090000 1734017287.090318 punch from 0x19c4e7 to 0x1ab1ee (0xed08 bytes) 091000 1734017290.263267 mapread 0x11e697 thru 0x11f3d3 (0xd3d bytes) 094000 1734017299.140078 trunc from 0x4bc7ac to 0x1d1efd (0x2ea8ae bytes) 095000 1734017302.199067 write 0x3109b8 thru 0x320104 (0xf74d bytes) 096000 1734017305.023751 mapwrite 0x100339 thru 0x1040e4 (0x3dac bytes) 097000 1734017307.959906 write 0x112dee thru 0x11eb05 (0xbd18 bytes) 098000 1734017311.149685 punch from 0x01f04d to 0x02b326 (0xc2da bytes) 099000 1734017314.100802 mapwrite 0x4bfbf4 thru 0x4c74cd (0x78da bytes) 100000 1734017316.747378 mapread 0x178b30 thru 0x1854bb (0xc98c bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4691117 (4584 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 11: 3674112.. 3674123: 12: 0000: net 1: 12.. 15: 3829188.. 3829191: 4: 0000: unwritten,net 2: 16.. 27: 3674132.. 3674143: 12: 0000: net 3: 60.. 63: 3828252.. 3828255: 4: 0000: net 4: 64.. 67: 3829204.. 3829207: 4: 0000: unwritten,net 5: 360.. 363: 3805108.. 3805111: 4: 0000: unwritten,net 6: 364.. 371: 3829300.. 3829307: 8: 0000: net 7: 372.. 383: 3809536.. 3809547: 12: 0000: unwritten,net 8: 404.. 435: 3829308.. 3829339: 32: 0000: net 9: 556.. 579: 3809488.. 3809511: 24: 0000: unwritten,net 10: 648.. 651: 3804228.. 3804231: 4: 0000: net 11: 1024.. 1047: 3804604.. 3804627: 24: 0000: net 12: 3540.. 3579: 3829340.. 3829379: 40: 0000: last,unwritten,net /mnt/lustre/f0.fsxfile: 12 extents found debug=0x33f0484 PASS fsx (289s) == sanity-benchmark test complete, duration 1490 sec ===== 10:28:37 (1734017317) === sanity-benchmark: start cleanup 10:28:38 (1734017318) === === sanity-benchmark: finish cleanup 10:28:39 (1734017319) ===