-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:16 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:26 (1734015866) === oleg243-client.virtnet: executing check_config_client /mnt/lustre oleg243-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg243-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a461800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a461800.idle_timeout=debug disable quota as required oleg243-server: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:47 (1734015887) === == sanity-benchmark test dbench: dbench ================== 10:04:48 (1734015888) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7596] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg243-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg243-client.virtnet at Thu Dec 12 10:04:51 EST 2024 waiting for dbench pid 10294 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 20 of 20 processes prepared for launch 0 sec releasing clients 3 9 3.11 MB/sec warmup 1 sec latency 876.426 ms 20 81 35.98 MB/sec warmup 2 sec latency 209.390 ms 20 137 39.75 MB/sec warmup 3 sec latency 198.465 ms 20 172 35.19 MB/sec warmup 4 sec latency 211.579 ms 20 213 33.21 MB/sec warmup 5 sec latency 185.434 ms 20 262 32.94 MB/sec warmup 6 sec latency 150.722 ms 20 302 31.69 MB/sec warmup 7 sec latency 197.695 ms 20 345 30.96 MB/sec warmup 8 sec latency 173.265 ms 20 392 30.89 MB/sec warmup 9 sec latency 167.710 ms 20 442 31.02 MB/sec warmup 10 sec latency 149.921 ms 20 494 31.21 MB/sec warmup 11 sec latency 155.771 ms 20 571 32.37 MB/sec warmup 12 sec latency 174.816 ms 20 653 32.36 MB/sec warmup 13 sec latency 160.527 ms 20 701 30.21 MB/sec warmup 14 sec latency 114.601 ms 20 745 28.35 MB/sec warmup 15 sec latency 127.398 ms 20 784 26.68 MB/sec warmup 16 sec latency 161.268 ms 20 825 25.24 MB/sec warmup 17 sec latency 157.445 ms 20 871 23.96 MB/sec warmup 18 sec latency 133.447 ms 20 893 22.77 MB/sec warmup 19 sec latency 585.763 ms 20 912 21.68 MB/sec warmup 20 sec latency 1285.509 ms 20 950 20.71 MB/sec warmup 21 sec latency 140.744 ms 20 1003 20.20 MB/sec warmup 22 sec latency 137.319 ms 20 1070 19.83 MB/sec warmup 23 sec latency 101.805 ms 20 1179 0.87 MB/sec execute 1 sec latency 129.335 ms 20 1225 0.84 MB/sec execute 2 sec latency 116.686 ms 20 1305 7.72 MB/sec execute 3 sec latency 123.625 ms 20 1402 14.42 MB/sec execute 4 sec latency 128.045 ms 20 1453 12.15 MB/sec execute 5 sec latency 127.408 ms 20 1499 10.20 MB/sec execute 6 sec latency 143.318 ms 20 1560 8.94 MB/sec execute 7 sec latency 121.918 ms 20 1610 7.92 MB/sec execute 8 sec latency 123.935 ms 20 1666 7.16 MB/sec execute 9 sec latency 117.117 ms 20 1716 6.52 MB/sec execute 10 sec latency 159.146 ms 20 1782 6.03 MB/sec execute 11 sec latency 132.053 ms 20 1830 5.60 MB/sec execute 12 sec latency 114.348 ms 20 1872 5.20 MB/sec execute 13 sec latency 128.000 ms 20 1958 4.94 MB/sec execute 14 sec latency 105.690 ms 20 2005 4.70 MB/sec execute 15 sec latency 125.842 ms 20 2059 4.53 MB/sec execute 16 sec latency 115.425 ms 20 2125 4.33 MB/sec execute 17 sec latency 119.943 ms 20 2164 4.15 MB/sec execute 18 sec latency 127.816 ms 20 2206 3.97 MB/sec execute 19 sec latency 130.990 ms 20 2289 4.54 MB/sec execute 20 sec latency 188.512 ms 20 2335 4.60 MB/sec execute 21 sec latency 778.681 ms 20 2357 4.46 MB/sec execute 22 sec latency 1542.283 ms 20 2402 4.35 MB/sec execute 23 sec latency 112.736 ms 20 2449 4.33 MB/sec execute 24 sec latency 116.138 ms 20 2522 4.64 MB/sec execute 25 sec latency 238.611 ms 20 2607 4.77 MB/sec execute 26 sec latency 104.731 ms 20 2777 6.56 MB/sec execute 27 sec latency 111.379 ms 20 2906 7.24 MB/sec execute 28 sec latency 133.519 ms 20 2985 7.25 MB/sec execute 29 sec latency 121.093 ms 20 3165 7.40 MB/sec execute 30 sec latency 103.691 ms 20 3293 7.93 MB/sec execute 31 sec latency 105.498 ms 20 3380 7.79 MB/sec execute 32 sec latency 119.475 ms 20 3529 9.24 MB/sec execute 33 sec latency 109.656 ms 20 3615 9.15 MB/sec execute 34 sec latency 78.690 ms 20 3672 8.97 MB/sec execute 35 sec latency 119.723 ms 20 3720 8.84 MB/sec execute 36 sec latency 123.919 ms 20 3785 9.05 MB/sec execute 37 sec latency 138.270 ms 20 3826 8.81 MB/sec execute 38 sec latency 126.758 ms 20 3870 8.59 MB/sec execute 39 sec latency 92.435 ms 20 3928 8.52 MB/sec execute 40 sec latency 104.942 ms 20 3967 8.32 MB/sec execute 41 sec latency 144.987 ms 20 4008 8.12 MB/sec execute 42 sec latency 125.820 ms 20 4058 7.93 MB/sec execute 43 sec latency 100.674 ms 20 4128 7.76 MB/sec execute 44 sec latency 102.178 ms 20 4207 7.62 MB/sec execute 45 sec latency 174.652 ms 20 4242 7.50 MB/sec execute 46 sec latency 209.330 ms 20 4289 7.39 MB/sec execute 47 sec latency 138.946 ms 20 4352 7.29 MB/sec execute 48 sec latency 93.461 ms 20 4416 7.21 MB/sec execute 49 sec latency 100.815 ms 20 4468 7.12 MB/sec execute 50 sec latency 299.054 ms 20 4525 7.02 MB/sec execute 51 sec latency 119.032 ms 20 4597 7.17 MB/sec execute 52 sec latency 89.173 ms 20 4680 7.20 MB/sec execute 53 sec latency 84.553 ms 20 4748 7.09 MB/sec execute 54 sec latency 89.885 ms 20 4816 6.98 MB/sec execute 55 sec latency 96.844 ms 20 4957 7.81 MB/sec execute 56 sec latency 86.066 ms 20 5020 7.76 MB/sec execute 57 sec latency 93.911 ms 20 5072 7.64 MB/sec execute 58 sec latency 116.139 ms 20 5127 7.53 MB/sec execute 59 sec latency 100.394 ms 20 5168 7.42 MB/sec execute 60 sec latency 111.726 ms 20 5235 7.32 MB/sec execute 61 sec latency 97.589 ms 20 5286 7.21 MB/sec execute 62 sec latency 89.755 ms 20 5343 7.11 MB/sec execute 63 sec latency 89.957 ms 20 5392 7.01 MB/sec execute 64 sec latency 80.521 ms 20 5463 6.93 MB/sec execute 65 sec latency 89.142 ms 20 5546 6.84 MB/sec execute 66 sec latency 94.501 ms 20 5595 6.77 MB/sec execute 67 sec latency 92.805 ms 20 5691 6.70 MB/sec execute 68 sec latency 77.587 ms 20 5747 6.62 MB/sec execute 69 sec latency 80.264 ms 20 5858 6.75 MB/sec execute 70 sec latency 85.243 ms 20 5934 6.77 MB/sec execute 71 sec latency 93.119 ms 20 5983 6.72 MB/sec execute 72 sec latency 93.473 ms 20 6038 6.76 MB/sec execute 73 sec latency 127.059 ms 20 6137 6.77 MB/sec execute 74 sec latency 114.000 ms 20 6253 7.17 MB/sec execute 75 sec latency 134.290 ms 20 6435 7.56 MB/sec execute 76 sec latency 104.858 ms 20 6526 7.69 MB/sec execute 77 sec latency 119.583 ms 20 6641 7.67 MB/sec execute 78 sec latency 120.823 ms 20 6815 7.83 MB/sec execute 79 sec latency 118.132 ms 20 6924 7.92 MB/sec execute 80 sec latency 167.529 ms 20 7072 8.45 MB/sec execute 81 sec latency 98.101 ms 20 7157 8.44 MB/sec execute 82 sec latency 73.486 ms 20 7226 8.39 MB/sec execute 83 sec latency 83.819 ms 20 7301 8.46 MB/sec execute 84 sec latency 125.975 ms 20 7356 8.43 MB/sec execute 85 sec latency 141.585 ms 20 7421 8.35 MB/sec execute 86 sec latency 63.190 ms 20 7488 8.31 MB/sec execute 87 sec latency 89.083 ms 20 7550 8.22 MB/sec execute 88 sec latency 68.262 ms 20 7608 8.13 MB/sec execute 89 sec latency 97.600 ms 20 7681 8.04 MB/sec execute 90 sec latency 136.226 ms 20 7776 7.99 MB/sec execute 91 sec latency 112.175 ms 20 7843 7.93 MB/sec execute 92 sec latency 107.994 ms 20 7919 7.89 MB/sec execute 93 sec latency 79.193 ms 20 8000 7.85 MB/sec execute 94 sec latency 81.986 ms 20 8065 7.79 MB/sec execute 95 sec latency 79.549 ms 20 8152 7.88 MB/sec execute 96 sec latency 86.293 ms 20 8249 7.87 MB/sec execute 97 sec latency 78.611 ms 20 8327 7.81 MB/sec execute 98 sec latency 90.109 ms 20 8448 8.10 MB/sec execute 99 sec latency 84.687 ms 20 8549 8.24 MB/sec execute 100 sec latency 78.705 ms 20 8611 8.17 MB/sec execute 101 sec latency 87.740 ms 20 8677 8.10 MB/sec execute 102 sec latency 75.776 ms 20 8750 8.04 MB/sec execute 103 sec latency 67.006 ms 20 8818 7.97 MB/sec execute 104 sec latency 117.601 ms 20 8894 7.91 MB/sec execute 105 sec latency 80.067 ms 20 8954 7.84 MB/sec execute 106 sec latency 77.694 ms 20 9069 7.78 MB/sec execute 107 sec latency 65.932 ms 20 9151 7.74 MB/sec execute 108 sec latency 85.928 ms 20 9255 7.69 MB/sec execute 109 sec latency 59.848 ms 20 9347 7.68 MB/sec execute 110 sec latency 92.307 ms 20 9465 7.77 MB/sec execute 111 sec latency 77.613 ms 20 9538 7.74 MB/sec execute 112 sec latency 72.559 ms 20 9655 7.80 MB/sec execute 113 sec latency 80.942 ms 20 9833 8.13 MB/sec execute 114 sec latency 79.842 ms 20 10024 8.41 MB/sec execute 115 sec latency 92.442 ms 20 10210 8.47 MB/sec execute 116 sec latency 75.988 ms 20 10426 8.62 MB/sec execute 117 sec latency 75.332 ms 20 10606 8.98 MB/sec execute 118 sec latency 70.033 ms 20 10717 9.04 MB/sec execute 119 sec latency 63.394 ms 20 cleanup 120 sec 20 cleanup 121 sec 2 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 32191 41.002 200.050 Close 24268 10.567 71.710 Rename 1427 60.446 159.133 Unlink 5902 12.806 78.044 Qpathinfo 30423 10.488 144.524 Qfileinfo 5548 0.226 28.453 Qfsinfo 5369 0.158 26.542 Sfileinfo 2562 42.768 209.322 Find 11796 2.927 108.941 WriteX 16328 5.536 144.829 ReadX 55021 0.037 11.941 LockX 120 11.481 31.404 UnlockX 120 11.230 37.438 Flush 2100 48.396 1542.267 Throughput 9.03772 MB/sec 20 clients 20 procs max_latency=1542.283 ms stopping dbench on /mnt/lustre/d0.oleg243-client.virtnet at Thu Dec 12 10:07:17 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg243-client.virtnet /mnt/lustre/d0.oleg243-client.virtnet /mnt/lustre/d0.oleg243-client.virtnet removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg243-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:24 (1734016044) min OST has 3541644kB available, using 5312466kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7596] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5187] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg243-clien 5187M 79843 61 55185 49 183217 40 2265 228 Latency 26391us 124ms 143ms 20989us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg243-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 288 18 7162 31 392 13 341 18 894 12 539 13 Latency 20009us 17108us 26921us 18383us 12904us 66925us 1.97,1.97,oleg243-client.virtnet,1,1734004901,5187M,,,,79843,61,55185,49,,,183217,40,2265,228,10,,,,,288,18,7162,31,392,13,341,18,894,12,539,13,,26391us,124ms,,143ms,20989us,20009us,17108us,26921us,18383us,12904us,66925us debug=0x33f0484 PASS bonnie (326s) == sanity-benchmark test iozone: iozone ================== 10:12:50 (1734016370) Waiting for MDT destroys to complete oleg243-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg243-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7596] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:59 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 142746 140325 111814 127507 63127 75181 iozone test complete. Waiting for MDT destroys to complete oleg243-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg243-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg243-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 oleg243-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:49 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 81818 75813 89534 88063 89528 77783 iozone test complete. Waiting for MDT destroys to complete oleg243-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg243-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (760s) == sanity-benchmark test fsx: fsx ======================== 10:25:30 (1734017130) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 19208 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 19208 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0xc3da4 fallocating to largest ever: 0x164ec3 truncating to largest ever: 0x1fc659 truncating to largest ever: 0x49a356 truncating to largest ever: 0x4a5aef truncating to largest ever: 0x4bb54f fallocating to largest ever: 0x4f6aa1 fallocating to largest ever: 0x51acfd truncating to largest ever: 0x526f70 fallocating to largest ever: 0x5285e2 001000 1734017133.775639 write 0x1c0792 thru 0x1c60f4 (0x5963 bytes) 002000 1734017136.618783 read 0x2155e5 thru 0x21fff8 (0xaa14 bytes) 003000 1734017139.387623 fallocate 0x0c7c50 thru 0x0d2a8b (0xae3c bytes) skipping zero size read 004000 1734017142.307637 mapwrite 0x10cf2e thru 0x10f5de (0x26b1 bytes) 005000 1734017145.161616 punch from 0x05eac0 to 0x06043d (0x197e bytes) 006000 1734017148.364761 mapread 0x169b9f thru 0x17792e (0xdd90 bytes) 007000 1734017151.243633 fallocate 0x3e0812 thru 0x3e7342 (0x6b31 bytes) 008000 1734017154.237985 fallocate 0x4c8b21 thru 0x4ca46a (0x194a bytes) 012000 1734017166.380095 write 0x35ddb2 thru 0x3606eb (0x293a bytes) 013000 1734017169.637267 mapread 0x4c6ddb thru 0x4c8b0e (0x1d34 bytes) 014000 1734017172.781691 fallocate 0x0bf6a3 thru 0x0c6c4e (0x75ac bytes) 016000 1734017178.622643 read 0x176c57 thru 0x17bd91 (0x513b bytes) 017000 1734017181.942971 trunc from 0x1c435f to 0x01130e (0x1b3050 bytes) 018000 1734017185.183553 punch from 0x28c933 to 0x2905f3 (0x3cc1 bytes) 019000 1734017188.741594 mapwrite 0x46b417 thru 0x470636 (0x5220 bytes) 020000 1734017192.037183 write 0x1f9e44 thru 0x207ea7 (0xe064 bytes) 021000 1734017195.221860 punch from 0x0e73c4 to 0x0f1d2b (0xa968 bytes) 022000 1734017197.876362 mapwrite 0x0e60b4 thru 0x0ed5da (0x7527 bytes) 024000 1734017203.102668 read 0x1ca3f1 thru 0x1cae33 (0xa43 bytes) skipping zero length fallocate 027000 1734017211.566703 mapwrite 0x0a5604 thru 0x0aef80 (0x997d bytes) 028000 1734017214.188967 write 0x29f96e thru 0x2aee8a (0xf51d bytes) 030000 1734017219.597613 trunc from 0x3b7611 to 0x1ffd6a (0x1b78a6 bytes) 031000 1734017222.483608 trunc from 0x43923f to 0x3d80ea (0x61154 bytes) 033000 1734017227.979120 fallocate 0x36cd4c thru 0x37712a (0xa3df bytes) 035000 1734017233.533560 punch from 0x476217 to 0x47cd0d (0x6af7 bytes) 036000 1734017236.656657 mapread 0x35105c thru 0x359f33 (0x8ed8 bytes) 038000 1734017242.558541 mapwrite 0x0a63f8 thru 0x0a8f0b (0x2b14 bytes) 039000 1734017245.727833 write 0x4d0d47 thru 0x4e019c (0xf456 bytes) 041000 1734017252.092954 mapwrite 0x3a8eaf thru 0x3ad39d (0x44ef bytes) 042000 1734017255.480582 read 0x01c5fc thru 0x0210fe (0x4b03 bytes) 043000 1734017258.384095 write 0x408e2a thru 0x40d767 (0x493e bytes) 044000 1734017261.391907 mapwrite 0x337c48 thru 0x33ad34 (0x30ed bytes) 045000 1734017264.293929 mapwrite 0x2228e0 thru 0x22351a (0xc3b bytes) 047000 1734017269.836596 write 0x06a9e5 thru 0x07550c (0xab28 bytes) 048000 1734017272.181078 mapread 0x20ee8f thru 0x21a5cb (0xb73d bytes) 049000 1734017274.895089 punch from 0x220c94 to 0x221dad (0x111a bytes) 050000 1734017277.361783 mapread 0x074242 thru 0x07906f (0x4e2e bytes) 051000 1734017279.915513 punch from 0x166d88 to 0x170ff6 (0xa26f bytes) 052000 1734017282.499753 read 0x1d9c70 thru 0x1e7af8 (0xde89 bytes) 055000 1734017290.426183 fallocate 0x11040e thru 0x1138d7 (0x34ca bytes) 056000 1734017292.927149 trunc from 0x3ed099 to 0x4f029a (0x103202 bytes) 057000 1734017295.548257 trunc from 0x4d46b7 to 0x4dadca (0x6714 bytes) 058000 1734017298.595198 punch from 0x39a315 to 0x3a7336 (0xd022 bytes) 059000 1734017301.013585 write 0x1669bc thru 0x1724c8 (0xbb0d bytes) 060000 1734017303.912894 trunc from 0x5285e2 to 0x397dbc (0x190825 bytes) 061000 1734017306.656900 trunc from 0x480c5f to 0x49f7f5 (0x1eb97 bytes) 062000 1734017309.232203 punch from 0x2b5286 to 0x2be57d (0x92f8 bytes) 063000 1734017311.720351 mapwrite 0x227e7e thru 0x233e2e (0xbfb1 bytes) 065000 1734017316.911083 write 0x20c4da thru 0x214a32 (0x8559 bytes) 066000 1734017319.439430 read 0x0c8558 thru 0x0d4ce3 (0xc78c bytes) 067000 1734017321.744526 write 0x292c7d thru 0x292ccb (0x4f bytes) 068000 1734017324.375139 read 0x11dfb9 thru 0x128ede (0xaf26 bytes) 069000 1734017327.127128 trunc from 0x09c435 to 0x334abd (0x298689 bytes) 072000 1734017334.752622 mapread 0x182625 thru 0x186385 (0x3d61 bytes) 074000 1734017340.129267 trunc from 0x2fba0c to 0x2eaa8e (0x10f7d bytes) 076000 1734017345.428355 trunc from 0x1424a8 to 0x329e15 (0x1e796e bytes) 077000 1734017347.727250 mapread 0x32dacb thru 0x339153 (0xb689 bytes) 078000 1734017350.197699 mapwrite 0x3b5d8c thru 0x3b8f06 (0x317b bytes) 079000 1734017353.249523 mapread 0x0fda66 thru 0x10bf45 (0xe4e0 bytes) 080000 1734017355.707447 read 0x046e06 thru 0x04ac4f (0x3e4a bytes) 081000 1734017358.425880 write 0x41caaf thru 0x424204 (0x7756 bytes) 082000 1734017361.105966 write 0x0fe47a thru 0x1076a8 (0x922f bytes) 086000 1734017371.881464 mapread 0x018667 thru 0x027808 (0xf1a2 bytes) 088000 1734017377.401413 read 0x085f7a thru 0x08610b (0x192 bytes) 090000 1734017382.582285 trunc from 0x4d62c9 to 0x011805 (0x4c4ac3 bytes) 091000 1734017385.883237 fallocate 0x0a3337 thru 0x0b10f1 (0xddbb bytes) 092000 1734017388.904001 trunc from 0x16b07b to 0x45725b (0x2ec1e1 bytes) 097000 1734017403.344334 trunc from 0x438c09 to 0x1e93f2 (0x24f816 bytes) 098000 1734017405.904584 mapread 0x12bbab thru 0x138964 (0xcdba bytes) 100000 1734017410.892726 mapread 0x20220f thru 0x206c3a (0x4a2c bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4568981 (4464 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 1839104.. 1839107: 4: 0000: net 1: 48.. 103: 1842336.. 1842391: 56: 0000: unwritten,net 2: 112.. 123: 1971340.. 1971351: 12: 0000: unwritten,net 3: 124.. 135: 1845400.. 1845411: 12: 0000: net 4: 136.. 139: 1971352.. 1971355: 4: 0000: unwritten,net 5: 176.. 187: 1847088.. 1847099: 12: 0000: net 6: 188.. 199: 1846768.. 1846779: 12: 0000: net 7: 200.. 211: 1850300.. 1850311: 12: 0000: net 8: 324.. 343: 1967880.. 1967899: 20: 0000: net 9: 572.. 615: 1967184.. 1967227: 44: 0000: net 10: 740.. 763: 1967476.. 1967499: 24: 0000: net 11: 964.. 1031: 1967700.. 1967767: 68: 0000: net 12: 1268.. 1279: 1968760.. 1968771: 12: 0000: unwritten,net 13: 1788.. 1819: 1969280.. 1969311: 32: 0000: net 14: 1820.. 1847: 1967104.. 1967131: 28: 0000: net 15: 1848.. 1883: 1967132.. 1967167: 36: 0000: unwritten,net 16: 2608.. 2627: 1847908.. 1847927: 20: 0000: unwritten,net 17: 2628.. 2679: 1971356.. 1971407: 52: 0000: last,net /mnt/lustre/f0.fsxfile: 15 extents found debug=0x33f0484 PASS fsx (281s) == sanity-benchmark test complete, duration 1555 sec ===== 10:30:12 (1734017412) === sanity-benchmark: start cleanup 10:30:12 (1734017412) === === sanity-benchmark: finish cleanup 10:30:13 (1734017413) ===