-----============= acceptance-small: sanity-benchmark ============----- Fri Aug 9 21:17:39 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 21:17:44 (1723252664) === oleg145-client.virtnet: executing check_config_client /mnt/lustre oleg145-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg145-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b7c19800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b7c19800.idle_timeout=debug disable quota as required oleg145-server: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 21:17:51 (1723252671) === == sanity-benchmark test dbench: dbench ================== 21:17:51 (1723252671) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7562] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg145-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg145-client.virtnet at Fri Aug 9 21:17:52 EDT 2024 waiting for dbench pid 9779 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 250 190.17 MB/sec warmup 1 sec latency 50.507 ms 20 552 190.29 MB/sec warmup 2 sec latency 33.386 ms 20 877 144.20 MB/sec warmup 3 sec latency 32.748 ms 20 1171 115.02 MB/sec warmup 4 sec latency 29.658 ms 20 1511 104.22 MB/sec warmup 5 sec latency 36.185 ms 20 1796 87.67 MB/sec warmup 6 sec latency 26.680 ms 20 2120 76.17 MB/sec warmup 7 sec latency 21.697 ms 20 2398 70.00 MB/sec warmup 8 sec latency 246.749 ms 20 2888 73.27 MB/sec warmup 9 sec latency 25.317 ms 20 3492 74.92 MB/sec warmup 10 sec latency 33.006 ms 20 3837 72.27 MB/sec warmup 11 sec latency 20.889 ms 20 4105 66.79 MB/sec warmup 12 sec latency 22.703 ms 20 4350 62.33 MB/sec warmup 13 sec latency 58.127 ms 20 4655 59.96 MB/sec warmup 14 sec latency 22.593 ms 20 5025 60.19 MB/sec warmup 15 sec latency 38.305 ms 20 5283 56.70 MB/sec warmup 16 sec latency 26.110 ms 20 5581 53.69 MB/sec warmup 17 sec latency 23.671 ms 20 5930 52.22 MB/sec warmup 18 sec latency 23.028 ms 20 6336 53.52 MB/sec warmup 19 sec latency 37.576 ms 20 6966 55.56 MB/sec warmup 20 sec latency 28.298 ms 20 7339 56.02 MB/sec warmup 21 sec latency 21.817 ms 20 7571 53.80 MB/sec warmup 22 sec latency 25.424 ms 20 7802 51.67 MB/sec warmup 23 sec latency 45.367 ms 20 8341 28.23 MB/sec execute 1 sec latency 32.067 ms 20 8672 43.12 MB/sec execute 2 sec latency 30.665 ms 20 8918 30.15 MB/sec execute 3 sec latency 25.019 ms 20 9259 24.74 MB/sec execute 4 sec latency 24.588 ms 20 9571 26.57 MB/sec execute 5 sec latency 27.243 ms 20 10116 39.56 MB/sec execute 6 sec latency 31.111 ms 20 10704 47.82 MB/sec execute 7 sec latency 33.299 ms 20 10996 45.30 MB/sec execute 8 sec latency 20.900 ms 20 11184 40.63 MB/sec execute 9 sec latency 64.378 ms 20 11456 37.49 MB/sec execute 10 sec latency 49.140 ms 20 11742 36.51 MB/sec execute 11 sec latency 37.541 ms 20 12103 38.69 MB/sec execute 12 sec latency 33.200 ms 20 12368 36.24 MB/sec execute 13 sec latency 24.458 ms 20 12650 34.03 MB/sec execute 14 sec latency 27.161 ms 20 12990 33.34 MB/sec execute 15 sec latency 24.405 ms 20 13389 35.50 MB/sec execute 16 sec latency 27.556 ms 20 14040 39.50 MB/sec execute 17 sec latency 32.788 ms 20 14417 40.87 MB/sec execute 18 sec latency 22.011 ms 20 14662 39.35 MB/sec execute 19 sec latency 23.057 ms 20 14920 37.68 MB/sec execute 20 sec latency 51.178 ms 20 15180 36.67 MB/sec execute 21 sec latency 30.878 ms 20 15524 37.17 MB/sec execute 22 sec latency 28.139 ms 20 15829 37.05 MB/sec execute 23 sec latency 28.545 ms 20 16095 35.69 MB/sec execute 24 sec latency 28.680 ms 20 16467 34.99 MB/sec execute 25 sec latency 19.526 ms 20 16879 36.07 MB/sec execute 26 sec latency 23.216 ms 20 17577 39.02 MB/sec execute 27 sec latency 22.305 ms 20 17987 40.05 MB/sec execute 28 sec latency 22.594 ms 20 18241 38.97 MB/sec execute 29 sec latency 24.096 ms 20 18519 37.94 MB/sec execute 30 sec latency 61.156 ms 20 18824 37.55 MB/sec execute 31 sec latency 25.405 ms 20 19221 38.41 MB/sec execute 32 sec latency 27.333 ms 20 19517 37.48 MB/sec execute 33 sec latency 26.388 ms 20 19876 36.61 MB/sec execute 34 sec latency 21.686 ms 20 20263 36.66 MB/sec execute 35 sec latency 19.178 ms 20 20916 38.81 MB/sec execute 36 sec latency 31.154 ms 20 21488 40.36 MB/sec execute 37 sec latency 24.060 ms 20 21783 39.82 MB/sec execute 38 sec latency 22.629 ms 20 22053 38.97 MB/sec execute 39 sec latency 47.853 ms 20 22327 38.46 MB/sec execute 40 sec latency 29.366 ms 20 22707 38.91 MB/sec execute 41 sec latency 25.307 ms 20 23035 38.55 MB/sec execute 42 sec latency 21.649 ms 20 23375 37.81 MB/sec execute 43 sec latency 20.873 ms 20 23684 37.52 MB/sec execute 44 sec latency 34.991 ms 20 24040 37.96 MB/sec execute 45 sec latency 37.930 ms 20 24534 38.92 MB/sec execute 46 sec latency 34.953 ms 20 24886 39.54 MB/sec execute 47 sec latency 42.543 ms 20 25051 39.11 MB/sec execute 48 sec latency 49.495 ms 20 25156 38.58 MB/sec execute 49 sec latency 76.202 ms 20 25217 37.86 MB/sec execute 50 sec latency 92.165 ms 20 25289 37.17 MB/sec execute 51 sec latency 76.746 ms 20 25336 36.46 MB/sec execute 52 sec latency 184.922 ms 20 25404 35.78 MB/sec execute 53 sec latency 135.712 ms 20 25489 35.15 MB/sec execute 54 sec latency 97.953 ms 20 25586 34.57 MB/sec execute 55 sec latency 91.394 ms 20 25678 34.03 MB/sec execute 56 sec latency 89.383 ms 20 25776 33.53 MB/sec execute 57 sec latency 64.110 ms 20 25866 33.08 MB/sec execute 58 sec latency 69.137 ms 20 25954 32.74 MB/sec execute 59 sec latency 83.335 ms 20 26033 32.26 MB/sec execute 60 sec latency 79.735 ms 20 26130 32.01 MB/sec execute 61 sec latency 72.797 ms 20 26218 31.71 MB/sec execute 62 sec latency 74.983 ms 20 26324 31.61 MB/sec execute 63 sec latency 82.488 ms 20 26395 31.18 MB/sec execute 64 sec latency 92.793 ms 20 26477 30.76 MB/sec execute 65 sec latency 83.397 ms 20 26549 30.32 MB/sec execute 66 sec latency 76.083 ms 20 26630 29.88 MB/sec execute 67 sec latency 91.011 ms 20 26748 29.47 MB/sec execute 68 sec latency 54.960 ms 20 26940 29.11 MB/sec execute 69 sec latency 64.071 ms 20 27174 28.95 MB/sec execute 70 sec latency 32.932 ms 20 27473 29.14 MB/sec execute 71 sec latency 33.669 ms 20 27841 29.72 MB/sec execute 72 sec latency 42.786 ms 20 28199 30.04 MB/sec execute 73 sec latency 47.016 ms 20 28452 30.29 MB/sec execute 74 sec latency 72.746 ms 20 28637 30.24 MB/sec execute 75 sec latency 36.239 ms 20 28796 29.96 MB/sec execute 76 sec latency 35.270 ms 20 28932 29.59 MB/sec execute 77 sec latency 53.131 ms 20 29092 29.26 MB/sec execute 78 sec latency 50.589 ms 20 29232 28.97 MB/sec execute 79 sec latency 52.193 ms 20 29391 28.75 MB/sec execute 80 sec latency 40.042 ms 20 29577 28.65 MB/sec execute 81 sec latency 48.656 ms 20 29757 28.63 MB/sec execute 82 sec latency 46.149 ms 20 29944 28.65 MB/sec execute 83 sec latency 43.044 ms 20 30130 28.38 MB/sec execute 84 sec latency 32.217 ms 20 30307 28.08 MB/sec execute 85 sec latency 34.024 ms 20 30503 27.81 MB/sec execute 86 sec latency 37.910 ms 20 30700 27.65 MB/sec execute 87 sec latency 44.151 ms 20 30902 27.64 MB/sec execute 88 sec latency 35.629 ms 20 31222 28.04 MB/sec execute 89 sec latency 48.904 ms 20 31593 28.34 MB/sec execute 90 sec latency 41.505 ms 20 31980 28.82 MB/sec execute 91 sec latency 35.234 ms 20 32189 28.81 MB/sec execute 92 sec latency 36.382 ms 20 32335 28.58 MB/sec execute 93 sec latency 35.140 ms 20 32474 28.30 MB/sec execute 94 sec latency 48.043 ms 20 32638 28.04 MB/sec execute 95 sec latency 54.318 ms 20 32804 27.83 MB/sec execute 96 sec latency 39.424 ms 20 32972 27.67 MB/sec execute 97 sec latency 43.197 ms 20 33158 27.65 MB/sec execute 98 sec latency 41.825 ms 20 33356 27.73 MB/sec execute 99 sec latency 46.792 ms 20 33551 27.64 MB/sec execute 100 sec latency 40.750 ms 20 33723 27.39 MB/sec execute 101 sec latency 35.285 ms 20 33903 27.16 MB/sec execute 102 sec latency 31.295 ms 20 34107 26.97 MB/sec execute 103 sec latency 38.449 ms 20 34365 26.95 MB/sec execute 104 sec latency 85.253 ms 20 34762 27.40 MB/sec execute 105 sec latency 32.047 ms 20 35271 27.88 MB/sec execute 106 sec latency 38.753 ms 20 35609 28.19 MB/sec execute 107 sec latency 28.630 ms 20 35775 28.10 MB/sec execute 108 sec latency 37.399 ms 20 35896 27.90 MB/sec execute 109 sec latency 44.403 ms 20 36034 27.66 MB/sec execute 110 sec latency 45.090 ms 20 36188 27.45 MB/sec execute 111 sec latency 52.778 ms 20 36341 27.26 MB/sec execute 112 sec latency 46.658 ms 20 36544 27.16 MB/sec execute 113 sec latency 35.527 ms 20 36783 27.20 MB/sec execute 114 sec latency 46.222 ms 20 37034 27.32 MB/sec execute 115 sec latency 29.087 ms 20 37275 27.15 MB/sec execute 116 sec latency 30.603 ms 20 37547 26.96 MB/sec execute 117 sec latency 25.677 ms 20 37827 26.91 MB/sec execute 118 sec latency 31.347 ms 20 38189 27.13 MB/sec execute 119 sec latency 27.720 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 105361 13.273 184.914 Close 78047 2.911 46.670 Rename 4526 18.386 92.782 Unlink 20650 4.328 55.188 Qpathinfo 96284 3.069 102.442 Qfileinfo 17074 0.086 14.719 Qfsinfo 17241 0.042 14.376 Sfileinfo 8720 13.280 87.836 Find 36944 0.570 99.014 WriteX 52552 1.411 60.026 ReadX 167424 0.014 3.823 LockX 358 2.662 9.409 UnlockX 358 2.720 10.289 Flush 7250 11.621 89.741 Throughput 27.1333 MB/sec 20 clients 20 procs max_latency=184.922 ms stopping dbench on /mnt/lustre/d0.oleg145-client.virtnet at Fri Aug 9 21:20:17 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg145-client.virtnet /mnt/lustre/d0.oleg145-client.virtnet /mnt/lustre/d0.oleg145-client.virtnet removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg145-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 21:20:20 (1723252820) min OST has 3362844kB available, using 5044266kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7562] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4926] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg145-clien 4926M 144983 97 138146 91 380072 68 4756 250 Latency 7902us 62110us 68763us 60370us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg145-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 479 17 8277 34 640 13 438 18 1062 13 549 13 Latency 20697us 13514us 21847us 16602us 8046us 18619us 1.97,1.97,oleg145-client.virtnet,1,1723263550,4926M,,,,144983,97,138146,91,,,380072,68,4756,250,10,,,,,479,17,8277,34,640,13,438,18,1062,13,549,13,,7902us,62110us,,68763us,60370us,20697us,13514us,21847us,16602us,8046us,18619us debug=0x33f0484 PASS bonnie (183s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 21:23:23 (1723253003) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7305 -P /tmp -l 5401290 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7305 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x3936aa truncating to largest ever: 0x3db5da fallocating to largest ever: 0x49254c truncating to largest ever: 0x4d2d28 fallocating to largest ever: 0x4e2a55 truncating to largest ever: 0x513ead truncating to largest ever: 0x525de5 fallocating to largest ever: 0x526aca 005000 1723253017.719195 write 0x2a53de thru 0x2a6f64 (0x1b87 bytes) 006000 1723253020.171307 punch from 0x4a13db to 0x4a4a74 (0x369a bytes) 007000 1723253022.276079 mapread 0x0c9fcf thru 0x0d30a2 (0x90d4 bytes) 008000 1723253024.492817 write 0x4d8b44 thru 0x4dab41 (0x1ffe bytes) 009000 1723253026.724497 fallocate 0x258a59 thru 0x261f13 (0x94bb bytes) 010000 1723253029.157102 read 0x2d3ab2 thru 0x2e1189 (0xd6d8 bytes) 011000 1723253031.939203 mapwrite 0x431737 thru 0x43f8dd (0xe1a7 bytes) 012000 1723253034.416942 punch from 0x326f80 to 0x327b99 (0xc1a bytes) 015000 1723253042.131056 fallocate 0x310807 thru 0x31ba9d (0xb297 bytes) 016000 1723253044.861852 punch from 0x46713e to 0x4694f9 (0x23bc bytes) 019000 1723253052.410956 write 0x2c4b2a thru 0x2c998f (0x4e66 bytes) 020000 1723253055.755851 mapread 0x002841 thru 0x00f709 (0xcec9 bytes) 022000 1723253061.367583 write 0x1f5f8a thru 0x1ff1c4 (0x923b bytes) 023000 1723253063.334218 fallocate 0x211578 thru 0x2170da (0x5b63 bytes) 024000 1723253065.282496 mapread 0x423600 thru 0x4312d2 (0xdcd3 bytes) 025000 1723253067.408502 read 0x0ed11c thru 0x0fce4d (0xfd32 bytes) 028000 1723253074.238298 mapread 0x09be3b thru 0x0a5468 (0x962e bytes) 030000 1723253078.773954 mapwrite 0x16158b thru 0x1629a4 (0x141a bytes) 032000 1723253083.752830 punch from 0x1c2a83 to 0x1cdef5 (0xb473 bytes) 038000 1723253099.905143 punch from 0x2fec0a to 0x305d3e (0x7135 bytes) 041000 1723253107.038530 read 0x4309db thru 0x435d15 (0x533b bytes) 044000 1723253114.632836 read 0x1b46ae thru 0x1b6e0a (0x275d bytes) 045000 1723253117.383672 mapwrite 0x153556 thru 0x163451 (0xfefc bytes) 046000 1723253119.837490 read 0x2abe88 thru 0x2b5c8c (0x9e05 bytes) 047000 1723253121.886682 fallocate 0x2a5102 thru 0x2b3b31 (0xea30 bytes) 048000 1723253124.335807 write 0x019bed thru 0x024a3a (0xae4e bytes) 051000 1723253132.045643 mapwrite 0x3d3fa9 thru 0x3da26f (0x62c7 bytes) 053000 1723253137.534883 read 0x0aea6d thru 0x0b3224 (0x47b8 bytes) 054000 1723253140.574860 mapread 0x05221b thru 0x0574f2 (0x52d8 bytes) 056000 1723253146.350133 read 0x3c6fc6 thru 0x3cc236 (0x5271 bytes) 058000 1723253152.726999 punch from 0x02b0e4 to 0x034502 (0x941f bytes) 060000 1723253158.514225 punch from 0x180082 to 0x18bf50 (0xbecf bytes) 063000 1723253167.938332 fallocate 0x14c397 thru 0x14d41e (0x1088 bytes) 064000 1723253170.691841 write 0x3df6c6 thru 0x3eb89a (0xc1d5 bytes) 065000 1723253173.313192 trunc from 0x35ace0 to 0x4e05f6 (0x185917 bytes) 066000 1723253176.147970 mapread 0x0b0628 thru 0x0b7d94 (0x776d bytes) 067000 1723253178.625387 read 0x1341a6 thru 0x13a185 (0x5fe0 bytes) 068000 1723253181.892872 write 0x12166e thru 0x125f99 (0x492c bytes) 070000 1723253187.999409 read 0x302924 thru 0x311422 (0xeaff bytes) 071000 1723253190.880530 mapwrite 0x4e70cc thru 0x4ed0b6 (0x5feb bytes) 074000 1723253199.768573 mapwrite 0x14a96a thru 0x15188f (0x6f26 bytes) 075000 1723253202.490490 mapwrite 0x1ab7e7 thru 0x1b4f08 (0x9722 bytes) 076000 1723253205.319729 trunc from 0x5132b6 to 0x114a16 (0x3fe89f bytes) 077000 1723253208.494662 read 0x2abfc5 thru 0x2ae420 (0x245c bytes) 079000 1723253214.323818 punch from 0x208274 to 0x2121ac (0x9f39 bytes) 080000 1723253216.828544 read 0x1427cf thru 0x14efe3 (0xc815 bytes) 081000 1723253219.225113 trunc from 0x4bd3b2 to 0x03a9a5 (0x482a0c bytes) 082000 1723253222.427286 punch from 0x04fbd1 to 0x0564ad (0x68dd bytes) 083000 1723253225.632763 fallocate 0x267d54 thru 0x26a0d7 (0x2384 bytes) 085000 1723253231.605826 write 0x1a9936 thru 0x1ad87e (0x3f49 bytes) 086000 1723253234.812118 mapread 0x0f1278 thru 0x0fdff3 (0xcd7c bytes) 087000 1723253237.660349 mapread 0x0f522a thru 0x101d51 (0xcb28 bytes) 088000 1723253240.306992 punch from 0x360617 to 0x36e907 (0xe2f1 bytes) 089000 1723253243.036502 mapwrite 0x0ad337 thru 0x0b30be (0x5d88 bytes) skipping zero size read 092000 1723253251.524656 write 0x1e7d87 thru 0x1f752e (0xf7a8 bytes) 095000 1723253258.163950 mapread 0x0a43b3 thru 0x0af1e2 (0xae30 bytes) 096000 1723253260.119141 fallocate 0x1d67fe thru 0x1dbc74 (0x5477 bytes) 097000 1723253262.019345 mapread 0x12555d thru 0x129e78 (0x491c bytes) 099000 1723253265.892009 punch from 0x06dfd2 to 0x07137f (0x33ae bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (266s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 21:27:49 (1723253269) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1723253272.568289 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1723253275.266019 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1723253277.947784 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1723253280.589306 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1723253286.040793 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1723253288.540178 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1723253291.538082 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1723253294.423076 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1723253296.989131 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1723253299.357370 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1723253301.978753 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1723253304.686010 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1723253307.047480 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1723253309.833321 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1723253312.651872 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1723253315.148098 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1723253318.250069 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1723253321.179915 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1723253323.729470 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1723253332.257986 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1723253335.337158 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1723253337.926664 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1723253340.436131 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1723253345.202082 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1723253350.147008 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1723253352.649791 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1723253355.125948 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1723253360.343112 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1723253363.058629 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1723253367.346936 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1723253369.787756 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1723253372.057269 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1723253374.672852 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1723253377.738680 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1723253383.217850 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1723253390.657561 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1723253397.834438 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1723253402.781448 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1723253405.633078 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1723253408.749156 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1723253417.029862 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1723253420.104096 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1723253423.265083 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1723253426.418845 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1723253429.026784 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1723253431.274554 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1723253433.651798 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1723253436.044845 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1723253438.664771 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1723253444.064440 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1723253447.272430 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1723253449.892901 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1723253452.580835 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1723253455.647297 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1723253461.221949 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1723253468.609338 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1723253473.788566 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1723253476.166810 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1723253478.523784 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1723253483.748161 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1723253486.206409 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1723253490.720502 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1723253493.355450 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1723253498.735476 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1723253503.601388 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1723253508.897534 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1723253511.514105 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1723253513.925965 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1723253516.319523 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1723253521.516306 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1723253524.298733 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1723253529.995978 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1723253532.914898 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (265s) == sanity-benchmark test complete, duration 874 sec ====== 21:32:14 (1723253534) === sanity-benchmark: start cleanup 21:32:14 (1723253534) === === sanity-benchmark: finish cleanup 21:32:14 (1723253534) ===