-----============= acceptance-small: sanity-benchmark ============----- Mon May 13 03:59:53 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 03:59:58 (1715587198) === oleg108-client.virtnet: executing check_config_client /mnt/lustre oleg108-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg108-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6fa3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6fa3000.idle_timeout=debug disable quota as required oleg108-server: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 04:00:03 (1715587203) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 04:00:04 (1715587204) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6874] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg108-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg108-client.virtnet at Mon May 13 04:00:05 EDT 2024 waiting for dbench pid 8925 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 210 163.97 MB/sec warmup 1 sec latency 105.548 ms 20 432 152.47 MB/sec warmup 2 sec latency 54.758 ms 20 671 141.09 MB/sec warmup 3 sec latency 218.536 ms 20 822 107.49 MB/sec warmup 4 sec latency 98.740 ms 20 1023 89.90 MB/sec warmup 5 sec latency 90.898 ms 20 1396 86.67 MB/sec warmup 6 sec latency 27.258 ms 20 1626 74.76 MB/sec warmup 7 sec latency 137.747 ms 20 1899 65.99 MB/sec warmup 8 sec latency 125.685 ms 20 2247 60.43 MB/sec warmup 9 sec latency 87.024 ms 20 2490 57.04 MB/sec warmup 10 sec latency 167.382 ms 20 2954 60.52 MB/sec warmup 11 sec latency 179.786 ms 20 3370 59.74 MB/sec warmup 12 sec latency 159.567 ms 20 3799 61.04 MB/sec warmup 13 sec latency 84.648 ms 20 4060 57.25 MB/sec warmup 14 sec latency 19.054 ms 20 4275 53.80 MB/sec warmup 15 sec latency 181.393 ms 20 4409 50.85 MB/sec warmup 16 sec latency 161.413 ms 20 4649 49.14 MB/sec warmup 17 sec latency 100.038 ms 20 5037 50.18 MB/sec warmup 18 sec latency 71.425 ms 20 5275 47.74 MB/sec warmup 19 sec latency 72.103 ms 20 5558 45.62 MB/sec warmup 20 sec latency 67.843 ms 20 5906 44.67 MB/sec warmup 21 sec latency 94.653 ms 20 6200 44.58 MB/sec warmup 22 sec latency 123.212 ms 20 6633 46.09 MB/sec warmup 23 sec latency 116.498 ms 20 7390 28.01 MB/sec execute 1 sec latency 149.140 ms 20 7615 16.76 MB/sec execute 2 sec latency 131.386 ms 20 7801 12.80 MB/sec execute 3 sec latency 238.780 ms 20 7944 11.31 MB/sec execute 4 sec latency 159.191 ms 20 8163 12.63 MB/sec execute 5 sec latency 92.153 ms 20 8528 21.20 MB/sec execute 6 sec latency 88.851 ms 20 8769 19.76 MB/sec execute 7 sec latency 86.021 ms 20 9015 17.84 MB/sec execute 8 sec latency 63.768 ms 20 9312 17.17 MB/sec execute 9 sec latency 79.171 ms 20 9558 17.98 MB/sec execute 10 sec latency 264.480 ms 20 9944 23.92 MB/sec execute 11 sec latency 107.702 ms 20 10411 27.05 MB/sec execute 12 sec latency 108.555 ms 20 10801 30.35 MB/sec execute 13 sec latency 66.151 ms 20 11032 29.65 MB/sec execute 14 sec latency 24.723 ms 20 11247 27.82 MB/sec execute 15 sec latency 198.293 ms 20 11422 26.51 MB/sec execute 16 sec latency 146.373 ms 20 11635 25.89 MB/sec execute 17 sec latency 112.113 ms 20 11953 26.74 MB/sec execute 18 sec latency 118.113 ms 20 12265 27.35 MB/sec execute 19 sec latency 73.498 ms 20 12542 26.23 MB/sec execute 20 sec latency 61.106 ms 20 12856 25.70 MB/sec execute 21 sec latency 71.210 ms 20 13124 25.88 MB/sec execute 22 sec latency 170.481 ms 20 13493 27.74 MB/sec execute 23 sec latency 124.683 ms 20 13911 29.35 MB/sec execute 24 sec latency 175.641 ms 20 14248 30.52 MB/sec execute 25 sec latency 125.491 ms 20 14509 30.55 MB/sec execute 26 sec latency 32.365 ms 20 14690 29.57 MB/sec execute 27 sec latency 229.369 ms 20 14870 28.64 MB/sec execute 28 sec latency 187.370 ms 20 15005 27.86 MB/sec execute 29 sec latency 235.184 ms 20 15176 27.40 MB/sec execute 30 sec latency 112.290 ms 20 15435 27.52 MB/sec execute 31 sec latency 114.788 ms 20 15731 28.15 MB/sec execute 32 sec latency 111.527 ms 20 15942 27.41 MB/sec execute 33 sec latency 75.725 ms 20 16176 26.73 MB/sec execute 34 sec latency 66.639 ms 20 16477 26.45 MB/sec execute 35 sec latency 108.336 ms 20 16755 26.91 MB/sec execute 36 sec latency 129.979 ms 20 17159 28.14 MB/sec execute 37 sec latency 154.402 ms 20 17564 29.02 MB/sec execute 38 sec latency 145.448 ms 20 17907 29.79 MB/sec execute 39 sec latency 148.236 ms 20 18138 29.46 MB/sec execute 40 sec latency 51.358 ms 20 18317 28.84 MB/sec execute 41 sec latency 349.840 ms 20 18474 28.26 MB/sec execute 42 sec latency 213.851 ms 20 18621 27.77 MB/sec execute 43 sec latency 190.455 ms 20 18837 27.70 MB/sec execute 44 sec latency 131.778 ms 20 19148 28.10 MB/sec execute 45 sec latency 118.973 ms 20 19420 27.95 MB/sec execute 46 sec latency 113.926 ms 20 19675 27.45 MB/sec execute 47 sec latency 62.376 ms 20 19955 27.08 MB/sec execute 48 sec latency 66.291 ms 20 20234 27.18 MB/sec execute 49 sec latency 149.879 ms 20 20593 27.96 MB/sec execute 50 sec latency 180.323 ms 20 21027 28.71 MB/sec execute 51 sec latency 126.535 ms 20 21415 29.53 MB/sec execute 52 sec latency 108.706 ms 20 21676 29.44 MB/sec execute 53 sec latency 25.637 ms 20 21872 28.98 MB/sec execute 54 sec latency 209.121 ms 20 22069 28.56 MB/sec execute 55 sec latency 169.370 ms 20 22231 28.21 MB/sec execute 56 sec latency 144.395 ms 20 22471 28.20 MB/sec execute 57 sec latency 130.567 ms 20 22815 28.67 MB/sec execute 58 sec latency 101.587 ms 20 23058 28.31 MB/sec execute 59 sec latency 96.033 ms 20 23322 27.95 MB/sec execute 60 sec latency 73.872 ms 20 23661 27.87 MB/sec execute 61 sec latency 90.343 ms 20 23930 28.00 MB/sec execute 62 sec latency 163.411 ms 20 24353 28.95 MB/sec execute 63 sec latency 157.992 ms 20 24721 29.17 MB/sec execute 64 sec latency 187.208 ms 20 25054 29.63 MB/sec execute 65 sec latency 84.911 ms 20 25267 29.47 MB/sec execute 66 sec latency 277.614 ms 20 25433 29.08 MB/sec execute 67 sec latency 114.936 ms 20 25635 28.73 MB/sec execute 68 sec latency 245.303 ms 20 25831 28.55 MB/sec execute 69 sec latency 117.170 ms 20 26073 28.50 MB/sec execute 70 sec latency 193.939 ms 20 26429 28.87 MB/sec execute 71 sec latency 147.529 ms 20 26681 28.55 MB/sec execute 72 sec latency 104.503 ms 20 26950 28.27 MB/sec execute 73 sec latency 91.461 ms 20 27273 28.29 MB/sec execute 74 sec latency 92.453 ms 20 27634 28.70 MB/sec execute 75 sec latency 137.329 ms 20 28061 29.27 MB/sec execute 76 sec latency 135.725 ms 20 28468 29.69 MB/sec execute 77 sec latency 145.327 ms 20 28782 29.82 MB/sec execute 78 sec latency 107.296 ms 20 28993 29.51 MB/sec execute 79 sec latency 150.496 ms 20 29220 29.28 MB/sec execute 80 sec latency 199.137 ms 20 29413 29.09 MB/sec execute 81 sec latency 160.903 ms 20 29688 29.12 MB/sec execute 82 sec latency 160.151 ms 20 30044 29.33 MB/sec execute 83 sec latency 78.483 ms 20 30314 29.11 MB/sec execute 84 sec latency 81.284 ms 20 30643 29.02 MB/sec execute 85 sec latency 87.479 ms 20 30968 29.02 MB/sec execute 86 sec latency 129.522 ms 20 31263 29.25 MB/sec execute 87 sec latency 123.740 ms 20 31647 29.73 MB/sec execute 88 sec latency 173.739 ms 20 31996 29.86 MB/sec execute 89 sec latency 138.707 ms 20 32291 30.03 MB/sec execute 90 sec latency 105.044 ms 20 32496 29.83 MB/sec execute 91 sec latency 155.983 ms 20 32714 29.59 MB/sec execute 92 sec latency 154.507 ms 20 32890 29.41 MB/sec execute 93 sec latency 202.356 ms 20 33089 29.21 MB/sec execute 94 sec latency 117.389 ms 20 33362 29.23 MB/sec execute 95 sec latency 107.321 ms 20 33698 29.41 MB/sec execute 96 sec latency 73.168 ms 20 34000 29.25 MB/sec execute 97 sec latency 92.819 ms 20 34279 29.15 MB/sec execute 98 sec latency 91.393 ms 20 34660 29.36 MB/sec execute 99 sec latency 144.941 ms 20 35000 29.65 MB/sec execute 100 sec latency 170.900 ms 20 35405 29.86 MB/sec execute 101 sec latency 153.160 ms 20 35738 30.15 MB/sec execute 102 sec latency 126.063 ms 20 35948 30.04 MB/sec execute 103 sec latency 138.555 ms 20 36148 29.84 MB/sec execute 104 sec latency 148.537 ms 20 36353 29.66 MB/sec execute 105 sec latency 205.519 ms 20 36528 29.46 MB/sec execute 106 sec latency 206.069 ms 20 36776 29.42 MB/sec execute 107 sec latency 104.704 ms 20 37037 29.40 MB/sec execute 108 sec latency 85.301 ms 20 37325 29.49 MB/sec execute 109 sec latency 115.868 ms 20 37609 29.37 MB/sec execute 110 sec latency 79.952 ms 20 37918 29.31 MB/sec execute 111 sec latency 78.215 ms 20 38265 29.42 MB/sec execute 112 sec latency 135.350 ms 20 38597 29.61 MB/sec execute 113 sec latency 149.870 ms 20 38954 29.82 MB/sec execute 114 sec latency 147.088 ms 20 39283 30.04 MB/sec execute 115 sec latency 123.181 ms 20 39519 29.99 MB/sec execute 116 sec latency 99.912 ms 20 39738 29.85 MB/sec execute 117 sec latency 160.604 ms 20 39938 29.64 MB/sec execute 118 sec latency 174.761 ms 20 40107 29.46 MB/sec execute 119 sec latency 175.989 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 116331 9.975 66.033 Close 84873 2.467 24.660 Rename 4874 13.549 49.062 Unlink 23947 4.296 42.949 Qpathinfo 104516 2.269 36.172 Qfileinfo 17903 0.068 7.933 Qfsinfo 19177 0.027 4.946 Sfileinfo 9466 6.640 30.142 Find 40044 0.447 40.291 WriteX 56667 0.801 31.443 ReadX 177595 0.012 2.197 LockX 360 2.820 10.361 UnlockX 360 2.915 11.392 Flush 8231 59.287 349.833 Throughput 29.4629 MB/sec 20 clients 20 procs max_latency=349.840 ms stopping dbench on /mnt/lustre/d0.oleg108-client.virtnet at Mon May 13 04:02:30 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg108-client.virtnet /mnt/lustre/d0.oleg108-client.virtnet /mnt/lustre/d0.oleg108-client.virtnet removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg108-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 04:02:33 (1715587353) min OST has 3248128kB available, using 4872192kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6874] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4758] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg108-clien 4758M 160344 97 124973 95 348849 85 1961 134 Latency 2513us 30905us 32081us 399ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg108-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 438 15 7780 33 591 10 460 15 1188 13 571 10 Latency 22294us 15873us 53449us 17640us 3376us 28915us 1.97,1.97,oleg108-client.virtnet,1,1715596905,4758M,,,,160344,97,124973,95,,,348849,85,1961,134,10,,,,,438,15,7780,33,591,10,460,15,1188,13,571,10,,2513us,30905us,,32081us,399ms,22294us,15873us,53449us,17640us,3376us,28915us debug=0x33f0484 PASS bonnie (185s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 04:05:40 (1715587540) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 14486 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 14486 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x2c7e7d truncating to largest ever: 0x4fed61 truncating to largest ever: 0x538a33 truncating to largest ever: 0x55b88f truncating to largest ever: 0x561c83 003000 1715587550.647893 read 0x050982 thru 0x0547bd (0x3e3c bytes) 006000 1715587559.134155 trunc from 0x4897ca to 0x1ae0a5 (0x2db724 bytes) 007000 1715587562.419180 mapread 0x32d7f2 thru 0x337c19 (0xa428 bytes) 010000 1715587571.509749 write 0x0e5e7f thru 0x0ea468 (0x45ea bytes) truncating to largest ever: 0x5620ae 012000 1715587577.202215 mapread 0x05f68e thru 0x06b6c9 (0xc03c bytes) 016000 1715587588.042418 write 0x19ce72 thru 0x1a54bd (0x864c bytes) 017000 1715587590.785466 write 0x01d3fa thru 0x028281 (0xae88 bytes) 019000 1715587597.069637 write 0x0db8f2 thru 0x0e6e77 (0xb586 bytes) truncating to largest ever: 0x562613 skipping zero size read 026000 1715587617.746549 read 0x06540f thru 0x07477f (0xf371 bytes) 027000 1715587620.410573 trunc from 0x44a3b1 to 0x1c1cf6 (0x2886ba bytes) 029000 1715587625.133808 trunc from 0x31ba78 to 0x3c1425 (0xa59ae bytes) 030000 1715587627.612550 write 0x1526a2 thru 0x15e409 (0xbd68 bytes) 031000 1715587630.311638 read 0x03e6d6 thru 0x041411 (0x2d3c bytes) 032000 1715587632.912336 read 0x01952b thru 0x023c04 (0xa6da bytes) 034000 1715587637.739838 mapread 0x0fd8fa thru 0x0ff57b (0x1c82 bytes) 035000 1715587640.164455 write 0x481964 thru 0x485293 (0x3930 bytes) truncating to largest ever: 0x562639 truncating to largest ever: 0x56279c 037000 1715587645.242311 trunc from 0x4d6f70 to 0x4f6808 (0x1f899 bytes) truncating to largest ever: 0x5628dc 039000 1715587650.842738 mapwrite 0x174a57 thru 0x17701d (0x25c7 bytes) 041000 1715587657.093557 trunc from 0x4eb1cc to 0x12ae45 (0x3c0386 bytes) 044000 1715587665.831443 trunc from 0x42a93f to 0x12da9a (0x2fcea4 bytes) 048000 1715587676.207273 mapread 0x36fb66 thru 0x372dac (0x3247 bytes) 049000 1715587678.399657 write 0x213fb1 thru 0x2155b2 (0x1602 bytes) 051000 1715587683.595352 trunc from 0x4e305d to 0x13eb5f (0x3a44fd bytes) 057000 1715587698.199247 mapread 0x3e896e thru 0x3f4ce6 (0xc379 bytes) 059000 1715587703.450640 mapread 0x1e6027 thru 0x1e8de8 (0x2dc2 bytes) 060000 1715587705.982247 mapread 0x09c871 thru 0x0aaf0c (0xe69c bytes) 061000 1715587708.714619 mapwrite 0x16c1c4 thru 0x17ae7a (0xecb7 bytes) 063000 1715587713.550896 mapwrite 0x18c008 thru 0x18eb15 (0x2b0e bytes) 064000 1715587715.970947 trunc from 0x392a03 to 0x4f455f (0x161b5d bytes) 066000 1715587720.807328 mapwrite 0x178a05 thru 0x184f15 (0xc511 bytes) 069000 1715587729.360409 mapread 0x18ba19 thru 0x18c7cb (0xdb3 bytes) 070000 1715587732.500833 mapread 0x0775cf thru 0x07cd0b (0x573d bytes) 071000 1715587735.617281 read 0x2a3aa7 thru 0x2b1b92 (0xe0ec bytes) 075000 1715587748.809977 mapread 0x3558e8 thru 0x35a194 (0x48ad bytes) 077000 1715587755.510264 mapread 0x0a268b thru 0x0a9cf3 (0x7669 bytes) 078000 1715587758.189735 mapwrite 0x4b8c3a thru 0x4c71af (0xe576 bytes) 079000 1715587761.215015 mapread 0x11df6e thru 0x1239df (0x5a72 bytes) 082000 1715587769.545257 mapread 0x0d33ad thru 0x0de257 (0xaeab bytes) 085000 1715587778.855428 write 0x4720b1 thru 0x480004 (0xdf54 bytes) 088000 1715587787.240426 mapwrite 0x19b85c thru 0x1a295e (0x7103 bytes) 089000 1715587790.152741 trunc from 0x4cd25e to 0x2b25cb (0x21ac92 bytes) 090000 1715587792.710630 write 0x31b6a2 thru 0x323e25 (0x8784 bytes) 092000 1715587798.024501 write 0x1bf3fb thru 0x1c8c29 (0x982f bytes) 094000 1715587803.941297 mapwrite 0x3166e1 thru 0x31aa2c (0x434c bytes) 095000 1715587806.993326 mapread 0x2347f2 thru 0x24032d (0xbb3c bytes) 099000 1715587818.975157 read 0x2ed50e thru 0x2f3aea (0x65dd bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (282s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 04:10:24 (1715587824) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1715587834.395623 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1715587841.975747 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1715587845.571791 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1715587859.202810 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1715587862.491157 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1715587875.200255 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1715587878.261734 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1715587884.527149 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1715587891.203572 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1715587894.405469 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1715587900.708653 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1715587904.140090 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1715587916.953519 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1715587922.685119 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1715587932.188871 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1715587941.860987 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1715587944.919232 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1715587958.337454 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1715587961.871335 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1715587971.725623 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1715587974.683993 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1715587978.078693 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1715587987.205430 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1715587993.264440 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1715587999.570026 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1715588002.976340 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1715588034.305795 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1715588043.634013 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1715588047.221805 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1715588050.249864 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1715588053.300060 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1715588063.126724 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1715588066.194452 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1715588076.328173 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1715588079.848921 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1715588089.058057 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1715588098.882867 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1715588102.364014 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1715588111.385074 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1715588127.547555 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1715588130.394749 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1715588136.477008 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1715588143.036253 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (323s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 953 sec ====== 04:15:47 (1715588147) === sanity-benchmark: start cleanup 04:15:47 (1715588147) === === sanity-benchmark: finish cleanup 04:15:48 (1715588148) ===