-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:23 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:32 (1734015872) === oleg111-client.virtnet: executing check_config_client /mnt/lustre oleg111-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg111-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aa132000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aa132000.idle_timeout=debug disable quota as required oleg111-server: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:55 (1734015895) === == sanity-benchmark test dbench: dbench ================== 10:04:57 (1734015897) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7595] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg111-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg111-client.virtnet at Thu Dec 12 10:05:00 EST 2024 waiting for dbench pid 10294 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 15 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 1 8 2.09 MB/sec warmup 1 sec latency 857.457 ms 20 64 27.53 MB/sec warmup 2 sec latency 213.082 ms 20 123 37.09 MB/sec warmup 3 sec latency 254.337 ms 20 155 32.50 MB/sec warmup 4 sec latency 240.485 ms 20 193 30.68 MB/sec warmup 5 sec latency 197.069 ms 20 238 30.34 MB/sec warmup 6 sec latency 199.131 ms 20 285 30.31 MB/sec warmup 7 sec latency 179.004 ms 20 332 30.06 MB/sec warmup 8 sec latency 177.434 ms 20 375 29.70 MB/sec warmup 9 sec latency 166.399 ms 20 425 29.97 MB/sec warmup 10 sec latency 208.124 ms 20 473 30.07 MB/sec warmup 11 sec latency 154.135 ms 20 525 30.30 MB/sec warmup 12 sec latency 183.069 ms 20 611 31.64 MB/sec warmup 13 sec latency 189.176 ms 20 667 30.16 MB/sec warmup 14 sec latency 185.526 ms 20 712 28.27 MB/sec warmup 15 sec latency 136.243 ms 20 751 26.63 MB/sec warmup 16 sec latency 164.697 ms 20 787 25.17 MB/sec warmup 17 sec latency 137.260 ms 20 829 23.88 MB/sec warmup 18 sec latency 133.472 ms 20 869 22.74 MB/sec warmup 19 sec latency 259.844 ms 20 881 21.65 MB/sec warmup 20 sec latency 1138.375 ms 20 881 20.61 MB/sec warmup 21 sec latency 2147.629 ms 20 886 19.68 MB/sec warmup 22 sec latency 3093.768 ms 20 915 18.86 MB/sec warmup 23 sec latency 3117.250 ms 20 998 5.67 MB/sec execute 1 sec latency 148.597 ms 20 1067 10.98 MB/sec execute 2 sec latency 120.930 ms 20 1127 7.77 MB/sec execute 3 sec latency 109.964 ms 20 1169 6.02 MB/sec execute 4 sec latency 143.271 ms 20 1221 5.26 MB/sec execute 5 sec latency 122.358 ms 20 1279 6.20 MB/sec execute 6 sec latency 150.606 ms 20 1332 7.47 MB/sec execute 7 sec latency 265.762 ms 20 1426 10.51 MB/sec execute 8 sec latency 133.430 ms 20 1479 9.39 MB/sec execute 9 sec latency 121.789 ms 20 1527 8.53 MB/sec execute 10 sec latency 104.554 ms 20 1580 7.84 MB/sec execute 11 sec latency 137.935 ms 20 1627 7.26 MB/sec execute 12 sec latency 153.018 ms 20 1671 6.76 MB/sec execute 13 sec latency 157.794 ms 20 1717 6.32 MB/sec execute 14 sec latency 157.704 ms 20 1786 5.98 MB/sec execute 15 sec latency 115.054 ms 20 1841 5.67 MB/sec execute 16 sec latency 108.546 ms 20 1888 5.37 MB/sec execute 17 sec latency 145.965 ms 20 1941 5.14 MB/sec execute 18 sec latency 121.333 ms 20 1997 4.92 MB/sec execute 19 sec latency 116.229 ms 20 2030 4.73 MB/sec execute 20 sec latency 195.920 ms 20 2062 4.55 MB/sec execute 21 sec latency 431.268 ms 20 2117 4.41 MB/sec execute 22 sec latency 104.132 ms 20 2170 4.26 MB/sec execute 23 sec latency 114.095 ms 20 2220 4.29 MB/sec execute 24 sec latency 147.393 ms 20 2276 4.37 MB/sec execute 25 sec latency 137.691 ms 20 2352 4.66 MB/sec execute 26 sec latency 227.807 ms 20 2391 4.55 MB/sec execute 27 sec latency 122.263 ms 20 2426 4.53 MB/sec execute 28 sec latency 133.612 ms 20 2471 4.54 MB/sec execute 29 sec latency 167.077 ms 20 2522 4.64 MB/sec execute 30 sec latency 172.758 ms 20 2620 4.99 MB/sec execute 31 sec latency 147.788 ms 20 2723 5.67 MB/sec execute 32 sec latency 170.348 ms 20 2854 6.47 MB/sec execute 33 sec latency 153.937 ms 20 2952 6.71 MB/sec execute 34 sec latency 126.606 ms 20 3029 6.77 MB/sec execute 35 sec latency 149.650 ms 20 3143 6.85 MB/sec execute 36 sec latency 149.697 ms 20 3272 7.03 MB/sec execute 37 sec latency 128.876 ms 20 3363 7.42 MB/sec execute 38 sec latency 150.433 ms 20 3471 7.77 MB/sec execute 39 sec latency 98.818 ms 20 3580 8.32 MB/sec execute 40 sec latency 126.827 ms 20 3630 8.16 MB/sec execute 41 sec latency 134.060 ms 20 3685 8.11 MB/sec execute 42 sec latency 136.816 ms 20 3727 8.03 MB/sec execute 43 sec latency 167.470 ms 20 3772 8.04 MB/sec execute 44 sec latency 161.189 ms 20 3812 7.96 MB/sec execute 45 sec latency 153.083 ms 20 3844 7.81 MB/sec execute 46 sec latency 161.420 ms 20 3878 7.67 MB/sec execute 47 sec latency 138.848 ms 20 3907 7.53 MB/sec execute 48 sec latency 178.992 ms 20 3949 7.44 MB/sec execute 49 sec latency 129.526 ms 20 3988 7.29 MB/sec execute 50 sec latency 123.898 ms 20 4016 7.15 MB/sec execute 51 sec latency 158.891 ms 20 4059 7.01 MB/sec execute 52 sec latency 133.840 ms 20 4093 6.88 MB/sec execute 53 sec latency 217.904 ms 20 4147 6.77 MB/sec execute 54 sec latency 170.090 ms 20 4196 6.67 MB/sec execute 55 sec latency 176.443 ms 20 4236 6.57 MB/sec execute 56 sec latency 269.512 ms 20 4284 6.50 MB/sec execute 57 sec latency 127.277 ms 20 4339 6.43 MB/sec execute 58 sec latency 96.881 ms 20 4391 6.37 MB/sec execute 59 sec latency 128.583 ms 20 4434 6.30 MB/sec execute 60 sec latency 133.092 ms 20 4474 6.22 MB/sec execute 61 sec latency 152.127 ms 20 4509 6.15 MB/sec execute 62 sec latency 138.471 ms 20 4553 6.14 MB/sec execute 63 sec latency 140.064 ms 20 4609 6.18 MB/sec execute 64 sec latency 157.993 ms 20 4677 6.23 MB/sec execute 65 sec latency 104.759 ms 20 4733 6.15 MB/sec execute 66 sec latency 130.852 ms 20 4781 6.07 MB/sec execute 67 sec latency 134.918 ms 20 4848 6.21 MB/sec execute 68 sec latency 119.295 ms 20 4916 6.41 MB/sec execute 69 sec latency 173.933 ms 20 4978 6.61 MB/sec execute 70 sec latency 174.811 ms 20 5019 6.56 MB/sec execute 71 sec latency 138.365 ms 20 5059 6.48 MB/sec execute 72 sec latency 146.421 ms 20 5097 6.40 MB/sec execute 73 sec latency 126.061 ms 20 5136 6.32 MB/sec execute 74 sec latency 140.965 ms 20 5169 6.25 MB/sec execute 75 sec latency 143.979 ms 20 5211 6.18 MB/sec execute 76 sec latency 127.545 ms 20 5249 6.10 MB/sec execute 77 sec latency 133.656 ms 20 5286 6.03 MB/sec execute 78 sec latency 148.873 ms 20 5317 5.96 MB/sec execute 79 sec latency 162.731 ms 20 5357 5.90 MB/sec execute 80 sec latency 138.307 ms 20 5388 5.83 MB/sec execute 81 sec latency 135.801 ms 20 5434 5.77 MB/sec execute 82 sec latency 116.656 ms 20 5492 5.71 MB/sec execute 83 sec latency 125.318 ms 20 5549 5.66 MB/sec execute 84 sec latency 104.001 ms 20 5603 5.61 MB/sec execute 85 sec latency 126.636 ms 20 5650 5.56 MB/sec execute 86 sec latency 162.320 ms 20 5713 5.51 MB/sec execute 87 sec latency 106.937 ms 20 5765 5.50 MB/sec execute 88 sec latency 128.959 ms 20 5828 5.50 MB/sec execute 89 sec latency 106.808 ms 20 5894 5.55 MB/sec execute 90 sec latency 121.537 ms 20 5954 5.55 MB/sec execute 91 sec latency 115.304 ms 20 5990 5.54 MB/sec execute 92 sec latency 167.431 ms 20 6056 5.56 MB/sec execute 93 sec latency 126.191 ms 20 6142 5.67 MB/sec execute 94 sec latency 127.010 ms 20 6236 5.82 MB/sec execute 95 sec latency 137.425 ms 20 6350 6.09 MB/sec execute 96 sec latency 122.443 ms 20 6466 6.22 MB/sec execute 97 sec latency 142.203 ms 20 6573 6.31 MB/sec execute 98 sec latency 125.710 ms 20 6674 6.33 MB/sec execute 99 sec latency 138.677 ms 20 6807 6.41 MB/sec execute 100 sec latency 158.559 ms 20 6911 6.56 MB/sec execute 101 sec latency 172.624 ms 20 7009 6.70 MB/sec execute 102 sec latency 112.694 ms 20 7105 6.89 MB/sec execute 103 sec latency 102.550 ms 20 7185 6.90 MB/sec execute 104 sec latency 91.487 ms 20 7245 6.89 MB/sec execute 105 sec latency 138.478 ms 20 7287 6.89 MB/sec execute 106 sec latency 201.763 ms 20 7339 6.90 MB/sec execute 107 sec latency 133.026 ms 20 7379 6.86 MB/sec execute 108 sec latency 128.672 ms 20 7422 6.81 MB/sec execute 109 sec latency 126.484 ms 20 7471 6.78 MB/sec execute 110 sec latency 107.972 ms 20 7505 6.72 MB/sec execute 111 sec latency 190.667 ms 20 7552 6.66 MB/sec execute 112 sec latency 100.906 ms 20 7601 6.61 MB/sec execute 113 sec latency 103.163 ms 20 7661 6.55 MB/sec execute 114 sec latency 107.884 ms 20 7722 6.51 MB/sec execute 115 sec latency 162.148 ms 20 7771 6.46 MB/sec execute 116 sec latency 413.175 ms 20 7814 6.42 MB/sec execute 117 sec latency 144.301 ms 20 7861 6.39 MB/sec execute 118 sec latency 113.841 ms 20 7903 6.35 MB/sec execute 119 sec latency 133.524 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 24112 54.482 431.250 Close 17635 14.853 153.913 Rename 1018 83.689 263.587 Unlink 4902 17.524 89.905 Qpathinfo 22494 13.686 203.826 Qfileinfo 3846 0.301 51.658 Qfsinfo 4036 0.257 36.555 Sfileinfo 1890 59.433 238.049 Find 8445 5.176 144.664 WriteX 11904 7.370 138.208 ReadX 38059 0.028 9.754 LockX 80 14.401 39.843 UnlockX 80 15.079 39.003 Flush 1637 59.959 413.168 Throughput 6.35389 MB/sec 20 clients 20 procs max_latency=431.268 ms stopping dbench on /mnt/lustre/d0.oleg111-client.virtnet at Thu Dec 12 10:07:27 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg111-client.virtnet /mnt/lustre/d0.oleg111-client.virtnet /mnt/lustre/d0.oleg111-client.virtnet removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg111-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (159s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:36 (1734016056) min OST has 3602040kB available, using 5403060kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7595] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5276] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...