-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:04 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:12 (1734015852) === oleg441-client.virtnet: executing check_config_client /mnt/lustre oleg441-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg441-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b613f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b613f800.idle_timeout=debug disable quota as required oleg441-server: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:31 (1734015871) === == sanity-benchmark test dbench: dbench ================== 10:04:32 (1734015872) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7593] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg441-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg441-client.virtnet at Thu Dec 12 10:04:35 EST 2024 waiting for dbench pid 10288 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 1 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 5 17 10.21 MB/sec warmup 1 sec latency 871.012 ms 20 93 42.02 MB/sec warmup 2 sec latency 219.724 ms 20 156 43.74 MB/sec warmup 3 sec latency 222.693 ms 20 209 40.80 MB/sec warmup 4 sec latency 143.123 ms 20 272 40.70 MB/sec warmup 5 sec latency 126.947 ms 20 321 38.91 MB/sec warmup 6 sec latency 137.437 ms 20 377 38.30 MB/sec warmup 7 sec latency 147.682 ms 20 440 38.65 MB/sec warmup 8 sec latency 135.050 ms 20 494 38.24 MB/sec warmup 9 sec latency 174.679 ms 20 594 40.26 MB/sec warmup 10 sec latency 127.788 ms 20 673 38.40 MB/sec warmup 11 sec latency 123.504 ms 20 717 35.39 MB/sec warmup 12 sec latency 126.114 ms 20 765 32.82 MB/sec warmup 13 sec latency 105.507 ms 20 814 30.66 MB/sec warmup 14 sec latency 124.953 ms 20 879 28.83 MB/sec warmup 15 sec latency 95.393 ms 20 923 27.17 MB/sec warmup 16 sec latency 117.718 ms 20 957 25.64 MB/sec warmup 17 sec latency 631.793 ms 20 974 24.27 MB/sec warmup 18 sec latency 1635.613 ms 20 979 23.02 MB/sec warmup 19 sec latency 2249.779 ms 20 1055 22.82 MB/sec warmup 20 sec latency 1967.023 ms 20 1121 21.84 MB/sec warmup 21 sec latency 106.800 ms 20 1170 20.89 MB/sec warmup 22 sec latency 141.338 ms 20 1228 20.03 MB/sec warmup 23 sec latency 79.250 ms 20 1428 33.97 MB/sec execute 1 sec latency 129.183 ms 20 1478 17.23 MB/sec execute 2 sec latency 108.643 ms 20 1531 11.84 MB/sec execute 3 sec latency 95.242 ms 20 1602 9.18 MB/sec execute 4 sec latency 94.339 ms 20 1654 7.55 MB/sec execute 5 sec latency 147.327 ms 20 1703 6.39 MB/sec execute 6 sec latency 147.091 ms 20 1792 5.70 MB/sec execute 7 sec latency 82.635 ms 20 1844 5.09 MB/sec execute 8 sec latency 112.992 ms 20 1905 4.65 MB/sec execute 9 sec latency 112.572 ms 20 1987 4.31 MB/sec execute 10 sec latency 77.732 ms 20 2039 4.11 MB/sec execute 11 sec latency 104.762 ms 20 2116 3.91 MB/sec execute 12 sec latency 85.320 ms 20 2164 3.70 MB/sec execute 13 sec latency 118.960 ms 20 2234 3.65 MB/sec execute 14 sec latency 105.572 ms 20 2340 4.72 MB/sec execute 15 sec latency 112.729 ms 20 2387 4.56 MB/sec execute 16 sec latency 126.721 ms 20 2431 4.44 MB/sec execute 17 sec latency 107.124 ms 20 2478 4.77 MB/sec execute 18 sec latency 126.569 ms 20 2580 4.88 MB/sec execute 19 sec latency 110.303 ms 20 2718 6.85 MB/sec execute 20 sec latency 112.649 ms 20 2893 8.14 MB/sec execute 21 sec latency 86.575 ms 20 2983 8.35 MB/sec execute 22 sec latency 110.128 ms 20 3108 8.33 MB/sec execute 23 sec latency 404.322 ms 20 3257 8.74 MB/sec execute 24 sec latency 153.699 ms 20 3359 8.88 MB/sec execute 25 sec latency 112.524 ms 20 3476 9.94 MB/sec execute 26 sec latency 106.834 ms 20 3595 10.50 MB/sec execute 27 sec latency 81.442 ms 20 3662 10.25 MB/sec execute 28 sec latency 103.895 ms 20 3729 10.20 MB/sec execute 29 sec latency 90.818 ms 20 3791 10.29 MB/sec execute 30 sec latency 151.602 ms 20 3824 9.95 MB/sec execute 31 sec latency 137.528 ms 20 3859 9.65 MB/sec execute 32 sec latency 177.861 ms 20 3905 9.48 MB/sec execute 33 sec latency 101.236 ms 20 3951 9.25 MB/sec execute 34 sec latency 125.632 ms 20 3987 8.99 MB/sec execute 35 sec latency 148.342 ms 20 4031 8.74 MB/sec execute 36 sec latency 121.756 ms 20 4077 8.51 MB/sec execute 37 sec latency 118.936 ms 20 4151 8.30 MB/sec execute 38 sec latency 97.956 ms 20 4214 8.13 MB/sec execute 39 sec latency 135.969 ms 20 4266 7.99 MB/sec execute 40 sec latency 134.469 ms 20 4313 7.85 MB/sec execute 41 sec latency 127.172 ms 20 4373 7.74 MB/sec execute 42 sec latency 96.561 ms 20 4441 7.63 MB/sec execute 43 sec latency 108.035 ms 20 4487 7.52 MB/sec execute 44 sec latency 101.619 ms 20 4545 7.43 MB/sec execute 45 sec latency 99.521 ms 20 4624 7.62 MB/sec execute 46 sec latency 103.820 ms 20 4696 7.56 MB/sec execute 47 sec latency 98.916 ms 20 4757 7.43 MB/sec execute 48 sec latency 103.430 ms 20 4809 7.30 MB/sec execute 49 sec latency 112.291 ms 20 4914 7.88 MB/sec execute 50 sec latency 136.786 ms 20 4990 8.15 MB/sec execute 51 sec latency 164.036 ms 20 5043 8.01 MB/sec execute 52 sec latency 88.658 ms 20 5090 7.87 MB/sec execute 53 sec latency 295.388 ms 20 5146 7.75 MB/sec execute 54 sec latency 86.975 ms 20 5200 7.62 MB/sec execute 55 sec latency 92.111 ms 20 5260 7.50 MB/sec execute 56 sec latency 109.193 ms 20 5307 7.38 MB/sec execute 57 sec latency 123.499 ms 20 5356 7.27 MB/sec execute 58 sec latency 91.438 ms 20 5401 7.16 MB/sec execute 59 sec latency 107.825 ms 20 5468 7.06 MB/sec execute 60 sec latency 97.939 ms 20 5548 6.97 MB/sec execute 61 sec latency 82.720 ms 20 5606 6.89 MB/sec execute 62 sec latency 104.661 ms 20 5686 6.81 MB/sec execute 63 sec latency 80.509 ms 20 5738 6.72 MB/sec execute 64 sec latency 119.030 ms 20 5813 6.71 MB/sec execute 65 sec latency 103.580 ms 20 5893 6.83 MB/sec execute 66 sec latency 120.486 ms 20 5949 6.79 MB/sec execute 67 sec latency 99.612 ms 20 5997 6.76 MB/sec execute 68 sec latency 146.872 ms 20 6052 6.79 MB/sec execute 69 sec latency 119.297 ms 20 6141 6.80 MB/sec execute 70 sec latency 118.794 ms 20 6297 7.36 MB/sec execute 71 sec latency 107.769 ms 20 6455 7.68 MB/sec execute 72 sec latency 110.521 ms 20 6538 7.74 MB/sec execute 73 sec latency 106.307 ms 20 6664 7.75 MB/sec execute 74 sec latency 138.817 ms 20 6821 7.91 MB/sec execute 75 sec latency 104.165 ms 20 6938 8.05 MB/sec execute 76 sec latency 101.260 ms 20 7082 8.54 MB/sec execute 77 sec latency 104.201 ms 20 7158 8.54 MB/sec execute 78 sec latency 108.383 ms 20 7223 8.48 MB/sec execute 79 sec latency 94.292 ms 20 7293 8.53 MB/sec execute 80 sec latency 149.457 ms 20 7342 8.51 MB/sec execute 81 sec latency 146.415 ms 20 7391 8.43 MB/sec execute 82 sec latency 125.476 ms 20 7435 8.36 MB/sec execute 83 sec latency 133.201 ms 20 7485 8.29 MB/sec execute 84 sec latency 116.422 ms 20 7519 8.20 MB/sec execute 85 sec latency 141.155 ms 20 7553 8.10 MB/sec execute 86 sec latency 165.659 ms 20 7604 8.01 MB/sec execute 87 sec latency 79.927 ms 20 7673 7.92 MB/sec execute 88 sec latency 118.977 ms 20 7740 7.85 MB/sec execute 89 sec latency 144.086 ms 20 7792 7.79 MB/sec execute 90 sec latency 135.963 ms 20 7851 7.73 MB/sec execute 91 sec latency 103.050 ms 20 7902 7.68 MB/sec execute 92 sec latency 123.670 ms 20 7967 7.63 MB/sec execute 93 sec latency 91.693 ms 20 8025 7.58 MB/sec execute 94 sec latency 84.296 ms 20 8081 7.53 MB/sec execute 95 sec latency 105.253 ms 20 8161 7.61 MB/sec execute 96 sec latency 85.690 ms 20 8240 7.60 MB/sec execute 97 sec latency 88.410 ms 20 8312 7.54 MB/sec execute 98 sec latency 82.169 ms 20 8404 7.64 MB/sec execute 99 sec latency 85.245 ms 20 8524 7.95 MB/sec execute 100 sec latency 81.397 ms 20 8589 7.91 MB/sec execute 101 sec latency 115.960 ms 20 8657 7.84 MB/sec execute 102 sec latency 71.959 ms 20 8717 7.78 MB/sec execute 103 sec latency 79.298 ms 20 8798 7.71 MB/sec execute 104 sec latency 77.518 ms 20 8864 7.65 MB/sec execute 105 sec latency 79.301 ms 20 8921 7.59 MB/sec execute 106 sec latency 90.432 ms 20 9003 7.53 MB/sec execute 107 sec latency 82.113 ms 20 9118 7.48 MB/sec execute 108 sec latency 64.190 ms 20 9234 7.44 MB/sec execute 109 sec latency 61.329 ms 20 9332 7.42 MB/sec execute 110 sec latency 57.871 ms 20 9457 7.52 MB/sec execute 111 sec latency 85.951 ms 20 9537 7.50 MB/sec execute 112 sec latency 67.783 ms 20 9622 7.54 MB/sec execute 113 sec latency 179.547 ms 20 9764 7.73 MB/sec execute 114 sec latency 92.716 ms 20 9978 8.10 MB/sec execute 115 sec latency 82.068 ms 20 10089 8.17 MB/sec execute 116 sec latency 94.230 ms 20 10276 8.22 MB/sec execute 117 sec latency 90.380 ms 20 10446 8.36 MB/sec execute 118 sec latency 84.969 ms 20 10592 8.69 MB/sec execute 119 sec latency 88.743 ms 20 cleanup 120 sec 20 cleanup 121 sec 15 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 31284 42.976 177.855 Close 23429 10.966 61.917 Rename 1284 65.054 153.684 Unlink 5768 14.109 58.737 Qpathinfo 29402 10.545 106.187 Qfileinfo 5417 0.176 28.691 Qfsinfo 5170 0.165 25.091 Sfileinfo 2325 45.092 135.957 Find 11535 2.624 134.675 WriteX 15916 5.555 73.494 ReadX 53354 0.027 14.901 LockX 120 10.545 22.416 UnlockX 120 10.470 19.959 Flush 2100 45.215 404.315 Throughput 8.69026 MB/sec 20 clients 20 procs max_latency=404.322 ms stopping dbench on /mnt/lustre/d0.oleg441-client.virtnet at Thu Dec 12 10:07:01 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg441-client.virtnet /mnt/lustre/d0.oleg441-client.virtnet /mnt/lustre/d0.oleg441-client.virtnet removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg441-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (158s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:10 (1734016030) min OST has 3564720kB available, using 5347080kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7593] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5221] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg441-clien 5221M 70527 57 46457 41 145302 35 2546 233 Latency 40013us 484ms 149ms 8872us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg441-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 249 18 6648 28 333 12 295 18 719 12 297 14 Latency 19129us 26395us 69710us 20066us 7699us 28923us 1.97,1.97,oleg441-client.virtnet,1,1734004898,5221M,,,,70527,57,46457,41,,,145302,35,2546,233,10,,,,,249,18,6648,28,333,12,295,18,719,12,297,14,,40013us,484ms,,149ms,8872us,19129us,26395us,69710us,20066us,7699us,28923us debug=0x33f0484 PASS bonnie (397s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 10:13:48 (1734016428) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 31976 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 31976 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read truncating to largest ever: 0x1fbae2 fallocating to largest ever: 0x35ac75 truncating to largest ever: 0x36f1cd fallocating to largest ever: 0x48f27d truncating to largest ever: 0x4ee9ad fallocating to largest ever: 0x504a9a truncating to largest ever: 0x524b15 002000 1734016447.432149 trunc from 0x3b3c96 to 0x081779 (0x33251c bytes) truncating to largest ever: 0x528323 fallocating to largest ever: 0x5285e2 004000 1734016471.007437 fallocate 0x4051d8 thru 0x40ef2d (0x9d56 bytes) 005000 1734016484.174019 mapwrite 0x328b6c thru 0x328b9f (0x34 bytes) 008000 1734016516.328315 trunc from 0x2649fa to 0x514014 (0x2af61b bytes) 009000 1734016526.655533 fallocate 0x076318 thru 0x076c8c (0x975 bytes) 013000 1734016569.018967 trunc from 0x2ad627 to 0x216bd2 (0x96a54 bytes) 014000 1734016578.635485 mapread 0x346f4c thru 0x351853 (0xa908 bytes) 015000 1734016587.838134 write 0x0d2170 thru 0x0da227 (0x80b8 bytes) 016000 1734016598.852418 write 0x28d475 thru 0x298a90 (0xb61c bytes) 017000 1734016609.602533 mapread 0x0d1b2d thru 0x0d80b9 (0x658d bytes) 018000 1734016618.621984 mapread 0x2b205e thru 0x2be1c7 (0xc16a bytes) 019000 1734016628.477427 write 0x20937e thru 0x2149b9 (0xb63c bytes) 020000 1734016636.943698 punch from 0x1c4c04 to 0x1cdb5d (0x8f5a bytes) 021000 1734016643.937508 read 0x0dd771 thru 0x0e92dd (0xbb6d bytes) 022000 1734016649.387500 fallocate 0x3abad9 thru 0x3b3041 (0x7569 bytes) 025000 1734016665.706972 read 0x1e1c81 thru 0x1e4ea6 (0x3226 bytes) 026000 1734016670.634245 punch from 0x45e110 to 0x46637f (0x8270 bytes) 027000 1734016674.794373 punch from 0x4173b0 to 0x424210 (0xce61 bytes) 031000 1734016688.517410 read 0x0095fc thru 0x011834 (0x8239 bytes) 032000 1734016692.123533 trunc from 0x4d88ec to 0x022b66 (0x4b5d85 bytes) 033000 1734016695.899390 mapread 0x45aac0 thru 0x46a9e7 (0xff28 bytes) 037000 1734016709.980826 trunc from 0x020ac4 to 0x4c5cf1 (0x4a522e bytes) 039000 1734016714.574389 mapwrite 0x2256a1 thru 0x225d95 (0x6f5 bytes) 041000 1734016719.404544 fallocate 0x315701 thru 0x31f37a (0x9c7a bytes) 042000 1734016725.668276 punch from 0x22679f to 0x2329e8 (0xc24a bytes) skipping zero size read 043000 1734016735.192615 punch from 0x1fb15a to 0x208c3e (0xdae5 bytes) 047000 1734016771.130771 read 0x008f0d thru 0x00efaf (0x60a3 bytes) 048000 1734016779.991019 punch from 0x13332c to 0x13452c (0x1201 bytes) 049000 1734016787.722853 mapread 0x04ccaa thru 0x052d33 (0x608a bytes) 050000 1734016795.219018 mapwrite 0x4f1145 thru 0x4f3d67 (0x2c23 bytes) 051000 1734016800.337511 read 0x02c8fc thru 0x03126b (0x4970 bytes) 052000 1734016805.488564 mapwrite 0x4850e4 thru 0x4867ed (0x170a bytes) 053000 1734016810.029961 fallocate 0x22b431 thru 0x235f95 (0xab65 bytes) 055000 1734016817.528292 fallocate 0x299cb7 thru 0x29be2a (0x2174 bytes) 058000 1734016826.329347 trunc from 0x064bbc to 0x2ad668 (0x248aad bytes) 060000 1734016833.454684 mapwrite 0x2bd0a2 thru 0x2c89c1 (0xb920 bytes) 061000 1734016836.731075 read 0x4071de thru 0x4161cf (0xeff2 bytes) 062000 1734016839.634923 fallocate 0x18662d thru 0x18b445 (0x4e19 bytes) 063000 1734016842.125314 trunc from 0x2f55e6 to 0x161beb (0x1939fa bytes) 064000 1734016845.205258 read 0x1bb435 thru 0x1c627e (0xae4a bytes) 065000 1734016848.167156 mapwrite 0x1bba98 thru 0x1bc62c (0xb95 bytes) 066000 1734016851.823284 fallocate 0x4436ed thru 0x44d6f9 (0xa00d bytes) 067000 1734016854.898900 write 0x029469 thru 0x038aa6 (0xf63e bytes) 069000 1734016860.568317 trunc from 0x3f1008 to 0x390fc0 (0x60047 bytes) 071000 1734016866.564685 punch from 0x1615ff to 0x16a88f (0x9291 bytes) 072000 1734016869.828288 fallocate 0x52769b thru 0x5285e1 (0xf47 bytes) 073000 1734016872.860627 punch from 0x38c3a9 to 0x38c722 (0x37a bytes) 074000 1734016876.196835 punch from 0x0bcec8 to 0x0c75dd (0xa716 bytes) 075000 1734016879.286659 mapread 0x40306d thru 0x408fce (0x5f62 bytes) 078000 1734016890.682900 read 0x052eb2 thru 0x059f6b (0x70ba bytes) 079000 1734016894.840015 write 0x21e87a thru 0x22bd9e (0xd525 bytes) 080000 1734016899.308248 punch from 0x0e05d6 to 0x0e686b (0x6296 bytes) 081000 1734016903.352840 trunc from 0x5264d3 to 0x0473a6 (0x4df12c bytes) 082000 1734016907.021923 write 0x28afb1 thru 0x291bdc (0x6c2c bytes) 086000 1734016920.298884 mapwrite 0x392822 thru 0x396af7 (0x42d6 bytes) 087000 1734016924.018223 mapread 0x0f7b7f thru 0x0fe596 (0x6a18 bytes) 089000 1734016931.182201 read 0x07a5c6 thru 0x0874ab (0xcee6 bytes) 090000 1734016934.816771 read 0x0fe3ba thru 0x0fe784 (0x3cb bytes) 091000 1734016938.628401 write 0x0e2931 thru 0x0eeee2 (0xc5b2 bytes) 093000 1734016945.387248 read 0x012ae9 thru 0x019a54 (0x6f6c bytes) 094000 1734016949.074628 fallocate 0x49e0e2 thru 0x4a6e3c (0x8d5b bytes) 095000 1734016953.060248 mapwrite 0x47d4ed thru 0x4896b9 (0xc1cd bytes) 096000 1734016956.733058 read 0x249d1b thru 0x24b564 (0x184a bytes) 097000 1734016960.633222 mapread 0x03d4a0 thru 0x045e78 (0x89d9 bytes) 098000 1734016964.338947 read 0x08006a thru 0x082c85 (0x2c1c bytes) 099000 1734016967.950324 trunc from 0x493002 to 0x3a8346 (0xeacbb bytes) 100000 1734016972.400566 fallocate 0x0a0343 thru 0x0a9274 (0x8f32 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4961614 (4848 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 1970176.. 1970179: 4: 0000: net 1: 8.. 11: 3014816.. 3014819: 4: 0000: unwritten,net 2: 12.. 15: 3147760.. 3147763: 4: 0000: unwritten,net 3: 16.. 23: 3014820.. 3014827: 8: 0000: unwritten,net 4: 24.. 27: 3022216.. 3022219: 4: 0000: net 5: 28.. 63: 3148604.. 3148639: 36: 0000: net 6: 64.. 75: 3148772.. 3148783: 12: 0000: unwritten,net 7: 76.. 87: 3018540.. 3018551: 12: 0000: unwritten,net 8: 96.. 119: 3014656.. 3014679: 24: 0000: net 9: 148.. 167: 3149852.. 3149871: 20: 0000: net 10: 640.. 679: 3149280.. 3149319: 40: 0000: unwritten,net 11: 1100.. 1143: 3014944.. 3014987: 44: 0000: net 12: 1184.. 1223: 3034620.. 3034659: 40: 0000: net 13: 2480.. 2511: 3147712.. 3147743: 32: 0000: unwritten,net 14: 3108.. 3171: 3147648.. 3147711: 64: 0000: last,net /mnt/lustre/f0.fsxfile: 15 extents found debug=0x33f0484 PASS fsx (545s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 10:22:53 (1734016973) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1734016979.297215 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1734016983.994515 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1734016988.607704 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1734016993.085733 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1734017001.295850 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1734017005.377914 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1734017009.812816 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1734017014.222478 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1734017018.443735 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1734017022.405043 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1734017026.533246 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1734017030.486330 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1734017034.144435 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1734017038.500447 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1734017042.794394 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1734017046.503198 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1734017050.704083 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1734017054.956918 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1734017058.917118 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1734017072.117543 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1734017076.316828 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1734017080.377268 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1734017084.365558 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1734017092.223790 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1734017099.886289 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1734017103.722605 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1734017107.680448 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1734017116.327485 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1734017120.914337 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1734017128.395536 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1734017132.650313 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1734017136.439624 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1734017140.903063 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1734017145.362504 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1734017153.792504 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1734017165.854997 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1734017178.392193 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1734017187.139827 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1734017191.329596 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1734017196.000800 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1734017207.898180 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1734017212.215247 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1734017216.485128 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1734017220.910561 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1734017225.078947 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1734017228.624149 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1734017232.122411 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1734017235.701520 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1734017239.748557 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1734017246.656098 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1734017251.001021 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1734017254.735179 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1734017258.662827 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1734017263.055285 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1734017270.936236 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1734017282.980379 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1734017291.400534 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1734017295.393579 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1734017299.045325 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1734017307.055912 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1734017311.145825 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1734017318.513428 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1734017322.480912 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1734017330.950691 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1734017339.480517 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1734017348.208506 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1734017352.584725 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1734017356.390516 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1734017360.029976 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1734017368.325661 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1734017372.374123 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1734017380.677759 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1734017385.274331 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (413s) == sanity-benchmark test complete, duration 1541 sec ===== 10:29:46 (1734017386) === sanity-benchmark: start cleanup 10:29:47 (1734017387) === === sanity-benchmark: finish cleanup 10:29:47 (1734017387) ===