-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:16 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:26 (1734015866) === oleg253-client.virtnet: executing check_config_client /mnt/lustre oleg253-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg253-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5d49000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5d49000.idle_timeout=debug disable quota as required oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:47 (1734015887) === == sanity-benchmark test dbench: dbench ================== 10:04:48 (1734015888) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7588] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg253-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg253-client.virtnet at Thu Dec 12 10:04:51 EST 2024 waiting for dbench pid 10287 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 3 10 3.40 MB/sec warmup 1 sec latency 908.025 ms 20 79 35.31 MB/sec warmup 2 sec latency 217.956 ms 20 136 39.63 MB/sec warmup 3 sec latency 257.821 ms 20 179 36.17 MB/sec warmup 4 sec latency 201.849 ms 20 231 35.44 MB/sec warmup 5 sec latency 182.948 ms 20 287 35.56 MB/sec warmup 6 sec latency 156.445 ms 20 333 34.32 MB/sec warmup 7 sec latency 166.148 ms 20 386 34.15 MB/sec warmup 8 sec latency 166.646 ms 20 447 34.77 MB/sec warmup 9 sec latency 137.924 ms 20 497 34.52 MB/sec warmup 10 sec latency 148.315 ms 20 581 35.81 MB/sec warmup 11 sec latency 156.723 ms 20 663 35.09 MB/sec warmup 12 sec latency 190.965 ms 20 714 32.58 MB/sec warmup 13 sec latency 105.775 ms 20 760 30.41 MB/sec warmup 14 sec latency 109.389 ms 20 812 28.58 MB/sec warmup 15 sec latency 105.167 ms 20 865 26.95 MB/sec warmup 16 sec latency 121.460 ms 20 905 25.49 MB/sec warmup 17 sec latency 131.179 ms 20 929 24.13 MB/sec warmup 18 sec latency 704.522 ms 20 949 22.90 MB/sec warmup 19 sec latency 1292.557 ms 20 1014 22.28 MB/sec warmup 20 sec latency 115.507 ms 20 1075 21.78 MB/sec warmup 21 sec latency 108.459 ms 20 1125 20.83 MB/sec warmup 22 sec latency 163.599 ms 20 1171 19.97 MB/sec warmup 23 sec latency 169.068 ms 20 1271 9.85 MB/sec execute 1 sec latency 131.870 ms 20 1336 14.19 MB/sec execute 2 sec latency 202.562 ms 20 1430 19.73 MB/sec execute 3 sec latency 132.076 ms 20 1473 14.88 MB/sec execute 4 sec latency 116.444 ms 20 1518 12.05 MB/sec execute 5 sec latency 134.900 ms 20 1567 10.20 MB/sec execute 6 sec latency 111.559 ms 20 1624 8.90 MB/sec execute 7 sec latency 120.092 ms 20 1674 7.88 MB/sec execute 8 sec latency 118.528 ms 20 1730 7.09 MB/sec execute 9 sec latency 123.034 ms 20 1801 6.50 MB/sec execute 10 sec latency 92.316 ms 20 1848 5.99 MB/sec execute 11 sec latency 117.469 ms 20 1915 5.57 MB/sec execute 12 sec latency 129.270 ms 20 1982 5.26 MB/sec execute 13 sec latency 113.721 ms 20 2038 5.01 MB/sec execute 14 sec latency 94.571 ms 20 2098 4.78 MB/sec execute 15 sec latency 114.933 ms 20 2140 4.54 MB/sec execute 16 sec latency 142.310 ms 20 2186 4.38 MB/sec execute 17 sec latency 127.030 ms 20 2247 4.58 MB/sec execute 18 sec latency 175.427 ms 20 2284 4.44 MB/sec execute 19 sec latency 458.889 ms 20 2327 4.69 MB/sec execute 20 sec latency 1459.017 ms 20 2372 4.64 MB/sec execute 21 sec latency 1821.909 ms 20 2419 4.56 MB/sec execute 22 sec latency 116.387 ms 20 2464 4.58 MB/sec execute 23 sec latency 138.377 ms 20 2518 4.78 MB/sec execute 24 sec latency 276.849 ms 20 2615 5.10 MB/sec execute 25 sec latency 131.473 ms 20 2760 6.57 MB/sec execute 26 sec latency 115.510 ms 20 2886 7.07 MB/sec execute 27 sec latency 134.515 ms 20 2967 7.45 MB/sec execute 28 sec latency 147.470 ms 20 3064 7.36 MB/sec execute 29 sec latency 122.164 ms 20 3240 7.69 MB/sec execute 30 sec latency 105.423 ms 20 3363 8.17 MB/sec execute 31 sec latency 124.198 ms 20 3489 9.07 MB/sec execute 32 sec latency 82.303 ms 20 3589 9.34 MB/sec execute 33 sec latency 88.567 ms 20 3660 9.18 MB/sec execute 34 sec latency 102.218 ms 20 3718 9.08 MB/sec execute 35 sec latency 111.149 ms 20 3780 9.23 MB/sec execute 36 sec latency 130.722 ms 20 3824 9.02 MB/sec execute 37 sec latency 128.844 ms 20 3870 8.81 MB/sec execute 38 sec latency 99.020 ms 20 3921 8.70 MB/sec execute 39 sec latency 105.397 ms 20 3962 8.49 MB/sec execute 40 sec latency 129.756 ms 20 3991 8.29 MB/sec execute 41 sec latency 222.437 ms 20 4028 8.09 MB/sec execute 42 sec latency 119.106 ms 20 4079 7.91 MB/sec execute 43 sec latency 118.970 ms 20 4143 7.74 MB/sec execute 44 sec latency 115.896 ms 20 4188 7.58 MB/sec execute 45 sec latency 237.435 ms 20 4241 7.47 MB/sec execute 46 sec latency 148.360 ms 20 4297 7.36 MB/sec execute 47 sec latency 105.487 ms 20 4362 7.28 MB/sec execute 48 sec latency 106.709 ms 20 4416 7.18 MB/sec execute 49 sec latency 234.810 ms 20 4478 7.10 MB/sec execute 50 sec latency 90.588 ms 20 4540 7.07 MB/sec execute 51 sec latency 88.182 ms 20 4608 7.15 MB/sec execute 52 sec latency 107.516 ms 20 4698 7.18 MB/sec execute 53 sec latency 89.399 ms 20 4765 7.07 MB/sec execute 54 sec latency 95.810 ms 20 4849 7.17 MB/sec execute 55 sec latency 84.593 ms 20 4972 7.84 MB/sec execute 56 sec latency 85.700 ms 20 5027 7.74 MB/sec execute 57 sec latency 120.893 ms 20 5085 7.62 MB/sec execute 58 sec latency 98.116 ms 20 5140 7.51 MB/sec execute 59 sec latency 92.051 ms 20 5197 7.40 MB/sec execute 60 sec latency 101.425 ms 20 5261 7.30 MB/sec execute 61 sec latency 99.909 ms 20 5315 7.20 MB/sec execute 62 sec latency 93.968 ms 20 5369 7.10 MB/sec execute 63 sec latency 92.956 ms 20 5429 7.00 MB/sec execute 64 sec latency 80.541 ms 20 5512 6.92 MB/sec execute 65 sec latency 87.944 ms 20 5583 6.84 MB/sec execute 66 sec latency 77.582 ms 20 5659 6.77 MB/sec execute 67 sec latency 90.862 ms 20 5737 6.69 MB/sec execute 68 sec latency 74.652 ms 20 5815 6.75 MB/sec execute 69 sec latency 115.125 ms 20 5910 6.82 MB/sec execute 70 sec latency 103.109 ms 20 5967 6.78 MB/sec execute 71 sec latency 95.684 ms 20 6023 6.79 MB/sec execute 72 sec latency 114.101 ms 20 6087 6.79 MB/sec execute 73 sec latency 118.224 ms 20 6225 7.12 MB/sec execute 74 sec latency 92.863 ms 20 6341 7.37 MB/sec execute 75 sec latency 135.005 ms 20 6475 7.62 MB/sec execute 76 sec latency 137.197 ms 20 6602 7.73 MB/sec execute 77 sec latency 98.529 ms 20 6742 7.80 MB/sec execute 78 sec latency 107.010 ms 20 6894 8.04 MB/sec execute 79 sec latency 196.460 ms 20 7017 8.22 MB/sec execute 80 sec latency 87.705 ms 20 7134 8.52 MB/sec execute 81 sec latency 93.690 ms 20 7206 8.47 MB/sec execute 82 sec latency 101.019 ms 20 7278 8.49 MB/sec execute 83 sec latency 94.999 ms 20 7337 8.50 MB/sec execute 84 sec latency 110.347 ms 20 7397 8.44 MB/sec execute 85 sec latency 97.829 ms 20 7457 8.36 MB/sec execute 86 sec latency 92.656 ms 20 7516 8.30 MB/sec execute 87 sec latency 75.651 ms 20 7582 8.20 MB/sec execute 88 sec latency 67.679 ms 20 7645 8.11 MB/sec execute 89 sec latency 136.887 ms 20 7728 8.04 MB/sec execute 90 sec latency 99.887 ms 20 7813 7.99 MB/sec execute 91 sec latency 78.556 ms 20 7875 7.94 MB/sec execute 92 sec latency 94.975 ms 20 7948 7.89 MB/sec execute 93 sec latency 70.391 ms 20 8025 7.84 MB/sec execute 94 sec latency 70.535 ms 20 8093 7.85 MB/sec execute 95 sec latency 90.718 ms 20 8180 7.89 MB/sec execute 96 sec latency 83.777 ms 20 8275 7.87 MB/sec execute 97 sec latency 73.068 ms 20 8377 7.93 MB/sec execute 98 sec latency 66.733 ms 20 8473 8.06 MB/sec execute 99 sec latency 80.232 ms 20 8579 8.24 MB/sec execute 100 sec latency 103.842 ms 20 8644 8.16 MB/sec execute 101 sec latency 86.342 ms 20 8714 8.10 MB/sec execute 102 sec latency 77.483 ms 20 8777 8.03 MB/sec execute 103 sec latency 100.567 ms 20 8849 7.96 MB/sec execute 104 sec latency 104.252 ms 20 8910 7.90 MB/sec execute 105 sec latency 76.046 ms 20 8986 7.83 MB/sec execute 106 sec latency 81.629 ms 20 9061 7.78 MB/sec execute 107 sec latency 88.166 ms 20 9169 7.73 MB/sec execute 108 sec latency 72.455 ms 20 9250 7.68 MB/sec execute 109 sec latency 92.549 ms 20 9357 7.71 MB/sec execute 110 sec latency 68.189 ms 20 9446 7.71 MB/sec execute 111 sec latency 79.202 ms 20 9549 7.76 MB/sec execute 112 sec latency 92.015 ms 20 9643 7.82 MB/sec execute 113 sec latency 100.132 ms 20 9806 8.03 MB/sec execute 114 sec latency 80.447 ms 20 9971 8.30 MB/sec execute 115 sec latency 88.324 ms 20 10178 8.46 MB/sec execute 116 sec latency 67.408 ms 20 10363 8.58 MB/sec execute 117 sec latency 84.209 ms 20 10550 8.82 MB/sec execute 118 sec latency 67.841 ms 20 10680 9.01 MB/sec execute 119 sec latency 77.406 ms 20 cleanup 120 sec 20 cleanup 121 sec 9 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 31805 41.791 237.423 Close 23945 10.767 67.968 Rename 1357 62.114 202.552 Unlink 5855 13.647 102.468 Qpathinfo 29884 10.518 196.430 Qfileinfo 5481 0.231 25.911 Qfsinfo 5299 0.172 24.371 Sfileinfo 2445 43.159 174.569 Find 11677 2.926 154.968 WriteX 16160 5.527 158.453 ReadX 54573 0.036 19.032 LockX 120 11.854 30.619 UnlockX 120 12.162 31.096 Flush 2100 46.527 1821.902 Throughput 9.01417 MB/sec 20 clients 20 procs max_latency=1821.909 ms stopping dbench on /mnt/lustre/d0.oleg253-client.virtnet at Thu Dec 12 10:07:18 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg253-client.virtnet /mnt/lustre/d0.oleg253-client.virtnet /mnt/lustre/d0.oleg253-client.virtnet removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg253-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:24 (1734016044) min OST has 3564000kB available, using 5346000kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7588] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5220] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg253-clien 5220M 78206 61 54248 48 198821 43 2667 240 Latency 31756us 146ms 81391us 8303us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg253-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 290 18 5278 24 401 13 352 17 878 12 544 13 Latency 19743us 34139us 28591us 16264us 5136us 69828us 1.97,1.97,oleg253-client.virtnet,1,1734004807,5220M,,,,78206,61,54248,48,,,198821,43,2667,240,10,,,,,290,18,5278,24,401,13,352,17,878,12,544,13,,31756us,146ms,,81391us,8303us,19743us,34139us,28591us,16264us,5136us,69828us debug=0x33f0484 PASS bonnie (327s) == sanity-benchmark test iozone: iozone ================== 10:12:51 (1734016371) Waiting for MDT destroys to complete oleg253-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg253-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7588] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:00 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 139806 142523 113627 129000 64036 74953 iozone test complete. Waiting for MDT destroys to complete oleg253-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg253-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg253-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg253-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:44 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 80210 76167 88244 88344 89747 77788 iozone test complete. Waiting for MDT destroys to complete oleg253-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg253-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (755s) == sanity-benchmark test fsx: fsx ======================== 10:25:26 (1734017126) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 4954 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 4954 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x137bd fallocating to largest ever: 0x51dbf5 fallocating to largest ever: 0x52626a 001000 1734017129.945996 write 0x23d749 thru 0x24aaf1 (0xd3a9 bytes) 002000 1734017132.733202 read 0x238c86 thru 0x241551 (0x88cc bytes) 003000 1734017135.802331 fallocate 0x33480f thru 0x340c1e (0xc410 bytes) fallocating to largest ever: 0x5285e2 004000 1734017138.860852 fallocate 0x0d2086 thru 0x0d71fa (0x5175 bytes) 006000 1734017145.906245 trunc from 0x1606b3 to 0x2da34d (0x179c9b bytes) 007000 1734017149.157346 mapread 0x13f823 thru 0x1495f1 (0x9dcf bytes) 008000 1734017152.226268 mapwrite 0x0f9807 thru 0x108867 (0xf061 bytes) 009000 1734017155.107514 punch from 0x15e7ad to 0x16528b (0x6adf bytes) 011000 1734017160.939151 trunc from 0x1f8dce to 0x435108 (0x23c33b bytes) 012000 1734017164.291251 mapwrite 0x4ba24d thru 0x4c365c (0x9410 bytes) 013000 1734017167.497809 read 0x047248 thru 0x04bb90 (0x4949 bytes) 014000 1734017170.907807 trunc from 0x4bdf29 to 0x01b301 (0x4a2c27 bytes) 015000 1734017173.846102 read 0x30f72f thru 0x31df5b (0xe82d bytes) 016000 1734017176.777863 punch from 0x06d549 to 0x070b39 (0x35f1 bytes) 017000 1734017180.235946 fallocate 0x22823c thru 0x228971 (0x736 bytes) 018000 1734017183.451512 punch from 0x0ecda3 to 0x0f7ec3 (0xb121 bytes) 019000 1734017186.685271 fallocate 0x0488ac thru 0x04eb30 (0x6285 bytes) 021000 1734017192.409435 trunc from 0x45dade to 0x336f87 (0x126b56 bytes) 022000 1734017195.517266 mapwrite 0x3e97ed thru 0x3f679b (0xcfaf bytes) 023000 1734017198.179913 mapread 0x43d711 thru 0x440d45 (0x3635 bytes) 026000 1734017206.171888 read 0x0bac3b thru 0x0c99e2 (0xeda8 bytes) 027000 1734017208.995924 write 0x39aa4a thru 0x3a4889 (0x9e40 bytes) 031000 1734017220.309160 read 0x3b7a9b thru 0x3b80d6 (0x63c bytes) 032000 1734017223.167191 read 0x0656de thru 0x06eb1d (0x9440 bytes) 033000 1734017226.095002 mapread 0x144b40 thru 0x151a0c (0xcecd bytes) 036000 1734017235.543182 mapwrite 0x283b43 thru 0x28bd93 (0x8251 bytes) 037000 1734017238.613522 mapread 0x1705c5 thru 0x17ce7c (0xc8b8 bytes) 038000 1734017241.363332 read 0x3e02cc thru 0x3eb8e0 (0xb615 bytes) 039000 1734017244.539427 mapread 0x119a08 thru 0x1237d4 (0x9dcd bytes) 041000 1734017250.608923 write 0x01d0dd thru 0x0261b2 (0x90d6 bytes) 042000 1734017253.894193 mapwrite 0x3ee761 thru 0x3fda6b (0xf30b bytes) 043000 1734017257.224910 write 0x02c928 thru 0x0322c0 (0x5999 bytes) 044000 1734017259.848335 write 0x030fbd thru 0x03fd6d (0xedb1 bytes) 045000 1734017262.765804 punch from 0x17e1f5 to 0x18afe1 (0xcded bytes) 047000 1734017268.638964 read 0x07c1b2 thru 0x08286f (0x66be bytes) 048000 1734017271.359578 mapwrite 0x3d971e thru 0x3e45f6 (0xaed9 bytes) 049000 1734017273.781881 punch from 0x3d0c04 to 0x3d9cdc (0x90d9 bytes) 051000 1734017279.103639 read 0x03d66f thru 0x04cae2 (0xf474 bytes) 052000 1734017281.950974 fallocate 0x04f265 thru 0x05bf52 (0xccee bytes) 054000 1734017287.610089 mapwrite 0x1822a5 thru 0x18c564 (0xa2c0 bytes) 056000 1734017293.047581 mapwrite 0x488b30 thru 0x493b92 (0xb063 bytes) 058000 1734017298.450248 trunc from 0x3c0e6e to 0x2b38cc (0x10d5a1 bytes) 059000 1734017301.096743 trunc from 0x189300 to 0x0635b4 (0x125d4b bytes) 060000 1734017304.075504 write 0x11954b thru 0x121252 (0x7d08 bytes) 061000 1734017306.964046 write 0x40dc47 thru 0x412aca (0x4e84 bytes) 062000 1734017309.657491 punch from 0x106bb6 to 0x114e32 (0xe27d bytes) 063000 1734017312.188685 trunc from 0x1ae4f4 to 0x0398b8 (0x174c3b bytes) 065000 1734017316.362195 write 0x307c96 thru 0x30d42a (0x5795 bytes) 070000 1734017329.717353 mapread 0x29b8df thru 0x2a09ca (0x50ec bytes) 071000 1734017332.362588 mapread 0x3a9744 thru 0x3aa774 (0x1031 bytes) 074000 1734017339.827446 mapread 0x32575a thru 0x325950 (0x1f7 bytes) 076000 1734017345.380876 read 0x0ef606 thru 0x0fcf72 (0xd96d bytes) 077000 1734017347.988390 punch from 0x061ffe to 0x0634fc (0x14ff bytes) 079000 1734017353.501482 mapread 0x114da2 thru 0x11bb37 (0x6d96 bytes) skipping zero size write 082000 1734017361.882691 read 0x2a1810 thru 0x2a2a83 (0x1274 bytes) 083000 1734017365.044743 fallocate 0x3c2977 thru 0x3d07f7 (0xde81 bytes) 084000 1734017367.938963 mapread 0x132a9e thru 0x13d075 (0xa5d8 bytes) 085000 1734017370.872434 write 0x1967b5 thru 0x19e350 (0x7b9c bytes) 086000 1734017373.381791 write 0x2d8411 thru 0x2dfa78 (0x7668 bytes) 087000 1734017375.789956 write 0x048474 thru 0x04dd89 (0x5916 bytes) 089000 1734017381.576671 read 0x067eca thru 0x073a3c (0xbb73 bytes) 090000 1734017384.550526 mapread 0x0094bf thru 0x00fe9c (0x69de bytes) 092000 1734017389.992014 mapread 0x3adcee thru 0x3b9d18 (0xc02b bytes) 093000 1734017392.596780 fallocate 0x255645 thru 0x263e3e (0xe7fa bytes) 094000 1734017395.361378 read 0x486ed9 thru 0x48e284 (0x73ac bytes) 096000 1734017400.556861 write 0x23af46 thru 0x23cf0f (0x1fca bytes) 097000 1734017403.036861 mapwrite 0x3dff9a thru 0x3e3309 (0x3370 bytes) 100000 1734017410.903957 fallocate 0x018f68 thru 0x021307 (0x83a0 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2969812 (2904 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 51: 3149824.. 3149875: 52: 0000: net 1: 52.. 63: 3147664.. 3147675: 12: 0000: net 2: 64.. 91: 3149948.. 3149975: 28: 0000: net 3: 92.. 99: 3168652.. 3168659: 8: 0000: net 4: 100.. 103: 3167532.. 3167535: 4: 0000: unwritten,net 5: 104.. 139: 3167252.. 3167287: 36: 0000: net 6: 140.. 143: 3166916.. 3166919: 4: 0000: net 7: 144.. 167: 3167288.. 3167311: 24: 0000: net 8: 176.. 211: 3146888.. 3146923: 36: 0000: net 9: 280.. 299: 3149412.. 3149431: 20: 0000: net 10: 344.. 399: 3169740.. 3169795: 56: 0000: net 11: 400.. 435: 3170004.. 3170039: 36: 0000: net 12: 460.. 475: 3146592.. 3146607: 16: 0000: net 13: 488.. 491: 3169816.. 3169819: 4: 0000: net 14: 552.. 555: 3145756.. 3145759: 4: 0000: unwritten,net 15: 712.. 763: 3147156.. 3147207: 52: 0000: net 16: 776.. 803: 3169820.. 3169847: 28: 0000: net 17: 820.. 839: 3169796.. 3169815: 20: 0000: net 18: 872.. 883: 3145744.. 3145755: 12: 0000: unwritten,net 19: 944.. 947: 3146528.. 3146531: 4: 0000: net 20: 984.. 987: 3169984.. 3169987: 4: 0000: net 21: 1312.. 1351: 3167312.. 3167351: 40: 0000: net 22: 1364.. 1367: 3167372.. 3167375: 4: 0000: net 23: 1472.. 1487: 3146872.. 3146887: 16: 0000: net 24: 1488.. 1491: 3146992.. 3146995: 4: 0000: net 25: 1492.. 1531: 3146240.. 3146279: 40: 0000: net 26: 1532.. 1543: 3146280.. 3146291: 12: 0000: unwritten,net 27: 1720.. 1751: 3169848.. 3169879: 32: 0000: net 28: 1752.. 1791: 3167480.. 3167519: 40: 0000: unwritten,net 29: 2044.. 2063: 3146476.. 3146495: 20: 0000: unwritten,net 30: 2136.. 2183: 3148120.. 3148167: 48: 0000: net 31: 2428.. 2439: 3167520.. 3167531: 12: 0000: unwritten,net 32: 2648.. 2687: 3146816.. 3146855: 40: 0000: last,unwritten,net /mnt/lustre/f0.fsxfile: 32 extents found debug=0x33f0484 PASS fsx (286s) == sanity-benchmark test complete, duration 1555 sec ===== 10:30:12 (1734017412) === sanity-benchmark: start cleanup 10:30:12 (1734017412) === === sanity-benchmark: finish cleanup 10:30:13 (1734017413) ===