-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:04 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:11 (1734015851) === oleg406-client.virtnet: executing check_config_client /mnt/lustre oleg406-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg406-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ab593000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab593000.idle_timeout=debug disable quota as required oleg406-server: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:30 (1734015870) === == sanity-benchmark test dbench: dbench ================== 10:04:31 (1734015871) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7583] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg406-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg406-client.virtnet at Thu Dec 12 10:04:33 EST 2024 waiting for dbench pid 10277 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 5 16 9.33 MB/sec warmup 1 sec latency 906.734 ms 20 98 44.51 MB/sec warmup 2 sec latency 223.290 ms 20 152 42.61 MB/sec warmup 3 sec latency 189.364 ms 20 202 39.64 MB/sec warmup 4 sec latency 164.946 ms 20 264 39.63 MB/sec warmup 5 sec latency 175.605 ms 20 318 38.54 MB/sec warmup 6 sec latency 135.454 ms 20 375 38.08 MB/sec warmup 7 sec latency 134.246 ms 20 441 38.62 MB/sec warmup 8 sec latency 129.592 ms 20 504 38.84 MB/sec warmup 9 sec latency 131.341 ms 20 622 41.45 MB/sec warmup 10 sec latency 154.290 ms 20 679 38.29 MB/sec warmup 11 sec latency 125.066 ms 20 726 35.29 MB/sec warmup 12 sec latency 109.086 ms 20 777 32.74 MB/sec warmup 13 sec latency 114.991 ms 20 818 30.57 MB/sec warmup 14 sec latency 124.305 ms 20 870 28.70 MB/sec warmup 15 sec latency 131.709 ms 20 908 27.03 MB/sec warmup 16 sec latency 124.197 ms 20 943 25.53 MB/sec warmup 17 sec latency 567.622 ms 20 998 24.60 MB/sec warmup 18 sec latency 184.029 ms 20 1070 24.03 MB/sec warmup 19 sec latency 109.796 ms 20 1141 22.91 MB/sec warmup 20 sec latency 96.442 ms 20 1201 21.88 MB/sec warmup 21 sec latency 94.407 ms 20 1256 21.06 MB/sec warmup 22 sec latency 114.458 ms 20 1363 21.81 MB/sec warmup 23 sec latency 117.429 ms 20 1492 0.62 MB/sec execute 1 sec latency 149.925 ms 20 1551 0.89 MB/sec execute 2 sec latency 99.604 ms 20 1617 1.00 MB/sec execute 3 sec latency 115.670 ms 20 1677 0.99 MB/sec execute 4 sec latency 107.750 ms 20 1746 1.02 MB/sec execute 5 sec latency 111.338 ms 20 1822 1.06 MB/sec execute 6 sec latency 90.408 ms 20 1874 1.03 MB/sec execute 7 sec latency 109.279 ms 20 1956 1.08 MB/sec execute 8 sec latency 97.422 ms 20 2008 1.11 MB/sec execute 9 sec latency 107.161 ms 20 2079 1.23 MB/sec execute 10 sec latency 96.480 ms 20 2150 1.23 MB/sec execute 11 sec latency 82.292 ms 20 2204 1.32 MB/sec execute 12 sec latency 92.617 ms 20 2290 2.17 MB/sec execute 13 sec latency 107.904 ms 20 2367 2.70 MB/sec execute 14 sec latency 153.987 ms 20 2415 2.71 MB/sec execute 15 sec latency 102.324 ms 20 2467 2.98 MB/sec execute 16 sec latency 118.875 ms 20 2548 3.36 MB/sec execute 17 sec latency 120.921 ms 20 2614 3.69 MB/sec execute 18 sec latency 154.308 ms 20 2696 5.02 MB/sec execute 19 sec latency 749.111 ms 20 2772 5.95 MB/sec execute 20 sec latency 1752.476 ms 20 2909 6.69 MB/sec execute 21 sec latency 1973.056 ms 20 2991 6.81 MB/sec execute 22 sec latency 131.872 ms 20 3137 6.93 MB/sec execute 23 sec latency 166.103 ms 20 3270 7.57 MB/sec execute 24 sec latency 124.734 ms 20 3373 7.55 MB/sec execute 25 sec latency 100.982 ms 20 3541 9.51 MB/sec execute 26 sec latency 111.435 ms 20 3624 9.30 MB/sec execute 27 sec latency 73.177 ms 20 3686 9.08 MB/sec execute 28 sec latency 93.950 ms 20 3732 8.99 MB/sec execute 29 sec latency 201.683 ms 20 3787 9.15 MB/sec execute 30 sec latency 147.834 ms 20 3823 8.86 MB/sec execute 31 sec latency 143.089 ms 20 3869 8.59 MB/sec execute 32 sec latency 99.740 ms 20 3920 8.50 MB/sec execute 33 sec latency 145.040 ms 20 3951 8.25 MB/sec execute 34 sec latency 262.892 ms 20 3987 8.02 MB/sec execute 35 sec latency 278.385 ms 20 4025 7.79 MB/sec execute 36 sec latency 122.583 ms 20 4069 7.59 MB/sec execute 37 sec latency 109.821 ms 20 4154 7.40 MB/sec execute 38 sec latency 91.312 ms 20 4218 7.27 MB/sec execute 39 sec latency 202.824 ms 20 4255 7.13 MB/sec execute 40 sec latency 199.459 ms 20 4305 7.02 MB/sec execute 41 sec latency 123.640 ms 20 4358 6.91 MB/sec execute 42 sec latency 128.133 ms 20 4420 6.82 MB/sec execute 43 sec latency 102.539 ms 20 4470 6.72 MB/sec execute 44 sec latency 123.485 ms 20 4524 6.62 MB/sec execute 45 sec latency 103.282 ms 20 4578 6.67 MB/sec execute 46 sec latency 117.592 ms 20 4666 6.82 MB/sec execute 47 sec latency 119.810 ms 20 4731 6.71 MB/sec execute 48 sec latency 110.087 ms 20 4786 6.59 MB/sec execute 49 sec latency 94.185 ms 20 4859 6.73 MB/sec execute 50 sec latency 123.447 ms 20 4962 7.43 MB/sec execute 51 sec latency 134.983 ms 20 5015 7.35 MB/sec execute 52 sec latency 127.437 ms 20 5062 7.22 MB/sec execute 53 sec latency 135.383 ms 20 5122 7.11 MB/sec execute 54 sec latency 116.769 ms 20 5166 6.99 MB/sec execute 55 sec latency 102.091 ms 20 5229 6.89 MB/sec execute 56 sec latency 116.427 ms 20 5278 6.78 MB/sec execute 57 sec latency 103.774 ms 20 5331 6.68 MB/sec execute 58 sec latency 100.281 ms 20 5369 6.58 MB/sec execute 59 sec latency 94.215 ms 20 5406 6.48 MB/sec execute 60 sec latency 106.285 ms 20 5476 6.40 MB/sec execute 61 sec latency 120.441 ms 20 5556 6.31 MB/sec execute 62 sec latency 129.867 ms 20 5604 6.24 MB/sec execute 63 sec latency 107.475 ms 20 5683 6.17 MB/sec execute 64 sec latency 113.961 ms 20 5730 6.09 MB/sec execute 65 sec latency 105.873 ms 20 5797 6.04 MB/sec execute 66 sec latency 97.116 ms 20 5888 6.22 MB/sec execute 67 sec latency 102.797 ms 20 5951 6.19 MB/sec execute 68 sec latency 103.939 ms 20 5991 6.14 MB/sec execute 69 sec latency 115.310 ms 20 6054 6.22 MB/sec execute 70 sec latency 105.451 ms 20 6141 6.21 MB/sec execute 71 sec latency 120.051 ms 20 6296 6.84 MB/sec execute 72 sec latency 95.332 ms 20 6455 7.18 MB/sec execute 73 sec latency 97.508 ms 20 6535 7.18 MB/sec execute 74 sec latency 140.608 ms 20 6699 7.23 MB/sec execute 75 sec latency 95.430 ms 20 6866 7.43 MB/sec execute 76 sec latency 130.437 ms 20 6986 7.73 MB/sec execute 77 sec latency 84.787 ms 20 7100 8.04 MB/sec execute 78 sec latency 131.528 ms 20 7182 8.02 MB/sec execute 79 sec latency 72.886 ms 20 7241 7.95 MB/sec execute 80 sec latency 84.434 ms 20 7316 8.06 MB/sec execute 81 sec latency 121.404 ms 20 7361 8.01 MB/sec execute 82 sec latency 162.022 ms 20 7407 7.91 MB/sec execute 83 sec latency 112.810 ms 20 7461 7.88 MB/sec execute 84 sec latency 90.374 ms 20 7508 7.80 MB/sec execute 85 sec latency 99.468 ms 20 7550 7.70 MB/sec execute 86 sec latency 128.108 ms 20 7582 7.62 MB/sec execute 87 sec latency 163.429 ms 20 7623 7.53 MB/sec execute 88 sec latency 118.858 ms 20 7704 7.46 MB/sec execute 89 sec latency 124.020 ms 20 7763 7.40 MB/sec execute 90 sec latency 196.671 ms 20 7809 7.34 MB/sec execute 91 sec latency 160.965 ms 20 7869 7.29 MB/sec execute 92 sec latency 105.645 ms 20 7931 7.24 MB/sec execute 93 sec latency 89.975 ms 20 7993 7.20 MB/sec execute 94 sec latency 92.112 ms 20 8047 7.15 MB/sec execute 95 sec latency 104.410 ms 20 8108 7.17 MB/sec execute 96 sec latency 96.985 ms 20 8195 7.22 MB/sec execute 97 sec latency 89.205 ms 20 8270 7.18 MB/sec execute 98 sec latency 81.017 ms 20 8338 7.12 MB/sec execute 99 sec latency 87.613 ms 20 8452 7.41 MB/sec execute 100 sec latency 91.914 ms 20 8550 7.56 MB/sec execute 101 sec latency 78.552 ms 20 8610 7.50 MB/sec execute 102 sec latency 126.648 ms 20 8671 7.44 MB/sec execute 103 sec latency 89.103 ms 20 8731 7.38 MB/sec execute 104 sec latency 83.742 ms 20 8800 7.32 MB/sec execute 105 sec latency 107.499 ms 20 8869 7.26 MB/sec execute 106 sec latency 87.586 ms 20 8933 7.20 MB/sec execute 107 sec latency 70.286 ms 20 9032 7.15 MB/sec execute 108 sec latency 97.465 ms 20 9111 7.10 MB/sec execute 109 sec latency 78.755 ms 20 9215 7.06 MB/sec execute 110 sec latency 69.518 ms 20 9325 7.04 MB/sec execute 111 sec latency 50.638 ms 20 9465 7.15 MB/sec execute 112 sec latency 62.777 ms 20 9535 7.13 MB/sec execute 113 sec latency 81.851 ms 20 9642 7.19 MB/sec execute 114 sec latency 69.404 ms 20 9811 7.50 MB/sec execute 115 sec latency 77.780 ms 20 10004 7.79 MB/sec execute 116 sec latency 88.888 ms 20 10141 7.84 MB/sec execute 117 sec latency 82.441 ms 20 10321 7.92 MB/sec execute 118 sec latency 141.393 ms 20 10494 8.12 MB/sec execute 119 sec latency 77.752 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 30812 43.674 278.379 Close 23083 11.005 86.119 Rename 1280 65.336 185.907 Unlink 5722 13.796 74.233 Qpathinfo 29026 10.619 145.963 Qfileinfo 5335 0.177 21.223 Qfsinfo 5079 0.191 52.202 Sfileinfo 2320 45.063 199.447 Find 11360 2.409 168.740 WriteX 15793 5.535 97.296 ReadX 51963 0.027 13.122 LockX 120 11.027 31.905 UnlockX 120 10.709 38.796 Flush 2100 49.660 1973.049 Throughput 8.11751 MB/sec 20 clients 20 procs max_latency=1973.056 ms stopping dbench on /mnt/lustre/d0.oleg406-client.virtnet at Thu Dec 12 10:07:00 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg406-client.virtnet /mnt/lustre/d0.oleg406-client.virtnet /mnt/lustre/d0.oleg406-client.virtnet removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg406-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:08 (1734016028) min OST has 3565960kB available, using 5348940kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7583] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5223] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg406-clien 5223M 73877 61 48483 43 123709 30 2196 229 Latency 33551us 164ms 142ms 74778us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg406-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 259 19 6195 27 343 13 289 18 841 12 372 14 Latency 17572us 20406us 34196us 24964us 6001us 24051us 1.97,1.97,oleg406-client.virtnet,1,1734004850,5223M,,,,73877,61,48483,43,,,123709,30,2196,229,10,,,,,259,19,6195,27,343,13,289,18,841,12,372,14,,33551us,164ms,,142ms,74778us,17572us,20406us,34196us,24964us,6001us,24051us debug=0x33f0484 PASS bonnie (384s) == sanity-benchmark test iozone: iozone ================== 10:13:32 (1734016412) Waiting for MDT destroys to complete oleg406-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg406-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7583] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:44 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 222165 127224 107421 117493 45873 92306 iozone test complete. Waiting for MDT destroys to complete oleg406-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg406-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg406-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 oleg406-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:45 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 66105 69263 71567 74451 77953 72056 iozone test complete. Waiting for MDT destroys to complete oleg406-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg406-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (840s) == sanity-benchmark test fsx: fsx ======================== 10:27:32 (1734017252) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 16241 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 16241 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole skipping zero size read skipping zero size read skipping zero size read fallocating to largest ever: 0x32c35b fallocating to largest ever: 0x33971a truncating to largest ever: 0x47bf1d fallocating to largest ever: 0x4caa41 truncating to largest ever: 0x525ca4 fallocating to largest ever: 0x5278ad fallocating to largest ever: 0x5285e2 001000 1734017256.152822 write 0x4e02c3 thru 0x4e8d45 (0x8a83 bytes) 002000 1734017259.458919 punch from 0x0d811c to 0x0de9cc (0x68b1 bytes) 003000 1734017262.684915 read 0x00216c thru 0x010823 (0xe6b8 bytes) 004000 1734017266.279522 fallocate 0x2ba8c2 thru 0x2c877f (0xdebe bytes) 005000 1734017269.782339 write 0x24e6b8 thru 0x257cd1 (0x961a bytes) 006000 1734017272.661305 write 0x305344 thru 0x307b93 (0x2850 bytes) 007000 1734017276.137191 punch from 0x28c410 to 0x297ecd (0xbabe bytes) skipping zero size read 009000 1734017282.750697 write 0x2422ce thru 0x250b8e (0xe8c1 bytes) 012000 1734017292.523027 mapread 0x29d2da thru 0x2a48d3 (0x75fa bytes) 013000 1734017296.139003 trunc from 0x3520bb to 0x0b9cc3 (0x2983f7 bytes) 014000 1734017299.631834 mapread 0x096be4 thru 0x09ef85 (0x83a2 bytes) 015000 1734017302.709114 mapwrite 0x10bd3c thru 0x10f2fe (0x35c3 bytes) 016000 1734017305.717648 write 0x289323 thru 0x290947 (0x7625 bytes) 017000 1734017308.852266 fallocate 0x437899 thru 0x4415b9 (0x9d21 bytes) 018000 1734017311.695190 trunc from 0x3cdf4c to 0x43c9f8 (0x6eaad bytes) 019000 1734017314.974083 fallocate 0x044200 thru 0x04f91c (0xb71d bytes) 020000 1734017318.065467 write 0x4652e2 thru 0x46a803 (0x5522 bytes) 021000 1734017321.580119 fallocate 0x33430d thru 0x33bf4f (0x7c43 bytes) 023000 1734017328.791342 mapwrite 0x1639d7 thru 0x166aab (0x30d5 bytes) 025000 1734017336.243607 mapwrite 0x3605a0 thru 0x36276a (0x21cb bytes) 027000 1734017343.022720 mapwrite 0x45e370 thru 0x46e1d2 (0xfe63 bytes) 028000 1734017346.705326 punch from 0x0fc2dc to 0x105763 (0x9488 bytes) 029000 1734017350.287067 fallocate 0x4c128c thru 0x4c464a (0x33bf bytes) 030000 1734017353.619806 write 0x1cce40 thru 0x1d7f37 (0xb0f8 bytes) 032000 1734017361.158630 fallocate 0x2d0ea2 thru 0x2da3d7 (0x9536 bytes) 033000 1734017365.268546 punch from 0x018bd1 to 0x0216d0 (0x8b00 bytes) 034000 1734017368.835961 punch from 0x059e54 to 0x05f08a (0x5237 bytes) 035000 1734017372.157748 read 0x0fbd2e thru 0x1088bc (0xcb8f bytes) 037000 1734017378.960884 mapwrite 0x2e4a0c thru 0x2f32ce (0xe8c3 bytes) 038000 1734017382.628439 write 0x227fb1 thru 0x23346b (0xb4bb bytes) 039000 1734017386.190407 mapwrite 0x46f755 thru 0x471e52 (0x26fe bytes) 040000 1734017389.705448 write 0x4fc56c thru 0x4feacc (0x2561 bytes) 041000 1734017393.048984 trunc from 0x5285e2 to 0x26e807 (0x2b9dda bytes) 043000 1734017400.347849 trunc from 0x4b9b75 to 0x0c4371 (0x3f5803 bytes) 044000 1734017403.938964 read 0x1e2d1a thru 0x1e5790 (0x2a77 bytes) 046000 1734017410.452071 mapread 0x150071 thru 0x150d30 (0xcc0 bytes) 048000 1734017416.888469 mapwrite 0x05eb52 thru 0x06cada (0xdf89 bytes) 049000 1734017419.948856 write 0x3d2d3c thru 0x3d4db9 (0x207e bytes) 050000 1734017423.199375 write 0x1ed217 thru 0x1ee613 (0x13fd bytes) 052000 1734017429.368809 punch from 0x293d8b to 0x297218 (0x348e bytes) 054000 1734017435.894772 write 0x00e277 thru 0x0131b2 (0x4f3c bytes) 056000 1734017441.032116 read 0x38f435 thru 0x395eac (0x6a78 bytes) 058000 1734017446.469199 read 0x243d25 thru 0x251625 (0xd901 bytes) 060000 1734017451.710472 write 0x0a5619 thru 0x0a6c21 (0x1609 bytes) 061000 1734017454.541760 write 0x11df4b thru 0x12aa8c (0xcb42 bytes) 063000 1734017459.957537 mapread 0x00549c thru 0x0089ad (0x3512 bytes) 065000 1734017465.735328 mapwrite 0x129423 thru 0x130bdb (0x77b9 bytes) 066000 1734017468.218411 mapwrite 0x251e57 thru 0x252a93 (0xc3d bytes) 067000 1734017471.238752 mapread 0x3d5429 thru 0x3e5132 (0xfd0a bytes) 069000 1734017476.198005 fallocate 0x134d91 thru 0x14157d (0xc7ed bytes) 071000 1734017481.833919 read 0x110efa thru 0x11dbfb (0xcd02 bytes) 072000 1734017484.839816 write 0x4f2bc9 thru 0x4fe569 (0xb9a1 bytes) 074000 1734017491.048833 mapread 0x11b4a9 thru 0x126630 (0xb188 bytes) 075000 1734017493.970510 punch from 0x14e4f9 to 0x15c674 (0xe17c bytes) 077000 1734017500.405145 fallocate 0x3ed11d thru 0x3ee890 (0x1774 bytes) 078000 1734017503.276363 punch from 0x087c0e to 0x09650d (0xe900 bytes) 081000 1734017512.274018 fallocate 0x4e9664 thru 0x4f0c5d (0x75fa bytes) 082000 1734017515.326384 mapwrite 0x2c8e83 thru 0x2cc740 (0x38be bytes) 083000 1734017518.661603 read 0x08f13b thru 0x094451 (0x5317 bytes) 084000 1734017521.890913 trunc from 0x2ade53 to 0x3adf07 (0x1000b5 bytes) 085000 1734017524.896609 punch from 0x088b25 to 0x090cb9 (0x8195 bytes) 086000 1734017527.935914 mapread 0x392a50 thru 0x394af6 (0x20a7 bytes) 087000 1734017531.121804 mapread 0x32500f thru 0x331c2a (0xcc1c bytes) 089000 1734017537.732408 fallocate 0x3d9732 thru 0x3e0f2f (0x77fe bytes) 091000 1734017544.097637 write 0x00f948 thru 0x01db83 (0xe23c bytes) 092000 1734017548.083207 read 0x3acf9b thru 0x3bc582 (0xf5e8 bytes) 094000 1734017555.185014 punch from 0x3ac0aa to 0x3ac742 (0x699 bytes) 095000 1734017557.805734 mapwrite 0x414326 thru 0x41f814 (0xb4ef bytes) 096000 1734017560.732079 punch from 0x215b51 to 0x21df11 (0x83c1 bytes) 098000 1734017566.402487 read 0x1eb5f4 thru 0x1fa477 (0xee84 bytes) 099000 1734017569.224445 mapread 0x4cc294 thru 0x4d2ad1 (0x683e bytes) 100000 1734017571.741490 punch from 0x148309 to 0x1532cf (0xafc7 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 1994782 (1952 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3674112.. 3674115: 4: 0000: net 1: 4.. 7: 4069272.. 4069275: 4: 0000: net 2: 8.. 43: 4069288.. 4069323: 36: 0000: net 3: 44.. 51: 4064396.. 4064403: 8: 0000: net 4: 620.. 651: 4074364.. 4074395: 32: 0000: unwritten,net 5: 1124.. 1131: 4074320.. 4074327: 8: 0000: last,unwritten,net /mnt/lustre/f0.fsxfile: 6 extents found debug=0x33f0484 PASS fsx (320s) == sanity-benchmark test complete, duration 1728 sec ===== 10:32:52 (1734017572) === sanity-benchmark: start cleanup 10:32:53 (1734017573) === === sanity-benchmark: finish cleanup 10:32:54 (1734017574) ===