-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:06 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:14 (1734015854) === oleg434-client.virtnet: executing check_config_client /mnt/lustre oleg434-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg434-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b600c800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b600c800.idle_timeout=debug disable quota as required oleg434-server: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:37 (1734015877) === == sanity-benchmark test dbench: dbench ================== 10:04:38 (1734015878) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7563] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg434-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg434-client.virtnet at Thu Dec 12 10:04:41 EST 2024 waiting for dbench pid 10261 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 2 8 2.07 MB/sec warmup 1 sec latency 853.793 ms 20 72 31.44 MB/sec warmup 2 sec latency 211.409 ms 20 135 39.53 MB/sec warmup 3 sec latency 234.589 ms 20 177 35.85 MB/sec warmup 4 sec latency 183.845 ms 20 224 34.49 MB/sec warmup 5 sec latency 162.120 ms 20 274 34.16 MB/sec warmup 6 sec latency 163.640 ms 20 316 32.96 MB/sec warmup 7 sec latency 161.270 ms 20 370 32.96 MB/sec warmup 8 sec latency 127.900 ms 20 422 33.02 MB/sec warmup 9 sec latency 190.328 ms 20 472 32.98 MB/sec warmup 10 sec latency 162.164 ms 20 521 32.80 MB/sec warmup 11 sec latency 163.663 ms 20 614 34.55 MB/sec warmup 12 sec latency 198.403 ms 20 675 32.51 MB/sec warmup 13 sec latency 155.993 ms 20 717 30.31 MB/sec warmup 14 sec latency 133.955 ms 20 757 28.42 MB/sec warmup 15 sec latency 139.217 ms 20 795 26.78 MB/sec warmup 16 sec latency 131.648 ms 20 854 25.35 MB/sec warmup 17 sec latency 109.877 ms 20 892 24.06 MB/sec warmup 18 sec latency 122.945 ms 20 908 22.86 MB/sec warmup 19 sec latency 1012.798 ms 20 912 21.73 MB/sec warmup 20 sec latency 2014.286 ms 20 937 20.71 MB/sec warmup 21 sec latency 2642.188 ms 20 976 19.89 MB/sec warmup 22 sec latency 151.361 ms 20 1042 19.76 MB/sec warmup 23 sec latency 109.828 ms 20 1150 1.08 MB/sec execute 1 sec latency 126.883 ms 20 1205 1.04 MB/sec execute 2 sec latency 144.698 ms 20 1245 0.93 MB/sec execute 3 sec latency 162.807 ms 20 1367 13.10 MB/sec execute 4 sec latency 152.236 ms 20 1424 11.70 MB/sec execute 5 sec latency 107.069 ms 20 1484 10.32 MB/sec execute 6 sec latency 97.036 ms 20 1546 9.00 MB/sec execute 7 sec latency 83.956 ms 20 1604 8.01 MB/sec execute 8 sec latency 105.434 ms 20 1662 7.25 MB/sec execute 9 sec latency 110.275 ms 20 1726 6.62 MB/sec execute 10 sec latency 106.334 ms 20 1796 6.13 MB/sec execute 11 sec latency 104.338 ms 20 1844 5.67 MB/sec execute 12 sec latency 107.606 ms 20 1899 5.32 MB/sec execute 13 sec latency 126.767 ms 20 1978 5.03 MB/sec execute 14 sec latency 104.990 ms 20 2030 4.82 MB/sec execute 15 sec latency 89.115 ms 20 2088 4.61 MB/sec execute 16 sec latency 118.009 ms 20 2146 4.40 MB/sec execute 17 sec latency 109.434 ms 20 2182 4.22 MB/sec execute 18 sec latency 124.736 ms 20 2253 4.24 MB/sec execute 19 sec latency 113.721 ms 20 2312 4.76 MB/sec execute 20 sec latency 628.829 ms 20 2372 4.75 MB/sec execute 21 sec latency 106.660 ms 20 2411 4.63 MB/sec execute 22 sec latency 132.635 ms 20 2453 4.59 MB/sec execute 23 sec latency 130.373 ms 20 2522 4.87 MB/sec execute 24 sec latency 130.334 ms 20 2585 4.91 MB/sec execute 25 sec latency 272.796 ms 20 2741 6.52 MB/sec execute 26 sec latency 108.451 ms 20 2892 7.29 MB/sec execute 27 sec latency 98.687 ms 20 2980 7.49 MB/sec execute 28 sec latency 123.196 ms 20 3139 7.62 MB/sec execute 29 sec latency 119.946 ms 20 3255 8.02 MB/sec execute 30 sec latency 140.113 ms 20 3360 8.08 MB/sec execute 31 sec latency 127.037 ms 20 3514 9.45 MB/sec execute 32 sec latency 87.884 ms 20 3607 9.44 MB/sec execute 33 sec latency 85.489 ms 20 3678 9.28 MB/sec execute 34 sec latency 95.392 ms 20 3737 9.29 MB/sec execute 35 sec latency 176.134 ms 20 3789 9.28 MB/sec execute 36 sec latency 143.957 ms 20 3826 9.08 MB/sec execute 37 sec latency 142.059 ms 20 3871 8.86 MB/sec execute 38 sec latency 89.244 ms 20 3921 8.75 MB/sec execute 39 sec latency 104.550 ms 20 3959 8.55 MB/sec execute 40 sec latency 172.980 ms 20 3986 8.34 MB/sec execute 41 sec latency 207.000 ms 20 4023 8.14 MB/sec execute 42 sec latency 124.350 ms 20 4063 7.96 MB/sec execute 43 sec latency 102.950 ms 20 4117 7.78 MB/sec execute 44 sec latency 142.120 ms 20 4179 7.63 MB/sec execute 45 sec latency 155.406 ms 20 4226 7.51 MB/sec execute 46 sec latency 158.155 ms 20 4278 7.40 MB/sec execute 47 sec latency 126.567 ms 20 4327 7.29 MB/sec execute 48 sec latency 130.695 ms 20 4379 7.19 MB/sec execute 49 sec latency 94.887 ms 20 4439 7.11 MB/sec execute 50 sec latency 106.272 ms 20 4480 7.02 MB/sec execute 51 sec latency 119.676 ms 20 4529 6.91 MB/sec execute 52 sec latency 121.307 ms 20 4597 7.06 MB/sec execute 53 sec latency 94.124 ms 20 4672 7.08 MB/sec execute 54 sec latency 122.592 ms 20 4729 6.97 MB/sec execute 55 sec latency 141.188 ms 20 4786 6.86 MB/sec execute 56 sec latency 104.034 ms 20 4849 6.92 MB/sec execute 57 sec latency 117.003 ms 20 4943 7.49 MB/sec execute 58 sec latency 181.955 ms 20 4995 7.51 MB/sec execute 59 sec latency 167.548 ms 20 5040 7.40 MB/sec execute 60 sec latency 110.031 ms 20 5087 7.29 MB/sec execute 61 sec latency 114.007 ms 20 5131 7.18 MB/sec execute 62 sec latency 118.228 ms 20 5170 7.08 MB/sec execute 63 sec latency 113.141 ms 20 5223 6.98 MB/sec execute 64 sec latency 105.776 ms 20 5273 6.89 MB/sec execute 65 sec latency 132.447 ms 20 5329 6.80 MB/sec execute 66 sec latency 104.286 ms 20 5369 6.71 MB/sec execute 67 sec latency 111.016 ms 20 5408 6.62 MB/sec execute 68 sec latency 106.826 ms 20 5473 6.54 MB/sec execute 69 sec latency 112.811 ms 20 5545 6.46 MB/sec execute 70 sec latency 105.354 ms 20 5588 6.39 MB/sec execute 71 sec latency 128.555 ms 20 5647 6.33 MB/sec execute 72 sec latency 116.046 ms 20 5705 6.26 MB/sec execute 73 sec latency 102.539 ms 20 5742 6.19 MB/sec execute 74 sec latency 148.645 ms 20 5798 6.15 MB/sec execute 75 sec latency 148.451 ms 20 5891 6.29 MB/sec execute 76 sec latency 111.213 ms 20 5942 6.26 MB/sec execute 77 sec latency 117.390 ms 20 5988 6.22 MB/sec execute 78 sec latency 107.960 ms 20 6055 6.28 MB/sec execute 79 sec latency 99.634 ms 20 6144 6.31 MB/sec execute 80 sec latency 113.647 ms 20 6292 6.78 MB/sec execute 81 sec latency 111.557 ms 20 6445 7.07 MB/sec execute 82 sec latency 100.180 ms 20 6545 7.15 MB/sec execute 83 sec latency 94.950 ms 20 6715 7.21 MB/sec execute 84 sec latency 111.494 ms 20 6849 7.37 MB/sec execute 85 sec latency 227.298 ms 20 6987 7.62 MB/sec execute 86 sec latency 91.344 ms 20 7104 7.92 MB/sec execute 87 sec latency 94.983 ms 20 7186 7.90 MB/sec execute 88 sec latency 82.475 ms 20 7252 7.87 MB/sec execute 89 sec latency 91.896 ms 20 7319 7.94 MB/sec execute 90 sec latency 130.931 ms 20 7369 7.89 MB/sec execute 91 sec latency 133.156 ms 20 7419 7.82 MB/sec execute 92 sec latency 93.129 ms 20 7474 7.78 MB/sec execute 93 sec latency 96.279 ms 20 7525 7.70 MB/sec execute 94 sec latency 99.454 ms 20 7568 7.62 MB/sec execute 95 sec latency 132.494 ms 20 7607 7.54 MB/sec execute 96 sec latency 157.606 ms 20 7672 7.47 MB/sec execute 97 sec latency 109.001 ms 20 7759 7.41 MB/sec execute 98 sec latency 134.725 ms 20 7830 7.37 MB/sec execute 99 sec latency 110.966 ms 20 7893 7.33 MB/sec execute 100 sec latency 81.422 ms 20 7966 7.29 MB/sec execute 101 sec latency 87.474 ms 20 8038 7.26 MB/sec execute 102 sec latency 82.583 ms 20 8112 7.26 MB/sec execute 103 sec latency 94.820 ms 20 8224 7.35 MB/sec execute 104 sec latency 73.794 ms 20 8306 7.29 MB/sec execute 105 sec latency 79.094 ms 20 8410 7.39 MB/sec execute 106 sec latency 87.873 ms 20 8544 7.71 MB/sec execute 107 sec latency 94.785 ms 20 8607 7.65 MB/sec execute 108 sec latency 96.229 ms 20 8672 7.59 MB/sec execute 109 sec latency 86.480 ms 20 8715 7.53 MB/sec execute 110 sec latency 131.371 ms 20 8785 7.47 MB/sec execute 111 sec latency 100.817 ms 20 8839 7.41 MB/sec execute 112 sec latency 116.666 ms 20 8904 7.36 MB/sec execute 113 sec latency 80.601 ms 20 8959 7.30 MB/sec execute 114 sec latency 99.555 ms 20 9044 7.25 MB/sec execute 115 sec latency 107.135 ms 20 9121 7.20 MB/sec execute 116 sec latency 86.343 ms 20 9194 7.16 MB/sec execute 117 sec latency 85.770 ms 20 9279 7.12 MB/sec execute 118 sec latency 79.567 ms 20 9364 7.11 MB/sec execute 119 sec latency 97.956 ms 20 cleanup 120 sec 20 cleanup 121 sec 2 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 29371 45.952 293.290 Close 22149 11.797 112.877 Rename 1182 67.649 175.009 Unlink 5359 14.546 59.413 Qpathinfo 27796 11.127 204.811 Qfileinfo 4760 0.245 46.410 Qfsinfo 4358 0.220 46.961 Sfileinfo 2377 47.208 259.836 Find 10049 3.453 115.926 WriteX 14195 5.968 130.526 ReadX 43911 0.037 12.989 LockX 80 12.616 32.250 UnlockX 80 11.666 27.935 Flush 1868 45.417 628.822 Throughput 7.11299 MB/sec 20 clients 20 procs max_latency=628.829 ms stopping dbench on /mnt/lustre/d0.oleg434-client.virtnet at Thu Dec 12 10:07:07 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg434-client.virtnet /mnt/lustre/d0.oleg434-client.virtnet /mnt/lustre/d0.oleg434-client.virtnet removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg434-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:15 (1734016035) min OST has 3588564kB available, using 5382846kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7563] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5256] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg434-clien 5256M 71787 60 47754 44 151046 35 2788 250 Latency 21981us 360ms 196ms 10380us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg434-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 259 18 5866 25 317 13 305 18 757 12 411 14 Latency 27601us 24727us 40539us 24263us 6605us 62513us 1.97,1.97,oleg434-client.virtnet,1,1734004845,5256M,,,,71787,60,47754,44,,,151046,35,2788,250,10,,,,,259,18,5866,25,317,13,305,18,757,12,411,14,,21981us,360ms,,196ms,10380us,27601us,24727us,40539us,24263us,6605us,62513us debug=0x33f0484 PASS bonnie (382s) == sanity-benchmark test iozone: iozone ================== 10:13:37 (1734016417) Waiting for MDT destroys to complete oleg434-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg434-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7563] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:46 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 180312 110007 97308 108802 56187 114831 iozone test complete. Waiting for MDT destroys to complete oleg434-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 oleg434-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg434-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg434-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:40 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 61631 71490 77558 76672 84489 72524 iozone test complete. Waiting for MDT destroys to complete oleg434-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg434-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (814s) == sanity-benchmark test fsx: fsx ======================== 10:27:12 (1734017232) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 8481 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 8481 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x244d0a fallocating to largest ever: 0x3f5595 fallocating to largest ever: 0x45dd2c fallocating to largest ever: 0x49e4fa fallocating to largest ever: 0x51c422 fallocating to largest ever: 0x522bd0 002000 1734017238.475114 fallocate 0x0996f7 thru 0x09c990 (0x329a bytes) truncating to largest ever: 0x526b93 fallocating to largest ever: 0x5274b6 fallocating to largest ever: 0x5277de fallocating to largest ever: 0x5285e2 004000 1734017244.342915 read 0x192543 thru 0x1a0ed7 (0xe995 bytes) 005000 1734017247.280363 mapread 0x18bef8 thru 0x194546 (0x864f bytes) 006000 1734017250.264115 write 0x18b982 thru 0x18c860 (0xedf bytes) 008000 1734017256.767241 punch from 0x385524 to 0x3934aa (0xdf87 bytes) 010000 1734017262.707182 write 0x489d7e thru 0x493992 (0x9c15 bytes) 011000 1734017265.757951 read 0x02e55d thru 0x03428c (0x5d30 bytes) 013000 1734017272.338799 fallocate 0x1b2ef8 thru 0x1b68ff (0x3a08 bytes) 014000 1734017275.385846 trunc from 0x4f07ab to 0x3cf646 (0x121164 bytes) 015000 1734017278.077156 trunc from 0x4d782a to 0x090f9a (0x44688f bytes) 018000 1734017287.477325 punch from 0x2627d7 to 0x26a80a (0x8034 bytes) 020000 1734017293.892427 fallocate 0x206541 thru 0x20f006 (0x8ac6 bytes) 021000 1734017296.934310 write 0x0296cd thru 0x03185d (0x8191 bytes) 022000 1734017300.035356 fallocate 0x0585f9 thru 0x06075a (0x8162 bytes) 023000 1734017303.322042 punch from 0x001417 to 0x00febe (0xeaa8 bytes) 026000 1734017312.968125 mapwrite 0x0237a4 thru 0x0243cc (0xc29 bytes) 028000 1734017319.644948 mapwrite 0x0d3e06 thru 0x0d5900 (0x1afb bytes) 029000 1734017322.757848 write 0x1ba4b9 thru 0x1c25fd (0x8145 bytes) 031000 1734017328.815668 mapread 0x430237 thru 0x4345ba (0x4384 bytes) 032000 1734017332.106599 punch from 0x2097c4 to 0x20f726 (0x5f63 bytes) 033000 1734017335.681837 trunc from 0x3adadf to 0x221471 (0x18c66d bytes) 035000 1734017342.720649 fallocate 0x518440 thru 0x525543 (0xd104 bytes) 036000 1734017346.217610 punch from 0x1f67e9 to 0x20360e (0xce26 bytes) 037000 1734017349.325215 trunc from 0x4fca0d to 0x3c49d6 (0x138036 bytes) 038000 1734017352.648982 write 0x4bb5f7 thru 0x4bda12 (0x241c bytes) 039000 1734017356.323457 trunc from 0x434350 to 0x503f9d (0xcfc4e bytes) 040000 1734017359.612559 mapwrite 0x0f636f thru 0x0ff0ca (0x8d5c bytes) skipping zero length fallocate 041000 1734017363.357647 fallocate 0x517946 thru 0x525d75 (0xe430 bytes) 044000 1734017373.511025 trunc from 0x4fdcfd to 0x22c799 (0x2d1563 bytes) 045000 1734017376.872600 read 0x309117 thru 0x30c6fb (0x35e5 bytes) 046000 1734017380.509270 trunc from 0x305c7e to 0x00e585 (0x2f76f8 bytes) 048000 1734017387.517746 read 0x0d2ba8 thru 0x0e0a51 (0xdeaa bytes) 049000 1734017391.233224 trunc from 0x4ae266 to 0x285d2b (0x22853a bytes) 050000 1734017394.816997 punch from 0x143b2c to 0x14ec3a (0xb10f bytes) 051000 1734017398.174733 trunc from 0x4b630e to 0x3ad877 (0x108a96 bytes) 052000 1734017401.680865 mapread 0x06350e thru 0x066cba (0x37ad bytes) 054000 1734017408.751388 mapwrite 0x05ed72 thru 0x062daf (0x403e bytes) 055000 1734017412.175892 read 0x20c0b9 thru 0x20c382 (0x2ca bytes) 056000 1734017415.570416 mapread 0x1b7f0a thru 0x1bb641 (0x3738 bytes) 057000 1734017418.825194 punch from 0x14af93 to 0x156d52 (0xbdc0 bytes) 058000 1734017421.710254 read 0x107b8b thru 0x10b8c4 (0x3d3a bytes) 059000 1734017424.705951 fallocate 0x51648d thru 0x5167e8 (0x35c bytes) 060000 1734017428.192553 fallocate 0x46809f thru 0x46aff4 (0x2f56 bytes) 061000 1734017431.784273 read 0x022277 thru 0x02cda0 (0xab2a bytes) 063000 1734017437.875432 mapwrite 0x288ff8 thru 0x29016b (0x7174 bytes) 065000 1734017444.012848 punch from 0x4ab87d to 0x4b6886 (0xb00a bytes) 066000 1734017447.096433 read 0x03ee95 thru 0x040245 (0x13b1 bytes) 069000 1734017455.690580 mapwrite 0x0dad6f thru 0x0e3da0 (0x9032 bytes) 070000 1734017458.429209 mapread 0x24d3e8 thru 0x25658d (0x91a6 bytes) 072000 1734017463.874481 write 0x39eebd thru 0x3abfae (0xd0f2 bytes) 073000 1734017466.824453 fallocate 0x0d0a50 thru 0x0d2d11 (0x22c2 bytes) 075000 1734017472.079476 write 0x442daf thru 0x44ab6e (0x7dc0 bytes) 076000 1734017474.900794 fallocate 0x1e00ad thru 0x1e180b (0x175f bytes) 077000 1734017477.611199 read 0x24134a thru 0x24429c (0x2f53 bytes) 078000 1734017480.289730 punch from 0x0d3f0b to 0x0dfae8 (0xbbde bytes) 080000 1734017486.267221 mapread 0x4eb836 thru 0x4f9d16 (0xe4e1 bytes) 081000 1734017489.319377 punch from 0x2e3400 to 0x2e466c (0x126d bytes) 082000 1734017491.917599 fallocate 0x4094c4 thru 0x415d35 (0xc872 bytes) 083000 1734017494.708964 mapread 0x354509 thru 0x359ec1 (0x59b9 bytes) 084000 1734017497.550752 read 0x49da59 thru 0x4ad9fc (0xffa4 bytes) 085000 1734017500.490428 fallocate 0x3cbd94 thru 0x3db527 (0xf794 bytes) 087000 1734017507.082731 mapwrite 0x32c0ec thru 0x335c69 (0x9b7e bytes) 088000 1734017510.462959 mapwrite 0x3b220b thru 0x3bd47f (0xb275 bytes) 089000 1734017513.555046 trunc from 0x4fdab1 to 0x30c87c (0x1f1234 bytes) 090000 1734017516.776175 read 0x08750e thru 0x0966c3 (0xf1b6 bytes) 091000 1734017520.063909 mapwrite 0x0d648e thru 0x0dcaff (0x6672 bytes) 093000 1734017525.799793 write 0x36c9fc thru 0x36d331 (0x936 bytes) 095000 1734017531.053849 fallocate 0x31a6f0 thru 0x32791f (0xd230 bytes) 098000 1734017540.156712 trunc from 0x48a753 to 0x17eeb5 (0x30b89d bytes) 100000 1734017545.933936 mapwrite 0x229f9e thru 0x23431b (0xa37e bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4431116 (4328 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 7: 4067328.. 4067335: 8: 0001: net 1: 412.. 451: 309184.. 309223: 40: 0001: unwritten,net 2: 492.. 523: 309120.. 309151: 32: 0001: unwritten,net 3: 728.. 747: 4070080.. 4070099: 20: 0001: net 4: 748.. 799: 4070028.. 4070079: 52: 0001: net 5: 896.. 931: 4070100.. 4070135: 36: 0001: net 6: 1124.. 1151: 4069784.. 4069811: 28: 0001: unwritten,net 7: 1584.. 1603: 317872.. 317891: 20: 0001: net 8: 2212.. 2259: 313952.. 313999: 48: 0001: net 9: 3456.. 3475: 319744.. 319763: 20: 0001: net 10: 4284.. 4311: 320572.. 320599: 28: 0001: last,net /mnt/lustre/f0.fsxfile: 10 extents found debug=0x33f0484 PASS fsx (315s) == sanity-benchmark test complete, duration 1701 sec ===== 10:32:27 (1734017547) === sanity-benchmark: start cleanup 10:32:27 (1734017547) === === sanity-benchmark: finish cleanup 10:32:28 (1734017548) ===