-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:02 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:12 (1734015852) === oleg322-client.virtnet: executing check_config_client /mnt/lustre oleg322-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg322-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b608b000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b608b000.idle_timeout=debug disable quota as required oleg322-server: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:31 (1734015871) === == sanity-benchmark test dbench: dbench ================== 10:04:32 (1734015872) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7586] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg322-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg322-client.virtnet at Thu Dec 12 10:04:34 EST 2024 waiting for dbench pid 10282 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 6 22 13.60 MB/sec warmup 1 sec latency 907.585 ms 20 121 55.14 MB/sec warmup 2 sec latency 159.256 ms 20 176 47.63 MB/sec warmup 3 sec latency 150.273 ms 20 234 44.88 MB/sec warmup 4 sec latency 137.588 ms 20 291 43.18 MB/sec warmup 5 sec latency 151.356 ms 20 344 41.21 MB/sec warmup 6 sec latency 124.464 ms 20 404 40.88 MB/sec warmup 7 sec latency 142.367 ms 20 468 40.94 MB/sec warmup 8 sec latency 133.740 ms 20 536 41.21 MB/sec warmup 9 sec latency 178.759 ms 20 644 42.08 MB/sec warmup 10 sec latency 166.625 ms 20 703 38.53 MB/sec warmup 11 sec latency 91.813 ms 20 760 35.55 MB/sec warmup 12 sec latency 109.440 ms 20 806 33.00 MB/sec warmup 13 sec latency 123.533 ms 20 869 30.86 MB/sec warmup 14 sec latency 111.412 ms 20 912 28.96 MB/sec warmup 15 sec latency 98.888 ms 20 952 27.23 MB/sec warmup 16 sec latency 476.899 ms 20 974 25.71 MB/sec warmup 17 sec latency 1381.267 ms 20 992 24.43 MB/sec warmup 18 sec latency 1629.718 ms 20 1074 24.10 MB/sec warmup 19 sec latency 97.304 ms 20 1143 22.97 MB/sec warmup 20 sec latency 104.208 ms 20 1206 21.93 MB/sec warmup 21 sec latency 97.775 ms 20 1260 20.99 MB/sec warmup 22 sec latency 93.661 ms 20 1397 22.47 MB/sec warmup 23 sec latency 114.374 ms 20 1511 0.80 MB/sec execute 1 sec latency 107.240 ms 20 1588 1.20 MB/sec execute 2 sec latency 83.602 ms 20 1655 1.18 MB/sec execute 3 sec latency 81.479 ms 20 1717 1.11 MB/sec execute 4 sec latency 127.372 ms 20 1803 1.18 MB/sec execute 5 sec latency 107.887 ms 20 1862 1.11 MB/sec execute 6 sec latency 94.566 ms 20 1956 1.20 MB/sec execute 7 sec latency 97.972 ms 20 2014 1.25 MB/sec execute 8 sec latency 90.415 ms 20 2099 1.40 MB/sec execute 9 sec latency 74.865 ms 20 2164 1.39 MB/sec execute 10 sec latency 89.314 ms 20 2235 1.41 MB/sec execute 11 sec latency 97.503 ms 20 2353 3.10 MB/sec execute 12 sec latency 120.338 ms 20 2405 3.06 MB/sec execute 13 sec latency 96.826 ms 20 2459 3.36 MB/sec execute 14 sec latency 111.345 ms 20 2570 3.88 MB/sec execute 15 sec latency 95.122 ms 20 2712 6.20 MB/sec execute 16 sec latency 88.994 ms 20 2863 7.62 MB/sec execute 17 sec latency 286.785 ms 20 2963 8.27 MB/sec execute 18 sec latency 547.467 ms 20 3095 8.21 MB/sec execute 19 sec latency 109.035 ms 20 3270 8.97 MB/sec execute 20 sec latency 102.954 ms 20 3394 9.33 MB/sec execute 21 sec latency 78.921 ms 20 3555 11.25 MB/sec execute 22 sec latency 81.127 ms 20 3648 10.97 MB/sec execute 23 sec latency 75.250 ms 20 3718 10.76 MB/sec execute 24 sec latency 76.316 ms 20 3791 10.95 MB/sec execute 25 sec latency 136.732 ms 20 3836 10.56 MB/sec execute 26 sec latency 148.195 ms 20 3895 10.31 MB/sec execute 27 sec latency 82.916 ms 20 3953 10.02 MB/sec execute 28 sec latency 103.412 ms 20 4004 9.67 MB/sec execute 29 sec latency 96.750 ms 20 4049 9.35 MB/sec execute 30 sec latency 145.101 ms 20 4099 9.06 MB/sec execute 31 sec latency 152.900 ms 20 4191 8.81 MB/sec execute 32 sec latency 87.144 ms 20 4241 8.62 MB/sec execute 33 sec latency 234.107 ms 20 4303 8.46 MB/sec execute 34 sec latency 98.096 ms 20 4366 8.30 MB/sec execute 35 sec latency 95.802 ms 20 4443 8.18 MB/sec execute 36 sec latency 83.891 ms 20 4492 8.02 MB/sec execute 37 sec latency 100.819 ms 20 4543 7.86 MB/sec execute 38 sec latency 100.284 ms 20 4623 8.15 MB/sec execute 39 sec latency 115.462 ms 20 4705 8.04 MB/sec execute 40 sec latency 84.561 ms 20 4774 7.87 MB/sec execute 41 sec latency 72.348 ms 20 4838 7.83 MB/sec execute 42 sec latency 95.347 ms 20 4959 8.81 MB/sec execute 43 sec latency 110.067 ms 20 5011 8.68 MB/sec execute 44 sec latency 130.949 ms 20 5066 8.50 MB/sec execute 45 sec latency 143.974 ms 20 5127 8.34 MB/sec execute 46 sec latency 87.849 ms 20 5164 8.18 MB/sec execute 47 sec latency 106.777 ms 20 5230 8.04 MB/sec execute 48 sec latency 112.774 ms 20 5277 7.89 MB/sec execute 49 sec latency 133.299 ms 20 5338 7.75 MB/sec execute 50 sec latency 95.380 ms 20 5381 7.61 MB/sec execute 51 sec latency 85.489 ms 20 5432 7.48 MB/sec execute 52 sec latency 120.445 ms 20 5536 7.37 MB/sec execute 53 sec latency 68.300 ms 20 5588 7.27 MB/sec execute 54 sec latency 89.211 ms 20 5672 7.18 MB/sec execute 55 sec latency 84.557 ms 20 5739 7.08 MB/sec execute 56 sec latency 75.819 ms 20 5834 7.13 MB/sec execute 57 sec latency 74.915 ms 20 5927 7.24 MB/sec execute 58 sec latency 89.626 ms 20 5982 7.17 MB/sec execute 59 sec latency 94.387 ms 20 6041 7.23 MB/sec execute 60 sec latency 119.227 ms 20 6142 7.23 MB/sec execute 61 sec latency 96.163 ms 20 6290 7.92 MB/sec execute 62 sec latency 111.815 ms 20 6456 8.27 MB/sec execute 63 sec latency 101.901 ms 20 6548 8.31 MB/sec execute 64 sec latency 114.967 ms 20 6724 8.37 MB/sec execute 65 sec latency 114.874 ms 20 6891 8.63 MB/sec execute 66 sec latency 104.613 ms 20 7047 9.17 MB/sec execute 67 sec latency 75.223 ms 20 7151 9.29 MB/sec execute 68 sec latency 65.634 ms 20 7224 9.21 MB/sec execute 69 sec latency 76.749 ms 20 7303 9.31 MB/sec execute 70 sec latency 102.596 ms 20 7354 9.25 MB/sec execute 71 sec latency 158.929 ms 20 7406 9.12 MB/sec execute 72 sec latency 84.972 ms 20 7460 9.07 MB/sec execute 73 sec latency 91.769 ms 20 7511 8.95 MB/sec execute 74 sec latency 103.406 ms 20 7557 8.83 MB/sec execute 75 sec latency 99.316 ms 20 7592 8.72 MB/sec execute 76 sec latency 170.802 ms 20 7655 8.61 MB/sec execute 77 sec latency 102.139 ms 20 7749 8.52 MB/sec execute 78 sec latency 114.236 ms 20 7802 8.45 MB/sec execute 79 sec latency 140.212 ms 20 7862 8.38 MB/sec execute 80 sec latency 112.031 ms 20 7926 8.31 MB/sec execute 81 sec latency 98.369 ms 20 8000 8.26 MB/sec execute 82 sec latency 174.459 ms 20 8064 8.19 MB/sec execute 83 sec latency 88.624 ms 20 8148 8.29 MB/sec execute 84 sec latency 86.118 ms 20 8238 8.27 MB/sec execute 85 sec latency 77.249 ms 20 8317 8.20 MB/sec execute 86 sec latency 80.663 ms 20 8446 8.49 MB/sec execute 87 sec latency 77.162 ms 20 8558 8.68 MB/sec execute 88 sec latency 102.995 ms 20 8639 8.60 MB/sec execute 89 sec latency 82.634 ms 20 8701 8.52 MB/sec execute 90 sec latency 69.448 ms 20 8776 8.44 MB/sec execute 91 sec latency 84.166 ms 20 8841 8.36 MB/sec execute 92 sec latency 87.977 ms 20 8912 8.28 MB/sec execute 93 sec latency 67.244 ms 20 8999 8.21 MB/sec execute 94 sec latency 69.392 ms 20 9112 8.15 MB/sec execute 95 sec latency 66.911 ms 20 9218 8.09 MB/sec execute 96 sec latency 63.649 ms 20 9309 8.04 MB/sec execute 97 sec latency 64.805 ms 20 9458 8.18 MB/sec execute 98 sec latency 70.437 ms 20 9532 8.14 MB/sec execute 99 sec latency 65.559 ms 20 9652 8.21 MB/sec execute 100 sec latency 75.531 ms 20 9834 8.62 MB/sec execute 101 sec latency 71.111 ms 20 10024 8.91 MB/sec execute 102 sec latency 73.577 ms 20 10215 8.96 MB/sec execute 103 sec latency 89.230 ms 20 10433 9.15 MB/sec execute 104 sec latency 82.160 ms 20 10605 9.55 MB/sec execute 105 sec latency 73.260 ms 20 10713 9.57 MB/sec execute 106 sec latency 65.670 ms 20 10792 9.53 MB/sec execute 107 sec latency 74.647 ms 20 10882 9.61 MB/sec execute 108 sec latency 82.887 ms 20 10938 9.53 MB/sec execute 109 sec latency 103.596 ms 20 11004 9.49 MB/sec execute 110 sec latency 118.903 ms 20 11068 9.41 MB/sec execute 111 sec latency 93.300 ms 20 11132 9.33 MB/sec execute 112 sec latency 81.545 ms 20 11212 9.25 MB/sec execute 113 sec latency 79.090 ms 20 11300 9.19 MB/sec execute 114 sec latency 148.248 ms 20 11369 9.14 MB/sec execute 115 sec latency 115.763 ms 20 11441 9.09 MB/sec execute 116 sec latency 87.625 ms 20 11528 9.05 MB/sec execute 117 sec latency 79.321 ms 20 11597 9.00 MB/sec execute 118 sec latency 99.766 ms 20 11701 9.06 MB/sec execute 119 sec latency 79.962 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 35931 37.849 178.898 Close 26225 9.497 57.232 Rename 1486 55.445 133.288 Unlink 7303 12.030 57.470 Qpathinfo 32800 9.013 160.847 Qfileinfo 5657 0.173 21.702 Qfsinfo 5976 0.167 30.033 Sfileinfo 2776 39.072 234.099 Find 12560 2.433 131.799 WriteX 17831 4.656 90.455 ReadX 55434 0.032 7.880 LockX 120 11.494 42.710 UnlockX 120 12.011 48.001 Flush 2580 36.883 547.459 Throughput 9.06156 MB/sec 20 clients 20 procs max_latency=547.467 ms stopping dbench on /mnt/lustre/d0.oleg322-client.virtnet at Thu Dec 12 10:07:00 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg322-client.virtnet /mnt/lustre/d0.oleg322-client.virtnet /mnt/lustre/d0.oleg322-client.virtnet removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg322-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:07 (1734016027) min OST has 3563520kB available, using 5345280kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7586] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5220] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg322-clien 5220M 78431 60 57977 50 267179 55 2808 233 Latency 56538us 368ms 78433us 50189us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg322-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 252 18 5669 27 436 14 323 19 769 12 189 10 Latency 40087us 20350us 35462us 26186us 6580us 54187us 1.97,1.97,oleg322-client.virtnet,1,1734004860,5220M,,,,78431,60,57977,50,,,267179,55,2808,233,10,,,,,252,18,5669,27,436,14,323,19,769,12,189,10,,56538us,368ms,,78433us,50189us,40087us,20350us,35462us,26186us,6580us,54187us debug=0x33f0484 PASS bonnie (359s) == sanity-benchmark test iozone: iozone ================== 10:13:06 (1734016386) Waiting for MDT destroys to complete oleg322-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg322-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7586] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:23 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 168857 177009 174831 250357 61256 159949 iozone test complete. Waiting for MDT destroys to complete oleg322-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg322-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg322-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg322-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:39 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 73832 68135 80284 80558 83041 74113 iozone test complete. Waiting for MDT destroys to complete oleg322-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg322-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 pdsh@oleg322-client: oleg322-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (712s) == sanity-benchmark test fsx: fsx ======================== 10:24:58 (1734017098) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 16300 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 16300 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero length punch hole truncating to largest ever: 0xb59b0 fallocating to largest ever: 0xf2f93 truncating to largest ever: 0x2c1861 truncating to largest ever: 0x2cc550 truncating to largest ever: 0x43df6d truncating to largest ever: 0x464569 fallocating to largest ever: 0x505aaf fallocating to largest ever: 0x51e7d5 fallocating to largest ever: 0x5285e2 001000 1734017102.561404 punch from 0x333b51 to 0x339efd (0x63ad bytes) 005000 1734017114.884090 read 0x243a12 thru 0x246ce9 (0x32d8 bytes) 006000 1734017118.487125 read 0x3c90d2 thru 0x3d8b79 (0xfaa8 bytes) 007000 1734017121.313777 fallocate 0x40d668 thru 0x4174a1 (0x9e3a bytes) 008000 1734017124.473034 trunc from 0x26fffd to 0x02816c (0x247e90 bytes) 009000 1734017127.537297 mapread 0x2229c1 thru 0x224f23 (0x2563 bytes) 010000 1734017130.379890 read 0x0749ac thru 0x07aa8a (0x60df bytes) 013000 1734017139.549200 write 0x0cd12b thru 0x0d9161 (0xc037 bytes) 014000 1734017142.642032 read 0x2da565 thru 0x2e3884 (0x9320 bytes) 015000 1734017145.467517 trunc from 0x45810c to 0x10d487 (0x34ac84 bytes) 016000 1734017148.150063 write 0x34e11f thru 0x351d56 (0x3c38 bytes) 021000 1734017164.138136 mapread 0x055478 thru 0x05ed8e (0x9917 bytes) 022000 1734017167.192156 mapwrite 0x0990ec thru 0x0a458a (0xb49f bytes) 023000 1734017170.073190 fallocate 0x005caf thru 0x00e155 (0x84a7 bytes) 024000 1734017172.907950 punch from 0x01435e to 0x015ecb (0x1b6e bytes) 025000 1734017175.876127 trunc from 0x4e2b2b to 0x50bde5 (0x292bb bytes) 026000 1734017179.055387 write 0x2886dd thru 0x28fffc (0x7920 bytes) 027000 1734017182.167924 mapwrite 0x39b635 thru 0x3aae85 (0xf851 bytes) 028000 1734017185.044108 read 0x29b764 thru 0x2a7485 (0xbd22 bytes) 029000 1734017188.027088 fallocate 0x026723 thru 0x029352 (0x2c30 bytes) 030000 1734017191.376997 read 0x17ca8f thru 0x17d418 (0x98a bytes) 032000 1734017197.569991 punch from 0x370f73 to 0x37b08c (0xa11a bytes) 033000 1734017200.874681 read 0x3fc6f8 thru 0x3fdd6f (0x1678 bytes) 036000 1734017210.145919 mapwrite 0x238376 thru 0x2421a6 (0x9e31 bytes) 037000 1734017213.006648 mapwrite 0x0e218b thru 0x0e6f1b (0x4d91 bytes) 038000 1734017216.542598 fallocate 0x4327e7 thru 0x4330f8 (0x912 bytes) 039000 1734017220.010756 read 0x0cbdab thru 0x0d4d6e (0x8fc4 bytes) 040000 1734017223.176903 punch from 0x02f368 to 0x0359f3 (0x668c bytes) 041000 1734017226.674909 read 0x053476 thru 0x05d457 (0x9fe2 bytes) 042000 1734017230.282186 trunc from 0x41c570 to 0x2e6fea (0x135585 bytes) 043000 1734017233.384488 mapwrite 0x1ccdf0 thru 0x1d6fae (0xa1bf bytes) 044000 1734017236.837262 fallocate 0x48ed00 thru 0x48ef5e (0x25f bytes) 045000 1734017240.512111 write 0x358c93 thru 0x364075 (0xb3e3 bytes) 047000 1734017247.088911 mapread 0x0467f0 thru 0x04c9a5 (0x61b6 bytes) 048000 1734017250.264259 mapwrite 0x15ce0e thru 0x16166d (0x4860 bytes) 049000 1734017253.883729 mapwrite 0x1fea85 thru 0x207910 (0x8e8c bytes) 050000 1734017257.074698 read 0x0116ae thru 0x017c42 (0x6595 bytes) 051000 1734017260.423021 read 0x0b76eb thru 0x0b8002 (0x918 bytes) 052000 1734017263.951659 mapwrite 0x20dc2f thru 0x212283 (0x4655 bytes) 053000 1734017267.182974 mapread 0x1590ae thru 0x15ac8d (0x1be0 bytes) 054000 1734017270.852516 write 0x4a5832 thru 0x4a584d (0x1c bytes) 056000 1734017277.534842 mapwrite 0x0a7b46 thru 0x0aae41 (0x32fc bytes) 058000 1734017284.579981 mapread 0x009c98 thru 0x018448 (0xe7b1 bytes) 059000 1734017287.824681 mapwrite 0x3c500a thru 0x3d0d19 (0xbd10 bytes) 060000 1734017291.174655 punch from 0x10f086 to 0x119fb7 (0xaf32 bytes) 063000 1734017300.728174 trunc from 0x47821c to 0x098bc6 (0x3df655 bytes) 064000 1734017304.495302 trunc from 0x1ade43 to 0x481b6d (0x2d3d2b bytes) 065000 1734017308.085783 punch from 0x46a013 to 0x47240d (0x83fb bytes) 067000 1734017315.002579 read 0x0862ee thru 0x0874f2 (0x1205 bytes) 068000 1734017317.927912 trunc from 0x165ad3 to 0x48a712 (0x324c40 bytes) 070000 1734017324.045386 fallocate 0x2549ee thru 0x25edff (0xa412 bytes) 071000 1734017326.874806 fallocate 0x3e9774 thru 0x3ed97a (0x4207 bytes) 072000 1734017329.647544 punch from 0x1b49c2 to 0x1ba4fd (0x5b3c bytes) 074000 1734017334.386805 mapwrite 0x4b9057 thru 0x4c633f (0xd2e9 bytes) 075000 1734017336.713364 read 0x15caab thru 0x162999 (0x5eef bytes) 076000 1734017338.978698 read 0x07aceb thru 0x07adcd (0xe3 bytes) 078000 1734017344.817987 mapwrite 0x409d7f thru 0x40e72e (0x49b0 bytes) 079000 1734017347.344036 mapwrite 0x174d60 thru 0x1752eb (0x58c bytes) 080000 1734017350.041838 mapwrite 0x1d11dc thru 0x1da560 (0x9385 bytes) 082000 1734017355.271626 mapwrite 0x4f487c thru 0x4f82fd (0x3a82 bytes) 084000 1734017360.444953 mapwrite 0x4bf50f thru 0x4c8aab (0x959d bytes) 085000 1734017362.677570 fallocate 0x1b6c28 thru 0x1c0879 (0x9c52 bytes) 086000 1734017364.886566 punch from 0x4b15a9 to 0x4bc4b5 (0xaf0d bytes) 088000 1734017369.964688 punch from 0x25da59 to 0x25dd1c (0x2c4 bytes) 089000 1734017372.059813 mapwrite 0x352239 thru 0x35c8c5 (0xa68d bytes) 090000 1734017374.395146 fallocate 0x403dd1 thru 0x40c10d (0x833d bytes) 092000 1734017378.685421 trunc from 0x19a130 to 0x36f219 (0x1d50ea bytes) 094000 1734017383.613409 punch from 0x171334 to 0x17a129 (0x8df6 bytes) 095000 1734017386.059371 punch from 0x450d7f to 0x451c59 (0xedb bytes) 096000 1734017388.344822 trunc from 0x3fe42e to 0x2c83c3 (0x13606a bytes) 097000 1734017390.531670 write 0x005a99 thru 0x012f51 (0xd4b9 bytes) 098000 1734017392.515566 punch from 0x1c7457 to 0x1d4c96 (0xd840 bytes) 100000 1734017396.571105 read 0x0dc01f thru 0x0ddbac (0x1b8e bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2853388 (2788 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 1839104.. 1839107: 4: 0001: net 1: 4.. 7: 1845236.. 1845239: 4: 0001: net 2: 8.. 35: 1839116.. 1839143: 28: 0001: net 3: 36.. 39: 1846148.. 1846151: 4: 0001: net 4: 40.. 59: 1856824.. 1856843: 20: 0001: net 5: 60.. 67: 1857468.. 1857475: 8: 0001: net 6: 68.. 71: 1846276.. 1846279: 4: 0001: net 7: 72.. 79: 1857476.. 1857483: 8: 0001: net 8: 80.. 103: 1847964.. 1847987: 24: 0001: net 9: 104.. 107: 1853436.. 1853439: 4: 0001: net 10: 152.. 195: 1835008.. 1835051: 44: 0001: net 11: 196.. 203: 1835456.. 1835463: 8: 0001: net 12: 216.. 219: 1835476.. 1835479: 4: 0001: net 13: 220.. 239: 1856772.. 1856791: 20: 0001: net 14: 240.. 255: 1846160.. 1846175: 16: 0001: net 15: 256.. 263: 1857108.. 1857115: 8: 0001: net 16: 504.. 511: 1835688.. 1835695: 8: 0001: net 17: 512.. 571: 1835712.. 1835771: 60: 0001: net 18: 728.. 759: 1978584.. 1978615: 32: 0001: net 19: 952.. 983: 1979000.. 1979031: 32: 0001: net 20: 1176.. 1207: 1835532.. 1835563: 32: 0001: net 21: 1308.. 1323: 1835696.. 1835711: 16: 0001: net 22: 1336.. 1351: 1835516.. 1835531: 16: 0001: unwritten,net 23: 1556.. 1595: 1980188.. 1980227: 40: 0001: unwritten,net 24: 2740.. 2787: 1978944.. 1978991: 48: 0001: last,net,eof /mnt/lustre/f0.fsxfile: 24 extents found debug=0x33f0484 PASS fsx (299s) == sanity-benchmark test complete, duration 1554 sec ===== 10:29:57 (1734017397) === sanity-benchmark: start cleanup 10:29:58 (1734017398) === === sanity-benchmark: finish cleanup 10:29:58 (1734017398) ===