-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:53 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:58 (1734015838) === oleg421-client.virtnet: executing check_config_client /mnt/lustre oleg421-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg421-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5994000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5994000.idle_timeout=debug disable quota as required oleg421-server: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:10 (1734015850) === == sanity-benchmark test dbench: dbench ================== 10:04:10 (1734015850) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6867] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg421-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg421-client.virtnet at Thu Dec 12 10:04:12 EST 2024 waiting for dbench pid 9430 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 13 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 73 63.56 MB/sec warmup 1 sec latency 148.703 ms 20 167 68.54 MB/sec warmup 2 sec latency 126.192 ms 20 256 64.60 MB/sec warmup 3 sec latency 98.551 ms 20 332 59.99 MB/sec warmup 4 sec latency 106.964 ms 20 413 58.36 MB/sec warmup 5 sec latency 96.517 ms 20 488 56.65 MB/sec warmup 6 sec latency 112.003 ms 20 586 57.09 MB/sec warmup 7 sec latency 152.896 ms 20 676 52.80 MB/sec warmup 8 sec latency 139.949 ms 20 731 47.24 MB/sec warmup 9 sec latency 98.071 ms 20 784 42.72 MB/sec warmup 10 sec latency 104.553 ms 20 842 39.11 MB/sec warmup 11 sec latency 116.615 ms 20 894 36.09 MB/sec warmup 12 sec latency 100.506 ms 20 929 33.46 MB/sec warmup 13 sec latency 278.967 ms 20 964 31.16 MB/sec warmup 14 sec latency 728.908 ms 20 1017 29.75 MB/sec warmup 15 sec latency 140.857 ms 20 1093 28.64 MB/sec warmup 16 sec latency 91.119 ms 20 1149 27.03 MB/sec warmup 17 sec latency 146.748 ms 20 1201 25.58 MB/sec warmup 18 sec latency 118.062 ms 20 1265 24.73 MB/sec warmup 19 sec latency 105.733 ms 20 1377 25.54 MB/sec warmup 20 sec latency 141.090 ms 20 1430 24.75 MB/sec warmup 21 sec latency 151.530 ms 20 1471 23.64 MB/sec warmup 22 sec latency 138.423 ms 20 1512 22.64 MB/sec warmup 23 sec latency 117.097 ms 20 1617 0.98 MB/sec execute 1 sec latency 123.253 ms 20 1661 0.85 MB/sec execute 2 sec latency 148.534 ms 20 1706 0.80 MB/sec execute 3 sec latency 159.824 ms 20 1755 0.80 MB/sec execute 4 sec latency 149.213 ms 20 1814 0.83 MB/sec execute 5 sec latency 106.313 ms 20 1857 0.82 MB/sec execute 6 sec latency 131.389 ms 20 1909 0.82 MB/sec execute 7 sec latency 120.739 ms 20 1963 0.88 MB/sec execute 8 sec latency 136.506 ms 20 2013 0.89 MB/sec execute 9 sec latency 137.518 ms 20 2054 0.94 MB/sec execute 10 sec latency 125.726 ms 20 2105 0.98 MB/sec execute 11 sec latency 114.344 ms 20 2146 0.97 MB/sec execute 12 sec latency 133.938 ms 20 2195 1.07 MB/sec execute 13 sec latency 150.903 ms 20 2237 1.31 MB/sec execute 14 sec latency 254.062 ms 20 2271 1.58 MB/sec execute 15 sec latency 1211.114 ms 20 2309 1.79 MB/sec execute 16 sec latency 2077.256 ms 20 2367 2.12 MB/sec execute 17 sec latency 2160.198 ms 20 2408 2.15 MB/sec execute 18 sec latency 147.514 ms 20 2452 2.25 MB/sec execute 19 sec latency 132.560 ms 20 2516 2.69 MB/sec execute 20 sec latency 144.151 ms 20 2603 2.92 MB/sec execute 21 sec latency 123.463 ms 20 2724 4.46 MB/sec execute 22 sec latency 134.820 ms 20 2853 5.46 MB/sec execute 23 sec latency 139.143 ms 20 2940 5.92 MB/sec execute 24 sec latency 155.459 ms 20 2996 5.95 MB/sec execute 25 sec latency 147.627 ms 20 3131 6.07 MB/sec execute 26 sec latency 137.157 ms 20 3238 6.29 MB/sec execute 27 sec latency 176.865 ms 20 3336 6.60 MB/sec execute 28 sec latency 142.180 ms 20 3408 6.94 MB/sec execute 29 sec latency 152.909 ms 20 3506 7.73 MB/sec execute 30 sec latency 122.086 ms 20 3601 7.99 MB/sec execute 31 sec latency 87.163 ms 20 3663 7.87 MB/sec execute 32 sec latency 101.466 ms 20 3699 7.70 MB/sec execute 33 sec latency 213.662 ms 20 3757 7.84 MB/sec execute 34 sec latency 124.637 ms 20 3803 7.79 MB/sec execute 35 sec latency 137.633 ms 20 3837 7.58 MB/sec execute 36 sec latency 117.864 ms 20 3871 7.39 MB/sec execute 37 sec latency 110.257 ms 20 3903 7.28 MB/sec execute 38 sec latency 135.643 ms 20 3949 7.14 MB/sec execute 39 sec latency 116.791 ms 20 3983 6.97 MB/sec execute 40 sec latency 115.186 ms 20 4024 6.80 MB/sec execute 41 sec latency 101.013 ms 20 4065 6.64 MB/sec execute 42 sec latency 96.939 ms 20 4104 6.49 MB/sec execute 43 sec latency 173.738 ms 20 4159 6.35 MB/sec execute 44 sec latency 190.119 ms 20 4208 6.25 MB/sec execute 45 sec latency 222.713 ms 20 4262 6.16 MB/sec execute 46 sec latency 127.939 ms 20 4308 6.08 MB/sec execute 47 sec latency 130.488 ms 20 4349 5.99 MB/sec execute 48 sec latency 196.438 ms 20 4381 5.91 MB/sec execute 49 sec latency 182.121 ms 20 4433 5.84 MB/sec execute 50 sec latency 180.988 ms 20 4478 5.77 MB/sec execute 51 sec latency 122.508 ms 20 4522 5.70 MB/sec execute 52 sec latency 164.502 ms 20 4565 5.69 MB/sec execute 53 sec latency 180.949 ms 20 4627 5.83 MB/sec execute 54 sec latency 139.194 ms 20 4695 5.80 MB/sec execute 55 sec latency 107.027 ms 20 4743 5.72 MB/sec execute 56 sec latency 152.338 ms 20 4794 5.68 MB/sec execute 57 sec latency 126.092 ms 20 4856 5.77 MB/sec execute 58 sec latency 121.608 ms 20 4946 6.29 MB/sec execute 59 sec latency 165.692 ms 20 5005 6.33 MB/sec execute 60 sec latency 236.225 ms 20 5052 6.24 MB/sec execute 61 sec latency 97.216 ms 20 5099 6.15 MB/sec execute 62 sec latency 112.266 ms 20 5133 6.06 MB/sec execute 63 sec latency 133.679 ms 20 5167 5.98 MB/sec execute 64 sec latency 143.669 ms 20 5211 5.90 MB/sec execute 65 sec latency 130.064 ms 20 5251 5.82 MB/sec execute 66 sec latency 145.445 ms 20 5279 5.74 MB/sec execute 67 sec latency 184.596 ms 20 5303 5.66 MB/sec execute 68 sec latency 173.906 ms 20 5339 5.59 MB/sec execute 69 sec latency 139.479 ms 20 5372 5.52 MB/sec execute 70 sec latency 113.218 ms 20 5401 5.44 MB/sec execute 71 sec latency 143.543 ms 20 5437 5.38 MB/sec execute 72 sec latency 146.327 ms 20 5495 5.32 MB/sec execute 73 sec latency 135.179 ms 20 5555 5.26 MB/sec execute 74 sec latency 120.222 ms 20 5594 5.21 MB/sec execute 75 sec latency 124.556 ms 20 5633 5.16 MB/sec execute 76 sec latency 150.755 ms 20 5695 5.11 MB/sec execute 77 sec latency 107.277 ms 20 5746 5.07 MB/sec execute 78 sec latency 102.464 ms 20 5791 5.06 MB/sec execute 79 sec latency 141.655 ms 20 5864 5.09 MB/sec execute 80 sec latency 157.517 ms 20 5936 5.17 MB/sec execute 81 sec latency 121.465 ms 20 5984 5.16 MB/sec execute 82 sec latency 102.406 ms 20 6047 5.18 MB/sec execute 83 sec latency 115.246 ms 20 6114 5.27 MB/sec execute 84 sec latency 158.906 ms 20 6218 5.43 MB/sec execute 85 sec latency 153.480 ms 20 6314 5.61 MB/sec execute 86 sec latency 125.906 ms 20 6439 5.92 MB/sec execute 87 sec latency 132.076 ms 20 6548 6.03 MB/sec execute 88 sec latency 152.273 ms 20 6663 6.07 MB/sec execute 89 sec latency 119.953 ms 20 6790 6.14 MB/sec execute 90 sec latency 129.286 ms 20 6905 6.31 MB/sec execute 91 sec latency 132.060 ms 20 7022 6.51 MB/sec execute 92 sec latency 87.071 ms 20 7125 6.76 MB/sec execute 93 sec latency 107.216 ms 20 7181 6.72 MB/sec execute 94 sec latency 102.543 ms 20 7239 6.71 MB/sec execute 95 sec latency 129.144 ms 20 7288 6.71 MB/sec execute 96 sec latency 202.997 ms 20 7343 6.73 MB/sec execute 97 sec latency 165.739 ms 20 7382 6.69 MB/sec execute 98 sec latency 121.192 ms 20 7424 6.64 MB/sec execute 99 sec latency 93.020 ms 20 7472 6.59 MB/sec execute 100 sec latency 108.443 ms 20 7503 6.54 MB/sec execute 101 sec latency 210.560 ms 20 7537 6.48 MB/sec execute 102 sec latency 190.086 ms 20 7577 6.42 MB/sec execute 103 sec latency 114.892 ms 20 7619 6.36 MB/sec execute 104 sec latency 114.108 ms 20 7665 6.30 MB/sec execute 105 sec latency 143.915 ms 20 7719 6.25 MB/sec execute 106 sec latency 133.333 ms 20 7780 6.21 MB/sec execute 107 sec latency 143.967 ms 20 7828 6.17 MB/sec execute 108 sec latency 138.819 ms 20 7872 6.14 MB/sec execute 109 sec latency 137.238 ms 20 7921 6.10 MB/sec execute 110 sec latency 140.657 ms 20 7975 6.07 MB/sec execute 111 sec latency 117.663 ms 20 8025 6.04 MB/sec execute 112 sec latency 120.079 ms 20 8072 6.03 MB/sec execute 113 sec latency 123.733 ms 20 8129 6.03 MB/sec execute 114 sec latency 127.488 ms 20 8188 6.06 MB/sec execute 115 sec latency 117.819 ms 20 8259 6.05 MB/sec execute 116 sec latency 93.059 ms 20 8329 6.06 MB/sec execute 117 sec latency 103.193 ms 20 8395 6.11 MB/sec execute 118 sec latency 117.636 ms 20 8466 6.20 MB/sec execute 119 sec latency 103.929 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23879 57.774 254.047 Close 17569 14.050 85.853 Rename 1040 86.280 206.118 Unlink 4903 18.423 99.419 Qpathinfo 22053 13.745 159.818 Qfileinfo 3766 0.294 41.204 Qfsinfo 4080 0.203 29.608 Sfileinfo 2000 52.988 244.858 Find 8468 3.796 136.417 WriteX 11857 5.597 119.188 ReadX 38098 0.029 10.180 LockX 80 22.782 48.637 UnlockX 80 21.884 43.664 Flush 1705 46.873 2160.182 Throughput 6.19552 MB/sec 20 clients 20 procs max_latency=2160.198 ms stopping dbench on /mnt/lustre/d0.oleg421-client.virtnet at Thu Dec 12 10:06:39 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg421-client.virtnet /mnt/lustre/d0.oleg421-client.virtnet /mnt/lustre/d0.oleg421-client.virtnet removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg421-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:47 (1734016007) min OST has 3594176kB available, using 5391264kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6867] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5264] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg421-clien 5264M 80132 62 47791 43 106164 27 887.0 166 Latency 24414us 262ms 228ms 29146us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg421-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 233 19 7258 31 351 14 263 19 869 12 469 14 Latency 27668us 17297us 30225us 24902us 5711us 18252us 1.97,1.97,oleg421-client.virtnet,1,1734006026,5264M,,,,80132,62,47791,43,,,106164,27,887.0,166,10,,,,,233,19,7258,31,351,14,263,19,869,12,469,14,,24414us,262ms,,228ms,29146us,27668us,17297us,30225us,24902us,5711us,18252us debug=0x33f0484 PASS bonnie (396s) == sanity-benchmark test iozone: iozone ================== 10:13:23 (1734016403) Waiting for MDT destroys to complete oleg421-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg421-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6867] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:35 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 287930 135232 91070 101832 46231 281942 iozone test complete. Waiting for MDT destroys to complete oleg421-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg421-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg421-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 oleg421-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:06 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 47224 70666 76024 79126 82348 69524 iozone test complete. Waiting for MDT destroys to complete oleg421-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg421-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (829s) == sanity-benchmark test fsx: fsx ======================== 10:27:12 (1734017232) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 23558 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 23558 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x525364 skipping zero size read truncating to largest ever: 0x527c1e truncating to largest ever: 0x5281ef fallocating to largest ever: 0x5286ae 003000 1734017241.947133 trunc from 0x44c94f to 0x302921 (0x14a02d bytes) 004000 1734017245.127741 trunc from 0x0398a1 to 0x0c9466 (0x8fbc6 bytes) 005000 1734017248.229715 mapwrite 0x0f5d9d thru 0x0f7e42 (0x20a6 bytes) 007000 1734017254.069820 fallocate 0x21eb52 thru 0x2219b4 (0x2e63 bytes) 008000 1734017256.954820 punch from 0x104d4b to 0x105bb2 (0xe68 bytes) 009000 1734017259.884075 mapread 0x15ca4a thru 0x168191 (0xb748 bytes) 011000 1734017265.948961 trunc from 0x519b58 to 0x146a12 (0x3d3145 bytes) 012000 1734017268.590990 mapwrite 0x3fe78d thru 0x4062dc (0x7b50 bytes) 013000 1734017271.202802 write 0x1c8d38 thru 0x1d6604 (0xd8cd bytes) 015000 1734017277.370156 mapread 0x1a39c1 thru 0x1a5282 (0x18c2 bytes) 017000 1734017283.737941 fallocate 0x526a91 thru 0x5286ad (0x1c1d bytes) 018000 1734017287.137645 mapread 0x2c0fec thru 0x2c6f8d (0x5fa2 bytes) 019000 1734017290.610476 fallocate 0x0762aa thru 0x07cca0 (0x69f7 bytes) 020000 1734017293.640568 write 0x32a830 thru 0x335278 (0xaa49 bytes) 021000 1734017296.402070 fallocate 0x2c44fc thru 0x2c9c00 (0x5705 bytes) 025000 1734017308.867372 write 0x20801b thru 0x214210 (0xc1f6 bytes) 027000 1734017315.502100 fallocate 0x3cd904 thru 0x3d7bc5 (0xa2c2 bytes) 028000 1734017318.170148 mapwrite 0x229d6f thru 0x238955 (0xebe7 bytes) 029000 1734017321.756924 mapwrite 0x172c3d thru 0x17debe (0xb282 bytes) 031000 1734017327.762713 trunc from 0x2cb917 to 0x29e6f7 (0x2d21f bytes) 033000 1734017334.856031 fallocate 0x39d292 thru 0x39eb6e (0x18dd bytes) 034000 1734017337.879243 trunc from 0x463a20 to 0x0f5e13 (0x36dc0c bytes) 036000 1734017345.396776 read 0x14544d thru 0x14a240 (0x4df4 bytes) 037000 1734017348.927134 punch from 0x0c308d to 0x0c6f23 (0x3e97 bytes) 038000 1734017351.958632 mapread 0x3b33c9 thru 0x3c101e (0xdc56 bytes) 040000 1734017358.630594 write 0x05d34e thru 0x061bbb (0x486e bytes) 041000 1734017362.111913 mapwrite 0x2cf12e thru 0x2d72fe (0x81d1 bytes) 042000 1734017365.644034 mapwrite 0x176229 thru 0x183f4e (0xdd26 bytes) 043000 1734017369.667951 write 0x1446b3 thru 0x14bdda (0x7728 bytes) 046000 1734017379.670383 read 0x2ebd35 thru 0x2f552f (0x97fb bytes) 048000 1734017386.620118 trunc from 0x45e5fc to 0x1ee8db (0x26fd20 bytes) 049000 1734017390.406608 trunc from 0x1e3dff to 0x03b697 (0x1a8767 bytes) 050000 1734017393.587913 read 0x1f47f8 thru 0x1f9f07 (0x5710 bytes) 051000 1734017397.269086 write 0x126cab thru 0x12e4b0 (0x7806 bytes) 052000 1734017400.856038 trunc from 0x46f53e to 0x3ae0a0 (0xc149d bytes) 053000 1734017404.332148 mapread 0x134d4e thru 0x13bcbd (0x6f70 bytes) 054000 1734017407.351103 fallocate 0x15908a thru 0x15a135 (0x10ac bytes) 055000 1734017410.784306 mapwrite 0x20d3f0 thru 0x2136da (0x62eb bytes) 056000 1734017414.139560 mapwrite 0x4b7797 thru 0x4c6424 (0xec8e bytes) 057000 1734017417.359817 punch from 0x49ca45 to 0x4a48d1 (0x7e8d bytes) 058000 1734017420.092018 fallocate 0x2e0106 thru 0x2ec48a (0xc385 bytes) 061000 1734017429.552250 trunc from 0x26bdb1 to 0x466861 (0x1faab1 bytes) 062000 1734017433.023487 fallocate 0x144d78 thru 0x14d373 (0x85fc bytes) 063000 1734017436.376264 punch from 0x1ac3fe to 0x1b7a7a (0xb67d bytes) 064000 1734017439.203606 mapread 0x10cb65 thru 0x118799 (0xbc35 bytes) 067000 1734017447.599065 read 0x37a01c thru 0x3817d2 (0x77b7 bytes) 069000 1734017453.437824 mapwrite 0x1c7c57 thru 0x1d41a9 (0xc553 bytes) 072000 1734017462.037130 mapread 0x1ad904 thru 0x1b0439 (0x2b36 bytes) 073000 1734017464.532429 read 0x1d7322 thru 0x1dacf8 (0x39d7 bytes) 074000 1734017467.396687 fallocate 0x0e9135 thru 0x0f41ca (0xb096 bytes) 075000 1734017470.143692 trunc from 0x405ab5 to 0x44e053 (0x4859f bytes) 076000 1734017472.777583 fallocate 0x15b24e thru 0x15d024 (0x1dd7 bytes) 077000 1734017475.630652 punch from 0x09a0fe to 0x0a1c69 (0x7b6c bytes) 078000 1734017478.640037 write 0x023863 thru 0x033799 (0xff37 bytes) 080000 1734017484.450678 punch from 0x0724d3 to 0x0760b4 (0x3be2 bytes) 081000 1734017487.218347 read 0x3f3dc0 thru 0x3fb589 (0x77ca bytes) 082000 1734017490.185179 mapwrite 0x4d292b thru 0x4db9dd (0x90b3 bytes) 083000 1734017492.669827 mapread 0x069fee thru 0x06af6b (0xf7e bytes) 086000 1734017501.702733 read 0x1c5b77 thru 0x1cc01a (0x64a4 bytes) 087000 1734017504.810237 mapwrite 0x2e1166 thru 0x2e5067 (0x3f02 bytes) 089000 1734017511.444851 punch from 0x247dad to 0x2565d9 (0xe82d bytes) 091000 1734017518.195891 mapread 0x067032 thru 0x068d04 (0x1cd3 bytes) 092000 1734017521.626112 mapread 0x32795a thru 0x32a28e (0x2935 bytes) 094000 1734017527.907894 write 0x46f386 thru 0x46ff5e (0xbd9 bytes) 095000 1734017530.793776 punch from 0x174327 to 0x179d08 (0x59e2 bytes) 096000 1734017533.739691 fallocate 0x00337b thru 0x003fc1 (0xc47 bytes) 097000 1734017536.381789 write 0x23870f thru 0x242d84 (0xa676 bytes) 098000 1734017539.312493 fallocate 0x074b4f thru 0x07b57c (0x6a2e bytes) 100000 1734017544.957930 fallocate 0x2443a6 thru 0x251aba (0xd715 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 1280422 (1252 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3936256.. 3936259: 4: 0000: net 1: 4.. 19: 4063736.. 4063751: 16: 0000: net 2: 20.. 63: 3932176.. 3932219: 44: 0000: net 3: 92.. 95: 4065208.. 4065211: 4: 0000: unwritten,net 4: 96.. 127: 3952328.. 3952359: 32: 0000: net 5: 128.. 131: 4064988.. 4064991: 4: 0000: net 6: 132.. 151: 4065716.. 4065735: 20: 0000: net 7: 152.. 159: 3932160.. 3932167: 8: 0000: net 8: 160.. 175: 3936416.. 3936431: 16: 0000: net 9: 180.. 191: 4064992.. 4065003: 12: 0000: net 10: 200.. 203: 4072140.. 4072143: 4: 0000: unwritten,net 11: 228.. 239: 4072168.. 4072179: 12: 0000: unwritten,net 12: 264.. 271: 3936312.. 3936319: 8: 0000: unwritten,net 13: 436.. 491: 4063680.. 4063735: 56: 0000: unwritten,net 14: 628.. 659: 3936268.. 3936299: 32: 0000: unwritten,net 15: 724.. 771: 4072600.. 4072647: 48: 0000: last,net /mnt/lustre/f0.fsxfile: 15 extents found debug=0x33f0484 PASS fsx (314s) == sanity-benchmark test complete, duration 1713 sec ===== 10:32:26 (1734017546) === sanity-benchmark: start cleanup 10:32:26 (1734017546) === === sanity-benchmark: finish cleanup 10:32:27 (1734017547) ===