-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:53 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:58 (1734015838) === oleg252-client.virtnet: executing check_config_client /mnt/lustre oleg252-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg252-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6290000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6290000.idle_timeout=debug disable quota as required oleg252-server: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:06 (1734015846) === == sanity-benchmark test dbench: dbench ================== 10:04:07 (1734015847) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg252-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg252-client.virtnet at Thu Dec 12 10:04:08 EST 2024 waiting for dbench pid 9448 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 69 60.61 MB/sec warmup 1 sec latency 123.709 ms 20 143 61.63 MB/sec warmup 2 sec latency 190.018 ms 20 213 55.40 MB/sec warmup 3 sec latency 134.315 ms 20 299 55.08 MB/sec warmup 4 sec latency 114.431 ms 20 368 52.53 MB/sec warmup 5 sec latency 128.473 ms 20 441 51.71 MB/sec warmup 6 sec latency 120.861 ms 20 511 50.67 MB/sec warmup 7 sec latency 144.722 ms 20 645 52.64 MB/sec warmup 8 sec latency 132.747 ms 20 676 47.03 MB/sec warmup 9 sec latency 429.077 ms 20 724 42.57 MB/sec warmup 10 sec latency 259.117 ms 20 769 38.81 MB/sec warmup 11 sec latency 150.094 ms 20 798 35.77 MB/sec warmup 12 sec latency 280.024 ms 20 863 33.20 MB/sec warmup 13 sec latency 154.779 ms 20 903 30.98 MB/sec warmup 14 sec latency 287.987 ms 20 952 29.06 MB/sec warmup 15 sec latency 182.865 ms 20 1006 27.70 MB/sec warmup 16 sec latency 239.944 ms 20 1093 26.98 MB/sec warmup 17 sec latency 84.897 ms 20 1153 25.55 MB/sec warmup 18 sec latency 120.048 ms 20 1213 24.26 MB/sec warmup 19 sec latency 94.877 ms 20 1280 23.54 MB/sec warmup 20 sec latency 102.198 ms 20 1404 24.76 MB/sec warmup 21 sec latency 135.709 ms 20 1463 23.65 MB/sec warmup 22 sec latency 265.953 ms 20 1515 22.66 MB/sec warmup 23 sec latency 195.770 ms 20 1633 0.71 MB/sec execute 1 sec latency 245.461 ms 20 1701 0.93 MB/sec execute 2 sec latency 264.601 ms 20 1775 1.04 MB/sec execute 3 sec latency 85.749 ms 20 1834 1.04 MB/sec execute 4 sec latency 227.014 ms 20 1890 0.97 MB/sec execute 5 sec latency 182.034 ms 20 1961 1.09 MB/sec execute 6 sec latency 243.371 ms 20 2022 1.15 MB/sec execute 7 sec latency 96.768 ms 20 2073 1.21 MB/sec execute 8 sec latency 140.008 ms 20 2126 1.21 MB/sec execute 9 sec latency 115.598 ms 20 2182 1.29 MB/sec execute 10 sec latency 107.038 ms 20 2225 1.61 MB/sec execute 11 sec latency 236.017 ms 20 2290 1.99 MB/sec execute 12 sec latency 292.855 ms 20 2369 2.77 MB/sec execute 13 sec latency 303.699 ms 20 2408 2.78 MB/sec execute 14 sec latency 375.798 ms 20 2448 2.85 MB/sec execute 15 sec latency 360.150 ms 20 2478 2.94 MB/sec execute 16 sec latency 1049.586 ms 20 2557 3.60 MB/sec execute 17 sec latency 239.906 ms 20 2635 4.22 MB/sec execute 18 sec latency 470.037 ms 20 2724 5.01 MB/sec execute 19 sec latency 431.961 ms 20 2846 6.49 MB/sec execute 20 sec latency 452.536 ms 20 2938 6.52 MB/sec execute 21 sec latency 466.224 ms 20 3016 6.85 MB/sec execute 22 sec latency 350.979 ms 20 3105 6.87 MB/sec execute 23 sec latency 498.521 ms 20 3178 6.89 MB/sec execute 24 sec latency 452.154 ms 20 3291 7.11 MB/sec execute 25 sec latency 340.004 ms 20 3386 7.73 MB/sec execute 26 sec latency 610.601 ms 20 3481 8.15 MB/sec execute 27 sec latency 242.288 ms 20 3569 8.50 MB/sec execute 28 sec latency 107.188 ms 20 3644 8.70 MB/sec execute 29 sec latency 92.137 ms 20 3693 8.56 MB/sec execute 30 sec latency 148.936 ms 20 3739 8.44 MB/sec execute 31 sec latency 165.131 ms 20 3777 8.31 MB/sec execute 32 sec latency 143.538 ms 20 3821 8.27 MB/sec execute 33 sec latency 143.836 ms 20 3856 8.06 MB/sec execute 34 sec latency 130.186 ms 20 3886 7.85 MB/sec execute 35 sec latency 121.246 ms 20 3906 7.66 MB/sec execute 36 sec latency 199.802 ms 20 3935 7.49 MB/sec execute 37 sec latency 175.569 ms 20 3962 7.32 MB/sec execute 38 sec latency 190.305 ms 20 3994 7.14 MB/sec execute 39 sec latency 162.435 ms 20 4034 6.96 MB/sec execute 40 sec latency 101.929 ms 20 4063 6.79 MB/sec execute 41 sec latency 200.240 ms 20 4104 6.64 MB/sec execute 42 sec latency 323.695 ms 20 4142 6.51 MB/sec execute 43 sec latency 495.111 ms 20 4188 6.38 MB/sec execute 44 sec latency 373.193 ms 20 4227 6.26 MB/sec execute 45 sec latency 641.103 ms 20 4260 6.17 MB/sec execute 46 sec latency 683.736 ms 20 4296 6.07 MB/sec execute 47 sec latency 267.949 ms 20 4318 5.97 MB/sec execute 48 sec latency 480.040 ms 20 4355 5.87 MB/sec execute 49 sec latency 312.580 ms 20 4390 5.80 MB/sec execute 50 sec latency 465.577 ms 20 4422 5.71 MB/sec execute 51 sec latency 407.444 ms 20 4458 5.63 MB/sec execute 52 sec latency 292.187 ms 20 4487 5.56 MB/sec execute 53 sec latency 578.424 ms 20 4522 5.53 MB/sec execute 54 sec latency 469.100 ms 20 4571 5.52 MB/sec execute 55 sec latency 388.135 ms 20 4610 5.51 MB/sec execute 56 sec latency 302.450 ms 20 4654 5.47 MB/sec execute 57 sec latency 364.175 ms 20 4719 5.50 MB/sec execute 58 sec latency 92.101 ms 20 4789 5.61 MB/sec execute 59 sec latency 129.735 ms 20 4832 5.64 MB/sec execute 60 sec latency 183.750 ms 20 4894 5.71 MB/sec execute 61 sec latency 149.310 ms 20 4942 5.80 MB/sec execute 62 sec latency 426.452 ms 20 5001 5.95 MB/sec execute 63 sec latency 437.241 ms 20 5045 5.94 MB/sec execute 64 sec latency 281.814 ms 20 5082 5.86 MB/sec execute 65 sec latency 299.859 ms 20 5120 5.78 MB/sec execute 66 sec latency 258.674 ms 20 5152 5.70 MB/sec execute 67 sec latency 332.754 ms 20 5195 5.63 MB/sec execute 68 sec latency 209.220 ms 20 5223 5.56 MB/sec execute 69 sec latency 272.498 ms 20 5269 5.48 MB/sec execute 70 sec latency 245.251 ms 20 5307 5.42 MB/sec execute 71 sec latency 166.216 ms 20 5346 5.35 MB/sec execute 72 sec latency 126.813 ms 20 5388 5.29 MB/sec execute 73 sec latency 203.312 ms 20 5437 5.23 MB/sec execute 74 sec latency 264.827 ms 20 5465 5.16 MB/sec execute 75 sec latency 441.559 ms 20 5501 5.11 MB/sec execute 76 sec latency 495.683 ms 20 5561 5.06 MB/sec execute 77 sec latency 188.944 ms 20 5621 5.01 MB/sec execute 78 sec latency 161.839 ms 20 5663 4.97 MB/sec execute 79 sec latency 108.566 ms 20 5735 4.93 MB/sec execute 80 sec latency 84.056 ms 20 5796 4.96 MB/sec execute 81 sec latency 274.337 ms 20 5848 4.95 MB/sec execute 82 sec latency 292.001 ms 20 5918 5.01 MB/sec execute 83 sec latency 430.156 ms 20 5964 5.00 MB/sec execute 84 sec latency 322.768 ms 20 6012 5.01 MB/sec execute 85 sec latency 401.740 ms 20 6049 4.99 MB/sec execute 86 sec latency 443.081 ms 20 6110 5.10 MB/sec execute 87 sec latency 354.596 ms 20 6205 5.23 MB/sec execute 88 sec latency 375.887 ms 20 6308 5.45 MB/sec execute 89 sec latency 279.936 ms 20 6428 5.67 MB/sec execute 90 sec latency 307.212 ms 20 6540 5.81 MB/sec execute 91 sec latency 347.450 ms 20 6635 5.84 MB/sec execute 92 sec latency 402.131 ms 20 6780 5.93 MB/sec execute 93 sec latency 290.688 ms 20 6904 6.09 MB/sec execute 94 sec latency 292.753 ms 20 7008 6.25 MB/sec execute 95 sec latency 259.273 ms 20 7117 6.47 MB/sec execute 96 sec latency 163.556 ms 20 7198 6.53 MB/sec execute 97 sec latency 84.340 ms 20 7269 6.55 MB/sec execute 98 sec latency 86.257 ms 20 7324 6.55 MB/sec execute 99 sec latency 102.257 ms 20 7364 6.55 MB/sec execute 100 sec latency 170.164 ms 20 7409 6.50 MB/sec execute 101 sec latency 144.476 ms 20 7453 6.45 MB/sec execute 102 sec latency 92.895 ms 20 7502 6.41 MB/sec execute 103 sec latency 88.261 ms 20 7547 6.35 MB/sec execute 104 sec latency 94.106 ms 20 7576 6.29 MB/sec execute 105 sec latency 143.536 ms 20 7622 6.23 MB/sec execute 106 sec latency 286.167 ms 20 7674 6.18 MB/sec execute 107 sec latency 307.850 ms 20 7720 6.14 MB/sec execute 108 sec latency 379.479 ms 20 7780 6.09 MB/sec execute 109 sec latency 317.543 ms 20 7819 6.06 MB/sec execute 110 sec latency 401.064 ms 20 7858 6.02 MB/sec execute 111 sec latency 262.959 ms 20 7897 5.98 MB/sec execute 112 sec latency 303.850 ms 20 7941 5.95 MB/sec execute 113 sec latency 326.016 ms 20 7976 5.91 MB/sec execute 114 sec latency 326.127 ms 20 8027 5.89 MB/sec execute 115 sec latency 297.302 ms 20 8070 5.87 MB/sec execute 116 sec latency 282.269 ms 20 8116 5.86 MB/sec execute 117 sec latency 373.078 ms 20 8171 5.85 MB/sec execute 118 sec latency 234.903 ms 20 8219 5.86 MB/sec execute 119 sec latency 389.079 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23062 53.258 259.038 Close 16924 12.997 65.930 Rename 973 79.540 259.170 Unlink 4800 18.012 75.674 Qpathinfo 21240 12.554 151.883 Qfileinfo 3630 0.218 46.281 Qfsinfo 3953 0.203 20.162 Sfileinfo 1822 48.616 170.822 Find 8176 3.383 126.671 WriteX 11579 4.042 96.721 ReadX 36070 0.027 9.835 LockX 80 17.556 32.322 UnlockX 80 16.441 34.655 Flush 1700 207.976 1049.571 Throughput 5.85555 MB/sec 20 clients 20 procs max_latency=1049.586 ms stopping dbench on /mnt/lustre/d0.oleg252-client.virtnet at Thu Dec 12 10:06:35 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg252-client.virtnet /mnt/lustre/d0.oleg252-client.virtnet /mnt/lustre/d0.oleg252-client.virtnet removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg252-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:42 (1734016002) min OST has 3593216kB available, using 5389824kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5263] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg252-clien 5263M 88310 65 65464 52 125169 29 439.0 101 Latency 33107us 152ms 91393us 857ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg252-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 198 17 8044 35 410 14 302 18 1027 13 491 12 Latency 31486us 13050us 55837us 16089us 3839us 22971us 1.97,1.97,oleg252-client.virtnet,1,1734006054,5263M,,,,88310,65,65464,52,,,125169,29,439.0,101,10,,,,,198,17,8044,35,410,14,302,18,1027,13,491,12,,33107us,152ms,,91393us,857ms,31486us,13050us,55837us,16089us,3839us,22971us debug=0x33f0484 PASS bonnie (356s) == sanity-benchmark test iozone: iozone ================== 10:12:38 (1734016358) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:54 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 127050 102511 103194 156619 69250 89580 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:09 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 27579 27335 105053 106003 99215 33888 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1153s) == sanity-benchmark test fsx: fsx ======================== 10:31:51 (1734017511) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 17909 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 17909 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0xf443 truncating to largest ever: 0x3c671b truncating to largest ever: 0x3da7b1 truncating to largest ever: 0x50c361 truncating to largest ever: 0x54dad6 truncating to largest ever: 0x55e3cb truncating to largest ever: 0x55f4ea 002000 1734017517.427146 read 0x3cb34a thru 0x3cee37 (0x3aee bytes) 003000 1734017519.728470 read 0x0b7add thru 0x0bd3a2 (0x58c6 bytes) 004000 1734017522.572821 read 0x47463d thru 0x47a3a3 (0x5d67 bytes) 005000 1734017525.612797 write 0x0d588a thru 0x0dd83e (0x7fb5 bytes) 006000 1734017528.696100 trunc from 0x14aec7 to 0x43dd53 (0x2f2e8d bytes) 010000 1734017540.516379 read 0x06dd4f thru 0x07023b (0x24ed bytes) 013000 1734017548.946674 trunc from 0x440a51 to 0x2845be (0x1bc492 bytes) truncating to largest ever: 0x560a7a 015000 1734017554.761481 mapread 0x2a5014 thru 0x2a5ede (0xecb bytes) 017000 1734017561.020664 read 0x1db894 thru 0x1e2588 (0x6cf5 bytes) 018000 1734017563.843132 read 0x4cedfb thru 0x4cf4d1 (0x6d7 bytes) 026000 1734017587.476692 write 0x350550 thru 0x3587f7 (0x82a8 bytes) 027000 1734017590.316932 trunc from 0x36daea to 0x4ecf45 (0x17f45c bytes) 028000 1734017593.265136 read 0x2f0470 thru 0x2ff76f (0xf300 bytes) 032000 1734017604.857330 trunc from 0x549d74 to 0x3424f7 (0x20787c bytes) 034000 1734017611.113576 trunc from 0x24643f to 0x55bfb5 (0x315b77 bytes) 035000 1734017613.893441 mapwrite 0x4c9b38 thru 0x4d2436 (0x88ff bytes) 037000 1734017618.912385 trunc from 0x4b5508 to 0x431fb0 (0x83557 bytes) 039000 1734017624.172796 mapwrite 0x40621b thru 0x4090d3 (0x2eb9 bytes) 040000 1734017627.009786 write 0x00fb94 thru 0x01f56b (0xf9d8 bytes) 041000 1734017629.793441 trunc from 0x18f062 to 0x456c47 (0x2c7be6 bytes) 042000 1734017632.392690 mapread 0x101dae thru 0x10e26e (0xc4c1 bytes) 043000 1734017635.174070 trunc from 0x4f78ff to 0x068c44 (0x48ecba bytes) 045000 1734017641.206261 mapread 0x124d1f thru 0x12ecab (0x9f8d bytes) truncating to largest ever: 0x561b0e 050000 1734017656.262962 write 0x535bc0 thru 0x53e9d3 (0x8e14 bytes) 052000 1734017662.606169 trunc from 0x483f3f to 0x5435c6 (0xbf688 bytes) 053000 1734017665.775001 read 0x4a39dd thru 0x4aaa73 (0x7097 bytes) 056000 1734017674.709485 mapread 0x016513 thru 0x025529 (0xf017 bytes) 058000 1734017680.396850 read 0x1fc1c3 thru 0x1fd833 (0x1671 bytes) 060000 1734017686.104151 write 0x192186 thru 0x1997a9 (0x7624 bytes) 064000 1734017697.523663 trunc from 0x24fd87 to 0x3cb249 (0x17b4c3 bytes) 067000 1734017706.085565 mapwrite 0x0554fc thru 0x064c2a (0xf72f bytes) 072000 1734017721.077776 write 0x1599da thru 0x15d4c6 (0x3aed bytes) 073000 1734017724.046256 mapread 0x08479e thru 0x0944ca (0xfd2d bytes) 075000 1734017729.468079 write 0x13a6e2 thru 0x147af4 (0xd413 bytes) 080000 1734017743.498763 mapread 0x37fd15 thru 0x38ced9 (0xd1c5 bytes) 081000 1734017746.259293 trunc from 0x4ae73f to 0x4047fe (0xa9f40 bytes) 082000 1734017749.212181 write 0x135c6a thru 0x13bc55 (0x5fec bytes) 083000 1734017752.102898 read 0x0bdb7c thru 0x0c96f3 (0xbb78 bytes) 084000 1734017754.781134 read 0x1ca73d thru 0x1ce968 (0x422c bytes) 087000 1734017762.952609 mapread 0x02571d thru 0x02f199 (0x9a7d bytes) 088000 1734017765.595741 read 0x23763f thru 0x23acfd (0x36bf bytes) 091000 1734017773.699416 mapread 0x2ea979 thru 0x2f3ffe (0x9686 bytes) 092000 1734017776.537414 write 0x356f5b thru 0x3665ea (0xf690 bytes) 093000 1734017779.123245 mapread 0x403d14 thru 0x40b93f (0x7c2c bytes) 094000 1734017781.829847 mapwrite 0x3d442c thru 0x3e0583 (0xc158 bytes) skipping zero size write 100000 1734017799.350063 trunc from 0x52815d to 0x25e24d (0x2c9f0f bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2482766 (2432 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (289s) == sanity-benchmark test complete, duration 1966 sec ===== 10:36:40 (1734017800) === sanity-benchmark: start cleanup 10:36:40 (1734017800) === === sanity-benchmark: finish cleanup 10:36:41 (1734017801) ===