-----============= acceptance-small: sanity-benchmark ============----- Wed Jun 19 22:48:31 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 22:48:35 (1718851715) === oleg227-client.virtnet: executing check_config_client /mnt/lustre oleg227-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg227-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800abef9000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800abef9000.idle_timeout=debug disable quota as required oleg227-server: oleg227-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 22:48:42 (1718851722) === == sanity-benchmark test dbench: dbench ================== 22:48:42 (1718851722) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6934] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg227-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg227-client.virtnet at Wed Jun 19 22:48:43 EDT 2024 waiting for dbench pid 8921 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 191 152.22 MB/sec warmup 1 sec latency 148.330 ms 20 413 146.14 MB/sec warmup 2 sec latency 55.325 ms 20 659 140.76 MB/sec warmup 3 sec latency 291.284 ms 20 791 107.24 MB/sec warmup 4 sec latency 330.973 ms 20 944 87.33 MB/sec warmup 5 sec latency 137.479 ms 20 1190 76.75 MB/sec warmup 6 sec latency 123.046 ms 20 1487 74.40 MB/sec warmup 7 sec latency 138.671 ms 20 1722 65.61 MB/sec warmup 8 sec latency 113.165 ms 20 2011 58.92 MB/sec warmup 9 sec latency 83.778 ms 20 2308 54.98 MB/sec warmup 10 sec latency 107.843 ms 20 2508 52.07 MB/sec warmup 11 sec latency 155.153 ms 20 2908 55.14 MB/sec warmup 12 sec latency 201.222 ms 20 3278 53.92 MB/sec warmup 13 sec latency 189.933 ms 20 3651 55.44 MB/sec warmup 14 sec latency 194.340 ms 20 3866 53.08 MB/sec warmup 15 sec latency 28.803 ms 20 4056 50.08 MB/sec warmup 16 sec latency 28.367 ms 20 4223 47.32 MB/sec warmup 17 sec latency 476.919 ms 20 4322 44.96 MB/sec warmup 18 sec latency 210.221 ms 20 4462 42.95 MB/sec warmup 19 sec latency 129.357 ms 20 4677 42.07 MB/sec warmup 20 sec latency 150.895 ms 20 5010 42.99 MB/sec warmup 21 sec latency 106.245 ms 20 5238 41.20 MB/sec warmup 22 sec latency 105.753 ms 20 5475 39.59 MB/sec warmup 23 sec latency 76.188 ms 20 6035 30.00 MB/sec execute 1 sec latency 147.620 ms 20 6412 53.63 MB/sec execute 2 sec latency 155.653 ms 20 6828 53.25 MB/sec execute 3 sec latency 151.660 ms 20 7199 58.95 MB/sec execute 4 sec latency 189.890 ms 20 7438 51.40 MB/sec execute 5 sec latency 24.289 ms 20 7617 43.49 MB/sec execute 6 sec latency 301.603 ms 20 7802 37.92 MB/sec execute 7 sec latency 200.710 ms 20 7917 33.85 MB/sec execute 8 sec latency 148.590 ms 20 8101 31.52 MB/sec execute 9 sec latency 129.466 ms 20 8347 31.41 MB/sec execute 10 sec latency 147.460 ms 20 8647 33.03 MB/sec execute 11 sec latency 196.031 ms 20 8871 30.60 MB/sec execute 12 sec latency 77.844 ms 20 9133 28.79 MB/sec execute 13 sec latency 71.689 ms 20 9442 28.20 MB/sec execute 14 sec latency 107.912 ms 20 9708 28.79 MB/sec execute 15 sec latency 152.106 ms 20 10147 32.26 MB/sec execute 16 sec latency 116.544 ms 20 10565 34.31 MB/sec execute 17 sec latency 142.567 ms 20 10874 35.09 MB/sec execute 18 sec latency 66.112 ms 20 11087 33.83 MB/sec execute 19 sec latency 27.921 ms 20 11240 32.22 MB/sec execute 20 sec latency 255.104 ms 20 11384 30.92 MB/sec execute 21 sec latency 303.216 ms 20 11522 29.90 MB/sec execute 22 sec latency 152.880 ms 20 11714 29.45 MB/sec execute 23 sec latency 115.770 ms 20 12020 30.05 MB/sec execute 24 sec latency 88.450 ms 20 12295 29.90 MB/sec execute 25 sec latency 145.860 ms 20 12545 28.92 MB/sec execute 26 sec latency 75.336 ms 20 12863 28.34 MB/sec execute 27 sec latency 66.212 ms 20 13156 28.54 MB/sec execute 28 sec latency 134.501 ms 20 13582 30.42 MB/sec execute 29 sec latency 125.862 ms 20 13993 31.36 MB/sec execute 30 sec latency 163.847 ms 20 14349 32.39 MB/sec execute 31 sec latency 112.775 ms 20 14584 31.98 MB/sec execute 32 sec latency 23.751 ms 20 14745 31.11 MB/sec execute 33 sec latency 273.564 ms 20 14932 30.35 MB/sec execute 34 sec latency 254.583 ms 20 15096 29.77 MB/sec execute 35 sec latency 100.648 ms 20 15355 29.81 MB/sec execute 36 sec latency 106.254 ms 20 15696 30.48 MB/sec execute 37 sec latency 98.179 ms 20 15949 29.78 MB/sec execute 38 sec latency 68.867 ms 20 16214 29.24 MB/sec execute 39 sec latency 74.525 ms 20 16525 29.12 MB/sec execute 40 sec latency 155.811 ms 20 16824 29.39 MB/sec execute 41 sec latency 169.333 ms 20 17251 30.61 MB/sec execute 42 sec latency 157.467 ms 20 17660 31.27 MB/sec execute 43 sec latency 135.306 ms 20 17988 31.69 MB/sec execute 44 sec latency 69.101 ms 20 18180 31.27 MB/sec execute 45 sec latency 163.525 ms 20 18367 30.67 MB/sec execute 46 sec latency 168.336 ms 20 18544 30.20 MB/sec execute 47 sec latency 182.413 ms 20 18741 29.92 MB/sec execute 48 sec latency 137.812 ms 20 18994 29.85 MB/sec execute 49 sec latency 137.030 ms 20 19330 30.23 MB/sec execute 50 sec latency 72.108 ms 20 19588 29.77 MB/sec execute 51 sec latency 82.176 ms 20 19860 29.43 MB/sec execute 52 sec latency 87.487 ms 20 20205 29.44 MB/sec execute 53 sec latency 86.663 ms 20 20516 29.76 MB/sec execute 54 sec latency 146.112 ms 20 20944 30.63 MB/sec execute 55 sec latency 167.838 ms 20 21362 31.17 MB/sec execute 56 sec latency 151.921 ms 20 21632 31.26 MB/sec execute 57 sec latency 120.355 ms 20 21807 30.90 MB/sec execute 58 sec latency 119.853 ms 20 22013 30.48 MB/sec execute 59 sec latency 172.491 ms 20 22214 30.20 MB/sec execute 60 sec latency 131.319 ms 20 22413 29.93 MB/sec execute 61 sec latency 160.607 ms 20 22689 29.88 MB/sec execute 62 sec latency 95.267 ms 20 23016 30.15 MB/sec execute 63 sec latency 98.633 ms 20 23266 29.92 MB/sec execute 64 sec latency 107.609 ms 20 23556 29.75 MB/sec execute 65 sec latency 101.205 ms 20 23887 29.73 MB/sec execute 66 sec latency 96.065 ms 20 24166 29.90 MB/sec execute 67 sec latency 177.520 ms 20 24555 30.52 MB/sec execute 68 sec latency 167.627 ms 20 24936 30.76 MB/sec execute 69 sec latency 179.123 ms 20 25202 30.92 MB/sec execute 70 sec latency 110.887 ms 20 25397 30.68 MB/sec execute 71 sec latency 165.593 ms 20 25618 30.41 MB/sec execute 72 sec latency 111.997 ms 20 25809 30.14 MB/sec execute 73 sec latency 171.792 ms 20 26001 29.86 MB/sec execute 74 sec latency 128.987 ms 20 26266 29.80 MB/sec execute 75 sec latency 147.432 ms 20 26610 30.16 MB/sec execute 76 sec latency 90.267 ms 20 26895 30.01 MB/sec execute 77 sec latency 95.463 ms 20 27199 29.86 MB/sec execute 78 sec latency 76.938 ms 20 27517 29.85 MB/sec execute 79 sec latency 154.503 ms 20 27783 29.93 MB/sec execute 80 sec latency 163.508 ms 20 28173 30.36 MB/sec execute 81 sec latency 119.238 ms 20 28545 30.65 MB/sec execute 82 sec latency 137.582 ms 20 28818 30.74 MB/sec execute 83 sec latency 108.645 ms 20 29038 30.60 MB/sec execute 84 sec latency 152.620 ms 20 29265 30.35 MB/sec execute 85 sec latency 173.403 ms 20 29447 30.08 MB/sec execute 86 sec latency 174.305 ms 20 29677 29.91 MB/sec execute 87 sec latency 123.612 ms 20 29959 29.93 MB/sec execute 88 sec latency 135.218 ms 20 30296 30.20 MB/sec execute 89 sec latency 97.558 ms 20 30571 30.04 MB/sec execute 90 sec latency 92.609 ms 20 30878 29.97 MB/sec execute 91 sec latency 78.724 ms 20 31170 29.92 MB/sec execute 92 sec latency 152.188 ms 20 31470 30.09 MB/sec execute 93 sec latency 160.926 ms 20 31807 30.34 MB/sec execute 94 sec latency 168.015 ms 20 32156 30.59 MB/sec execute 95 sec latency 129.454 ms 20 32395 30.61 MB/sec execute 96 sec latency 153.319 ms 20 32619 30.48 MB/sec execute 97 sec latency 118.646 ms 20 32838 30.24 MB/sec execute 98 sec latency 204.672 ms 20 33013 30.02 MB/sec execute 99 sec latency 214.204 ms 20 33227 29.84 MB/sec execute 100 sec latency 214.595 ms 20 33479 29.80 MB/sec execute 101 sec latency 214.753 ms 20 33826 30.12 MB/sec execute 102 sec latency 119.252 ms 20 34116 30.03 MB/sec execute 103 sec latency 90.715 ms 20 34420 29.93 MB/sec execute 104 sec latency 111.989 ms 20 34711 29.88 MB/sec execute 105 sec latency 154.260 ms 20 35004 29.98 MB/sec execute 106 sec latency 166.903 ms 20 35395 30.27 MB/sec execute 107 sec latency 179.769 ms 20 35738 30.49 MB/sec execute 108 sec latency 129.005 ms 20 35997 30.49 MB/sec execute 109 sec latency 122.053 ms 20 36226 30.39 MB/sec execute 110 sec latency 135.213 ms 20 36452 30.19 MB/sec execute 111 sec latency 178.313 ms 20 36636 29.98 MB/sec execute 112 sec latency 128.520 ms 20 36878 29.88 MB/sec execute 113 sec latency 119.894 ms 20 37203 30.07 MB/sec execute 114 sec latency 113.231 ms 20 37522 30.11 MB/sec execute 115 sec latency 96.298 ms 20 37818 30.07 MB/sec execute 116 sec latency 113.538 ms 20 38146 29.99 MB/sec execute 117 sec latency 73.012 ms 20 38406 29.98 MB/sec execute 118 sec latency 148.533 ms 20 38788 30.29 MB/sec execute 119 sec latency 164.503 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 114243 10.069 59.861 Close 83866 2.350 22.026 Rename 4932 13.504 46.659 Unlink 23182 4.288 44.976 Qpathinfo 103614 2.353 59.928 Qfileinfo 18347 0.068 7.877 Qfsinfo 19364 0.028 3.154 Sfileinfo 9338 6.571 26.915 Find 40568 0.424 33.678 WriteX 57135 0.804 23.639 ReadX 184079 0.012 2.817 LockX 400 3.013 20.901 UnlockX 400 2.863 16.310 Flush 8055 63.097 303.210 Throughput 30.289 MB/sec 20 clients 20 procs max_latency=303.216 ms stopping dbench on /mnt/lustre/d0.oleg227-client.virtnet at Wed Jun 19 22:51:08 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg227-client.virtnet /mnt/lustre/d0.oleg227-client.virtnet /mnt/lustre/d0.oleg227-client.virtnet removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg227-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 22:51:11 (1718851871) min OST has 3112960kB available, using 4669440kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6934] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4560] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg227-clien 4560M 157710 98 146804 95 407799 85 2599 123 Latency 1575us 36461us 32041us 503ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg227-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 442 15 9151 33 595 10 484 15 1203 12 584 10 Latency 13337us 12879us 52812us 16973us 3817us 12159us 1.97,1.97,oleg227-client.virtnet,1,1718861371,4560M,,,,157710,98,146804,95,,,407799,85,2599,123,10,,,,,442,15,9151,33,595,10,484,15,1203,12,584,10,,1575us,36461us,,32041us,503ms,13337us,12879us,52812us,16973us,3817us,12159us debug=0x33f0484 PASS bonnie (170s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 22:54:02 (1718852042) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 31614 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 31614 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x45ec truncating to largest ever: 0x3c667e truncating to largest ever: 0x5324cb truncating to largest ever: 0x55c9e1 truncating to largest ever: 0x55d43e 003000 1718852053.636872 read 0x0048f0 thru 0x00d62c (0x8d3d bytes) 005000 1718852060.011741 trunc from 0x2d8332 to 0x434d9d (0x15ca6c bytes) truncating to largest ever: 0x562d1f 007000 1718852067.807351 mapread 0x30cbe9 thru 0x311339 (0x4751 bytes) 009000 1718852074.000766 mapread 0x03c803 thru 0x0457d3 (0x8fd1 bytes) 010000 1718852076.512875 write 0x43beb3 thru 0x43f519 (0x3667 bytes) 011000 1718852079.829755 write 0x2565ba thru 0x260eeb (0xa932 bytes) 016000 1718852097.453603 mapread 0x259869 thru 0x26666e (0xce06 bytes) 017000 1718852101.404195 read 0x25f750 thru 0x25fa12 (0x2c3 bytes) 019000 1718852108.393725 mapwrite 0x2e7a2f thru 0x2f73c4 (0xf996 bytes) 021000 1718852114.819757 write 0x4d135c thru 0x4dbf11 (0xabb6 bytes) 024000 1718852124.023493 read 0x533875 thru 0x5408c7 (0xd053 bytes) 029000 1718852140.345077 mapread 0x1956c7 thru 0x197c16 (0x2550 bytes) 030000 1718852143.866958 write 0x3ca3f5 thru 0x3d030d (0x5f19 bytes) 031000 1718852147.354596 write 0x042a87 thru 0x044877 (0x1df1 bytes) 033000 1718852153.499989 trunc from 0x017eed to 0x23d466 (0x22557a bytes) 036000 1718852163.252574 mapwrite 0x55268d thru 0x55cd55 (0xa6c9 bytes) 038000 1718852169.585008 mapread 0x2c997e thru 0x2d142f (0x7ab2 bytes) 040000 1718852175.642093 write 0x085ee2 thru 0x0933b4 (0xd4d3 bytes) 041000 1718852180.762070 write 0x451dc7 thru 0x45d4d6 (0xb710 bytes) 043000 1718852189.531035 trunc from 0x322771 to 0x046f37 (0x2db839 bytes) 044000 1718852193.281319 trunc from 0x34a21b to 0x490180 (0x145f66 bytes) 046000 1718852199.209939 mapwrite 0x14b0b0 thru 0x14bf83 (0xed4 bytes) 049000 1718852208.461831 mapwrite 0x012618 thru 0x017bc9 (0x55b2 bytes) 050000 1718852211.769877 mapread 0x3df120 thru 0x3df41c (0x2fd bytes) 051000 1718852215.159445 write 0x1ca6f1 thru 0x1d73ad (0xccbd bytes) 054000 1718852223.884007 write 0x1c3af4 thru 0x1cfd79 (0xc286 bytes) 056000 1718852229.669055 read 0x2730f3 thru 0x274319 (0x1227 bytes) 057000 1718852233.033891 trunc from 0x485ac0 to 0x430ad3 (0x54fec bytes) 058000 1718852235.874457 trunc from 0x450341 to 0x3bbabd (0x94883 bytes) 059000 1718852238.967658 mapwrite 0x0b43c1 thru 0x0b72f1 (0x2f31 bytes) 061000 1718852245.682957 trunc from 0x4533a9 to 0x4b79d7 (0x6462f bytes) 065000 1718852257.609665 write 0x15880a thru 0x15d4cf (0x4cc6 bytes) skipping zero size read 069000 1718852269.075353 mapwrite 0x3869cf thru 0x395463 (0xea95 bytes) 071000 1718852274.838784 mapread 0x252333 thru 0x255613 (0x32e1 bytes) 073000 1718852280.643807 trunc from 0x2ef803 to 0x043a2d (0x2abdd5 bytes) 075000 1718852286.386346 trunc from 0x3d611e to 0x3d5b56 (0x5c7 bytes) 078000 1718852294.827695 mapread 0x192d52 thru 0x197e6f (0x511e bytes) 081000 1718852304.755818 write 0x2e3046 thru 0x2e4dd3 (0x1d8e bytes) 087000 1718852324.006155 trunc from 0x2b3561 to 0x51e549 (0x26afe9 bytes) 089000 1718852330.553749 write 0x219336 thru 0x21ac19 (0x18e4 bytes) 090000 1718852334.538266 write 0x3f7fc7 thru 0x4063fb (0xe435 bytes) 092000 1718852341.142647 trunc from 0x3eba60 to 0x2ad155 (0x13e90a bytes) 095000 1718852351.248929 mapwrite 0x4f5def thru 0x4fa2bb (0x44cd bytes) 096000 1718852354.186877 mapwrite 0x2efa19 thru 0x2ff5ee (0xfbd6 bytes) 100000 1718852367.549047 trunc from 0x1ca03a to 0x34f31e (0x1852e5 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (326s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 22:59:28 (1718852368) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1718852378.280939 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1718852386.025319 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1718852389.724091 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1718852404.392162 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1718852407.741353 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1718852421.238038 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1718852424.599453 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1718852431.313837 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1718852438.878373 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1718852443.873056 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1718852451.214231 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1718852455.266602 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1718852470.973510 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1718852478.988329 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1718852493.336800 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1718852510.431877 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1718852515.770523 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1718852540.587496 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1718852546.454335 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1718852558.661896 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1718852563.295289 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1718852567.771415 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1718852581.305628 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1718852589.633724 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1718852599.907536 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1718852606.414062 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1718852656.860089 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1718852668.912954 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1718852674.151465 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1718852678.237979 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1718852684.067294 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1718852698.816568 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1718852703.918162 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1718852722.317583 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1718852729.252170 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1718852741.663052 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1718852754.760000 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1718852759.155091 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1718852769.783683 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1718852793.812616 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1718852798.219309 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1718852808.676500 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1718852820.175297 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (459s) == sanity-benchmark test complete, duration 1116 sec ===== 23:07:07 (1718852827) === sanity-benchmark: start cleanup 23:07:07 (1718852827) === === sanity-benchmark: finish cleanup 23:07:07 (1718852827) ===