-----============= acceptance-small: sanity-benchmark ============----- Tue Aug 27 11:41:52 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 11:41:57 (1724773317) === oleg143-client.virtnet: executing check_config_client /mnt/lustre oleg143-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg143-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6fe4000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6fe4000.idle_timeout=debug disable quota as required oleg143-server: oleg143-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 11:42:03 (1724773323) === == sanity-benchmark test dbench: dbench ================== 11:42:03 (1724773323) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6991] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg143-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg143-client.virtnet at Tue Aug 27 11:42:04 EDT 2024 waiting for dbench pid 8995 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 204 160.75 MB/sec warmup 1 sec latency 95.339 ms 20 463 162.56 MB/sec warmup 2 sec latency 38.104 ms 20 700 141.32 MB/sec warmup 3 sec latency 258.412 ms 20 888 108.38 MB/sec warmup 4 sec latency 75.855 ms 20 1163 92.04 MB/sec warmup 5 sec latency 87.650 ms 20 1487 86.82 MB/sec warmup 6 sec latency 90.396 ms 20 1764 75.10 MB/sec warmup 7 sec latency 75.867 ms 20 2029 66.38 MB/sec warmup 8 sec latency 68.103 ms 20 2364 62.05 MB/sec warmup 9 sec latency 77.578 ms 20 2651 59.82 MB/sec warmup 10 sec latency 121.198 ms 20 3106 61.72 MB/sec warmup 11 sec latency 117.090 ms 20 3572 64.10 MB/sec warmup 12 sec latency 87.835 ms 20 3847 61.19 MB/sec warmup 13 sec latency 23.080 ms 20 4042 57.24 MB/sec warmup 14 sec latency 24.149 ms 20 4226 53.64 MB/sec warmup 15 sec latency 189.595 ms 20 4385 50.79 MB/sec warmup 16 sec latency 221.036 ms 20 4587 48.60 MB/sec warmup 17 sec latency 75.568 ms 20 4870 47.87 MB/sec warmup 18 sec latency 83.626 ms 20 5159 47.64 MB/sec warmup 19 sec latency 99.154 ms 20 5363 45.42 MB/sec warmup 20 sec latency 55.252 ms 20 5613 43.51 MB/sec warmup 21 sec latency 61.364 ms 20 5913 42.72 MB/sec warmup 22 sec latency 112.704 ms 20 6236 42.88 MB/sec warmup 23 sec latency 125.210 ms 20 7212 88.50 MB/sec execute 1 sec latency 116.633 ms 20 7440 54.05 MB/sec execute 2 sec latency 28.202 ms 20 7652 37.50 MB/sec execute 3 sec latency 180.963 ms 20 7861 29.88 MB/sec execute 4 sec latency 114.805 ms 20 8044 25.95 MB/sec execute 5 sec latency 84.219 ms 20 8308 26.52 MB/sec execute 6 sec latency 84.930 ms 20 8636 30.61 MB/sec execute 7 sec latency 64.402 ms 20 8867 27.28 MB/sec execute 8 sec latency 51.643 ms 20 9104 24.76 MB/sec execute 9 sec latency 48.562 ms 20 9408 24.13 MB/sec execute 10 sec latency 51.792 ms 20 9710 26.14 MB/sec execute 11 sec latency 207.153 ms 20 10224 31.52 MB/sec execute 12 sec latency 83.078 ms 20 10698 35.71 MB/sec execute 13 sec latency 130.810 ms 20 10956 34.95 MB/sec execute 14 sec latency 24.654 ms 20 11160 32.96 MB/sec execute 15 sec latency 129.198 ms 20 11387 31.30 MB/sec execute 16 sec latency 114.008 ms 20 11592 30.18 MB/sec execute 17 sec latency 150.306 ms 20 11866 30.39 MB/sec execute 18 sec latency 105.282 ms 20 12168 31.39 MB/sec execute 19 sec latency 78.685 ms 20 12377 30.00 MB/sec execute 20 sec latency 60.748 ms 20 12604 28.78 MB/sec execute 21 sec latency 56.362 ms 20 12861 27.98 MB/sec execute 22 sec latency 51.134 ms 20 13169 28.50 MB/sec execute 23 sec latency 72.444 ms 20 13642 30.96 MB/sec execute 24 sec latency 94.431 ms 20 14152 32.90 MB/sec execute 25 sec latency 94.150 ms 20 14460 33.34 MB/sec execute 26 sec latency 29.701 ms 20 14686 32.48 MB/sec execute 27 sec latency 128.216 ms 20 14915 31.51 MB/sec execute 28 sec latency 174.190 ms 20 15108 30.87 MB/sec execute 29 sec latency 110.692 ms 20 15392 31.03 MB/sec execute 30 sec latency 82.813 ms 20 15723 31.59 MB/sec execute 31 sec latency 58.071 ms 20 15992 30.74 MB/sec execute 32 sec latency 44.610 ms 20 16272 30.01 MB/sec execute 33 sec latency 34.557 ms 20 16582 29.86 MB/sec execute 34 sec latency 85.430 ms 20 16985 31.11 MB/sec execute 35 sec latency 116.655 ms 20 17475 32.42 MB/sec execute 36 sec latency 92.506 ms 20 17883 33.43 MB/sec execute 37 sec latency 77.519 ms 20 18144 33.08 MB/sec execute 38 sec latency 20.296 ms 20 18367 32.34 MB/sec execute 39 sec latency 138.091 ms 20 18569 31.74 MB/sec execute 40 sec latency 116.947 ms 20 18796 31.39 MB/sec execute 41 sec latency 121.495 ms 20 19119 31.70 MB/sec execute 42 sec latency 64.336 ms 20 19393 31.71 MB/sec execute 43 sec latency 49.108 ms 20 19631 31.09 MB/sec execute 44 sec latency 64.645 ms 20 19903 30.64 MB/sec execute 45 sec latency 52.535 ms 20 20155 30.34 MB/sec execute 46 sec latency 63.209 ms 20 20472 30.95 MB/sec execute 47 sec latency 119.375 ms 20 20890 31.74 MB/sec execute 48 sec latency 105.297 ms 20 21239 32.25 MB/sec execute 49 sec latency 101.550 ms 20 21513 32.51 MB/sec execute 50 sec latency 75.320 ms 20 21726 32.16 MB/sec execute 51 sec latency 29.958 ms 20 21910 31.61 MB/sec execute 52 sec latency 220.828 ms 20 22079 31.13 MB/sec execute 53 sec latency 131.545 ms 20 22244 30.72 MB/sec execute 54 sec latency 115.427 ms 20 22486 30.64 MB/sec execute 55 sec latency 107.926 ms 20 22779 30.99 MB/sec execute 56 sec latency 100.073 ms 20 22997 30.65 MB/sec execute 57 sec latency 66.812 ms 20 23189 30.18 MB/sec execute 58 sec latency 58.193 ms 20 23464 29.83 MB/sec execute 59 sec latency 41.988 ms 20 23758 29.80 MB/sec execute 60 sec latency 86.911 ms 20 24088 30.38 MB/sec execute 61 sec latency 119.510 ms 20 24529 30.94 MB/sec execute 62 sec latency 110.501 ms 20 24945 31.72 MB/sec execute 63 sec latency 96.693 ms 20 25203 31.58 MB/sec execute 64 sec latency 22.419 ms 20 25428 31.17 MB/sec execute 65 sec latency 198.668 ms 20 25614 30.78 MB/sec execute 66 sec latency 259.462 ms 20 25813 30.48 MB/sec execute 67 sec latency 100.900 ms 20 26115 30.54 MB/sec execute 68 sec latency 80.490 ms 20 26414 30.83 MB/sec execute 69 sec latency 74.716 ms 20 26665 30.45 MB/sec execute 70 sec latency 48.546 ms 20 26918 30.10 MB/sec execute 71 sec latency 96.179 ms 20 27261 30.08 MB/sec execute 72 sec latency 72.078 ms 20 27662 30.66 MB/sec execute 73 sec latency 86.094 ms 20 28110 31.15 MB/sec execute 74 sec latency 115.314 ms 20 28479 31.70 MB/sec execute 75 sec latency 96.671 ms 20 28722 31.61 MB/sec execute 76 sec latency 29.988 ms 20 28926 31.26 MB/sec execute 77 sec latency 62.553 ms 20 29129 30.93 MB/sec execute 78 sec latency 155.996 ms 20 29279 30.63 MB/sec execute 79 sec latency 107.539 ms 20 29529 30.59 MB/sec execute 80 sec latency 94.752 ms 20 29860 30.97 MB/sec execute 81 sec latency 71.931 ms 20 30058 30.63 MB/sec execute 82 sec latency 86.208 ms 20 30279 30.31 MB/sec execute 83 sec latency 48.309 ms 20 30575 30.05 MB/sec execute 84 sec latency 44.463 ms 20 30852 30.02 MB/sec execute 85 sec latency 104.704 ms 20 31271 30.71 MB/sec execute 86 sec latency 96.509 ms 20 31766 31.11 MB/sec execute 87 sec latency 101.615 ms 20 32120 31.46 MB/sec execute 88 sec latency 55.623 ms 20 32375 31.34 MB/sec execute 89 sec latency 19.545 ms 20 32588 31.02 MB/sec execute 90 sec latency 236.275 ms 20 32805 30.78 MB/sec execute 91 sec latency 117.140 ms 20 33094 30.76 MB/sec execute 92 sec latency 84.826 ms 20 33466 31.09 MB/sec execute 93 sec latency 61.843 ms 20 33718 30.81 MB/sec execute 94 sec latency 54.433 ms 20 33975 30.54 MB/sec execute 95 sec latency 49.303 ms 20 34277 30.42 MB/sec execute 96 sec latency 84.470 ms 20 34571 30.58 MB/sec execute 97 sec latency 113.805 ms 20 34992 31.07 MB/sec execute 98 sec latency 108.220 ms 20 35347 31.25 MB/sec execute 99 sec latency 122.764 ms 20 35620 31.45 MB/sec execute 100 sec latency 64.622 ms 20 35815 31.36 MB/sec execute 101 sec latency 42.191 ms 20 35991 31.10 MB/sec execute 102 sec latency 105.397 ms 20 36196 30.84 MB/sec execute 103 sec latency 216.162 ms 20 36357 30.61 MB/sec execute 104 sec latency 117.455 ms 20 36593 30.53 MB/sec execute 105 sec latency 74.531 ms 20 36844 30.53 MB/sec execute 106 sec latency 96.553 ms 20 37100 30.61 MB/sec execute 107 sec latency 63.347 ms 20 37276 30.36 MB/sec execute 108 sec latency 62.167 ms 20 37501 30.12 MB/sec execute 109 sec latency 49.256 ms 20 37776 29.98 MB/sec execute 110 sec latency 63.851 ms 20 38028 30.02 MB/sec execute 111 sec latency 96.179 ms 20 38441 30.48 MB/sec execute 112 sec latency 104.186 ms 20 38880 30.76 MB/sec execute 113 sec latency 108.332 ms 20 39214 31.00 MB/sec execute 114 sec latency 54.896 ms 20 39423 30.89 MB/sec execute 115 sec latency 25.502 ms 20 39598 30.65 MB/sec execute 116 sec latency 153.686 ms 20 39793 30.43 MB/sec execute 117 sec latency 193.448 ms 20 39963 30.24 MB/sec execute 118 sec latency 120.341 ms 20 40227 30.21 MB/sec execute 119 sec latency 80.642 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 117602 10.901 51.517 Close 85995 2.057 17.110 Rename 4975 15.767 45.137 Unlink 24227 3.330 27.094 Qpathinfo 105801 2.656 33.364 Qfileinfo 18125 0.072 7.196 Qfsinfo 19817 0.025 5.316 Sfileinfo 9680 8.760 28.276 Find 41077 0.424 40.211 WriteX 57584 0.777 17.924 ReadX 182693 0.012 4.279 LockX 360 2.969 10.600 UnlockX 360 2.785 8.919 Flush 8304 41.453 259.456 Throughput 30.2122 MB/sec 20 clients 20 procs max_latency=259.462 ms stopping dbench on /mnt/lustre/d0.oleg143-client.virtnet at Tue Aug 27 11:44:28 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg143-client.virtnet /mnt/lustre/d0.oleg143-client.virtnet /mnt/lustre/d0.oleg143-client.virtnet removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg143-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) == sanity-benchmark test bonnie: bonnie++ ================ 11:44:30 (1724773470) min OST has 3407872kB available, using 5111808kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6991] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4992] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg143-clien 4992M 150885 98 141044 95 389489 80 2133 136 Latency 2938us 25768us 27922us 193ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg143-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 450 17 7492 30 584 11 518 16 1280 13 626 12 Latency 19098us 15528us 46947us 17446us 2685us 18278us 1.97,1.97,oleg143-client.virtnet,1,1724764940,4992M,,,,150885,98,141044,95,,,389489,80,2133,136,10,,,,,450,17,7492,30,584,11,518,16,1280,13,626,12,,2938us,25768us,,27922us,193ms,19098us,15528us,46947us,17446us,2685us,18278us debug=0x33f0484 PASS bonnie (180s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 11:47:30 (1724773650) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 27333 -P /tmp -l 5646336 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 27333 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x42624 truncating to largest ever: 0x35200e truncating to largest ever: 0x4d9e80 truncating to largest ever: 0x50a93c truncating to largest ever: 0x50d7e1 truncating to largest ever: 0x51aef5 truncating to largest ever: 0x53c565 truncating to largest ever: 0x546612 truncating to largest ever: 0x55be64 002000 1724773657.167879 read 0x04fd6b thru 0x0507f1 (0xa87 bytes) truncating to largest ever: 0x55cabb truncating to largest ever: 0x56121e 004000 1724773663.076771 mapwrite 0x335414 thru 0x339c48 (0x4835 bytes) 005000 1724773666.081128 read 0x1bc02d thru 0x1c529e (0x9272 bytes) truncating to largest ever: 0x5626b2 009000 1724773676.830005 mapwrite 0x121738 thru 0x128751 (0x701a bytes) 010000 1724773679.783324 mapwrite 0x2e567f thru 0x2e8871 (0x31f3 bytes) 013000 1724773687.946487 read 0x2768fb thru 0x28470c (0xde12 bytes) 014000 1724773690.502845 mapwrite 0x3cfd49 thru 0x3d35d8 (0x3890 bytes) 022000 1724773713.318626 trunc from 0x44f165 to 0x2b78f1 (0x197873 bytes) 023000 1724773716.261860 read 0x12216f thru 0x1276a5 (0x5537 bytes) skipping zero size read 025000 1724773722.062717 write 0x02a49f thru 0x03283d (0x839f bytes) 027000 1724773727.795923 trunc from 0x0cd7fa to 0x34a93b (0x27d142 bytes) 028000 1724773731.144924 mapwrite 0x384746 thru 0x3946db (0xff96 bytes) 030000 1724773737.175689 read 0x1162f3 thru 0x11d3db (0x70e9 bytes) 031000 1724773739.930733 write 0x354e98 thru 0x35bffe (0x7167 bytes) 037000 1724773756.996060 read 0x1d5506 thru 0x1dfc6c (0xa767 bytes) 038000 1724773760.563646 mapwrite 0x18b1d5 thru 0x18b25f (0x8b bytes) 039000 1724773763.724910 read 0x0efefa thru 0x0f495e (0x4a65 bytes) 041000 1724773769.425232 write 0x078880 thru 0x07e6fa (0x5e7b bytes) truncating to largest ever: 0x56272d 046000 1724773784.414881 read 0x182cd8 thru 0x1858c4 (0x2bed bytes) 048000 1724773789.814625 write 0x2541f3 thru 0x2542ae (0xbc bytes) 053000 1724773805.448477 mapread 0x25edf1 thru 0x268795 (0x99a5 bytes) 054000 1724773808.451775 mapwrite 0x09f102 thru 0x0ae53e (0xf43d bytes) 057000 1724773817.253657 mapwrite 0x1bf9b8 thru 0x1c534e (0x5997 bytes) 059000 1724773823.227021 trunc from 0x4f02ce to 0x0dda7a (0x412853 bytes) 065000 1724773840.620147 mapwrite 0x39839c thru 0x3a5e30 (0xda95 bytes) 067000 1724773846.024371 write 0x43ccaa thru 0x440ac2 (0x3e19 bytes) 072000 1724773859.845005 mapread 0x29ec14 thru 0x2a953e (0xa92b bytes) 073000 1724773862.675201 trunc from 0x15fc07 to 0x223d00 (0xc40fa bytes) 078000 1724773877.411117 write 0x0e2923 thru 0x0ef467 (0xcb45 bytes) 080000 1724773882.690025 trunc from 0x4a787a to 0x4afbd3 (0x835a bytes) 085000 1724773896.781209 trunc from 0x02da5e to 0x2acae9 (0x27f08c bytes) 087000 1724773902.070101 read 0x4984e6 thru 0x49e210 (0x5d2b bytes) 088000 1724773904.539852 mapread 0x4ec3cf thru 0x4f01ad (0x3ddf bytes) 089000 1724773907.319381 mapread 0x1d2d94 thru 0x1dce60 (0xa0cd bytes) 091000 1724773912.980669 trunc from 0x562800 to 0x2b3260 (0x2af59f bytes) 092000 1724773915.937542 mapwrite 0x0f46cf thru 0x101a8f (0xd3c1 bytes) 093000 1724773918.632487 read 0x17b031 thru 0x17e625 (0x35f5 bytes) 094000 1724773921.465988 mapread 0x39199f thru 0x39cd2a (0xb38c bytes) 095000 1724773924.164584 mapwrite 0x4db932 thru 0x4dd626 (0x1cf5 bytes) 096000 1724773927.131945 mapwrite 0x0f46a1 thru 0x0fd44a (0x8daa bytes) 100000 1724773938.856409 mapwrite 0x26fda1 thru 0x27400b (0x426b bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (289s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 11:52:19 (1724773939) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1724773949.994311 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1724773957.385721 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1724773960.832324 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1724773974.879414 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1724773977.957183 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1724773991.124131 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1724773994.450009 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1724774000.778160 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1724774007.433530 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1724774010.527385 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1724774016.862200 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1724774020.319726 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1724774033.135905 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1724774039.188160 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1724774049.406955 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1724774059.415790 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1724774062.272704 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1724774076.888711 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1724774080.846810 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1724774090.814763 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1724774094.150943 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1724774097.732522 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1724774106.992487 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1724774113.382918 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1724774119.772014 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1724774123.206927 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1724774156.087516 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1724774166.039267 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1724774169.632980 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1724774173.027729 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1724774176.643750 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1724774186.927664 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1724774190.329051 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1724774200.954930 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1724774204.667920 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1724774214.877777 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1724774224.929388 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1724774228.247611 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1724774237.793538 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1724774255.583948 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1724774258.664754 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1724774265.097282 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1724774271.826572 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (337s) == sanity-benchmark test complete, duration 964 sec ====== 11:57:56 (1724774276) === sanity-benchmark: start cleanup 11:57:56 (1724774276) === === sanity-benchmark: finish cleanup 11:57:56 (1724774276) ===