-----============= acceptance-small: sanity-benchmark ============----- Fri May 10 05:20:07 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 05:20:13 (1715332813) === oleg230-client.virtnet: executing check_config_client /mnt/lustre oleg230-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg230-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b638a800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b638a800.idle_timeout=debug disable quota as required oleg230-server: oleg230-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 05:20:21 (1715332821) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 05:20:22 (1715332822) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6881] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg230-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg230-client.virtnet at Fri May 10 05:20:24 EDT 2024 waiting for dbench pid 8937 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 115 105.84 MB/sec warmup 1 sec latency 132.152 ms 20 262 98.71 MB/sec warmup 2 sec latency 112.578 ms 20 389 92.16 MB/sec warmup 3 sec latency 62.131 ms 20 510 88.62 MB/sec warmup 4 sec latency 75.032 ms 20 659 84.41 MB/sec warmup 5 sec latency 275.591 ms 20 714 70.77 MB/sec warmup 6 sec latency 212.243 ms 20 783 61.13 MB/sec warmup 7 sec latency 185.513 ms 20 863 53.97 MB/sec warmup 8 sec latency 179.660 ms 20 932 48.38 MB/sec warmup 9 sec latency 215.555 ms 20 1071 45.79 MB/sec warmup 10 sec latency 167.941 ms 20 1210 41.91 MB/sec warmup 11 sec latency 47.007 ms 20 1416 43.34 MB/sec warmup 12 sec latency 81.312 ms 20 1525 40.11 MB/sec warmup 13 sec latency 182.617 ms 20 1644 37.39 MB/sec warmup 14 sec latency 150.964 ms 20 1785 35.05 MB/sec warmup 15 sec latency 116.327 ms 20 1885 32.97 MB/sec warmup 16 sec latency 142.932 ms 20 2031 31.23 MB/sec warmup 17 sec latency 114.297 ms 20 2177 29.74 MB/sec warmup 18 sec latency 35.667 ms 20 2315 28.92 MB/sec warmup 19 sec latency 204.628 ms 20 2433 28.17 MB/sec warmup 20 sec latency 170.873 ms 20 2564 27.64 MB/sec warmup 21 sec latency 202.082 ms 20 2793 28.89 MB/sec warmup 22 sec latency 243.160 ms 20 2962 29.03 MB/sec warmup 23 sec latency 286.391 ms 20 3310 26.18 MB/sec execute 1 sec latency 252.228 ms 20 3528 37.30 MB/sec execute 2 sec latency 152.528 ms 20 3693 33.18 MB/sec execute 3 sec latency 43.743 ms 20 3826 29.10 MB/sec execute 4 sec latency 47.346 ms 20 3908 23.99 MB/sec execute 5 sec latency 52.615 ms 20 4013 20.36 MB/sec execute 6 sec latency 53.066 ms 20 4111 17.54 MB/sec execute 7 sec latency 187.330 ms 20 4225 15.69 MB/sec execute 8 sec latency 275.034 ms 20 4293 14.33 MB/sec execute 9 sec latency 230.519 ms 20 4353 13.15 MB/sec execute 10 sec latency 217.101 ms 20 4446 12.44 MB/sec execute 11 sec latency 195.916 ms 20 4581 12.25 MB/sec execute 12 sec latency 121.414 ms 20 4757 12.82 MB/sec execute 13 sec latency 134.498 ms 20 5004 15.98 MB/sec execute 14 sec latency 180.538 ms 20 5125 15.03 MB/sec execute 15 sec latency 119.017 ms 20 5260 14.24 MB/sec execute 16 sec latency 100.932 ms 20 5399 13.54 MB/sec execute 17 sec latency 64.439 ms 20 5533 12.93 MB/sec execute 18 sec latency 127.981 ms 20 5698 12.53 MB/sec execute 19 sec latency 110.938 ms 20 5846 12.57 MB/sec execute 20 sec latency 133.996 ms 20 5980 12.75 MB/sec execute 21 sec latency 235.993 ms 20 6088 12.73 MB/sec execute 22 sec latency 180.478 ms 20 6320 14.19 MB/sec execute 23 sec latency 163.257 ms 20 6565 15.79 MB/sec execute 24 sec latency 175.046 ms 20 6817 16.04 MB/sec execute 25 sec latency 200.078 ms 20 7070 17.51 MB/sec execute 26 sec latency 150.021 ms 20 7241 17.83 MB/sec execute 27 sec latency 39.391 ms 20 7376 17.82 MB/sec execute 28 sec latency 46.621 ms 20 7513 17.40 MB/sec execute 29 sec latency 33.485 ms 20 7603 16.83 MB/sec execute 30 sec latency 177.265 ms 20 7743 16.36 MB/sec execute 31 sec latency 177.277 ms 20 7830 15.97 MB/sec execute 32 sec latency 212.297 ms 20 7912 15.60 MB/sec execute 33 sec latency 156.542 ms 20 8023 15.32 MB/sec execute 34 sec latency 148.371 ms 20 8155 15.30 MB/sec execute 35 sec latency 189.386 ms 20 8387 15.55 MB/sec execute 36 sec latency 96.750 ms 20 8616 16.40 MB/sec execute 37 sec latency 117.058 ms 20 8747 16.03 MB/sec execute 38 sec latency 102.214 ms 20 8870 15.67 MB/sec execute 39 sec latency 131.438 ms 20 8977 15.33 MB/sec execute 40 sec latency 92.308 ms 20 9106 15.04 MB/sec execute 41 sec latency 132.508 ms 20 9251 14.82 MB/sec execute 42 sec latency 99.538 ms 20 9389 14.72 MB/sec execute 43 sec latency 187.763 ms 20 9538 14.84 MB/sec execute 44 sec latency 192.622 ms 20 9663 14.87 MB/sec execute 45 sec latency 202.841 ms 20 9898 15.62 MB/sec execute 46 sec latency 179.340 ms 20 10166 16.30 MB/sec execute 47 sec latency 213.402 ms 20 10465 16.70 MB/sec execute 48 sec latency 162.774 ms 20 10732 17.55 MB/sec execute 49 sec latency 116.845 ms 20 10916 17.60 MB/sec execute 50 sec latency 32.828 ms 20 11055 17.38 MB/sec execute 51 sec latency 165.499 ms 20 11167 17.07 MB/sec execute 52 sec latency 142.920 ms 20 11312 16.80 MB/sec execute 53 sec latency 148.359 ms 20 11403 16.57 MB/sec execute 54 sec latency 178.689 ms 20 11511 16.37 MB/sec execute 55 sec latency 153.218 ms 20 11650 16.27 MB/sec execute 56 sec latency 142.449 ms 20 11839 16.39 MB/sec execute 57 sec latency 119.823 ms 20 12074 16.80 MB/sec execute 58 sec latency 84.168 ms 20 12251 16.79 MB/sec execute 59 sec latency 98.665 ms 20 12402 16.56 MB/sec execute 60 sec latency 85.490 ms 20 12577 16.36 MB/sec execute 61 sec latency 67.346 ms 20 12810 16.28 MB/sec execute 62 sec latency 70.993 ms 20 13067 16.41 MB/sec execute 63 sec latency 116.420 ms 20 13310 16.73 MB/sec execute 64 sec latency 152.955 ms 20 13698 17.66 MB/sec execute 65 sec latency 119.941 ms 20 14002 17.94 MB/sec execute 66 sec latency 145.571 ms 20 14237 18.40 MB/sec execute 67 sec latency 147.754 ms 20 14384 18.40 MB/sec execute 68 sec latency 44.709 ms 20 14478 18.31 MB/sec execute 69 sec latency 242.821 ms 20 14551 18.09 MB/sec execute 70 sec latency 207.696 ms 20 14634 17.88 MB/sec execute 71 sec latency 144.869 ms 20 14720 17.64 MB/sec execute 72 sec latency 182.476 ms 20 14820 17.42 MB/sec execute 73 sec latency 236.225 ms 20 14923 17.25 MB/sec execute 74 sec latency 259.453 ms 20 14985 17.05 MB/sec execute 75 sec latency 180.986 ms 20 15065 16.91 MB/sec execute 76 sec latency 507.192 ms 20 15153 16.78 MB/sec execute 77 sec latency 873.556 ms 20 15264 16.69 MB/sec execute 78 sec latency 202.670 ms 20 15428 16.74 MB/sec execute 79 sec latency 123.856 ms 20 15593 16.81 MB/sec execute 80 sec latency 129.751 ms 20 15748 16.94 MB/sec execute 81 sec latency 130.132 ms 20 15873 16.77 MB/sec execute 82 sec latency 94.729 ms 20 16001 16.60 MB/sec execute 83 sec latency 95.168 ms 20 16138 16.44 MB/sec execute 84 sec latency 90.261 ms 20 16335 16.37 MB/sec execute 85 sec latency 100.019 ms 20 16532 16.37 MB/sec execute 86 sec latency 99.721 ms 20 16703 16.45 MB/sec execute 87 sec latency 176.063 ms 20 16826 16.44 MB/sec execute 88 sec latency 262.007 ms 20 17055 16.77 MB/sec execute 89 sec latency 164.221 ms 20 17266 17.00 MB/sec execute 90 sec latency 194.685 ms 20 17492 17.12 MB/sec execute 91 sec latency 179.365 ms 20 17718 17.41 MB/sec execute 92 sec latency 154.963 ms 20 17897 17.51 MB/sec execute 93 sec latency 147.099 ms 20 18023 17.48 MB/sec execute 94 sec latency 137.813 ms 20 18135 17.37 MB/sec execute 95 sec latency 111.931 ms 20 18253 17.22 MB/sec execute 96 sec latency 164.558 ms 20 18374 17.07 MB/sec execute 97 sec latency 148.578 ms 20 18492 16.96 MB/sec execute 98 sec latency 166.002 ms 20 18576 16.83 MB/sec execute 99 sec latency 154.869 ms 20 18670 16.72 MB/sec execute 100 sec latency 178.525 ms 20 18786 16.61 MB/sec execute 101 sec latency 143.086 ms 20 18965 16.71 MB/sec execute 102 sec latency 151.718 ms 20 19146 16.77 MB/sec execute 103 sec latency 109.495 ms 20 19298 16.88 MB/sec execute 104 sec latency 156.363 ms 20 19379 16.73 MB/sec execute 105 sec latency 150.289 ms 20 19457 16.59 MB/sec execute 106 sec latency 261.943 ms 20 19561 16.46 MB/sec execute 107 sec latency 133.678 ms 20 19685 16.35 MB/sec execute 108 sec latency 95.797 ms 20 19813 16.24 MB/sec execute 109 sec latency 96.516 ms 20 19959 16.16 MB/sec execute 110 sec latency 118.076 ms 20 20089 16.10 MB/sec execute 111 sec latency 112.246 ms 20 20248 16.13 MB/sec execute 112 sec latency 137.497 ms 20 20431 16.21 MB/sec execute 113 sec latency 174.657 ms 20 20645 16.44 MB/sec execute 114 sec latency 187.147 ms 20 20826 16.60 MB/sec execute 115 sec latency 182.830 ms 20 21060 16.72 MB/sec execute 116 sec latency 150.424 ms 20 21292 16.93 MB/sec execute 117 sec latency 165.989 ms 20 21481 17.05 MB/sec execute 118 sec latency 115.064 ms 20 21624 17.03 MB/sec execute 119 sec latency 144.493 ms 20 cleanup 120 sec 3 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 64650 19.090 112.869 Close 47245 4.967 28.534 Rename 2708 23.798 66.179 Unlink 13180 7.097 36.951 Qpathinfo 58054 4.182 60.600 Qfileinfo 9953 0.108 12.359 Qfsinfo 11028 0.046 8.911 Sfileinfo 5018 12.856 60.087 Find 22802 0.745 57.084 WriteX 31639 1.521 41.370 ReadX 101480 0.018 7.427 LockX 200 6.264 20.319 UnlockX 200 6.107 16.153 Flush 4425 88.637 873.547 Throughput 17.0307 MB/sec 20 clients 20 procs max_latency=873.556 ms stopping dbench on /mnt/lustre/d0.oleg230-client.virtnet at Fri May 10 05:22:49 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg230-client.virtnet /mnt/lustre/d0.oleg230-client.virtnet /mnt/lustre/d0.oleg230-client.virtnet removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg230-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (151s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 05:22:55 (1715332975) min OST has 3043328kB available, using 4564992kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6881] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4458] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg230-clien 4458M 68973 48 123046 86 312398 56 1133 140 Latency 141ms 40904us 32871us 401ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg230-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 232 18 5181 24 316 13 268 17 752 13 355 13 Latency 24445us 29618us 92046us 16111us 6831us 17921us 1.97,1.97,oleg230-client.virtnet,1,1715323130,4458M,,,,68973,48,123046,86,,,312398,56,1133,140,10,,,,,232,18,5181,24,316,13,268,17,752,13,355,13,,141ms,40904us,,32871us,401ms,24445us,29618us,92046us,16111us,6831us,17921us debug=0x33f0484 PASS bonnie (291s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 05:27:49 (1715333269) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 8365 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 8365 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x31d884 truncating to largest ever: 0x52cc38 truncating to largest ever: 0x553251 truncating to largest ever: 0x558815 004000 1715333290.176646 trunc from 0x4040fe to 0x234a0e (0x1cf6ef bytes) truncating to largest ever: 0x55d56f truncating to largest ever: 0x560d24 006000 1715333299.129007 read 0x096498 thru 0x0985d2 (0x213b bytes) 010000 1715333317.821591 read 0x068b97 thru 0x07606c (0xd4d6 bytes) 012000 1715333326.795353 read 0x30ff0f thru 0x31c55d (0xc64f bytes) 013000 1715333332.594230 trunc from 0x5324e6 to 0x172bbb (0x3bf92a bytes) truncating to largest ever: 0x562078 017000 1715333351.475074 read 0x0a27d6 thru 0x0a8c83 (0x64ae bytes) 018000 1715333355.663660 write 0x472ad2 thru 0x47789d (0x4dcc bytes) 021000 1715333368.678183 trunc from 0x53c5bc to 0x442bae (0xf9a0d bytes) 024000 1715333382.624732 mapread 0x09b6b9 thru 0x0a618a (0xaad2 bytes) 025000 1715333386.728825 mapwrite 0x217998 thru 0x2197b8 (0x1e21 bytes) 029000 1715333400.419191 read 0x2e7c41 thru 0x2ec496 (0x4856 bytes) 030000 1715333404.361617 write 0x1ce124 thru 0x1dd240 (0xf11d bytes) truncating to largest ever: 0x56248b 031000 1715333408.575567 read 0x3ed82b thru 0x3f3a04 (0x61da bytes) skipping zero size read 034000 1715333420.193576 mapread 0x3eced7 thru 0x3f6185 (0x92af bytes) 036000 1715333425.879685 mapread 0x16baf9 thru 0x16f2d0 (0x37d8 bytes) 038000 1715333432.681720 mapwrite 0x344b78 thru 0x35246f (0xd8f8 bytes) 039000 1715333435.769765 trunc from 0x297a7a to 0x4b276f (0x21acf6 bytes) 045000 1715333455.739958 trunc from 0x1b5f09 to 0x034b53 (0x1813b5 bytes) truncating to largest ever: 0x562d2d 046000 1715333459.768830 mapread 0x0b14ea thru 0x0b4ad9 (0x35f0 bytes) 047000 1715333463.421996 mapread 0x0bd992 thru 0x0bf30a (0x1979 bytes) 048000 1715333466.471442 mapwrite 0x4bbe40 thru 0x4c3126 (0x72e7 bytes) skipping zero size read 052000 1715333479.069030 mapread 0x09874a thru 0x099c0c (0x14c3 bytes) 053000 1715333481.934354 read 0x2d5830 thru 0x2d7956 (0x2127 bytes) 054000 1715333485.079929 mapread 0x0632f7 thru 0x069047 (0x5d51 bytes) 056000 1715333491.654127 mapread 0x153a62 thru 0x15d974 (0x9f13 bytes) 057000 1715333495.475685 trunc from 0x4fa985 to 0x309363 (0x1f1621 bytes) 058000 1715333498.788293 mapread 0x35f53d thru 0x36110e (0x1bd2 bytes) 062000 1715333512.106126 trunc from 0x491178 to 0x0a97b7 (0x3e79c0 bytes) 063000 1715333515.528558 trunc from 0x545c7a to 0x4e83ab (0x5d8ce bytes) 065000 1715333521.999618 trunc from 0x48963b to 0x114483 (0x3751b7 bytes) 069000 1715333535.388098 write 0x5585b3 thru 0x562dff (0xa84d bytes) 072000 1715333545.331745 mapread 0x3e1d0f thru 0x3ee594 (0xc886 bytes) 073000 1715333548.968238 mapwrite 0x07a56c thru 0x088c63 (0xe6f8 bytes) 074000 1715333552.432956 mapwrite 0x4bf6f6 thru 0x4c25b9 (0x2ec4 bytes) 075000 1715333555.566765 read 0x01d5ee thru 0x01e64f (0x1062 bytes) 076000 1715333558.741943 write 0x0907b5 thru 0x094e2f (0x467b bytes) 077000 1715333562.205000 write 0x1944e5 thru 0x1a2ef5 (0xea11 bytes) 078000 1715333565.327924 read 0x07fdcf thru 0x088401 (0x8633 bytes) 080000 1715333572.100855 trunc from 0x4492f1 to 0x010eef (0x438401 bytes) 081000 1715333574.850176 trunc from 0x4f35c9 to 0x52909a (0x35ad2 bytes) 085000 1715333586.011069 trunc from 0x3eebbc to 0x3ba69c (0x3451f bytes) 092000 1715333605.812519 mapread 0x031c81 thru 0x036ad3 (0x4e53 bytes) 096000 1715333617.958262 mapwrite 0x339f9b thru 0x343429 (0x948f bytes) 098000 1715333623.467371 mapread 0x0acab8 thru 0x0b58dd (0x8e26 bytes) 099000 1715333626.168529 trunc from 0x276c80 to 0x3cbb4a (0x154ecb bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (361s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 05:33:51 (1715333631) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1715333641.751451 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1715333648.960385 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1715333652.937876 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1715333667.280958 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1715333670.251261 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1715333682.421776 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1715333685.558284 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1715333691.688339 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1715333697.844903 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1715333701.033042 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1715333707.216348 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1715333710.727314 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1715333723.764178 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1715333730.465256 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1715333741.112569 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1715333750.521542 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1715333753.490440 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1715333767.210157 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1715333770.750514 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1715333780.571576 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1715333783.675186 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1715333787.058440 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1715333796.020522 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1715333803.281507 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1715333810.182276 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1715333814.072859 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1715333850.527474 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1715333862.199937 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1715333866.323971 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1715333869.623015 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1715333873.012664 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1715333883.963972 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1715333887.716512 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1715333899.221832 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1715333903.354637 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1715333913.863817 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1715333924.546106 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1715333928.159663 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1715333937.864191 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1715333955.074517 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1715333958.119265 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1715333964.630380 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1715333971.611543 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (344s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1169 sec ===== 05:39:36 (1715333976) === sanity-benchmark: start cleanup 05:39:36 (1715333976) === === sanity-benchmark: finish cleanup 05:39:36 (1715333976) ===