-----============= acceptance-small: sanity-benchmark ============----- Sat May 11 16:54:24 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg154-client.virtnet: executing check_config_client /mnt/lustre oleg154-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg154-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012bdba000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012bdba000.idle_timeout=debug disable quota as required oleg154-server: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 16:54:38 (1715460878) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7465] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg154-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg154-client.virtnet at Sat May 11 16:54:39 EDT 2024 waiting for dbench pid 9606 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 290 215.25 MB/sec warmup 1 sec latency 41.043 ms 20 658 210.99 MB/sec warmup 2 sec latency 163.563 ms 20 905 144.58 MB/sec warmup 3 sec latency 558.962 ms 20 1438 130.05 MB/sec warmup 4 sec latency 40.613 ms 20 1902 105.59 MB/sec warmup 5 sec latency 18.026 ms 20 2431 93.97 MB/sec warmup 6 sec latency 19.090 ms 20 3205 98.44 MB/sec warmup 7 sec latency 22.989 ms 20 3828 99.38 MB/sec warmup 8 sec latency 23.610 ms 20 4173 89.20 MB/sec warmup 9 sec latency 74.603 ms 20 4543 82.29 MB/sec warmup 10 sec latency 36.842 ms 20 5056 82.12 MB/sec warmup 11 sec latency 21.757 ms 20 5469 75.87 MB/sec warmup 12 sec latency 19.087 ms 20 6001 72.94 MB/sec warmup 13 sec latency 17.705 ms 20 6774 76.87 MB/sec warmup 14 sec latency 25.621 ms 20 7353 78.39 MB/sec warmup 15 sec latency 24.972 ms 20 7674 74.04 MB/sec warmup 16 sec latency 38.497 ms 20 8039 70.64 MB/sec warmup 17 sec latency 41.989 ms 20 8535 71.09 MB/sec warmup 18 sec latency 21.582 ms 20 8953 67.99 MB/sec warmup 19 sec latency 22.327 ms 20 9505 66.29 MB/sec warmup 20 sec latency 17.965 ms 20 10152 68.75 MB/sec warmup 21 sec latency 21.282 ms 20 10807 70.24 MB/sec warmup 22 sec latency 21.960 ms 20 11124 68.09 MB/sec warmup 23 sec latency 21.373 ms 20 11868 44.63 MB/sec execute 1 sec latency 52.957 ms 20 12302 47.23 MB/sec execute 2 sec latency 46.807 ms 20 12747 37.18 MB/sec execute 3 sec latency 110.902 ms 20 13271 44.14 MB/sec execute 4 sec latency 171.010 ms 20 13773 50.46 MB/sec execute 5 sec latency 111.144 ms 20 14223 51.53 MB/sec execute 6 sec latency 304.235 ms 20 14601 49.60 MB/sec execute 7 sec latency 1304.319 ms 20 14957 49.22 MB/sec execute 8 sec latency 2304.422 ms 20 15310 45.10 MB/sec execute 9 sec latency 3304.532 ms 20 15743 46.43 MB/sec execute 10 sec latency 4304.607 ms 20 16248 49.12 MB/sec execute 11 sec latency 5304.684 ms 20 16554 46.58 MB/sec execute 12 sec latency 6304.762 ms 20 16874 44.98 MB/sec execute 13 sec latency 7304.849 ms 20 17230 44.33 MB/sec execute 14 sec latency 8304.917 ms 20 17608 42.36 MB/sec execute 15 sec latency 9304.989 ms 20 18071 44.00 MB/sec execute 16 sec latency 10305.071 ms 20 18543 45.69 MB/sec execute 17 sec latency 11305.145 ms 20 18854 44.34 MB/sec execute 18 sec latency 12305.217 ms 20 19233 44.07 MB/sec execute 19 sec latency 13305.291 ms 20 19634 44.39 MB/sec execute 20 sec latency 14305.424 ms 20 20018 43.35 MB/sec execute 21 sec latency 15305.526 ms 20 20518 44.77 MB/sec execute 22 sec latency 16305.688 ms 20 20911 45.00 MB/sec execute 23 sec latency 17305.769 ms 20 21211 43.69 MB/sec execute 24 sec latency 18306.010 ms 20 21554 43.29 MB/sec execute 25 sec latency 19306.206 ms 20 21916 42.82 MB/sec execute 26 sec latency 20306.265 ms 20 22319 42.47 MB/sec execute 27 sec latency 21306.436 ms 20 22890 44.15 MB/sec execute 28 sec latency 22306.503 ms 20 23253 44.20 MB/sec execute 29 sec latency 23306.583 ms 20 23577 43.47 MB/sec execute 30 sec latency 24306.659 ms 20 23966 43.89 MB/sec execute 31 sec latency 25306.806 ms 20 24308 43.09 MB/sec execute 32 sec latency 26306.888 ms 20 24696 42.93 MB/sec execute 33 sec latency 27306.967 ms 20 25249 44.36 MB/sec execute 34 sec latency 28307.040 ms 20 25552 43.89 MB/sec execute 35 sec latency 29307.101 ms 20 25855 43.14 MB/sec execute 36 sec latency 30307.170 ms 20 26233 43.33 MB/sec execute 37 sec latency 31307.266 ms 20 26567 42.36 MB/sec execute 38 sec latency 32307.342 ms 20 26988 42.48 MB/sec execute 39 sec latency 33307.430 ms 20 27567 43.73 MB/sec execute 40 sec latency 34307.501 ms 20 27881 43.34 MB/sec execute 41 sec latency 35307.577 ms 20 28228 42.88 MB/sec execute 42 sec latency 36307.667 ms 20 28631 43.06 MB/sec execute 43 sec latency 37307.733 ms 20 29016 42.56 MB/sec execute 44 sec latency 38307.811 ms 20 29361 42.65 MB/sec execute 45 sec latency 39307.906 ms 20 29719 42.89 MB/sec execute 46 sec latency 40307.982 ms 20 29979 42.62 MB/sec execute 47 sec latency 41308.064 ms 20 30187 42.10 MB/sec execute 48 sec latency 42308.145 ms 20 30410 41.59 MB/sec execute 49 sec latency 43308.231 ms 20 30626 41.13 MB/sec execute 50 sec latency 44308.346 ms 20 30864 40.79 MB/sec execute 51 sec latency 45308.432 ms 20 31110 40.41 MB/sec execute 52 sec latency 46308.615 ms 20 31445 40.52 MB/sec execute 53 sec latency 47308.772 ms 20 31719 40.44 MB/sec execute 54 sec latency 48308.843 ms 20 31970 40.21 MB/sec execute 55 sec latency 49308.946 ms 20 32231 40.02 MB/sec execute 56 sec latency 50309.014 ms 20 32477 39.77 MB/sec execute 57 sec latency 51309.096 ms 20 32736 39.67 MB/sec execute 58 sec latency 52309.181 ms 20 32952 39.25 MB/sec execute 59 sec latency 53309.250 ms 20 33183 38.84 MB/sec execute 60 sec latency 54309.369 ms 20 33445 38.69 MB/sec execute 61 sec latency 55309.438 ms 20 33777 38.85 MB/sec execute 62 sec latency 56309.530 ms 20 34043 38.72 MB/sec execute 63 sec latency 57309.638 ms 20 34274 38.47 MB/sec execute 64 sec latency 58309.744 ms 20 34527 38.29 MB/sec execute 65 sec latency 59309.879 ms 20 34757 38.03 MB/sec execute 66 sec latency 60309.968 ms 20 34998 37.71 MB/sec execute 67 sec latency 61310.041 ms 20 35238 37.50 MB/sec execute 68 sec latency 62310.107 ms 20 35552 37.59 MB/sec execute 69 sec latency 63310.235 ms 20 35821 37.52 MB/sec execute 70 sec latency 64310.343 ms 20 36063 37.39 MB/sec execute 71 sec latency 65310.408 ms 20 36307 37.24 MB/sec execute 72 sec latency 66310.487 ms 20 36562 37.06 MB/sec execute 73 sec latency 67310.561 ms 20 36789 36.87 MB/sec execute 74 sec latency 68310.631 ms 20 37013 36.58 MB/sec execute 75 sec latency 69310.754 ms 20 37324 36.68 MB/sec execute 76 sec latency 70310.846 ms 20 37598 36.65 MB/sec execute 77 sec latency 71310.932 ms 20 37785 36.31 MB/sec execute 78 sec latency 72311.120 ms 20 38019 36.14 MB/sec execute 79 sec latency 73311.296 ms 20 38296 36.10 MB/sec execute 80 sec latency 74311.387 ms 20 38564 36.07 MB/sec execute 81 sec latency 75311.525 ms 20 38780 35.84 MB/sec execute 82 sec latency 76311.598 ms 20 39041 35.72 MB/sec execute 83 sec latency 77311.692 ms 20 39336 35.77 MB/sec execute 84 sec latency 78311.760 ms 20 39562 35.61 MB/sec execute 85 sec latency 79311.845 ms 20 39791 35.42 MB/sec execute 86 sec latency 80312.145 ms 20 40045 35.30 MB/sec execute 87 sec latency 81312.267 ms 20 40313 35.28 MB/sec execute 88 sec latency 82312.340 ms 20 40586 35.30 MB/sec execute 89 sec latency 83312.509 ms 20 40840 35.19 MB/sec execute 90 sec latency 84312.592 ms 20 41053 35.01 MB/sec execute 91 sec latency 85312.672 ms 20 41266 34.80 MB/sec execute 92 sec latency 86312.772 ms 20 41536 34.74 MB/sec execute 93 sec latency 87312.857 ms 20 41780 34.65 MB/sec execute 94 sec latency 88313.245 ms 20 42058 34.61 MB/sec execute 95 sec latency 89313.308 ms 20 42306 34.56 MB/sec execute 96 sec latency 90313.392 ms 20 42595 34.59 MB/sec execute 97 sec latency 91313.458 ms 20 42858 34.51 MB/sec execute 98 sec latency 92313.545 ms 20 43101 34.39 MB/sec execute 99 sec latency 93313.630 ms 20 43370 34.40 MB/sec execute 100 sec latency 94313.719 ms 20 43603 34.26 MB/sec execute 101 sec latency 95313.795 ms 20 43845 34.13 MB/sec execute 102 sec latency 96313.888 ms 20 44105 34.07 MB/sec execute 103 sec latency 97314.049 ms 20 44373 34.01 MB/sec execute 104 sec latency 98314.207 ms 20 44616 33.93 MB/sec execute 105 sec latency 99314.284 ms 20 44875 33.90 MB/sec execute 106 sec latency 100314.380 ms 20 45110 33.77 MB/sec execute 107 sec latency 101314.488 ms 20 45371 33.74 MB/sec execute 108 sec latency 102314.572 ms 20 45670 33.77 MB/sec execute 109 sec latency 103314.671 ms 20 45941 33.75 MB/sec execute 110 sec latency 104314.749 ms 20 46169 33.65 MB/sec execute 111 sec latency 105315.223 ms 20 46432 33.57 MB/sec execute 112 sec latency 106315.303 ms 20 46667 33.48 MB/sec execute 113 sec latency 107315.380 ms 20 46933 33.46 MB/sec execute 114 sec latency 108315.456 ms 20 47192 33.40 MB/sec execute 115 sec latency 109315.541 ms 20 47461 33.37 MB/sec execute 116 sec latency 110315.609 ms 20 47714 33.36 MB/sec execute 117 sec latency 111315.674 ms 20 47983 33.30 MB/sec execute 118 sec latency 112315.739 ms 20 48218 33.25 MB/sec execute 119 sec latency 113315.809 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 128052 7.257 21445.907 Close 94497 8.868 114942.894 Rename 5446 24.480 76026.286 Unlink 25400 6.535 22351.468 Qpathinfo 116204 1.103 67.176 Qfileinfo 20366 0.051 3.886 Qfsinfo 21054 0.022 2.882 Sfileinfo 10604 9.713 12106.723 Find 44743 0.230 25.176 WriteX 63385 0.663 14.956 ReadX 200646 0.009 1.831 LockX 414 3.137 92.785 UnlockX 414 4.225 170.232 Flush 8916 4.795 44.037 Throughput 33.2469 MB/sec 20 clients 20 procs max_latency=113315.809 ms stopping dbench on /mnt/lustre/d0.oleg154-client.virtnet at Sat May 11 16:57:04 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg154-client.virtnet /mnt/lustre/d0.oleg154-client.virtnet /mnt/lustre/d0.oleg154-client.virtnet removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg154-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 16:57:06 (1715461026) min OST has 3453968kB available, using 5180952kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7465] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5059] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg154-clien 5059M 156714 98 141013 98 298081 65 3478 197 Latency 4617us 41851us 69747us 5661us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg154-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 390 16 4019 16 526 14 417 16 465 14 716 14 Latency 18913us 6593us 33063us 24278us 14472us 14569us 1.97,1.97,oleg154-client.virtnet,1,1715466710,5059M,,,,156714,98,141013,98,,,298081,65,3478,197,10,,,,,390,16,4019,16,526,14,417,16,465,14,716,14,,4617us,41851us,,69747us,5661us,18913us,6593us,33063us,24278us,14472us,14569us debug=0x33f0484 PASS bonnie (204s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 17:00:31 (1715461231) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 25113 -P /tmp -l 5400984 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 25113 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x4c74cc fallocating to largest ever: 0x5034a6 truncating to largest ever: 0x520be2 fallocating to largest ever: 0x526998 002000 1715461237.227039 fallocate 0x303f77 thru 0x313878 (0xf902 bytes) 006000 1715461246.810049 mapread 0x1b103e thru 0x1be007 (0xcfca bytes) 007000 1715461250.866289 mapwrite 0x024a59 thru 0x033fb3 (0xf55b bytes) 010000 1715461260.828953 read 0x13bdd6 thru 0x148c73 (0xce9e bytes) 011000 1715461264.431527 mapwrite 0x19e4b0 thru 0x1ad50c (0xf05d bytes) 012000 1715461267.579970 read 0x345b47 thru 0x34c330 (0x67ea bytes) 013000 1715461270.047604 read 0x3d18cc thru 0x3d94dd (0x7c12 bytes) 014000 1715461272.606578 punch from 0x180dc9 to 0x189501 (0x8739 bytes) 016000 1715461278.246109 mapread 0x078f7d thru 0x07fb2d (0x6bb1 bytes) 018000 1715461285.663005 fallocate 0x235684 thru 0x242215 (0xcb92 bytes) 019000 1715461289.128523 write 0x08ec71 thru 0x09ca64 (0xddf4 bytes) 024000 1715461303.999774 punch from 0x1eda2d to 0x1ee538 (0xb0c bytes) 025000 1715461308.107647 fallocate 0x01fe04 thru 0x02e177 (0xe374 bytes) 027000 1715461315.562622 read 0x050f1d thru 0x053775 (0x2859 bytes) 028000 1715461319.224867 trunc from 0x35cd7b to 0x2e8526 (0x74854 bytes) 029000 1715461323.447375 write 0x0adb60 thru 0x0b576b (0x7c0c bytes) 030000 1715461327.614257 mapread 0x44df47 thru 0x45cd36 (0xedf0 bytes) 033000 1715461337.923641 trunc from 0x4a63e6 to 0x115e21 (0x3905c4 bytes) 034000 1715461341.159076 fallocate 0x50178e thru 0x507f39 (0x67ac bytes) 036000 1715461346.673852 punch from 0x160ff5 to 0x170c22 (0xfc2e bytes) 037000 1715461349.322568 write 0x2bc74a thru 0x2c663a (0x9ef1 bytes) 038000 1715461352.740276 mapwrite 0x2c0734 thru 0x2c8e56 (0x8723 bytes) 039000 1715461355.361710 read 0x4caddb thru 0x4d3cfb (0x8f21 bytes) 040000 1715461358.524855 mapread 0x1942ee thru 0x19c038 (0x7d4b bytes) 041000 1715461360.987661 mapread 0x32af91 thru 0x32ff9c (0x500c bytes) 042000 1715461363.262018 read 0x1681cf thru 0x17219e (0x9fd0 bytes) 043000 1715461365.933676 mapread 0x1c9288 thru 0x1ca3e3 (0x115c bytes) 044000 1715461370.137123 fallocate 0x46ef51 thru 0x47cbb9 (0xdc69 bytes) 046000 1715461377.605292 write 0x1139ba thru 0x11ca8e (0x90d5 bytes) 047000 1715461381.623978 punch from 0x01e00d to 0x0253c5 (0x73b9 bytes) 048000 1715461385.069231 punch from 0x17f38e to 0x18b462 (0xc0d5 bytes) 049000 1715461390.074324 fallocate 0x4195af thru 0x42696f (0xd3c1 bytes) 050000 1715461393.676340 mapread 0x0022fb thru 0x00752b (0x5231 bytes) 051000 1715461397.083845 fallocate 0x25c894 thru 0x2684b6 (0xbc23 bytes) 052000 1715461401.322394 write 0x2a2596 thru 0x2ac379 (0x9de4 bytes) 053000 1715461404.675218 trunc from 0x3b5d41 to 0x0ac8cb (0x309475 bytes) 056000 1715461412.921546 trunc from 0x2b6067 to 0x0dea5c (0x1d760a bytes) 058000 1715461418.661410 punch from 0x4855f6 to 0x48b807 (0x6212 bytes) 061000 1715461428.161301 mapread 0x334223 thru 0x339474 (0x5252 bytes) 062000 1715461432.347212 fallocate 0x06c174 thru 0x073889 (0x7716 bytes) 063000 1715461436.362144 write 0x308163 thru 0x3137c2 (0xb660 bytes) 064000 1715461440.330836 punch from 0x116b81 to 0x1206c0 (0x9b40 bytes) 065000 1715461445.149311 mapread 0x0e62d7 thru 0x0eb967 (0x5691 bytes) 066000 1715461449.084424 read 0x0b25dd thru 0x0b4337 (0x1d5b bytes) 068000 1715461456.341842 read 0x1d8d48 thru 0x1e42a1 (0xb55a bytes) 069000 1715461460.395689 mapwrite 0x3320e0 thru 0x3372f6 (0x5217 bytes) 070000 1715461463.757980 read 0x2941a6 thru 0x29459b (0x3f6 bytes) 071000 1715461467.231868 write 0x1a3139 thru 0x1a5442 (0x230a bytes) 075000 1715461480.729659 write 0x05d46f thru 0x06942d (0xbfbf bytes) 076000 1715461484.102009 mapread 0x0f725f thru 0x0f79d4 (0x776 bytes) 077000 1715461486.982050 read 0x2c1046 thru 0x2cb6ea (0xa6a5 bytes) 080000 1715461496.566421 fallocate 0x37c2ab thru 0x37ca6b (0x7c1 bytes) 081000 1715461501.212925 mapread 0x09e6a9 thru 0x0a21d6 (0x3b2e bytes) 083000 1715461508.530300 fallocate 0x0aff0c thru 0x0b375d (0x3852 bytes) 084000 1715461511.905566 read 0x1adad1 thru 0x1b5d06 (0x8236 bytes) 085000 1715461514.651784 mapwrite 0x3adbf8 thru 0x3ba400 (0xc809 bytes) 086000 1715461518.285600 read 0x0224f7 thru 0x028fe7 (0x6af1 bytes) 087000 1715461521.431415 trunc from 0x4a0c45 to 0x44583a (0x5b40a bytes) 088000 1715461525.460974 mapwrite 0x3d6129 thru 0x3dec88 (0x8b60 bytes) 089000 1715461529.430983 trunc from 0x272804 to 0x157d39 (0x11aaca bytes) 091000 1715461537.559654 read 0x0506a5 thru 0x05101f (0x97b bytes) 092000 1715461541.123334 trunc from 0x3ef30d to 0x2716b7 (0x17dc55 bytes) 093000 1715461545.074406 read 0x1a5839 thru 0x1aa914 (0x50dc bytes) 094000 1715461548.308868 mapread 0x436a6d thru 0x441670 (0xac04 bytes) 095000 1715461552.383005 mapwrite 0x298886 thru 0x2a21f6 (0x9971 bytes) 096000 1715461556.861598 punch from 0x023740 to 0x029f77 (0x6838 bytes) 098000 1715461565.795340 mapread 0x0bbe90 thru 0x0be45d (0x25ce bytes) 099000 1715461569.807175 mapread 0x1955af thru 0x195a40 (0x492 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (343s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:06:14 (1715461574) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1715461578.998825 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1715461582.355855 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1715461597.784853 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1715461601.995232 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1715461606.720619 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1715461610.936331 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1715461614.534078 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1715461623.485936 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1715461628.009586 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1715461637.755831 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1715461643.359222 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1715461654.081110 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1715461658.447187 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1715461669.428759 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1715461674.570653 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1715461679.556839 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1715461685.178065 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1715461689.722992 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1715461695.154143 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1715461700.198313 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1715461704.748967 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1715461715.045643 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1715461719.883495 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1715461725.177747 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1715461730.490252 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1715461735.604317 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1715461740.684301 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1715461745.834363 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1715461750.347364 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1715461755.968357 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1715461761.022978 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1715461766.119937 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1715461774.865004 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1715461780.226732 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1715461785.104327 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1715461790.254065 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1715461806.286341 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1715461811.612337 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1715461816.381897 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1715461821.358068 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1715461826.251337 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1715461831.358429 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1715461841.745172 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1715461846.935693 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1715461852.423695 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1715461869.006976 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1715461880.025246 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1715461884.880310 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1715461890.080851 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1715461900.521205 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1715461910.986441 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1715461916.846038 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1715461922.585152 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1715461933.548962 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1715461938.652561 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1715461944.407516 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1715461949.507730 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1715461954.608746 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1715461959.811835 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1715461969.534159 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1715461980.444842 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1715461985.040092 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1715461989.910615 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1715461995.402210 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1715462003.905976 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1715462014.454594 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1715462025.232179 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1715462030.164588 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1715462034.764045 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1715462039.373896 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1715462044.299862 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1715462055.334960 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1715462060.524758 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1715462065.929128 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1715462077.054937 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (504s) == sanity-benchmark test complete, duration 1213 sec ===== 17:14:38 (1715462078)