-----============= acceptance-small: sanity-benchmark ============----- Tue Jun 3 16:13:13 EDT 2025 oleg348-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanity-benchmark.*ex: No such file or directory excepting tests: skipping tests SLOW=no: iozone oleg348-client.virtnet: executing check_config_client /mnt/lustre oleg348-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg348-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b7c0c800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b7c0c800.idle_timeout=debug disable quota as required oleg348-server: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 16:13:24 (1748981604) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7455] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg348-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg348-client.virtnet at Tue Jun 3 16:13:25 EDT 2025 waiting for dbench pid 9689 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 251 191.14 MB/sec warmup 1 sec latency 43.266 ms 20 529 183.01 MB/sec warmup 2 sec latency 42.365 ms 20 713 141.36 MB/sec warmup 3 sec latency 508.126 ms 20 1058 114.32 MB/sec warmup 4 sec latency 22.913 ms 20 1473 104.13 MB/sec warmup 5 sec latency 29.877 ms 20 1808 87.74 MB/sec warmup 6 sec latency 26.718 ms 20 2198 77.21 MB/sec warmup 7 sec latency 21.602 ms 20 2616 74.80 MB/sec warmup 8 sec latency 26.062 ms 20 3293 78.38 MB/sec warmup 9 sec latency 26.475 ms 20 3794 79.15 MB/sec warmup 10 sec latency 23.651 ms 20 4065 72.87 MB/sec warmup 11 sec latency 26.590 ms 20 4335 67.47 MB/sec warmup 12 sec latency 72.273 ms 20 4673 64.50 MB/sec warmup 13 sec latency 25.901 ms 20 5089 64.57 MB/sec warmup 14 sec latency 34.938 ms 20 5430 60.68 MB/sec warmup 15 sec latency 26.949 ms 20 5808 58.02 MB/sec warmup 16 sec latency 20.218 ms 20 6298 58.49 MB/sec warmup 17 sec latency 21.211 ms 20 6940 61.40 MB/sec warmup 18 sec latency 22.342 ms 20 7383 61.77 MB/sec warmup 19 sec latency 29.358 ms 20 7685 59.38 MB/sec warmup 20 sec latency 34.119 ms 20 7992 57.26 MB/sec warmup 21 sec latency 61.884 ms 20 8357 56.57 MB/sec warmup 22 sec latency 27.627 ms 20 8777 56.04 MB/sec warmup 23 sec latency 25.413 ms 20 9731 58.32 MB/sec execute 1 sec latency 20.430 ms 20 10282 80.87 MB/sec execute 2 sec latency 22.304 ms 20 10808 79.63 MB/sec execute 3 sec latency 24.807 ms 20 11111 64.98 MB/sec execute 4 sec latency 53.709 ms 20 11397 54.98 MB/sec execute 5 sec latency 25.009 ms 20 11717 50.51 MB/sec execute 6 sec latency 50.944 ms 20 12048 46.39 MB/sec execute 7 sec latency 22.478 ms 20 12435 46.38 MB/sec execute 8 sec latency 33.968 ms 20 12767 44.10 MB/sec execute 9 sec latency 69.778 ms 20 13220 44.19 MB/sec execute 10 sec latency 23.301 ms 20 13615 44.73 MB/sec execute 11 sec latency 24.348 ms 20 14172 47.66 MB/sec execute 12 sec latency 28.078 ms 20 14562 48.37 MB/sec execute 13 sec latency 47.579 ms 20 14863 46.95 MB/sec execute 14 sec latency 29.394 ms 20 15142 45.34 MB/sec execute 15 sec latency 47.124 ms 20 15415 43.10 MB/sec execute 16 sec latency 29.298 ms 20 15774 41.97 MB/sec execute 17 sec latency 22.620 ms 20 16181 43.11 MB/sec execute 18 sec latency 28.730 ms 20 16621 43.25 MB/sec execute 19 sec latency 25.978 ms 20 17013 42.96 MB/sec execute 20 sec latency 28.326 ms 20 17355 42.89 MB/sec execute 21 sec latency 31.656 ms 20 17833 43.68 MB/sec execute 22 sec latency 56.351 ms 20 18238 44.60 MB/sec execute 23 sec latency 24.636 ms 20 18548 44.21 MB/sec execute 24 sec latency 27.960 ms 20 18838 42.63 MB/sec execute 25 sec latency 68.759 ms 20 19155 41.55 MB/sec execute 26 sec latency 25.413 ms 20 19523 41.88 MB/sec execute 27 sec latency 22.663 ms 20 19944 42.37 MB/sec execute 28 sec latency 30.828 ms 20 20341 42.20 MB/sec execute 29 sec latency 31.096 ms 20 20688 41.57 MB/sec execute 30 sec latency 22.219 ms 20 21036 41.65 MB/sec execute 31 sec latency 43.040 ms 20 21488 42.22 MB/sec execute 32 sec latency 28.228 ms 20 21947 43.41 MB/sec execute 33 sec latency 25.036 ms 20 22241 42.53 MB/sec execute 34 sec latency 27.547 ms 20 22582 41.53 MB/sec execute 35 sec latency 39.596 ms 20 22935 41.31 MB/sec execute 36 sec latency 26.173 ms 20 23464 42.57 MB/sec execute 37 sec latency 22.347 ms 20 23827 42.34 MB/sec execute 38 sec latency 29.018 ms 20 24170 41.51 MB/sec execute 39 sec latency 26.456 ms 20 24536 41.30 MB/sec execute 40 sec latency 33.765 ms 20 25098 42.51 MB/sec execute 41 sec latency 23.964 ms 20 25584 43.32 MB/sec execute 42 sec latency 23.383 ms 20 25906 42.58 MB/sec execute 43 sec latency 22.133 ms 20 26257 42.04 MB/sec execute 44 sec latency 51.774 ms 20 26748 42.45 MB/sec execute 45 sec latency 23.308 ms 20 27216 43.19 MB/sec execute 46 sec latency 28.263 ms 20 27558 42.48 MB/sec execute 47 sec latency 18.997 ms 20 27922 42.00 MB/sec execute 48 sec latency 31.345 ms 20 28332 42.49 MB/sec execute 49 sec latency 24.579 ms 20 28930 43.44 MB/sec execute 50 sec latency 23.367 ms 20 29319 43.29 MB/sec execute 51 sec latency 21.408 ms 20 29645 42.80 MB/sec execute 52 sec latency 62.925 ms 20 30072 42.89 MB/sec execute 53 sec latency 27.166 ms 20 30538 43.34 MB/sec execute 54 sec latency 23.052 ms 20 30878 43.18 MB/sec execute 55 sec latency 30.709 ms 20 31218 42.53 MB/sec execute 56 sec latency 48.492 ms 20 31580 42.28 MB/sec execute 57 sec latency 23.505 ms 20 32061 42.97 MB/sec execute 58 sec latency 29.235 ms 20 32594 43.46 MB/sec execute 59 sec latency 25.146 ms 20 32954 43.29 MB/sec execute 60 sec latency 26.619 ms 20 33240 43.00 MB/sec execute 61 sec latency 52.113 ms 20 33659 42.95 MB/sec execute 62 sec latency 41.303 ms 20 34018 43.02 MB/sec execute 63 sec latency 29.573 ms 20 34354 43.07 MB/sec execute 64 sec latency 31.357 ms 20 34654 42.49 MB/sec execute 65 sec latency 43.549 ms 20 35027 42.15 MB/sec execute 66 sec latency 23.062 ms 20 35490 42.50 MB/sec execute 67 sec latency 20.020 ms 20 36026 42.96 MB/sec execute 68 sec latency 29.000 ms 20 36414 43.04 MB/sec execute 69 sec latency 88.314 ms 20 36709 42.95 MB/sec execute 70 sec latency 26.760 ms 20 37082 42.82 MB/sec execute 71 sec latency 51.483 ms 20 37436 42.79 MB/sec execute 72 sec latency 27.805 ms 20 37770 42.68 MB/sec execute 73 sec latency 24.605 ms 20 38078 42.46 MB/sec execute 74 sec latency 59.390 ms 20 38421 42.08 MB/sec execute 75 sec latency 27.884 ms 20 38871 42.17 MB/sec execute 76 sec latency 25.585 ms 20 39366 42.45 MB/sec execute 77 sec latency 23.849 ms 20 39918 42.91 MB/sec execute 78 sec latency 19.833 ms 20 40325 43.09 MB/sec execute 79 sec latency 26.071 ms 20 40725 43.04 MB/sec execute 80 sec latency 43.439 ms 20 41053 42.83 MB/sec execute 81 sec latency 24.338 ms 20 41407 42.73 MB/sec execute 82 sec latency 48.948 ms 20 41751 42.55 MB/sec execute 83 sec latency 23.536 ms 20 42118 42.36 MB/sec execute 84 sec latency 23.826 ms 20 42501 42.23 MB/sec execute 85 sec latency 25.062 ms 20 42964 42.48 MB/sec execute 86 sec latency 25.833 ms 20 43510 43.01 MB/sec execute 87 sec latency 28.492 ms 20 43964 43.23 MB/sec execute 88 sec latency 25.260 ms 20 44292 43.06 MB/sec execute 89 sec latency 41.828 ms 20 44576 42.74 MB/sec execute 90 sec latency 30.088 ms 20 44876 42.54 MB/sec execute 91 sec latency 34.411 ms 20 45246 42.53 MB/sec execute 92 sec latency 26.403 ms 20 45626 42.39 MB/sec execute 93 sec latency 22.409 ms 20 46008 42.15 MB/sec execute 94 sec latency 20.376 ms 20 46509 42.42 MB/sec execute 95 sec latency 28.010 ms 20 47117 43.06 MB/sec execute 96 sec latency 28.755 ms 20 47569 43.27 MB/sec execute 97 sec latency 29.818 ms 20 47867 43.04 MB/sec execute 98 sec latency 42.430 ms 20 48165 42.73 MB/sec execute 99 sec latency 75.465 ms 20 48524 42.61 MB/sec execute 100 sec latency 33.452 ms 20 48926 42.71 MB/sec execute 101 sec latency 30.045 ms 20 49292 42.44 MB/sec execute 102 sec latency 24.203 ms 20 49750 42.34 MB/sec execute 103 sec latency 20.165 ms 20 50292 42.81 MB/sec execute 104 sec latency 21.522 ms 20 50889 43.39 MB/sec execute 105 sec latency 27.670 ms 20 51256 43.36 MB/sec execute 106 sec latency 29.466 ms 20 51546 43.03 MB/sec execute 107 sec latency 43.252 ms 20 51865 42.78 MB/sec execute 108 sec latency 36.290 ms 20 52251 42.86 MB/sec execute 109 sec latency 27.405 ms 20 52615 42.79 MB/sec execute 110 sec latency 22.574 ms 20 53036 42.50 MB/sec execute 111 sec latency 19.125 ms 20 53511 42.61 MB/sec execute 112 sec latency 23.262 ms 20 54161 43.21 MB/sec execute 113 sec latency 23.254 ms 20 54665 43.58 MB/sec execute 114 sec latency 24.849 ms 20 54925 43.33 MB/sec execute 115 sec latency 43.341 ms 20 55218 43.02 MB/sec execute 116 sec latency 61.889 ms 20 55559 42.89 MB/sec execute 117 sec latency 22.647 ms 20 55973 43.05 MB/sec execute 118 sec latency 22.505 ms 20 56304 42.79 MB/sec execute 119 sec latency 30.829 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 164686 8.567 68.753 Close 121132 1.879 16.931 Rename 6938 11.815 52.096 Unlink 33149 2.810 42.146 Qpathinfo 149526 1.917 50.328 Qfileinfo 26010 0.066 7.231 Qfsinfo 27234 0.028 4.715 Sfileinfo 13340 5.982 30.614 Find 57638 0.387 32.364 WriteX 81249 1.121 26.817 ReadX 257727 0.011 3.671 LockX 534 2.052 9.510 UnlockX 534 2.104 6.515 Flush 11509 8.018 88.308 Throughput 42.7854 MB/sec 20 clients 20 procs max_latency=88.314 ms stopping dbench on /mnt/lustre/d0.oleg348-client.virtnet at Tue Jun 3 16:15:49 EDT 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg348-client.virtnet /mnt/lustre/d0.oleg348-client.virtnet /mnt/lustre/d0.oleg348-client.virtnet removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg348-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 16:15:52 (1748981752) min OST has 3373204kB available, using 5059806kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7455] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4941] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg348-clien 4941M 160149 99 138695 98 288632 68 4802 245 Latency 3589us 25739us 40409us 5949us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg348-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 439 17 3846 18 616 14 478 17 623 14 780 13 Latency 15361us 13723us 22721us 13797us 7354us 49778us 1.97,1.97,oleg348-client.virtnet,1,1748991455,4941M,,,,160149,99,138695,98,,,288632,68,4802,245,10,,,,,439,17,3846,18,616,14,478,17,623,14,780,13,,3589us,25739us,,40409us,5949us,15361us,13723us,22721us,13797us,7354us,49778us debug=0x33f0484 PASS bonnie (187s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 16:18:59 (1748981939) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 24499 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 24499 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x2aaae7 fallocating to largest ever: 0x48b2f4 truncating to largest ever: 0x4d1b62 fallocating to largest ever: 0x50a01a truncating to largest ever: 0x50e35c fallocating to largest ever: 0x520e89 001000 1748981943.468627 trunc from 0x4274ea to 0x0a9527 (0x37dfc2 bytes) truncating to largest ever: 0x52443f fallocating to largest ever: 0x528540 002000 1748981945.627172 punch from 0x0d0c30 to 0x0df866 (0xec37 bytes) 004000 1748981950.110703 mapread 0x202ae7 thru 0x2102ed (0xd807 bytes) 005000 1748981952.627316 mapwrite 0x4e9550 thru 0x4f8df9 (0xf8aa bytes) 007000 1748981957.682250 trunc from 0x4314f7 to 0x022a00 (0x40eaf6 bytes) 008000 1748981960.035578 fallocate 0x18229e thru 0x183d2d (0x1a90 bytes) 009000 1748981962.381297 write 0x38dcaa thru 0x38e9d3 (0xd2a bytes) 010000 1748981964.904103 fallocate 0x01848e thru 0x01af17 (0x2a8a bytes) 011000 1748981967.324479 mapwrite 0x41f6e0 thru 0x42c1e7 (0xcb08 bytes) 012000 1748981969.543977 trunc from 0x3d762a to 0x0964cf (0x34115a bytes) 013000 1748981972.323469 mapwrite 0x2a73c0 thru 0x2b1fb2 (0xabf3 bytes) 014000 1748981974.645962 trunc from 0x4f6552 to 0x4670d8 (0x8f479 bytes) 015000 1748981977.012671 punch from 0x17f3ce to 0x182e86 (0x3ab9 bytes) 016000 1748981979.378911 mapread 0x31148d thru 0x31350c (0x2080 bytes) 018000 1748981984.036539 mapwrite 0x2c27c7 thru 0x2c67d2 (0x400c bytes) 019000 1748981986.244116 trunc from 0x0945c3 to 0x0d2ad1 (0x3e50f bytes) 020000 1748981988.710925 trunc from 0x3260ac to 0x4b53be (0x18f313 bytes) 021000 1748981990.925929 fallocate 0x4bd7b0 thru 0x4c7819 (0xa06a bytes) skipping zero length fallocate 023000 1748981996.110718 punch from 0x32f3bb to 0x3399f2 (0xa638 bytes) 024000 1748981998.737303 read 0x33134e thru 0x338c5a (0x790d bytes) 025000 1748982001.067841 punch from 0x4bf321 to 0x4cc580 (0xd260 bytes) 026000 1748982003.336640 trunc from 0x2336af to 0x1f0e11 (0x4289d bytes) 027000 1748982006.065406 punch from 0x0d925a to 0x0e6625 (0xd3cc bytes) 029000 1748982011.169308 read 0x1f80d0 thru 0x1ff8e5 (0x7816 bytes) 030000 1748982013.445978 punch from 0x3d975b to 0x3e3adb (0xa381 bytes) 031000 1748982016.033126 punch from 0x0db2af to 0x0e5a9d (0xa7ef bytes) 032000 1748982018.516396 mapread 0x2832e1 thru 0x291ee9 (0xec09 bytes) 033000 1748982020.841424 read 0x144562 thru 0x1477cf (0x326e bytes) 034000 1748982023.479389 write 0x1e3e92 thru 0x1f08b0 (0xca1f bytes) skipping zero size read 036000 1748982028.524110 read 0x1eb6ef thru 0x1fb40d (0xfd1f bytes) 038000 1748982034.229103 read 0x2a24f9 thru 0x2b03a7 (0xdeaf bytes) 040000 1748982040.082233 mapread 0x040565 thru 0x04906a (0x8b06 bytes) 041000 1748982042.790988 punch from 0x093b09 to 0x09d166 (0x965e bytes) 042000 1748982045.328640 write 0x35b085 thru 0x36936c (0xe2e8 bytes) 043000 1748982047.801146 mapread 0x07e06c thru 0x08cc90 (0xec25 bytes) 044000 1748982050.555990 punch from 0x0b5460 to 0x0b98be (0x445f bytes) skipping zero size write 046000 1748982056.212408 mapread 0x066e41 thru 0x07356f (0xc72f bytes) 048000 1748982062.375262 mapread 0x23fc47 thru 0x24976f (0x9b29 bytes) 049000 1748982065.200458 mapread 0x410a4d thru 0x41525a (0x480e bytes) 050000 1748982067.883617 read 0x45819f thru 0x45d06a (0x4ecc bytes) 051000 1748982070.882120 mapwrite 0x0f9684 thru 0x0fb281 (0x1bfe bytes) 052000 1748982073.557448 mapread 0x298fff thru 0x2a0aaf (0x7ab1 bytes) 055000 1748982082.488996 trunc from 0x0939bf to 0x08f0c4 (0x48fa bytes) 057000 1748982088.282859 read 0x24b069 thru 0x251eb5 (0x6e4d bytes) 059000 1748982094.271045 read 0x202cf8 thru 0x205c99 (0x2fa2 bytes) 060000 1748982097.244649 punch from 0x21fa7a to 0x22581b (0x5da2 bytes) 061000 1748982100.062094 write 0x2492a6 thru 0x2547c9 (0xb524 bytes) 062000 1748982102.731751 punch from 0x180f6b to 0x185a80 (0x4b16 bytes) 064000 1748982108.181632 punch from 0x36c9b8 to 0x370a7a (0x40c3 bytes) 065000 1748982111.372019 mapread 0x02fbac thru 0x03dcb5 (0xe10a bytes) 066000 1748982113.990852 fallocate 0x3f7a9f thru 0x3fbc76 (0x41d8 bytes) 067000 1748982116.808244 mapread 0x15cf78 thru 0x168dfa (0xbe83 bytes) 068000 1748982119.484190 punch from 0x2c057f to 0x2c48bb (0x433d bytes) 069000 1748982122.368457 mapread 0x002bb8 thru 0x006915 (0x3d5e bytes) 070000 1748982125.119600 punch from 0x3abdd3 to 0x3af8dc (0x3b0a bytes) 071000 1748982127.570541 read 0x162db1 thru 0x167730 (0x4980 bytes) 072000 1748982130.171073 write 0x112dac thru 0x120f7d (0xe1d2 bytes) 075000 1748982137.285016 mapwrite 0x349556 thru 0x34ba98 (0x2543 bytes) 076000 1748982139.999125 trunc from 0x4c60de to 0x043400 (0x482cdd bytes) 077000 1748982142.488160 punch from 0x35630f to 0x361178 (0xae6a bytes) 078000 1748982144.995183 mapread 0x278abc thru 0x2851fb (0xc740 bytes) 079000 1748982147.312351 punch from 0x18cfb8 to 0x197425 (0xa46e bytes) 080000 1748982149.951991 mapread 0x27787c thru 0x27b922 (0x40a7 bytes) 082000 1748982155.489862 write 0x245c81 thru 0x2549c0 (0xed40 bytes) 083000 1748982157.962041 trunc from 0x45cdcc to 0x0a085e (0x3bc56d bytes) 084000 1748982160.793518 punch from 0x334b7f to 0x3367fe (0x1c80 bytes) 087000 1748982168.567501 mapread 0x4b4aa3 thru 0x4bc527 (0x7a85 bytes) 089000 1748982173.362647 trunc from 0x210a29 to 0x3ccdf4 (0x1bc3cc bytes) 090000 1748982175.835162 mapread 0x19f9ad thru 0x1a66bf (0x6d13 bytes) 091000 1748982178.631035 trunc from 0x3a7c0d to 0x12e2cb (0x279941 bytes) 092000 1748982181.236406 trunc from 0x3e197b to 0x109943 (0x2d8037 bytes) 093000 1748982183.492857 mapread 0x2b0ae1 thru 0x2baa49 (0x9f69 bytes) 094000 1748982186.052027 mapread 0x4d336a thru 0x4d61bf (0x2e56 bytes) 095000 1748982188.899322 trunc from 0x096dab to 0x29ae01 (0x204057 bytes) 096000 1748982191.651686 read 0x19cd34 thru 0x19d9fb (0xcc8 bytes) 097000 1748982193.874053 read 0x08630c thru 0x089ce9 (0x39de bytes) 098000 1748982196.497371 trunc from 0x4cf36b to 0x4514b3 (0x7deb7 bytes) 099000 1748982198.871747 read 0x3152e5 thru 0x31dbe1 (0x88fd bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (263s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 16:23:22 (1748982202) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1748982205.635261 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1748982207.903068 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1748982218.100845 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1748982220.485501 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1748982222.892949 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1748982225.286116 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1748982227.613302 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1748982231.878727 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1748982234.131068 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1748982238.960536 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1748982242.077370 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1748982247.667836 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1748982249.978354 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1748982255.775347 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1748982258.330815 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1748982260.743669 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1748982263.830162 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1748982266.243462 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1748982269.016050 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1748982271.675373 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1748982274.180956 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1748982279.377954 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1748982281.868610 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1748982284.371047 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1748982286.930211 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1748982289.574108 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1748982292.159025 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1748982294.786962 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1748982297.310742 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1748982300.111475 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1748982302.452372 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1748982304.694318 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1748982309.081251 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1748982311.414070 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1748982313.632010 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1748982316.105221 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1748982323.662723 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1748982325.928617 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1748982328.193223 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1748982330.561801 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1748982332.765261 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1748982335.018857 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1748982339.795999 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1748982342.149514 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1748982344.585233 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1748982352.087738 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1748982357.400654 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1748982360.058488 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1748982362.731897 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1748982367.977861 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1748982373.500625 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1748982376.399485 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1748982379.295916 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1748982385.220128 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1748982388.081867 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1748982391.034147 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1748982393.862045 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1748982397.446118 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1748982400.765863 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1748982407.397367 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1748982413.354864 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1748982416.026270 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1748982418.501633 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1748982421.857733 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1748982427.361434 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1748982433.456664 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1748982439.160282 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1748982442.211712 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1748982445.665029 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1748982448.423518 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1748982451.222696 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1748982457.310689 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1748982460.981066 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1748982465.118392 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1748982471.243326 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (270s) == sanity-benchmark test complete, duration 878 sec ====== 16:27:52 (1748982472)