-----============= acceptance-small: sanity-benchmark ============----- Tue Jun 3 16:12:56 EDT 2025 oleg441-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanity-benchmark.*ex: No such file or directory excepting tests: skipping tests SLOW=no: iozone oleg441-client.virtnet: executing check_config_client /mnt/lustre oleg441-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg441-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b3428800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3428800.idle_timeout=debug disable quota as required oleg441-server: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 16:13:07 (1748981587) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6731] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg441-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg441-client.virtnet at Tue Jun 3 16:13:08 EDT 2025 waiting for dbench pid 8850 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 269 202.09 MB/sec warmup 1 sec latency 42.630 ms 20 536 186.14 MB/sec warmup 2 sec latency 39.567 ms 20 735 142.03 MB/sec warmup 3 sec latency 516.668 ms 20 1056 114.42 MB/sec warmup 4 sec latency 24.465 ms 20 1447 104.06 MB/sec warmup 5 sec latency 23.753 ms 20 1788 87.66 MB/sec warmup 6 sec latency 21.557 ms 20 2176 76.41 MB/sec warmup 7 sec latency 18.449 ms 20 2596 73.43 MB/sec warmup 8 sec latency 21.566 ms 20 3285 77.70 MB/sec warmup 9 sec latency 23.900 ms 20 3775 79.20 MB/sec warmup 10 sec latency 25.921 ms 20 4022 72.83 MB/sec warmup 11 sec latency 21.604 ms 20 4334 67.48 MB/sec warmup 12 sec latency 27.283 ms 20 4700 64.76 MB/sec warmup 13 sec latency 30.003 ms 20 5096 64.57 MB/sec warmup 14 sec latency 30.791 ms 20 5410 60.63 MB/sec warmup 15 sec latency 29.583 ms 20 5864 58.27 MB/sec warmup 16 sec latency 18.745 ms 20 6438 61.09 MB/sec warmup 17 sec latency 20.832 ms 20 7135 64.00 MB/sec warmup 18 sec latency 27.677 ms 20 7472 62.23 MB/sec warmup 19 sec latency 20.219 ms 20 7762 59.34 MB/sec warmup 20 sec latency 30.547 ms 20 8104 57.66 MB/sec warmup 21 sec latency 28.751 ms 20 8524 58.02 MB/sec warmup 22 sec latency 34.528 ms 20 8834 56.07 MB/sec warmup 23 sec latency 31.447 ms 20 9620 39.35 MB/sec execute 1 sec latency 20.180 ms 20 10257 76.72 MB/sec execute 2 sec latency 26.019 ms 20 10801 82.47 MB/sec execute 3 sec latency 20.524 ms 20 11054 67.05 MB/sec execute 4 sec latency 22.692 ms 20 11322 54.45 MB/sec execute 5 sec latency 38.907 ms 20 11631 48.60 MB/sec execute 6 sec latency 33.574 ms 20 12016 49.48 MB/sec execute 7 sec latency 32.023 ms 20 12370 46.78 MB/sec execute 8 sec latency 22.419 ms 20 12716 42.46 MB/sec execute 9 sec latency 32.354 ms 20 13106 41.79 MB/sec execute 10 sec latency 23.003 ms 20 13702 47.80 MB/sec execute 11 sec latency 37.355 ms 20 14275 51.86 MB/sec execute 12 sec latency 22.487 ms 20 14542 49.82 MB/sec execute 13 sec latency 25.060 ms 20 14773 46.56 MB/sec execute 14 sec latency 38.553 ms 20 15108 44.44 MB/sec execute 15 sec latency 32.359 ms 20 15503 44.86 MB/sec execute 16 sec latency 35.121 ms 20 15878 44.48 MB/sec execute 17 sec latency 31.126 ms 20 16266 42.45 MB/sec execute 18 sec latency 21.998 ms 20 16671 42.29 MB/sec execute 19 sec latency 24.432 ms 20 17296 45.63 MB/sec execute 20 sec latency 31.309 ms 20 17869 48.05 MB/sec execute 21 sec latency 22.938 ms 20 18148 46.94 MB/sec execute 22 sec latency 22.096 ms 20 18422 45.09 MB/sec execute 23 sec latency 38.444 ms 20 18769 44.22 MB/sec execute 24 sec latency 28.066 ms 20 19191 45.16 MB/sec execute 25 sec latency 27.804 ms 20 19507 43.84 MB/sec execute 26 sec latency 23.868 ms 20 19902 42.57 MB/sec execute 27 sec latency 20.530 ms 20 20296 42.48 MB/sec execute 28 sec latency 24.054 ms 20 20908 44.81 MB/sec execute 29 sec latency 28.143 ms 20 21445 46.41 MB/sec execute 30 sec latency 22.452 ms 20 21719 45.67 MB/sec execute 31 sec latency 26.264 ms 20 21992 44.38 MB/sec execute 32 sec latency 41.550 ms 20 22315 43.66 MB/sec execute 33 sec latency 30.063 ms 20 22681 43.79 MB/sec execute 34 sec latency 24.381 ms 20 23013 43.48 MB/sec execute 35 sec latency 29.426 ms 20 23357 42.46 MB/sec execute 36 sec latency 21.159 ms 20 23760 42.24 MB/sec execute 37 sec latency 24.411 ms 20 24322 43.83 MB/sec execute 38 sec latency 29.117 ms 20 24889 45.14 MB/sec execute 39 sec latency 56.044 ms 20 25192 44.87 MB/sec execute 40 sec latency 24.502 ms 20 25406 43.90 MB/sec execute 41 sec latency 48.826 ms 20 25715 43.11 MB/sec execute 42 sec latency 39.480 ms 20 26066 43.00 MB/sec execute 43 sec latency 31.648 ms 20 26469 43.25 MB/sec execute 44 sec latency 20.197 ms 20 26789 42.41 MB/sec execute 45 sec latency 22.832 ms 20 27193 41.98 MB/sec execute 46 sec latency 21.176 ms 20 27664 42.76 MB/sec execute 47 sec latency 26.703 ms 20 28350 44.29 MB/sec execute 48 sec latency 25.943 ms 20 28724 44.42 MB/sec execute 49 sec latency 24.596 ms 20 28963 43.65 MB/sec execute 50 sec latency 40.234 ms 20 29290 43.05 MB/sec execute 51 sec latency 33.770 ms 20 29644 42.92 MB/sec execute 52 sec latency 33.454 ms 20 30023 43.12 MB/sec execute 53 sec latency 28.156 ms 20 30337 42.43 MB/sec execute 54 sec latency 25.738 ms 20 30779 42.17 MB/sec execute 55 sec latency 17.117 ms 20 31385 43.41 MB/sec execute 56 sec latency 22.068 ms 20 32053 44.51 MB/sec execute 57 sec latency 24.277 ms 20 32353 44.19 MB/sec execute 58 sec latency 21.014 ms 20 32689 43.55 MB/sec execute 59 sec latency 36.422 ms 20 33059 43.38 MB/sec execute 60 sec latency 27.005 ms 20 33509 43.71 MB/sec execute 61 sec latency 24.440 ms 20 33845 43.11 MB/sec execute 62 sec latency 26.095 ms 20 34251 42.72 MB/sec execute 63 sec latency 17.782 ms 20 34743 43.29 MB/sec execute 64 sec latency 22.527 ms 20 35382 44.21 MB/sec execute 65 sec latency 25.129 ms 20 35753 44.52 MB/sec execute 66 sec latency 27.154 ms 20 35974 43.98 MB/sec execute 67 sec latency 49.368 ms 20 36297 43.47 MB/sec execute 68 sec latency 30.627 ms 20 36604 43.22 MB/sec execute 69 sec latency 39.148 ms 20 37017 43.55 MB/sec execute 70 sec latency 25.512 ms 20 37320 43.01 MB/sec execute 71 sec latency 30.168 ms 20 37705 42.58 MB/sec execute 72 sec latency 18.029 ms 20 38156 42.87 MB/sec execute 73 sec latency 21.057 ms 20 38819 43.71 MB/sec execute 74 sec latency 24.410 ms 20 39286 44.24 MB/sec execute 75 sec latency 20.147 ms 20 39548 43.80 MB/sec execute 76 sec latency 41.299 ms 20 39901 43.39 MB/sec execute 77 sec latency 32.722 ms 20 40275 43.32 MB/sec execute 78 sec latency 29.337 ms 20 40690 43.45 MB/sec execute 79 sec latency 26.177 ms 20 41062 43.01 MB/sec execute 80 sec latency 25.196 ms 20 41501 42.93 MB/sec execute 81 sec latency 19.277 ms 20 42101 43.71 MB/sec execute 82 sec latency 29.249 ms 20 42720 44.42 MB/sec execute 83 sec latency 22.986 ms 20 43021 44.17 MB/sec execute 84 sec latency 21.160 ms 20 43329 43.73 MB/sec execute 85 sec latency 41.902 ms 20 43665 43.52 MB/sec execute 86 sec latency 29.313 ms 20 44074 43.74 MB/sec execute 87 sec latency 32.318 ms 20 44391 43.39 MB/sec execute 88 sec latency 26.969 ms 20 44780 43.03 MB/sec execute 89 sec latency 19.699 ms 20 45229 43.25 MB/sec execute 90 sec latency 21.293 ms 20 45923 44.01 MB/sec execute 91 sec latency 23.621 ms 20 46370 44.35 MB/sec execute 92 sec latency 21.566 ms 20 46619 44.02 MB/sec execute 93 sec latency 33.517 ms 20 46962 43.65 MB/sec execute 94 sec latency 35.193 ms 20 47318 43.54 MB/sec execute 95 sec latency 26.641 ms 20 47737 43.72 MB/sec execute 96 sec latency 26.001 ms 20 48098 43.33 MB/sec execute 97 sec latency 21.279 ms 20 48540 43.20 MB/sec execute 98 sec latency 20.677 ms 20 49127 43.84 MB/sec execute 99 sec latency 39.698 ms 20 49732 44.38 MB/sec execute 100 sec latency 22.022 ms 20 50037 44.28 MB/sec execute 101 sec latency 22.564 ms 20 50295 43.90 MB/sec execute 102 sec latency 30.931 ms 20 50637 43.65 MB/sec execute 103 sec latency 26.708 ms 20 51012 43.72 MB/sec execute 104 sec latency 22.878 ms 20 51351 43.62 MB/sec execute 105 sec latency 30.987 ms 20 51680 43.27 MB/sec execute 106 sec latency 22.299 ms 20 52113 43.18 MB/sec execute 107 sec latency 20.209 ms 20 52688 43.74 MB/sec execute 108 sec latency 27.666 ms 20 53311 44.31 MB/sec execute 109 sec latency 23.076 ms 20 53591 44.14 MB/sec execute 110 sec latency 25.122 ms 20 53838 43.78 MB/sec execute 111 sec latency 31.214 ms 20 54179 43.55 MB/sec execute 112 sec latency 31.087 ms 20 54576 43.68 MB/sec execute 113 sec latency 24.030 ms 20 54915 43.54 MB/sec execute 114 sec latency 28.119 ms 20 55246 43.21 MB/sec execute 115 sec latency 21.152 ms 20 55646 43.11 MB/sec execute 116 sec latency 25.666 ms 20 56204 43.61 MB/sec execute 117 sec latency 23.947 ms 20 56819 44.09 MB/sec execute 118 sec latency 23.448 ms 20 57111 44.01 MB/sec execute 119 sec latency 24.612 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 166172 8.781 49.362 Close 121562 1.828 16.029 Rename 7061 11.606 35.181 Unlink 33831 2.813 15.907 Qpathinfo 150302 1.920 28.956 Qfileinfo 26267 0.065 6.937 Qfsinfo 27923 0.023 3.696 Sfileinfo 13332 5.382 27.108 Find 58392 0.351 30.832 WriteX 82086 0.998 18.388 ReadX 263157 0.010 2.728 LockX 560 2.682 6.864 UnlockX 560 2.731 7.346 Flush 11453 5.669 56.039 Throughput 44.0093 MB/sec 20 clients 20 procs max_latency=56.044 ms stopping dbench on /mnt/lustre/d0.oleg441-client.virtnet at Tue Jun 3 16:15:33 EDT 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg441-client.virtnet /mnt/lustre/d0.oleg441-client.virtnet /mnt/lustre/d0.oleg441-client.virtnet removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg441-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 16:15:35 (1748981735) min OST has 3330392kB available, using 4995588kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6731] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4878] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg441-clien 4878M 162377 98 136452 97 310905 67 7196 311 Latency 5419us 56484us 39278us 27656us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg441-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 523 17 4348 19 816 15 478 16 600 14 742 14 Latency 16413us 5098us 17307us 23377us 6817us 29481us 1.97,1.97,oleg441-client.virtnet,1,1748988169,4878M,,,,162377,98,136452,97,,,310905,67,7196,311,10,,,,,523,17,4348,19,816,15,478,16,600,14,742,14,,5419us,56484us,,39278us,27656us,16413us,5098us,17307us,23377us,6817us,29481us debug=0x33f0484 PASS bonnie (178s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 16:18:33 (1748981913) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 19362 -P /tmp -l 5401164 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 19362 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read fallocating to largest ever: 0x4d2e16 truncating to largest ever: 0x4e479f fallocating to largest ever: 0x4ee491 fallocating to largest ever: 0x4fd7e1 fallocating to largest ever: 0x518021 fallocating to largest ever: 0x51c046 fallocating to largest ever: 0x51dfbb 001000 1748981918.197656 mapread 0x1c35d5 thru 0x1c801a (0x4a46 bytes) fallocating to largest ever: 0x525424 fallocating to largest ever: 0x526a4c 002000 1748981920.370019 trunc from 0x523b47 to 0x2d9f16 (0x249c30 bytes) 003000 1748981922.469808 mapread 0x2b05fc thru 0x2b6ed4 (0x68d9 bytes) 004000 1748981924.706306 punch from 0x07e262 to 0x080f9c (0x2d3b bytes) 007000 1748981931.431772 fallocate 0x4485f7 thru 0x453d39 (0xb743 bytes) 008000 1748981933.855089 write 0x0d921c thru 0x0e7239 (0xe01e bytes) 009000 1748981936.198810 mapwrite 0x0eb46b thru 0x0ed359 (0x1eef bytes) 011000 1748981942.072404 trunc from 0x459c08 to 0x0f313c (0x366acb bytes) 012000 1748981944.359565 punch from 0x064c77 to 0x065e81 (0x120b bytes) 014000 1748981949.019052 mapread 0x009d60 thru 0x010a8e (0x6d2f bytes) 015000 1748981951.480175 trunc from 0x2aba34 to 0x444937 (0x198f04 bytes) 016000 1748981954.033181 trunc from 0x517049 to 0x413429 (0x103c1f bytes) 017000 1748981956.581690 mapwrite 0x12331e thru 0x12bb00 (0x87e3 bytes) 018000 1748981959.014457 mapread 0x288b37 thru 0x296908 (0xddd2 bytes) 019000 1748981961.532230 punch from 0x3e1971 to 0x3f0321 (0xe9b1 bytes) 020000 1748981963.946060 write 0x03351e thru 0x03eea9 (0xb98c bytes) 021000 1748981965.998219 punch from 0x019543 to 0x0200d2 (0x6b90 bytes) 022000 1748981968.059813 mapread 0x1548cf thru 0x15f5a1 (0xacd3 bytes) 023000 1748981970.446459 trunc from 0x449065 to 0x508409 (0xbf3a5 bytes) 024000 1748981972.505254 fallocate 0x23306b thru 0x2359e9 (0x297f bytes) 025000 1748981975.076700 punch from 0x095833 to 0x09fa01 (0xa1cf bytes) 026000 1748981977.375333 read 0x0e9d86 thru 0x0edcea (0x3f65 bytes) 027000 1748981979.892810 mapwrite 0x37601b thru 0x383bc1 (0xdba7 bytes) 028000 1748981981.989659 mapread 0x06c2dd thru 0x074399 (0x80bd bytes) 029000 1748981984.309721 read 0x0d6788 thru 0x0e602c (0xf8a5 bytes) 030000 1748981986.591028 trunc from 0x453788 to 0x47789e (0x24117 bytes) 031000 1748981988.996496 read 0x354881 thru 0x35dde3 (0x9563 bytes) 032000 1748981991.135136 write 0x06c770 thru 0x0732be (0x6b4f bytes) 034000 1748981995.544786 write 0x08737a thru 0x08b9be (0x4645 bytes) 035000 1748981997.781547 fallocate 0x419584 thru 0x4264f2 (0xcf6f bytes) 037000 1748982002.049779 mapwrite 0x050958 thru 0x05e7cc (0xde75 bytes) 038000 1748982004.526094 read 0x10f2bd thru 0x11af8f (0xbcd3 bytes) 041000 1748982011.275735 mapread 0x0e97a4 thru 0x0f3235 (0x9a92 bytes) 043000 1748982015.829642 read 0x0b4bb8 thru 0x0c17f8 (0xcc41 bytes) 044000 1748982018.583703 fallocate 0x14800c thru 0x14fafd (0x7af2 bytes) 045000 1748982020.833880 read 0x35e103 thru 0x35fd0d (0x1c0b bytes) 046000 1748982023.010915 mapread 0x036666 thru 0x038533 (0x1ece bytes) 047000 1748982025.672903 punch from 0x0b1d20 to 0x0b48b8 (0x2b99 bytes) 048000 1748982027.776730 mapwrite 0x23e1c3 thru 0x2409fe (0x283c bytes) skipping zero size write 050000 1748982032.514708 fallocate 0x14629e thru 0x14d269 (0x6fcc bytes) 052000 1748982036.808122 mapwrite 0x39bdd3 thru 0x39ceda (0x1108 bytes) 054000 1748982040.958890 fallocate 0x3a9671 thru 0x3b4d7e (0xb70e bytes) 055000 1748982043.510483 fallocate 0x289bf2 thru 0x2911a0 (0x75af bytes) 057000 1748982047.644489 read 0x45048b thru 0x45b44f (0xafc5 bytes) 060000 1748982054.191431 punch from 0x0aba6b to 0x0adae9 (0x207f bytes) 061000 1748982056.211172 punch from 0x2c8f18 to 0x2d4289 (0xb372 bytes) 063000 1748982060.773514 punch from 0x2d8812 to 0x2d9280 (0xa6f bytes) 064000 1748982063.075677 read 0x093672 thru 0x096a1f (0x33ae bytes) 065000 1748982065.350298 read 0x4f36ca thru 0x5022d5 (0xec0c bytes) 066000 1748982067.546806 punch from 0x069596 to 0x07582e (0xc299 bytes) 067000 1748982070.224113 punch from 0x335bf9 to 0x33ef1d (0x9325 bytes) 068000 1748982072.133861 read 0x427dd3 thru 0x432ee7 (0xb115 bytes) 069000 1748982074.046895 trunc from 0x1d24f9 to 0x004d8d (0x1cd76b bytes) 070000 1748982076.432074 read 0x0b1f94 thru 0x0b2e8a (0xef7 bytes) 072000 1748982082.232720 punch from 0x092ffa to 0x095ff4 (0x2ffb bytes) 074000 1748982087.970256 write 0x35eba0 thru 0x36a012 (0xb473 bytes) 075000 1748982091.114525 read 0x0fd67f thru 0x1030d2 (0x5a54 bytes) 076000 1748982093.082674 punch from 0x01d8bc to 0x0202ab (0x29f0 bytes) 077000 1748982095.268979 write 0x49d280 thru 0x49d9e7 (0x768 bytes) 078000 1748982097.848316 fallocate 0x4b1eec thru 0x4b3a9d (0x1bb2 bytes) 079000 1748982100.112152 write 0x39789a thru 0x39dc6f (0x63d6 bytes) 080000 1748982102.447299 write 0x4a8838 thru 0x4ab8ff (0x30c8 bytes) 081000 1748982105.778477 write 0x338268 thru 0x34057a (0x8313 bytes) 082000 1748982108.019430 trunc from 0x4db7bb to 0x417f38 (0xc3882 bytes) 083000 1748982110.100564 read 0x22ad97 thru 0x22d7a9 (0x2a13 bytes) 085000 1748982115.386256 mapread 0x1adf9a thru 0x1af3c2 (0x1429 bytes) 086000 1748982118.308310 mapread 0x22055d thru 0x22693e (0x63e2 bytes) 087000 1748982120.395742 mapwrite 0x31d745 thru 0x31df7e (0x83a bytes) 088000 1748982122.757215 trunc from 0x471170 to 0x0982dc (0x3d8e93 bytes) skipping zero length punch hole 089000 1748982124.809502 write 0x327b67 thru 0x3319fa (0x9e94 bytes) 091000 1748982129.297645 read 0x32f152 thru 0x33aaa7 (0xb956 bytes) 092000 1748982132.490120 trunc from 0x1f9f0e to 0x26d319 (0x7340c bytes) 093000 1748982134.619649 fallocate 0x0b7d57 thru 0x0c1fc3 (0xa26d bytes) 094000 1748982136.888985 mapread 0x1d6eed thru 0x1e3d94 (0xcea8 bytes) 095000 1748982138.980505 fallocate 0x342bbb thru 0x34527c (0x26c2 bytes) 096000 1748982141.144308 fallocate 0x1620f3 thru 0x169866 (0x7774 bytes) 097000 1748982143.401227 write 0x0712f0 thru 0x078409 (0x711a bytes) skipping zero size write 099000 1748982148.651991 fallocate 0x1c4309 thru 0x1c69d3 (0x26cb bytes) 100000 1748982150.982602 read 0x0b35a5 thru 0x0b81cc (0x4c28 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (238s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 16:22:32 (1748982152) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1748982155.155260 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1748982157.404293 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1748982169.379508 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1748982173.346518 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1748982176.324845 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1748982179.021763 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1748982181.807649 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1748982187.345376 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1748982190.015763 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1748982195.060470 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1748982197.938466 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1748982203.755943 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1748982205.992555 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1748982212.080081 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1748982214.823165 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1748982217.363763 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1748982220.600469 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1748982223.659538 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1748982226.691146 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1748982229.472808 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1748982231.967293 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1748982237.606692 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1748982240.306686 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1748982242.989755 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1748982245.721434 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1748982248.602504 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1748982251.137537 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1748982253.786593 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1748982256.618220 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1748982260.077268 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1748982262.839206 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1748982265.422761 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1748982270.728467 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1748982274.052770 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1748982276.502665 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1748982279.061305 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1748982287.929395 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1748982290.742773 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1748982293.912617 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1748982296.636160 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1748982299.145527 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1748982301.683697 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1748982307.001523 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1748982309.588473 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1748982312.501033 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1748982321.340578 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1748982328.621138 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1748982332.334739 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1748982336.143682 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1748982341.920170 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1748982347.412703 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1748982350.878894 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1748982354.835103 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1748982361.648495 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1748982365.998264 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1748982370.381139 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1748982374.117662 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1748982376.932194 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1748982379.541752 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1748982386.866369 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1748982396.726748 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1748982400.254066 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1748982403.458485 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1748982408.176791 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1748982415.464984 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1748982422.899442 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1748982430.650038 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1748982434.129928 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1748982438.683557 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1748982441.552370 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1748982445.217483 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1748982454.897631 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1748982459.624028 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1748982464.626142 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1748982471.866635 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (320s) == sanity-benchmark test complete, duration 896 sec ====== 16:27:52 (1748982472)