-----============= acceptance-small: sanity-benchmark ============----- Wed Jul 17 08:00:42 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg157-client.virtnet: executing check_config_client /mnt/lustre oleg157-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg157-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b389a000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b389a000.idle_timeout=debug disable quota as required oleg157-server: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 08:00:52 (1721217652) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7430] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg157-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg157-client.virtnet at Wed Jul 17 08:00:52 EDT 2024 waiting for dbench pid 9569 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 268 201.12 MB/sec warmup 1 sec latency 60.220 ms 20 572 194.44 MB/sec warmup 2 sec latency 35.933 ms 20 739 142.12 MB/sec warmup 3 sec latency 689.369 ms 20 1111 114.78 MB/sec warmup 4 sec latency 20.551 ms 20 1534 104.34 MB/sec warmup 5 sec latency 26.907 ms 20 1917 88.06 MB/sec warmup 6 sec latency 29.381 ms 20 2345 78.96 MB/sec warmup 7 sec latency 23.318 ms 20 2899 81.99 MB/sec warmup 8 sec latency 24.513 ms 20 3570 84.80 MB/sec warmup 9 sec latency 25.342 ms 20 3906 79.84 MB/sec warmup 10 sec latency 23.491 ms 20 4200 73.15 MB/sec warmup 11 sec latency 47.923 ms 20 4550 68.71 MB/sec warmup 12 sec latency 59.015 ms 20 4978 67.97 MB/sec warmup 13 sec latency 28.784 ms 20 5341 64.87 MB/sec warmup 14 sec latency 26.228 ms 20 5769 61.72 MB/sec warmup 15 sec latency 22.223 ms 20 6256 61.91 MB/sec warmup 16 sec latency 21.124 ms 20 6895 64.64 MB/sec warmup 17 sec latency 23.453 ms 20 7330 64.94 MB/sec warmup 18 sec latency 22.772 ms 20 7601 62.37 MB/sec warmup 19 sec latency 39.878 ms 20 7874 59.64 MB/sec warmup 20 sec latency 69.209 ms 20 8235 58.66 MB/sec warmup 21 sec latency 28.879 ms 20 8614 57.83 MB/sec warmup 22 sec latency 21.634 ms 20 8998 56.22 MB/sec warmup 23 sec latency 32.027 ms 20 9883 62.22 MB/sec execute 1 sec latency 30.213 ms 20 10445 81.61 MB/sec execute 2 sec latency 24.030 ms 20 10886 76.38 MB/sec execute 3 sec latency 22.483 ms 20 11178 62.08 MB/sec execute 4 sec latency 37.484 ms 20 11501 52.57 MB/sec execute 5 sec latency 52.414 ms 20 11835 49.33 MB/sec execute 6 sec latency 25.655 ms 20 12226 48.34 MB/sec execute 7 sec latency 22.352 ms 20 12601 45.40 MB/sec execute 8 sec latency 23.718 ms 20 13029 44.99 MB/sec execute 9 sec latency 43.794 ms 20 13504 46.55 MB/sec execute 10 sec latency 18.349 ms 20 13995 49.57 MB/sec execute 11 sec latency 32.201 ms 20 14471 50.84 MB/sec execute 12 sec latency 44.758 ms 20 14758 48.72 MB/sec execute 13 sec latency 22.856 ms 20 15048 46.85 MB/sec execute 14 sec latency 73.753 ms 20 15366 44.96 MB/sec execute 15 sec latency 35.244 ms 20 15765 44.38 MB/sec execute 16 sec latency 22.104 ms 20 16142 44.04 MB/sec execute 17 sec latency 31.447 ms 20 16596 44.10 MB/sec execute 18 sec latency 23.351 ms 20 17068 44.67 MB/sec execute 19 sec latency 20.238 ms 20 17534 46.19 MB/sec execute 20 sec latency 28.470 ms 20 18028 47.16 MB/sec execute 21 sec latency 44.242 ms 20 18348 46.40 MB/sec execute 22 sec latency 33.349 ms 20 18655 45.55 MB/sec execute 23 sec latency 41.996 ms 20 19035 44.33 MB/sec execute 24 sec latency 24.966 ms 20 19452 44.19 MB/sec execute 25 sec latency 21.541 ms 20 19847 44.33 MB/sec execute 26 sec latency 22.485 ms 20 20325 44.38 MB/sec execute 27 sec latency 25.432 ms 20 20701 44.19 MB/sec execute 28 sec latency 22.386 ms 20 21141 44.97 MB/sec execute 29 sec latency 37.625 ms 20 21639 45.66 MB/sec execute 30 sec latency 33.740 ms 20 21991 45.57 MB/sec execute 31 sec latency 28.984 ms 20 22286 44.75 MB/sec execute 32 sec latency 39.773 ms 20 22643 43.82 MB/sec execute 33 sec latency 24.513 ms 20 23045 43.88 MB/sec execute 34 sec latency 22.287 ms 20 23509 44.44 MB/sec execute 35 sec latency 25.318 ms 20 23949 44.31 MB/sec execute 36 sec latency 22.277 ms 20 24340 43.99 MB/sec execute 37 sec latency 20.927 ms 20 24880 44.89 MB/sec execute 38 sec latency 35.923 ms 20 25379 45.61 MB/sec execute 39 sec latency 61.890 ms 20 25719 45.31 MB/sec execute 40 sec latency 25.485 ms 20 26038 44.37 MB/sec execute 41 sec latency 55.511 ms 20 26424 43.98 MB/sec execute 42 sec latency 24.038 ms 20 26903 44.86 MB/sec execute 43 sec latency 25.203 ms 20 27337 44.81 MB/sec execute 44 sec latency 24.418 ms 20 27730 44.27 MB/sec execute 45 sec latency 29.102 ms 20 28164 44.38 MB/sec execute 46 sec latency 30.532 ms 20 28727 45.27 MB/sec execute 47 sec latency 32.099 ms 20 29147 45.64 MB/sec execute 48 sec latency 22.170 ms 20 29435 44.86 MB/sec execute 49 sec latency 62.143 ms 20 29801 44.30 MB/sec execute 50 sec latency 23.781 ms 20 30236 44.70 MB/sec execute 51 sec latency 22.561 ms 20 30704 45.08 MB/sec execute 52 sec latency 23.258 ms 20 31055 44.60 MB/sec execute 53 sec latency 21.225 ms 20 31425 44.12 MB/sec execute 54 sec latency 36.152 ms 20 31887 44.55 MB/sec execute 55 sec latency 23.761 ms 20 32450 45.32 MB/sec execute 56 sec latency 24.990 ms 20 32830 45.21 MB/sec execute 57 sec latency 24.155 ms 20 33161 44.63 MB/sec execute 58 sec latency 56.960 ms 20 33567 44.55 MB/sec execute 59 sec latency 24.368 ms 20 34077 44.99 MB/sec execute 60 sec latency 22.691 ms 20 34455 44.97 MB/sec execute 61 sec latency 25.910 ms 20 34804 44.41 MB/sec execute 62 sec latency 35.924 ms 20 35256 44.45 MB/sec execute 63 sec latency 19.071 ms 20 35846 45.28 MB/sec execute 64 sec latency 20.454 ms 20 36297 45.39 MB/sec execute 65 sec latency 22.804 ms 20 36620 44.99 MB/sec execute 66 sec latency 63.549 ms 20 36997 44.78 MB/sec execute 67 sec latency 26.398 ms 20 37434 44.99 MB/sec execute 68 sec latency 22.929 ms 20 37823 45.20 MB/sec execute 69 sec latency 27.987 ms 20 38132 44.69 MB/sec execute 70 sec latency 27.295 ms 20 38556 44.34 MB/sec execute 71 sec latency 24.768 ms 20 39001 44.60 MB/sec execute 72 sec latency 21.500 ms 20 39537 45.08 MB/sec execute 73 sec latency 23.955 ms 20 39975 45.14 MB/sec execute 74 sec latency 23.578 ms 20 40313 44.94 MB/sec execute 75 sec latency 40.142 ms 20 40773 44.98 MB/sec execute 76 sec latency 26.182 ms 20 41195 45.13 MB/sec execute 77 sec latency 23.014 ms 20 41556 44.98 MB/sec execute 78 sec latency 28.540 ms 20 41937 44.56 MB/sec execute 79 sec latency 29.847 ms 20 42402 44.65 MB/sec execute 80 sec latency 20.228 ms 20 42945 45.10 MB/sec execute 81 sec latency 22.193 ms 20 43450 45.29 MB/sec execute 82 sec latency 25.663 ms 20 43827 45.22 MB/sec execute 83 sec latency 24.855 ms 20 44221 45.20 MB/sec execute 84 sec latency 44.878 ms 20 44585 45.15 MB/sec execute 85 sec latency 24.040 ms 20 44951 45.05 MB/sec execute 86 sec latency 28.331 ms 20 45316 44.81 MB/sec execute 87 sec latency 25.867 ms 20 45694 44.56 MB/sec execute 88 sec latency 26.950 ms 20 46122 44.65 MB/sec execute 89 sec latency 23.380 ms 20 46670 45.02 MB/sec execute 90 sec latency 27.547 ms 20 47169 45.28 MB/sec execute 91 sec latency 22.047 ms 20 47595 45.33 MB/sec execute 92 sec latency 26.827 ms 20 47963 45.20 MB/sec execute 93 sec latency 48.411 ms 20 48314 45.08 MB/sec execute 94 sec latency 25.661 ms 20 48694 45.01 MB/sec execute 95 sec latency 35.722 ms 20 49087 44.76 MB/sec execute 96 sec latency 24.270 ms 20 49510 44.65 MB/sec execute 97 sec latency 24.585 ms 20 49986 44.87 MB/sec execute 98 sec latency 19.740 ms 20 50560 45.24 MB/sec execute 99 sec latency 50.689 ms 20 50990 45.45 MB/sec execute 100 sec latency 24.615 ms 20 51347 45.34 MB/sec execute 101 sec latency 44.119 ms 20 51676 45.09 MB/sec execute 102 sec latency 29.498 ms 20 52003 44.96 MB/sec execute 103 sec latency 32.931 ms 20 52385 44.87 MB/sec execute 104 sec latency 23.896 ms 20 52743 44.64 MB/sec execute 105 sec latency 31.045 ms 20 53153 44.53 MB/sec execute 106 sec latency 19.633 ms 20 53673 44.77 MB/sec execute 107 sec latency 22.594 ms 20 54248 45.20 MB/sec execute 108 sec latency 24.095 ms 20 54694 45.35 MB/sec execute 109 sec latency 23.774 ms 20 55046 45.19 MB/sec execute 110 sec latency 44.978 ms 20 55368 44.97 MB/sec execute 111 sec latency 23.966 ms 20 55749 44.92 MB/sec execute 112 sec latency 25.635 ms 20 56126 44.78 MB/sec execute 113 sec latency 23.960 ms 20 56572 44.64 MB/sec execute 114 sec latency 21.851 ms 20 57038 44.72 MB/sec execute 115 sec latency 20.238 ms 20 57678 45.18 MB/sec execute 116 sec latency 22.749 ms 20 58198 45.53 MB/sec execute 117 sec latency 22.296 ms 20 58497 45.35 MB/sec execute 118 sec latency 82.661 ms 20 58818 45.08 MB/sec execute 119 sec latency 34.219 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 171854 8.208 82.656 Close 125841 1.806 20.999 Rename 7338 11.360 48.396 Unlink 35209 2.629 29.839 Qpathinfo 155368 1.857 34.053 Qfileinfo 27063 0.061 4.744 Qfsinfo 29035 0.028 5.587 Sfileinfo 14044 5.671 31.427 Find 60449 0.372 39.300 WriteX 85099 1.082 28.797 ReadX 271588 0.011 5.963 LockX 574 2.010 8.060 UnlockX 574 1.943 8.502 Flush 12169 7.378 73.745 Throughput 45.0819 MB/sec 20 clients 20 procs max_latency=82.661 ms stopping dbench on /mnt/lustre/d0.oleg157-client.virtnet at Wed Jul 17 08:03:17 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg157-client.virtnet /mnt/lustre/d0.oleg157-client.virtnet /mnt/lustre/d0.oleg157-client.virtnet removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg157-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) == sanity-benchmark test bonnie: bonnie++ ================ 08:03:19 (1721217799) min OST has 3486588kB available, using 5229882kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7430] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5107] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg157-clien 5107M 161715 98 158810 98 276052 52 6552 306 Latency 5496us 67651us 44373us 3659us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg157-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 557 18 4109 18 778 15 395 18 304 14 587 16 Latency 48012us 13695us 17096us 20518us 8804us 21225us 1.97,1.97,oleg157-client.virtnet,1,1721211540,5107M,,,,161715,98,158810,98,,,276052,52,6552,306,10,,,,,557,18,4109,18,778,15,395,18,304,14,587,16,,5496us,67651us,,44373us,3659us,48012us,13695us,17096us,20518us,8804us,21225us debug=0x33f0484 PASS bonnie (204s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 08:06:43 (1721218003) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 30038 -P /tmp -l 5400888 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 30038 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x46cd3a fallocating to largest ever: 0x4a7ccf fallocating to largest ever: 0x4de624 truncating to largest ever: 0x4fd431 fallocating to largest ever: 0x519c28 fallocating to largest ever: 0x526938 003000 1721218018.390571 punch from 0x42e598 to 0x42eb21 (0x58a bytes) 004000 1721218022.454358 trunc from 0x2247f4 to 0x1b31b1 (0x71642 bytes) 005000 1721218025.728930 write 0x2d9209 thru 0x2e3cb2 (0xaaaa bytes) 006000 1721218029.363457 fallocate 0x3b1e69 thru 0x3b9889 (0x7a21 bytes) 007000 1721218032.905304 punch from 0x041b4f to 0x044846 (0x2cf8 bytes) 008000 1721218037.347555 trunc from 0x3a9ea5 to 0x25d4c2 (0x14c9e2 bytes) 009000 1721218041.334309 mapread 0x347640 thru 0x351c9d (0xa65e bytes) 010000 1721218045.183588 mapwrite 0x055fa1 thru 0x0643f2 (0xe452 bytes) 012000 1721218054.900823 mapwrite 0x472836 thru 0x48045e (0xdc29 bytes) 013000 1721218058.751283 mapwrite 0x0e373f thru 0x0edaea (0xa3ac bytes) 014000 1721218063.159953 read 0x00a27e thru 0x0180fd (0xde80 bytes) 015000 1721218066.837790 mapwrite 0x261350 thru 0x265467 (0x4118 bytes) 016000 1721218071.580215 read 0x38c8fa thru 0x394e75 (0x857c bytes) 017000 1721218074.924260 mapread 0x1aa043 thru 0x1b79e9 (0xd9a7 bytes) 018000 1721218079.643198 mapread 0x27c750 thru 0x28277b (0x602c bytes) 020000 1721218088.158020 punch from 0x2f02fc to 0x2faa83 (0xa788 bytes) 021000 1721218092.079288 punch from 0x38ef5d to 0x391a5e (0x2b02 bytes) 022000 1721218096.170560 punch from 0x05e8d1 to 0x05fe88 (0x15b8 bytes) 023000 1721218099.855458 trunc from 0x1fd68d to 0x3dd87d (0x1e01f1 bytes) 024000 1721218103.956367 mapread 0x418a81 thru 0x41eda8 (0x6328 bytes) 026000 1721218110.887403 mapread 0x2a173f thru 0x2a86b7 (0x6f79 bytes) 027000 1721218115.234582 fallocate 0x41a105 thru 0x41e48d (0x4389 bytes) 028000 1721218118.794114 mapread 0x3fbf28 thru 0x40964b (0xd724 bytes) 029000 1721218120.988166 write 0x0137d6 thru 0x019294 (0x5abf bytes) 030000 1721218124.876054 fallocate 0x3b58f7 thru 0x3b9222 (0x392c bytes) 032000 1721218130.412635 mapwrite 0x218d75 thru 0x21b95c (0x2be8 bytes) 033000 1721218134.198982 punch from 0x34f864 to 0x35ae8d (0xb62a bytes) skipping zero size read 034000 1721218137.453347 punch from 0x03719e to 0x041109 (0x9f6c bytes) 035000 1721218140.348272 write 0x492e20 thru 0x49951d (0x66fe bytes) 036000 1721218143.889811 fallocate 0x381887 thru 0x38b584 (0x9cfe bytes) 038000 1721218151.115462 mapread 0x321885 thru 0x323a57 (0x21d3 bytes) 040000 1721218158.230423 write 0x02d10d thru 0x032aa2 (0x5996 bytes) skipping zero size write 041000 1721218160.819942 trunc from 0x4dd098 to 0x4596c5 (0x839d2 bytes) 042000 1721218164.336574 trunc from 0x4c1561 to 0x08f320 (0x432240 bytes) 043000 1721218167.547618 punch from 0x0753a5 to 0x079915 (0x4571 bytes) 044000 1721218170.450884 mapwrite 0x2544bf thru 0x25d4e3 (0x9025 bytes) 045000 1721218173.201083 mapwrite 0x3471b0 thru 0x3538c1 (0xc712 bytes) 046000 1721218176.208573 write 0x495ddf thru 0x4a0b7d (0xad9f bytes) 047000 1721218179.745646 mapwrite 0x125ef5 thru 0x131c96 (0xbda2 bytes) 048000 1721218183.492433 write 0x1893bd thru 0x189b79 (0x7bd bytes) 049000 1721218186.233401 read 0x134b99 thru 0x14130f (0xc777 bytes) 050000 1721218189.237926 read 0x164911 thru 0x16c85f (0x7f4f bytes) 051000 1721218191.405515 mapwrite 0x2969e6 thru 0x29fa53 (0x906e bytes) 052000 1721218194.443837 read 0x08171b thru 0x0868ae (0x5194 bytes) 053000 1721218197.930346 mapread 0x10a99a thru 0x115445 (0xaaac bytes) 054000 1721218201.345058 mapwrite 0x19d809 thru 0x1a93ff (0xbbf7 bytes) 055000 1721218204.827006 read 0x0884bc thru 0x08b1f6 (0x2d3b bytes) 057000 1721218212.146043 trunc from 0x4bd5c0 to 0x000bfc (0x4bc9c3 bytes) 058000 1721218216.561933 write 0x09d6dc thru 0x0a3670 (0x5f95 bytes) 059000 1721218219.894654 mapwrite 0x23552c thru 0x244b66 (0xf63b bytes) 060000 1721218222.657882 write 0x0e0b58 thru 0x0f03a5 (0xf84e bytes) 062000 1721218229.670778 read 0x2010e3 thru 0x20b7c0 (0xa6de bytes) 065000 1721218240.506298 punch from 0x029024 to 0x0314c4 (0x84a1 bytes) 066000 1721218244.278393 mapwrite 0x3b7ab9 thru 0x3be4bc (0x6a04 bytes) 067000 1721218247.759725 write 0x05cf75 thru 0x05ef78 (0x2004 bytes) 068000 1721218251.845383 fallocate 0x4f2843 thru 0x4f50e5 (0x28a3 bytes) 069000 1721218255.426492 mapwrite 0x307658 thru 0x314e55 (0xd7fe bytes) 071000 1721218263.102819 mapwrite 0x156e03 thru 0x15d7e6 (0x69e4 bytes) 072000 1721218267.541271 mapread 0x48a51f thru 0x48d680 (0x3162 bytes) 075000 1721218280.470898 trunc from 0x4a08c4 to 0x2e67ad (0x1ba116 bytes) 076000 1721218283.944299 mapwrite 0x000390 thru 0x006efe (0x6b6f bytes) 077000 1721218288.538310 mapread 0x163b51 thru 0x17287f (0xed2f bytes) 078000 1721218292.036474 punch from 0x1806c0 to 0x18fe35 (0xf776 bytes) 079000 1721218297.333197 write 0x2c48aa thru 0x2cfed4 (0xb62b bytes) 080000 1721218300.866241 mapread 0x0f46fc thru 0x0f9e13 (0x5718 bytes) 082000 1721218310.391630 mapread 0x381e33 thru 0x389ab7 (0x7c85 bytes) 083000 1721218313.743242 fallocate 0x2a7ad5 thru 0x2ae89a (0x6dc6 bytes) 084000 1721218317.693722 trunc from 0x39847b to 0x0bcb04 (0x2db976 bytes) 085000 1721218321.157939 read 0x3d30b2 thru 0x3d565a (0x25a9 bytes) 086000 1721218325.618946 mapwrite 0x503215 thru 0x50fb1e (0xc90a bytes) 087000 1721218329.872019 mapread 0x38b62a thru 0x39126d (0x5c44 bytes) 088000 1721218333.899036 mapread 0x002676 thru 0x00f3bc (0xcd47 bytes) 089000 1721218337.825828 write 0x1bcb0a thru 0x1c2304 (0x57fb bytes) 090000 1721218341.692913 fallocate 0x183aa7 thru 0x18dc76 (0xa1d0 bytes) 091000 1721218345.767211 write 0x50d576 thru 0x51047f (0x2f0a bytes) 092000 1721218350.157123 read 0x0d6860 thru 0x0d713f (0x8e0 bytes) 094000 1721218357.863808 mapread 0x3b4f80 thru 0x3b9e62 (0x4ee3 bytes) 096000 1721218366.465953 mapwrite 0x21b25e thru 0x21b775 (0x518 bytes) 097000 1721218370.225459 trunc from 0x4edbf2 to 0x1b5410 (0x3387e1 bytes) 098000 1721218374.575656 mapread 0x1db20e thru 0x1de1bd (0x2fb0 bytes) 099000 1721218378.481455 write 0x1aca5d thru 0x1ad1a9 (0x74d bytes) 100000 1721218383.325842 trunc from 0x23f1ed to 0x32ff4f (0xf0d63 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (381s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 08:13:04 (1721218384) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1721218390.948702 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1721218395.537361 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1721218415.248964 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1721218419.818120 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1721218423.910317 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1721218427.572520 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1721218431.964843 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1721218441.567293 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1721218446.406359 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1721218455.388958 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1721218461.114505 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1721218471.872280 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1721218475.289991 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1721218485.688297 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1721218489.718078 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1721218494.457240 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1721218499.949101 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1721218504.649008 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1721218509.148777 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1721218514.324956 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1721218519.396082 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1721218529.852273 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1721218535.097514 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1721218540.395426 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1721218545.381390 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1721218550.398113 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1721218554.073400 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1721218558.696220 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1721218562.776803 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1721218568.787151 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1721218574.214722 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1721218579.284016 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1721218589.090190 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1721218594.149038 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1721218599.017834 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1721218603.995583 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1721218618.685608 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1721218623.133357 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1721218626.634385 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1721218629.690145 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1721218632.140627 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1721218634.636397 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1721218640.167071 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1721218643.251139 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1721218646.597533 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1721218661.871896 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1721218670.950529 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1721218674.983671 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1721218680.071100 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1721218688.890959 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1721218698.724787 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1721218704.559538 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1721218710.092512 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1721218720.754495 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1721218724.805948 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1721218730.574772 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1721218734.770290 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1721218740.102624 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1721218744.456491 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1721218752.811876 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1721218762.249282 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1721218766.219904 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1721218769.540313 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1721218772.682040 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1721218779.993931 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1721218788.097617 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1721218795.407183 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1721218797.943699 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1721218800.594874 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1721218803.337094 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1721218806.120918 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1721218811.768283 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1721218814.445900 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1721218817.300372 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1721218823.090715 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (440s) == sanity-benchmark test complete, duration 1182 sec ===== 08:20:24 (1721218824)