-----============= acceptance-small: sanity-benchmark ============----- Wed Jul 31 23:12:35 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg252-client.virtnet: executing check_config_client /mnt/lustre oleg252-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg252-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b62c3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b62c3000.idle_timeout=debug disable quota as required oleg252-server: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 23:12:46 (1722481966) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7472] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg252-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg252-client.virtnet at Wed Jul 31 23:12:47 EDT 2024 waiting for dbench pid 9611 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 226 174.37 MB/sec warmup 1 sec latency 62.927 ms 20 478 167.02 MB/sec warmup 2 sec latency 41.076 ms 20 669 141.09 MB/sec warmup 3 sec latency 519.753 ms 20 911 108.55 MB/sec warmup 4 sec latency 498.191 ms 20 1243 92.90 MB/sec warmup 5 sec latency 28.608 ms 20 1652 87.30 MB/sec warmup 6 sec latency 32.249 ms 20 2045 75.98 MB/sec warmup 7 sec latency 24.434 ms 20 2471 72.49 MB/sec warmup 8 sec latency 23.228 ms 20 3013 75.19 MB/sec warmup 9 sec latency 23.327 ms 20 3574 75.75 MB/sec warmup 10 sec latency 31.268 ms 20 3930 72.53 MB/sec warmup 11 sec latency 21.154 ms 20 4198 67.12 MB/sec warmup 12 sec latency 34.714 ms 20 4475 63.03 MB/sec warmup 13 sec latency 70.420 ms 20 4839 61.30 MB/sec warmup 14 sec latency 27.112 ms 20 5231 60.44 MB/sec warmup 15 sec latency 31.220 ms 20 5574 57.60 MB/sec warmup 16 sec latency 24.731 ms 20 6100 57.10 MB/sec warmup 17 sec latency 21.203 ms 20 6573 58.23 MB/sec warmup 18 sec latency 24.693 ms 20 7156 59.88 MB/sec warmup 19 sec latency 24.882 ms 20 7522 59.14 MB/sec warmup 20 sec latency 41.641 ms 20 7837 57.44 MB/sec warmup 21 sec latency 20.851 ms 20 8141 55.36 MB/sec warmup 22 sec latency 60.474 ms 20 8509 54.05 MB/sec warmup 23 sec latency 23.023 ms 20 9332 35.51 MB/sec execute 1 sec latency 32.340 ms 20 9733 32.94 MB/sec execute 2 sec latency 20.917 ms 20 10077 35.80 MB/sec execute 3 sec latency 24.804 ms 20 10615 45.61 MB/sec execute 4 sec latency 42.579 ms 20 11082 52.23 MB/sec execute 5 sec latency 21.138 ms 20 11378 48.11 MB/sec execute 6 sec latency 24.174 ms 20 11653 41.80 MB/sec execute 7 sec latency 57.396 ms 20 11986 39.25 MB/sec execute 8 sec latency 25.434 ms 20 12404 42.16 MB/sec execute 9 sec latency 38.490 ms 20 12797 42.93 MB/sec execute 10 sec latency 33.058 ms 20 13106 40.05 MB/sec execute 11 sec latency 27.917 ms 20 13517 38.80 MB/sec execute 12 sec latency 38.753 ms 20 13994 42.09 MB/sec execute 13 sec latency 25.128 ms 20 14606 46.00 MB/sec execute 14 sec latency 24.422 ms 20 14972 44.75 MB/sec execute 15 sec latency 21.812 ms 20 15285 42.82 MB/sec execute 16 sec latency 58.497 ms 20 15714 42.73 MB/sec execute 17 sec latency 24.390 ms 20 16175 44.42 MB/sec execute 18 sec latency 31.765 ms 20 16510 43.17 MB/sec execute 19 sec latency 24.064 ms 20 16872 41.46 MB/sec execute 20 sec latency 40.131 ms 20 17309 41.73 MB/sec execute 21 sec latency 25.090 ms 20 17926 44.14 MB/sec execute 22 sec latency 23.729 ms 20 18458 45.60 MB/sec execute 23 sec latency 20.183 ms 20 18784 45.20 MB/sec execute 24 sec latency 25.321 ms 20 19155 44.59 MB/sec execute 25 sec latency 79.060 ms 20 19490 43.95 MB/sec execute 26 sec latency 28.669 ms 20 19882 44.23 MB/sec execute 27 sec latency 32.658 ms 20 20229 43.21 MB/sec execute 28 sec latency 26.406 ms 20 20660 42.61 MB/sec execute 29 sec latency 22.134 ms 20 21091 42.65 MB/sec execute 30 sec latency 20.370 ms 20 21757 44.46 MB/sec execute 31 sec latency 26.171 ms 20 22280 45.84 MB/sec execute 32 sec latency 22.565 ms 20 22662 45.58 MB/sec execute 33 sec latency 20.710 ms 20 22987 44.59 MB/sec execute 34 sec latency 60.666 ms 20 23374 44.37 MB/sec execute 35 sec latency 40.240 ms 20 23793 44.57 MB/sec execute 36 sec latency 33.708 ms 20 24184 43.71 MB/sec execute 37 sec latency 25.139 ms 20 24660 43.49 MB/sec execute 38 sec latency 21.012 ms 20 25252 45.18 MB/sec execute 39 sec latency 31.008 ms 20 25860 46.58 MB/sec execute 40 sec latency 21.018 ms 20 26155 46.04 MB/sec execute 41 sec latency 23.733 ms 20 26423 45.06 MB/sec execute 42 sec latency 60.233 ms 20 26732 44.45 MB/sec execute 43 sec latency 41.337 ms 20 27133 44.79 MB/sec execute 44 sec latency 24.506 ms 20 27495 44.33 MB/sec execute 45 sec latency 29.595 ms 20 27904 43.68 MB/sec execute 46 sec latency 27.402 ms 20 28342 43.85 MB/sec execute 47 sec latency 23.265 ms 20 28888 44.99 MB/sec execute 48 sec latency 24.094 ms 20 29397 45.64 MB/sec execute 49 sec latency 28.309 ms 20 29722 45.40 MB/sec execute 50 sec latency 28.439 ms 20 29989 44.70 MB/sec execute 51 sec latency 39.781 ms 20 30321 44.36 MB/sec execute 52 sec latency 35.285 ms 20 30696 44.12 MB/sec execute 53 sec latency 22.338 ms 20 31112 44.12 MB/sec execute 54 sec latency 23.916 ms 20 31512 43.90 MB/sec execute 55 sec latency 26.842 ms 20 31997 43.99 MB/sec execute 56 sec latency 18.843 ms 20 32500 44.66 MB/sec execute 57 sec latency 23.367 ms 20 33058 45.21 MB/sec execute 58 sec latency 26.588 ms 20 33405 45.11 MB/sec execute 59 sec latency 31.624 ms 20 33709 44.69 MB/sec execute 60 sec latency 43.307 ms 20 34063 44.22 MB/sec execute 61 sec latency 30.299 ms 20 34461 44.24 MB/sec execute 62 sec latency 22.189 ms 20 34872 44.40 MB/sec execute 63 sec latency 32.208 ms 20 35276 44.20 MB/sec execute 64 sec latency 23.318 ms 20 35661 43.94 MB/sec execute 65 sec latency 20.125 ms 20 36147 44.36 MB/sec execute 66 sec latency 37.730 ms 20 36717 45.08 MB/sec execute 67 sec latency 26.188 ms 20 37079 45.00 MB/sec execute 68 sec latency 20.909 ms 20 37374 44.44 MB/sec execute 69 sec latency 70.296 ms 20 37743 44.17 MB/sec execute 70 sec latency 25.658 ms 20 38240 44.57 MB/sec execute 71 sec latency 24.923 ms 20 38638 44.57 MB/sec execute 72 sec latency 24.249 ms 20 38978 44.06 MB/sec execute 73 sec latency 43.625 ms 20 39367 43.90 MB/sec execute 74 sec latency 22.082 ms 20 39903 44.55 MB/sec execute 75 sec latency 24.553 ms 20 40421 44.98 MB/sec execute 76 sec latency 22.258 ms 20 40764 44.78 MB/sec execute 77 sec latency 22.424 ms 20 41028 44.43 MB/sec execute 78 sec latency 55.818 ms 20 41449 44.35 MB/sec execute 79 sec latency 26.122 ms 20 41863 44.52 MB/sec execute 80 sec latency 21.741 ms 20 42230 44.36 MB/sec execute 81 sec latency 26.187 ms 20 42572 43.95 MB/sec execute 82 sec latency 34.542 ms 20 43002 43.93 MB/sec execute 83 sec latency 21.685 ms 20 43551 44.37 MB/sec execute 84 sec latency 22.741 ms 20 44149 44.88 MB/sec execute 85 sec latency 22.673 ms 20 44507 44.89 MB/sec execute 86 sec latency 24.695 ms 20 44872 44.73 MB/sec execute 87 sec latency 53.123 ms 20 45224 44.50 MB/sec execute 88 sec latency 32.247 ms 20 45620 44.55 MB/sec execute 89 sec latency 32.810 ms 20 45966 44.28 MB/sec execute 90 sec latency 28.957 ms 20 46386 44.07 MB/sec execute 91 sec latency 22.303 ms 20 46873 44.15 MB/sec execute 92 sec latency 20.445 ms 20 47529 44.80 MB/sec execute 93 sec latency 24.597 ms 20 48060 45.24 MB/sec execute 94 sec latency 19.566 ms 20 48382 45.03 MB/sec execute 95 sec latency 56.262 ms 20 48700 44.66 MB/sec execute 96 sec latency 64.026 ms 20 49043 44.51 MB/sec execute 97 sec latency 29.617 ms 20 49464 44.68 MB/sec execute 98 sec latency 35.183 ms 20 49804 44.32 MB/sec execute 99 sec latency 47.004 ms 20 50240 44.11 MB/sec execute 100 sec latency 20.165 ms 20 50738 44.55 MB/sec execute 101 sec latency 21.803 ms 20 51383 45.12 MB/sec execute 102 sec latency 22.927 ms 20 51741 45.18 MB/sec execute 103 sec latency 23.526 ms 20 52003 44.83 MB/sec execute 104 sec latency 65.646 ms 20 52329 44.51 MB/sec execute 105 sec latency 68.904 ms 20 52723 44.53 MB/sec execute 106 sec latency 32.352 ms 20 53140 44.54 MB/sec execute 107 sec latency 21.990 ms 20 53555 44.26 MB/sec execute 108 sec latency 22.447 ms 20 54037 44.34 MB/sec execute 109 sec latency 19.390 ms 20 54687 44.95 MB/sec execute 110 sec latency 20.289 ms 20 55217 45.29 MB/sec execute 111 sec latency 22.347 ms 20 55534 45.06 MB/sec execute 112 sec latency 35.537 ms 20 55878 44.79 MB/sec execute 113 sec latency 61.740 ms 20 56260 44.68 MB/sec execute 114 sec latency 23.419 ms 20 56709 44.79 MB/sec execute 115 sec latency 33.292 ms 20 57118 44.60 MB/sec execute 116 sec latency 24.201 ms 20 57667 44.72 MB/sec execute 117 sec latency 17.980 ms 20 58242 45.11 MB/sec execute 118 sec latency 22.213 ms 20 58783 45.39 MB/sec execute 119 sec latency 27.997 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 173413 8.279 79.035 Close 127370 1.702 20.815 Rename 7351 11.173 57.731 Unlink 34892 2.620 45.891 Qpathinfo 157143 1.839 33.900 Qfileinfo 27502 0.058 19.243 Qfsinfo 28922 0.023 6.194 Sfileinfo 13883 5.503 37.726 Find 60849 0.352 55.293 WriteX 85759 1.041 25.440 ReadX 274050 0.009 2.017 LockX 580 2.120 7.575 UnlockX 580 2.091 7.751 Flush 12047 7.078 70.290 Throughput 45.3948 MB/sec 20 clients 20 procs max_latency=79.060 ms stopping dbench on /mnt/lustre/d0.oleg252-client.virtnet at Wed Jul 31 23:15:12 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg252-client.virtnet /mnt/lustre/d0.oleg252-client.virtnet /mnt/lustre/d0.oleg252-client.virtnet removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg252-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 23:15:14 (1722482114) min OST has 3452716kB available, using 5179074kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7472] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5057] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg252-clien 5057M 141971 98 126588 98 268061 54 6235 299 Latency 9005us 88862us 53828us 3000us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg252-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 537 18 3894 18 759 14 504 17 594 15 794 14 Latency 26903us 6221us 17708us 18857us 3232us 70310us 1.97,1.97,oleg252-client.virtnet,1,1722471478,5057M,,,,141971,98,126588,98,,,268061,54,6235,299,10,,,,,537,18,3894,18,759,14,504,17,594,15,794,14,,9005us,88862us,,53828us,3000us,26903us,6221us,17708us,18857us,3232us,70310us debug=0x33f0484 PASS bonnie (190s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 23:18:24 (1722482304) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 22950 -P /tmp -l 5400912 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 22950 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x3f048e fallocating to largest ever: 0x499176 truncating to largest ever: 0x4c8dd5 fallocating to largest ever: 0x520ce2 001000 1722482308.289719 write 0x1081c3 thru 0x109746 (0x1584 bytes) fallocating to largest ever: 0x526950 002000 1722482310.849453 mapread 0x0c72e8 thru 0x0cff05 (0x8c1e bytes) 004000 1722482315.512523 read 0x0d20ce thru 0x0de69f (0xc5d2 bytes) 005000 1722482318.002365 fallocate 0x1fb4ac thru 0x203baf (0x8704 bytes) 006000 1722482320.281994 mapwrite 0x0e7d9d thru 0x0f0f62 (0x91c6 bytes) 009000 1722482328.981509 punch from 0x341caa to 0x350b77 (0xeece bytes) 010000 1722482331.880784 mapwrite 0x31fcef thru 0x323638 (0x394a bytes) 011000 1722482334.338907 punch from 0x143221 to 0x152067 (0xee47 bytes) 012000 1722482336.596894 read 0x041ee9 thru 0x04b1c9 (0x92e1 bytes) 013000 1722482338.886897 write 0x4b2222 thru 0x4b9cb2 (0x7a91 bytes) 014000 1722482341.427236 fallocate 0x2fa6f0 thru 0x3057ea (0xb0fb bytes) 015000 1722482344.039920 fallocate 0x1dfb9c thru 0x1e5921 (0x5d86 bytes) 016000 1722482346.150662 read 0x1612ad thru 0x16f3af (0xe103 bytes) 018000 1722482350.930766 trunc from 0x526950 to 0x05c3f4 (0x4ca55b bytes) 019000 1722482353.323203 mapread 0x001e78 thru 0x00c8f9 (0xaa82 bytes) 020000 1722482355.562403 fallocate 0x1e939f thru 0x1e98da (0x53c bytes) 021000 1722482357.974407 punch from 0x207c31 to 0x210fba (0x938a bytes) 022000 1722482360.260447 fallocate 0x1a1d76 thru 0x1a5472 (0x36fd bytes) 023000 1722482362.469761 fallocate 0x4ae2c2 thru 0x4b246d (0x41ac bytes) 024000 1722482364.589137 write 0x177ea4 thru 0x17da6b (0x5bc8 bytes) 025000 1722482366.669938 mapread 0x281ddb thru 0x28fc5b (0xde81 bytes) 026000 1722482368.890187 write 0x4ac718 thru 0x4ba3f6 (0xdcdf bytes) 027000 1722482371.267665 read 0x313bd0 thru 0x322b97 (0xefc8 bytes) 028000 1722482373.442546 punch from 0x216fdf to 0x222502 (0xb524 bytes) 029000 1722482375.589391 fallocate 0x11e06e thru 0x128f13 (0xaea6 bytes) 030000 1722482377.944838 fallocate 0x193271 thru 0x19d844 (0xa5d4 bytes) 031000 1722482380.306987 mapwrite 0x4278c3 thru 0x42feca (0x8608 bytes) 032000 1722482383.096939 mapwrite 0x18a035 thru 0x1912bc (0x7288 bytes) 034000 1722482387.529982 punch from 0x03f489 to 0x048ea2 (0x9a1a bytes) 036000 1722482392.114080 mapwrite 0x053f25 thru 0x056243 (0x231f bytes) 037000 1722482394.657950 punch from 0x10af57 to 0x10d93c (0x29e6 bytes) 038000 1722482396.957234 punch from 0x1fa406 to 0x1fe06f (0x3c6a bytes) 039000 1722482399.178560 trunc from 0x4f9ffb to 0x38a3ef (0x16fc0b bytes) 040000 1722482401.699853 fallocate 0x0a91ad thru 0x0b77a4 (0xe5f8 bytes) 041000 1722482403.874429 trunc from 0x5126c1 to 0x195ada (0x37cbe6 bytes) 043000 1722482408.219289 read 0x250d66 thru 0x25aac1 (0x9d5c bytes) 047000 1722482417.695698 fallocate 0x2ccfa9 thru 0x2d227b (0x52d3 bytes) 048000 1722482419.686047 read 0x00032f thru 0x00066c (0x33e bytes) 049000 1722482421.789680 read 0x352b63 thru 0x359f33 (0x73d1 bytes) 050000 1722482424.101403 fallocate 0x23e3e7 thru 0x240fbe (0x2bd8 bytes) 051000 1722482426.444381 trunc from 0x314889 to 0x0bb543 (0x259345 bytes) 052000 1722482428.640260 trunc from 0x4d2d43 to 0x4f30c1 (0x2037f bytes) 053000 1722482431.037276 punch from 0x1f3dad to 0x1ffe8b (0xc0df bytes) 054000 1722482433.399958 mapwrite 0x2437a4 thru 0x2485be (0x4e1b bytes) 055000 1722482436.177936 write 0x36ee9d thru 0x370748 (0x18ac bytes) 057000 1722482441.524309 fallocate 0x280699 thru 0x284f13 (0x487b bytes) 058000 1722482443.582701 punch from 0x073dd3 to 0x07c665 (0x8893 bytes) 059000 1722482445.655159 read 0x2e027b thru 0x2ef7f2 (0xf578 bytes) 060000 1722482447.820092 fallocate 0x4e0e7f thru 0x4eda71 (0xcbf3 bytes) 061000 1722482450.165013 punch from 0x1570da to 0x16683a (0xf761 bytes) 062000 1722482452.434822 read 0x2fff1d thru 0x300be2 (0xcc6 bytes) 063000 1722482454.535689 read 0x18a120 thru 0x1912fb (0x71dc bytes) 064000 1722482456.664925 punch from 0x1b91e2 to 0x1c40bf (0xaede bytes) 065000 1722482458.900822 punch from 0x1d4571 to 0x1e41f7 (0xfc87 bytes) 066000 1722482461.058021 mapwrite 0x408aa6 thru 0x415f5c (0xd4b7 bytes) 068000 1722482465.488782 fallocate 0x22a3f5 thru 0x23265b (0x8267 bytes) 070000 1722482469.863857 fallocate 0x4c0d4c thru 0x4cbf33 (0xb1e8 bytes) 071000 1722482472.679955 trunc from 0x4a0615 to 0x1053bd (0x39b257 bytes) 072000 1722482476.023333 mapwrite 0x3f45fd thru 0x3f68c1 (0x22c5 bytes) 073000 1722482478.230859 trunc from 0x361b69 to 0x35e8c0 (0x32a8 bytes) 074000 1722482480.754892 mapwrite 0x01b34c thru 0x01fdc5 (0x4a7a bytes) 076000 1722482485.021451 write 0x4f559d thru 0x4f7ae2 (0x2546 bytes) 077000 1722482487.199348 read 0x28c4b8 thru 0x28e046 (0x1b8f bytes) 078000 1722482489.477550 mapwrite 0x33c987 thru 0x346f91 (0xa60b bytes) 079000 1722482492.027547 punch from 0x0f839c to 0x10199e (0x9603 bytes) 081000 1722482496.907047 write 0x45490d thru 0x460097 (0xb78b bytes) 082000 1722482499.205365 trunc from 0x5140f8 to 0x48c160 (0x87f97 bytes) 084000 1722482503.839808 mapread 0x1f9fa0 thru 0x20944e (0xf4af bytes) 085000 1722482506.066226 read 0x046324 thru 0x0493f7 (0x30d4 bytes) 086000 1722482508.543641 trunc from 0x3a3676 to 0x1bb182 (0x1e84f3 bytes) 087000 1722482510.923008 fallocate 0x4a0d19 thru 0x4b03fb (0xf6e3 bytes) 088000 1722482513.755279 read 0x4b2302 thru 0x4c1dd2 (0xfad1 bytes) 089000 1722482516.727860 mapwrite 0x2a1d3f thru 0x2a27e7 (0xaa9 bytes) 090000 1722482519.431059 trunc from 0x4d5fce to 0x05768b (0x47e942 bytes) 092000 1722482523.749816 read 0x423a78 thru 0x430fdc (0xd565 bytes) 094000 1722482529.845511 fallocate 0x2fc346 thru 0x30233d (0x5ff8 bytes) 095000 1722482532.369992 mapread 0x09ebe4 thru 0x0a3eec (0x5309 bytes) 096000 1722482535.412245 read 0x091465 thru 0x09d62d (0xc1c9 bytes) 097000 1722482538.304798 mapwrite 0x06092f thru 0x06527c (0x494e bytes) 098000 1722482541.080965 write 0x094f77 thru 0x098f1c (0x3fa6 bytes) 099000 1722482544.645826 write 0x14b1ca thru 0x151c6e (0x6aa5 bytes) 100000 1722482547.880374 trunc from 0x356817 to 0x168aaf (0x1edd67 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (244s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 23:22:28 (1722482548) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1722482552.183763 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1722482554.591845 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1722482566.056856 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1722482568.798548 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1722482571.452693 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1722482574.064999 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1722482576.824080 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1722482581.680616 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1722482584.113329 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1722482589.355908 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1722482593.304257 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1722482599.063768 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1722482601.325741 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1722482607.286179 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1722482610.079039 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1722482612.518927 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1722482615.381127 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1722482617.838126 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1722482620.694260 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1722482623.410896 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1722482626.301734 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1722482632.645736 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1722482636.286369 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1722482639.259259 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1722482643.285582 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1722482646.195525 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1722482649.932433 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1722482653.152554 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1722482656.476978 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1722482659.578876 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1722482662.414669 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1722482664.929943 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1722482669.877756 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1722482672.710289 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1722482675.574486 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1722482678.452383 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1722482688.669144 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1722482691.951147 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1722482696.353988 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1722482698.935659 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1722482701.354988 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1722482703.796207 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1722482709.493844 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1722482712.386133 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1722482715.138018 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1722482725.090272 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1722482735.089573 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1722482738.800385 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1722482742.572727 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1722482750.288824 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1722482756.033324 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1722482759.217975 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1722482762.689130 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1722482770.859371 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1722482773.747459 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1722482776.943309 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1722482780.831090 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1722482784.814184 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1722482788.581709 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1722482795.744570 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1722482802.213520 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1722482805.142513 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1722482809.097542 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1722482814.260416 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1722482821.547808 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1722482830.623294 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1722482839.076868 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1722482842.686311 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1722482846.498150 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1722482850.186022 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1722482854.526667 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1722482864.158411 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1722482868.688357 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1722482871.586184 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1722482880.816390 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (334s) == sanity-benchmark test complete, duration 926 sec ====== 23:28:02 (1722482882)