-----============= acceptance-small: sanity-benchmark ============----- Fri Jul 19 12:37:05 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg444-client.virtnet: executing check_config_client /mnt/lustre oleg444-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg444-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5cfc000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5cfc000.idle_timeout=debug disable quota as required oleg444-server: oleg444-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 12:37:14 (1721407034) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6822] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg444-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg444-client.virtnet at Fri Jul 19 12:37:15 EDT 2024 waiting for dbench pid 8752 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 215 167.28 MB/sec warmup 1 sec latency 75.138 ms 20 436 153.21 MB/sec warmup 2 sec latency 62.277 ms 20 676 141.13 MB/sec warmup 3 sec latency 257.822 ms 20 873 108.26 MB/sec warmup 4 sec latency 101.064 ms 20 1126 91.91 MB/sec warmup 5 sec latency 87.434 ms 20 1466 86.76 MB/sec warmup 6 sec latency 76.804 ms 20 1711 74.97 MB/sec warmup 7 sec latency 140.360 ms 20 2022 66.36 MB/sec warmup 8 sec latency 100.579 ms 20 2363 62.05 MB/sec warmup 9 sec latency 116.915 ms 20 2660 60.34 MB/sec warmup 10 sec latency 111.991 ms 20 3128 62.02 MB/sec warmup 11 sec latency 157.549 ms 20 3602 64.22 MB/sec warmup 12 sec latency 132.205 ms 20 3880 61.33 MB/sec warmup 13 sec latency 25.988 ms 20 4121 57.31 MB/sec warmup 14 sec latency 122.972 ms 20 4290 53.86 MB/sec warmup 15 sec latency 264.887 ms 20 4469 51.02 MB/sec warmup 16 sec latency 145.570 ms 20 4763 49.60 MB/sec warmup 17 sec latency 122.079 ms 20 5110 50.24 MB/sec warmup 18 sec latency 120.496 ms 20 5367 47.83 MB/sec warmup 19 sec latency 70.011 ms 20 5693 45.80 MB/sec warmup 20 sec latency 79.855 ms 20 5992 45.06 MB/sec warmup 21 sec latency 120.758 ms 20 6411 46.93 MB/sec warmup 22 sec latency 185.586 ms 20 6879 47.63 MB/sec warmup 23 sec latency 137.572 ms 20 7527 17.45 MB/sec execute 1 sec latency 66.685 ms 20 7753 10.02 MB/sec execute 2 sec latency 211.098 ms 20 7918 9.28 MB/sec execute 3 sec latency 182.398 ms 20 8134 10.81 MB/sec execute 4 sec latency 98.210 ms 20 8514 22.24 MB/sec execute 5 sec latency 103.490 ms 20 8781 20.48 MB/sec execute 6 sec latency 125.222 ms 20 9067 18.28 MB/sec execute 7 sec latency 54.594 ms 20 9427 18.59 MB/sec execute 8 sec latency 65.833 ms 20 9756 22.56 MB/sec execute 9 sec latency 146.316 ms 20 10216 28.40 MB/sec execute 10 sec latency 134.975 ms 20 10629 31.94 MB/sec execute 11 sec latency 149.419 ms 20 10950 32.91 MB/sec execute 12 sec latency 22.445 ms 20 11167 30.80 MB/sec execute 13 sec latency 130.587 ms 20 11391 29.06 MB/sec execute 14 sec latency 161.019 ms 20 11567 27.73 MB/sec execute 15 sec latency 98.165 ms 20 11847 27.77 MB/sec execute 16 sec latency 92.589 ms 20 12211 29.59 MB/sec execute 17 sec latency 76.374 ms 20 12486 28.21 MB/sec execute 18 sec latency 78.651 ms 20 12823 27.33 MB/sec execute 19 sec latency 51.434 ms 20 13166 27.77 MB/sec execute 20 sec latency 92.680 ms 20 13691 31.41 MB/sec execute 21 sec latency 111.794 ms 20 14173 33.12 MB/sec execute 22 sec latency 176.165 ms 20 14511 33.83 MB/sec execute 23 sec latency 23.980 ms 20 14730 32.63 MB/sec execute 24 sec latency 190.631 ms 20 14954 31.60 MB/sec execute 25 sec latency 231.338 ms 20 15166 30.93 MB/sec execute 26 sec latency 100.741 ms 20 15514 31.33 MB/sec execute 27 sec latency 85.290 ms 20 15854 31.69 MB/sec execute 28 sec latency 75.697 ms 20 16156 30.82 MB/sec execute 29 sec latency 62.540 ms 20 16555 30.75 MB/sec execute 30 sec latency 81.637 ms 20 16925 31.67 MB/sec execute 31 sec latency 122.925 ms 20 17434 33.23 MB/sec execute 32 sec latency 105.941 ms 20 17905 34.71 MB/sec execute 33 sec latency 102.592 ms 20 18148 34.22 MB/sec execute 34 sec latency 121.799 ms 20 18365 33.36 MB/sec execute 35 sec latency 157.533 ms 20 18559 32.73 MB/sec execute 36 sec latency 127.128 ms 20 18769 32.19 MB/sec execute 37 sec latency 120.339 ms 20 19126 32.56 MB/sec execute 38 sec latency 101.494 ms 20 19441 32.60 MB/sec execute 39 sec latency 66.043 ms 20 19714 31.92 MB/sec execute 40 sec latency 56.336 ms 20 20041 31.55 MB/sec execute 41 sec latency 125.089 ms 20 20352 31.73 MB/sec execute 42 sec latency 98.802 ms 20 20808 33.04 MB/sec execute 43 sec latency 117.206 ms 20 21265 33.76 MB/sec execute 44 sec latency 125.067 ms 20 21595 34.18 MB/sec execute 45 sec latency 90.710 ms 20 21807 33.68 MB/sec execute 46 sec latency 132.118 ms 20 22054 33.14 MB/sec execute 47 sec latency 135.244 ms 20 22229 32.63 MB/sec execute 48 sec latency 123.754 ms 20 22481 32.42 MB/sec execute 49 sec latency 116.414 ms 20 22866 33.01 MB/sec execute 50 sec latency 101.735 ms 20 23179 32.60 MB/sec execute 51 sec latency 71.273 ms 20 23535 32.22 MB/sec execute 52 sec latency 66.135 ms 20 23884 32.38 MB/sec execute 53 sec latency 99.476 ms 20 24343 33.35 MB/sec execute 54 sec latency 126.518 ms 20 24848 34.18 MB/sec execute 55 sec latency 139.384 ms 20 25164 34.29 MB/sec execute 56 sec latency 111.147 ms 20 25386 33.92 MB/sec execute 57 sec latency 115.247 ms 20 25638 33.49 MB/sec execute 58 sec latency 140.936 ms 20 25824 33.10 MB/sec execute 59 sec latency 109.397 ms 20 26117 33.01 MB/sec execute 60 sec latency 81.341 ms 20 26505 33.39 MB/sec execute 61 sec latency 88.346 ms 20 26797 33.04 MB/sec execute 62 sec latency 68.570 ms 20 27158 32.82 MB/sec execute 63 sec latency 82.504 ms 20 27504 32.96 MB/sec execute 64 sec latency 123.651 ms 20 27949 33.76 MB/sec execute 65 sec latency 133.684 ms 20 28379 34.05 MB/sec execute 66 sec latency 139.958 ms 20 28713 34.41 MB/sec execute 67 sec latency 95.246 ms 20 28938 34.10 MB/sec execute 68 sec latency 105.687 ms 20 29194 33.73 MB/sec execute 69 sec latency 134.896 ms 20 29366 33.37 MB/sec execute 70 sec latency 147.378 ms 20 29626 33.22 MB/sec execute 71 sec latency 123.826 ms 20 30013 33.67 MB/sec execute 72 sec latency 101.212 ms 20 30301 33.37 MB/sec execute 73 sec latency 95.197 ms 20 30643 33.11 MB/sec execute 74 sec latency 109.451 ms 20 31012 33.18 MB/sec execute 75 sec latency 117.806 ms 20 31375 33.50 MB/sec execute 76 sec latency 133.005 ms 20 31839 33.96 MB/sec execute 77 sec latency 145.364 ms 20 32221 34.38 MB/sec execute 78 sec latency 93.069 ms 20 32472 34.20 MB/sec execute 79 sec latency 121.808 ms 20 32723 33.87 MB/sec execute 80 sec latency 130.792 ms 20 32931 33.56 MB/sec execute 81 sec latency 142.656 ms 20 33199 33.47 MB/sec execute 82 sec latency 111.674 ms 20 33552 33.62 MB/sec execute 83 sec latency 101.882 ms 20 33891 33.60 MB/sec execute 84 sec latency 89.044 ms 20 34201 33.38 MB/sec execute 85 sec latency 90.206 ms 20 34526 33.30 MB/sec execute 86 sec latency 95.141 ms 20 34902 33.64 MB/sec execute 87 sec latency 110.153 ms 20 35331 34.01 MB/sec execute 88 sec latency 138.970 ms 20 35714 34.33 MB/sec execute 89 sec latency 138.771 ms 20 35974 34.24 MB/sec execute 90 sec latency 93.369 ms 20 36199 33.96 MB/sec execute 91 sec latency 119.246 ms 20 36432 33.69 MB/sec execute 92 sec latency 106.586 ms 20 36669 33.54 MB/sec execute 93 sec latency 137.223 ms 20 36977 33.55 MB/sec execute 94 sec latency 126.007 ms 20 37329 33.72 MB/sec execute 95 sec latency 68.961 ms 20 37622 33.53 MB/sec execute 96 sec latency 68.822 ms 20 37940 33.38 MB/sec execute 97 sec latency 82.975 ms 20 38281 33.47 MB/sec execute 98 sec latency 94.692 ms 20 38651 33.72 MB/sec execute 99 sec latency 112.735 ms 20 39046 33.96 MB/sec execute 100 sec latency 130.665 ms 20 39367 34.12 MB/sec execute 101 sec latency 142.161 ms 20 39608 34.03 MB/sec execute 102 sec latency 129.945 ms 20 39817 33.74 MB/sec execute 103 sec latency 153.841 ms 20 40042 33.55 MB/sec execute 104 sec latency 140.411 ms 20 40270 33.41 MB/sec execute 105 sec latency 156.684 ms 20 40548 33.38 MB/sec execute 106 sec latency 121.691 ms 20 40898 33.53 MB/sec execute 107 sec latency 78.935 ms 20 41187 33.38 MB/sec execute 108 sec latency 80.546 ms 20 41488 33.26 MB/sec execute 109 sec latency 112.116 ms 20 41858 33.34 MB/sec execute 110 sec latency 136.974 ms 20 42187 33.52 MB/sec execute 111 sec latency 129.926 ms 20 42576 33.67 MB/sec execute 112 sec latency 133.345 ms 20 42935 33.92 MB/sec execute 113 sec latency 78.569 ms 20 43171 33.80 MB/sec execute 114 sec latency 110.409 ms 20 43381 33.59 MB/sec execute 115 sec latency 119.894 ms 20 43638 33.41 MB/sec execute 116 sec latency 133.441 ms 20 43889 33.32 MB/sec execute 117 sec latency 165.409 ms 20 44194 33.30 MB/sec execute 118 sec latency 97.492 ms 20 44560 33.45 MB/sec execute 119 sec latency 67.341 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 131349 9.300 62.696 Close 96090 2.050 21.889 Rename 5487 11.789 55.170 Unlink 26695 3.259 34.772 Qpathinfo 118343 2.026 45.131 Qfileinfo 20437 0.060 5.240 Qfsinfo 21491 0.021 3.866 Sfileinfo 10777 5.305 27.575 Find 45370 0.386 29.729 WriteX 64154 0.704 14.582 ReadX 201357 0.009 2.971 LockX 408 2.581 8.006 UnlockX 408 2.526 16.593 Flush 9224 49.974 231.332 Throughput 33.4483 MB/sec 20 clients 20 procs max_latency=231.338 ms stopping dbench on /mnt/lustre/d0.oleg444-client.virtnet at Fri Jul 19 12:39:40 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg444-client.virtnet /mnt/lustre/d0.oleg444-client.virtnet /mnt/lustre/d0.oleg444-client.virtnet removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg444-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 12:39:42 (1721407182) min OST has 3145728kB available, using 4718592kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6822] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4608] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg444-clien 4608M 151051 98 157995 98 281238 51 2313 124 Latency 3292us 31460us 48945us 258ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg444-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 467 16 3933 17 653 12 474 16 575 14 678 13 Latency 18297us 6572us 50626us 16447us 7794us 13353us 1.97,1.97,oleg444-client.virtnet,1,1721413778,4608M,,,,151051,98,157995,98,,,281238,51,2313,124,10,,,,,467,16,3933,17,653,12,474,16,575,14,678,13,,3292us,31460us,,48945us,258ms,18297us,6572us,50626us,16447us,7794us,13353us debug=0x33f0484 PASS bonnie (182s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 12:42:45 (1721407365) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 10667 -P /tmp -l 5646336 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 10667 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x39a12e truncating to largest ever: 0x506ff8 truncating to largest ever: 0x553fbb truncating to largest ever: 0x55ebbc 002000 1721407372.914626 write 0x1f6f92 thru 0x1f8768 (0x17d7 bytes) 003000 1721407375.972336 read 0x0c2c07 thru 0x0c90b9 (0x64b3 bytes) truncating to largest ever: 0x561c6e 004000 1721407379.246711 read 0x2a1709 thru 0x2af27f (0xdb77 bytes) 005000 1721407382.763968 mapwrite 0x16f901 thru 0x170cc1 (0x13c1 bytes) skipping zero size read 010000 1721407403.356564 mapread 0x244762 thru 0x24e211 (0x9ab0 bytes) 011000 1721407408.157232 mapwrite 0x01d314 thru 0x029eb0 (0xcb9d bytes) 012000 1721407412.004610 mapwrite 0x131137 thru 0x1366cb (0x5595 bytes) 013000 1721407415.938476 read 0x0fdbc4 thru 0x109398 (0xb7d5 bytes) 014000 1721407420.115698 mapwrite 0x0af9c8 thru 0x0bc3ba (0xc9f3 bytes) 015000 1721407425.811627 trunc from 0x558140 to 0x112a39 (0x445706 bytes) 016000 1721407431.507001 mapwrite 0x17fdbb thru 0x188e69 (0x90af bytes) 017000 1721407436.379541 mapwrite 0x4126ea thru 0x416f4a (0x4861 bytes) 020000 1721407452.040116 mapread 0x0c2500 thru 0x0c8109 (0x5c0a bytes) 021000 1721407456.745064 read 0x01eadc thru 0x026d74 (0x8299 bytes) 022000 1721407461.948347 write 0x45067f thru 0x453f6f (0x38f1 bytes) 024000 1721407473.160104 mapwrite 0x34587a thru 0x351e1f (0xc5a6 bytes) 025000 1721407477.131847 write 0x2f84e9 thru 0x30141c (0x8f34 bytes) 026000 1721407481.165128 read 0x1496b3 thru 0x154a7e (0xb3cc bytes) 028000 1721407488.420326 mapwrite 0x1a065c thru 0x1a3a1f (0x33c4 bytes) 030000 1721407496.724807 mapread 0x316055 thru 0x31da88 (0x7a34 bytes) 031000 1721407500.358281 mapwrite 0x09d2d8 thru 0x0a4d82 (0x7aab bytes) 032000 1721407504.015443 mapwrite 0x5065b5 thru 0x5111b8 (0xac04 bytes) truncating to largest ever: 0x562330 035000 1721407515.716677 read 0x442106 thru 0x446f97 (0x4e92 bytes) truncating to largest ever: 0x5625e3 036000 1721407519.971621 mapwrite 0x4e663d thru 0x4ef920 (0x92e4 bytes) 038000 1721407528.059174 mapread 0x2e3666 thru 0x2f0343 (0xccde bytes) 039000 1721407531.790012 read 0x0fd26c thru 0x10670b (0x94a0 bytes) 041000 1721407538.296222 trunc from 0x4b98b4 to 0x2c0a95 (0x1f8e1e bytes) 042000 1721407541.686786 write 0x422597 thru 0x424f03 (0x296d bytes) 044000 1721407548.459956 mapread 0x1ad380 thru 0x1bbf7a (0xebfb bytes) 045000 1721407551.548094 mapwrite 0x0ae0a6 thru 0x0b6807 (0x8762 bytes) 046000 1721407554.915995 mapwrite 0x3f7917 thru 0x3fb893 (0x3f7d bytes) 049000 1721407564.907789 mapwrite 0x0fc138 thru 0x10912b (0xcff4 bytes) 051000 1721407571.431535 trunc from 0x3d5202 to 0x281ffe (0x153203 bytes) 053000 1721407577.830618 trunc from 0x34b4d1 to 0x0f3aea (0x2579e6 bytes) 054000 1721407581.009170 trunc from 0x310c79 to 0x23e495 (0xd27e3 bytes) 056000 1721407587.899119 trunc from 0x21d4e1 to 0x3afc73 (0x192793 bytes) 057000 1721407591.034584 mapread 0x35accb thru 0x360fce (0x6304 bytes) 058000 1721407594.768105 read 0x1368a8 thru 0x146753 (0xfeac bytes) 059000 1721407598.260783 mapwrite 0x14df3b thru 0x15130c (0x33d2 bytes) 061000 1721407605.035067 mapwrite 0x297c21 thru 0x29fbb6 (0x7f96 bytes) 062000 1721407608.530235 write 0x136b36 thru 0x13fdc9 (0x9294 bytes) 063000 1721407613.058214 mapwrite 0x1f9425 thru 0x1fba61 (0x263d bytes) 067000 1721407626.004065 trunc from 0x128cc0 to 0x1752af (0x4c5f0 bytes) 068000 1721407629.448860 write 0x41621e thru 0x416ef3 (0xcd6 bytes) truncating to largest ever: 0x56261a 072000 1721407643.812533 mapwrite 0x177d07 thru 0x17a644 (0x293e bytes) 073000 1721407647.297868 read 0x2b7831 thru 0x2b811d (0x8ed bytes) 075000 1721407654.614208 trunc from 0x4eb146 to 0x404328 (0xe6e1d bytes) 077000 1721407661.079975 write 0x1dcecc thru 0x1ea47b (0xd5b0 bytes) 078000 1721407664.622196 mapwrite 0x0cb2c3 thru 0x0cdb1c (0x285a bytes) 079000 1721407668.547122 read 0x3216fb thru 0x3309a6 (0xf2ac bytes) 080000 1721407672.531972 mapwrite 0x44d9a0 thru 0x45d50e (0xfb6f bytes) 082000 1721407679.850903 mapwrite 0x05d599 thru 0x064279 (0x6ce1 bytes) 083000 1721407683.782512 write 0x4906fc thru 0x49dbba (0xd4bf bytes) 086000 1721407696.901096 write 0x121194 thru 0x12f77f (0xe5ec bytes) 087000 1721407700.260930 write 0x12cf94 thru 0x130df1 (0x3e5e bytes) 088000 1721407704.072543 trunc from 0x1a12fe to 0x0b7698 (0xe9c65 bytes) 089000 1721407708.249273 read 0x3a34b5 thru 0x3b0d6d (0xd8b9 bytes) 090000 1721407711.328139 mapread 0x233840 thru 0x23c7f5 (0x8fb6 bytes) 092000 1721407718.142007 mapread 0x029d4c thru 0x032c7d (0x8f32 bytes) 093000 1721407721.316367 trunc from 0x3cb49e to 0x352b28 (0x78975 bytes) 094000 1721407725.996490 write 0x41b89f thru 0x41cd71 (0x14d3 bytes) 097000 1721407741.778714 mapwrite 0x47e000 thru 0x483b25 (0x5b26 bytes) 098000 1721407745.804734 mapwrite 0x4c6495 thru 0x4cf701 (0x926d bytes) 099000 1721407749.722940 write 0x16d517 thru 0x176f74 (0x9a5e bytes) 100000 1721407753.919505 read 0x401b04 thru 0x40e07b (0xc578 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (390s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 12:49:15 (1721407755) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1721407769.776552 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1721407775.033418 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1721407783.839789 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1721407787.993552 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1721407793.486858 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1721407820.315633 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1721407824.104712 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1721407828.626177 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1721407836.676208 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1721407842.180016 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1721407846.229207 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1721407856.567057 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1721407861.288616 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1721407869.768641 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1721407873.650370 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1721407877.384011 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1721407888.352968 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1721407894.459856 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1721407911.059185 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1721407930.320951 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1721407937.238163 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1721407944.432265 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1721407951.621814 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1721407956.562062 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1721407982.259230 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1721407987.546821 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1721407995.316827 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1721408049.534860 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1721408111.457158 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1721408142.075124 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1721408152.377831 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1721408182.896354 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1721408204.208544 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1721408212.122936 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1721408216.279877 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1721408220.926026 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1721408263.156255 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1721408281.660379 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1721408299.359430 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1721408335.339981 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1721408368.072937 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1721408383.802151 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1721408423.597390 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1721408433.848129 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1721408438.682109 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1721408446.160874 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1721408452.142860 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1721408460.040346 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1721408468.362399 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1721408482.521046 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1721408568.239804 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1721408585.539846 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1721408619.179098 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (879s) == sanity-benchmark test complete, duration 1609 sec ===== 13:03:54 (1721408634)