-----============= acceptance-small: sanity-benchmark ============----- Mon Jul 29 03:24:59 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg218-client.virtnet: executing check_config_client /mnt/lustre oleg218-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg218-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012aa62800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aa62800.idle_timeout=debug disable quota as required oleg218-server: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 03:25:09 (1722237909) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6833] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg218-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg218-client.virtnet at Mon Jul 29 03:25:10 EDT 2024 waiting for dbench pid 8763 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 159 132.99 MB/sec warmup 1 sec latency 110.033 ms 20 314 114.91 MB/sec warmup 2 sec latency 59.593 ms 20 473 110.31 MB/sec warmup 3 sec latency 69.278 ms 20 667 105.77 MB/sec warmup 4 sec latency 417.314 ms 20 774 85.42 MB/sec warmup 5 sec latency 143.025 ms 20 884 72.21 MB/sec warmup 6 sec latency 127.404 ms 20 1005 63.74 MB/sec warmup 7 sec latency 149.362 ms 20 1202 57.61 MB/sec warmup 8 sec latency 38.854 ms 20 1448 57.81 MB/sec warmup 9 sec latency 46.867 ms 20 1591 52.29 MB/sec warmup 10 sec latency 214.218 ms 20 1726 47.72 MB/sec warmup 11 sec latency 108.821 ms 20 1875 43.96 MB/sec warmup 12 sec latency 124.619 ms 20 2045 40.87 MB/sec warmup 13 sec latency 106.241 ms 20 2226 38.67 MB/sec warmup 14 sec latency 42.974 ms 20 2388 37.31 MB/sec warmup 15 sec latency 139.325 ms 20 2534 36.07 MB/sec warmup 16 sec latency 153.116 ms 20 2854 38.42 MB/sec warmup 17 sec latency 152.887 ms 20 3110 37.81 MB/sec warmup 18 sec latency 177.031 ms 20 3418 38.51 MB/sec warmup 19 sec latency 159.534 ms 20 3678 38.89 MB/sec warmup 20 sec latency 114.370 ms 20 3857 37.96 MB/sec warmup 21 sec latency 35.498 ms 20 3989 36.41 MB/sec warmup 22 sec latency 39.245 ms 20 4129 34.88 MB/sec warmup 23 sec latency 197.697 ms 20 4359 4.37 MB/sec execute 1 sec latency 179.249 ms 20 4492 5.51 MB/sec execute 2 sec latency 109.239 ms 20 4652 9.62 MB/sec execute 3 sec latency 140.914 ms 20 4903 17.40 MB/sec execute 4 sec latency 64.582 ms 20 5108 19.55 MB/sec execute 5 sec latency 101.839 ms 20 5288 16.83 MB/sec execute 6 sec latency 85.049 ms 20 5486 14.91 MB/sec execute 7 sec latency 75.028 ms 20 5703 13.71 MB/sec execute 8 sec latency 59.991 ms 20 5930 14.91 MB/sec execute 9 sec latency 127.642 ms 20 6176 17.81 MB/sec execute 10 sec latency 116.753 ms 20 6474 21.55 MB/sec execute 11 sec latency 223.643 ms 20 6850 23.28 MB/sec execute 12 sec latency 131.597 ms 20 7166 26.77 MB/sec execute 13 sec latency 105.615 ms 20 7362 26.52 MB/sec execute 14 sec latency 35.319 ms 20 7507 25.13 MB/sec execute 15 sec latency 31.827 ms 20 7667 23.63 MB/sec execute 16 sec latency 168.677 ms 20 7842 22.58 MB/sec execute 17 sec latency 148.352 ms 20 7993 21.74 MB/sec execute 18 sec latency 118.977 ms 20 8192 21.70 MB/sec execute 19 sec latency 104.133 ms 20 8468 22.90 MB/sec execute 20 sec latency 104.142 ms 20 8673 22.88 MB/sec execute 21 sec latency 92.487 ms 20 8861 21.98 MB/sec execute 22 sec latency 79.192 ms 20 9062 21.19 MB/sec execute 23 sec latency 88.158 ms 20 9302 20.73 MB/sec execute 24 sec latency 101.795 ms 20 9529 20.88 MB/sec execute 25 sec latency 131.815 ms 20 9814 21.98 MB/sec execute 26 sec latency 142.156 ms 20 10199 23.70 MB/sec execute 27 sec latency 122.531 ms 20 10672 26.02 MB/sec execute 28 sec latency 102.349 ms 20 10902 25.99 MB/sec execute 29 sec latency 32.528 ms 20 11071 25.31 MB/sec execute 30 sec latency 30.996 ms 20 11230 24.55 MB/sec execute 31 sec latency 193.738 ms 20 11398 23.96 MB/sec execute 32 sec latency 155.155 ms 20 11523 23.42 MB/sec execute 33 sec latency 96.629 ms 20 11693 23.13 MB/sec execute 34 sec latency 119.624 ms 20 11928 23.57 MB/sec execute 35 sec latency 117.926 ms 20 12145 23.93 MB/sec execute 36 sec latency 125.853 ms 20 12291 23.35 MB/sec execute 37 sec latency 126.990 ms 20 12443 22.81 MB/sec execute 38 sec latency 96.123 ms 20 12626 22.31 MB/sec execute 39 sec latency 73.037 ms 20 12854 21.99 MB/sec execute 40 sec latency 86.003 ms 20 13061 22.00 MB/sec execute 41 sec latency 164.998 ms 20 13298 22.58 MB/sec execute 42 sec latency 143.824 ms 20 13610 23.32 MB/sec execute 43 sec latency 158.672 ms 20 13945 23.76 MB/sec execute 44 sec latency 131.614 ms 20 14180 24.23 MB/sec execute 45 sec latency 118.986 ms 20 14396 24.53 MB/sec execute 46 sec latency 37.905 ms 20 14530 24.23 MB/sec execute 47 sec latency 40.817 ms 20 14658 23.79 MB/sec execute 48 sec latency 38.122 ms 20 14795 23.34 MB/sec execute 49 sec latency 228.750 ms 20 14927 22.97 MB/sec execute 50 sec latency 220.905 ms 20 15056 22.64 MB/sec execute 51 sec latency 155.024 ms 20 15218 22.54 MB/sec execute 52 sec latency 135.951 ms 20 15472 22.65 MB/sec execute 53 sec latency 85.880 ms 20 15734 23.05 MB/sec execute 54 sec latency 84.450 ms 20 15896 22.68 MB/sec execute 55 sec latency 74.602 ms 20 16066 22.32 MB/sec execute 56 sec latency 72.186 ms 20 16295 22.02 MB/sec execute 57 sec latency 63.778 ms 20 16523 21.98 MB/sec execute 58 sec latency 91.212 ms 20 16717 22.06 MB/sec execute 59 sec latency 135.664 ms 20 17040 22.75 MB/sec execute 60 sec latency 132.174 ms 20 17367 23.12 MB/sec execute 61 sec latency 126.172 ms 20 17657 23.62 MB/sec execute 62 sec latency 111.661 ms 20 17894 23.88 MB/sec execute 63 sec latency 95.376 ms 20 18067 23.76 MB/sec execute 64 sec latency 35.650 ms 20 18221 23.45 MB/sec execute 65 sec latency 34.975 ms 20 18373 23.13 MB/sec execute 66 sec latency 156.875 ms 20 18489 22.86 MB/sec execute 67 sec latency 169.903 ms 20 18623 22.61 MB/sec execute 68 sec latency 116.513 ms 20 18783 22.49 MB/sec execute 69 sec latency 114.840 ms 20 19012 22.57 MB/sec execute 70 sec latency 92.927 ms 20 19244 22.91 MB/sec execute 71 sec latency 142.175 ms 20 19434 22.63 MB/sec execute 72 sec latency 64.465 ms 20 19621 22.36 MB/sec execute 73 sec latency 73.033 ms 20 19854 22.14 MB/sec execute 74 sec latency 62.275 ms 20 20080 22.05 MB/sec execute 75 sec latency 73.407 ms 20 20261 22.08 MB/sec execute 76 sec latency 155.058 ms 20 20527 22.46 MB/sec execute 77 sec latency 141.808 ms 20 20851 22.88 MB/sec execute 78 sec latency 125.870 ms 20 21182 23.16 MB/sec execute 79 sec latency 125.694 ms 20 21447 23.55 MB/sec execute 80 sec latency 100.873 ms 20 21621 23.49 MB/sec execute 81 sec latency 37.571 ms 20 21775 23.26 MB/sec execute 82 sec latency 32.177 ms 20 21909 23.00 MB/sec execute 83 sec latency 187.209 ms 20 22042 22.78 MB/sec execute 84 sec latency 185.460 ms 20 22141 22.56 MB/sec execute 85 sec latency 151.377 ms 20 22282 22.40 MB/sec execute 86 sec latency 114.603 ms 20 22454 22.37 MB/sec execute 87 sec latency 153.869 ms 20 22703 22.56 MB/sec execute 88 sec latency 89.640 ms 20 22888 22.59 MB/sec execute 89 sec latency 98.073 ms 20 23054 22.37 MB/sec execute 90 sec latency 87.988 ms 20 23236 22.16 MB/sec execute 91 sec latency 65.978 ms 20 23453 22.01 MB/sec execute 92 sec latency 99.801 ms 20 23652 21.93 MB/sec execute 93 sec latency 112.655 ms 20 23855 22.02 MB/sec execute 94 sec latency 143.255 ms 20 24130 22.34 MB/sec execute 95 sec latency 149.171 ms 20 24475 22.68 MB/sec execute 96 sec latency 116.256 ms 20 24765 22.93 MB/sec execute 97 sec latency 136.909 ms 20 25007 23.14 MB/sec execute 98 sec latency 78.489 ms 20 25181 23.09 MB/sec execute 99 sec latency 36.264 ms 20 25330 22.90 MB/sec execute 100 sec latency 162.841 ms 20 25467 22.69 MB/sec execute 101 sec latency 196.879 ms 20 25608 22.51 MB/sec execute 102 sec latency 153.724 ms 20 25721 22.35 MB/sec execute 103 sec latency 118.613 ms 20 25868 22.25 MB/sec execute 104 sec latency 114.429 ms 20 26067 22.28 MB/sec execute 105 sec latency 148.599 ms 20 26296 22.37 MB/sec execute 106 sec latency 104.295 ms 20 26487 22.37 MB/sec execute 107 sec latency 87.568 ms 20 26667 22.20 MB/sec execute 108 sec latency 72.041 ms 20 26855 22.04 MB/sec execute 109 sec latency 59.533 ms 20 27088 21.94 MB/sec execute 110 sec latency 75.511 ms 20 27310 21.99 MB/sec execute 111 sec latency 117.612 ms 20 27567 22.19 MB/sec execute 112 sec latency 122.225 ms 20 27870 22.48 MB/sec execute 113 sec latency 139.041 ms 20 28134 22.61 MB/sec execute 114 sec latency 158.490 ms 20 28442 22.85 MB/sec execute 115 sec latency 151.333 ms 20 28677 22.94 MB/sec execute 116 sec latency 30.701 ms 20 28829 22.83 MB/sec execute 117 sec latency 157.489 ms 20 28959 22.66 MB/sec execute 118 sec latency 131.131 ms 20 29110 22.50 MB/sec execute 119 sec latency 143.748 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 86498 14.565 67.120 Close 63638 3.330 16.912 Rename 3672 17.763 49.270 Unlink 17416 4.642 26.444 Qpathinfo 77959 3.125 47.063 Qfileinfo 13650 0.091 13.887 Qfsinfo 14385 0.032 6.824 Sfileinfo 7103 8.423 34.664 Find 30196 0.549 42.806 WriteX 42807 1.104 22.051 ReadX 135341 0.012 3.248 LockX 280 4.485 13.264 UnlockX 280 4.349 12.291 Flush 6248 65.175 228.742 Throughput 22.496 MB/sec 20 clients 20 procs max_latency=228.750 ms stopping dbench on /mnt/lustre/d0.oleg218-client.virtnet at Mon Jul 29 03:27:34 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg218-client.virtnet /mnt/lustre/d0.oleg218-client.virtnet /mnt/lustre/d0.oleg218-client.virtnet removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg218-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 03:27:37 (1722238057) min OST has 3394560kB available, using 5091840kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6833] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4972] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg218-clien 4972M 143284 98 139749 98 299980 58 2035 147 Latency 20395us 42960us 50985us 301ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg218-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 463 17 3533 17 614 12 476 16 634 14 699 12 Latency 12988us 8608us 58852us 13869us 4245us 11659us 1.97,1.97,oleg218-client.virtnet,1,1722245870,4972M,,,,143284,98,139749,98,,,299980,58,2035,147,10,,,,,463,17,3533,17,614,12,476,16,634,14,699,12,,20395us,42960us,,50985us,301ms,12988us,8608us,58852us,13869us,4245us,11659us debug=0x33f0484 PASS bonnie (193s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 03:30:51 (1722238251) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 2131 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 2131 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1a85ae truncating to largest ever: 0x2f9044 truncating to largest ever: 0x38d390 truncating to largest ever: 0x56293e 002000 1722238258.754234 mapread 0x03204d thru 0x0382a3 (0x6257 bytes) 003000 1722238262.133622 mapread 0x328007 thru 0x32896b (0x965 bytes) 004000 1722238265.477861 trunc from 0x31693a to 0x01ef02 (0x2f7a37 bytes) 006000 1722238272.371399 trunc from 0x4fbdc8 to 0x25981c (0x2a25ab bytes) 007000 1722238275.533893 mapwrite 0x3007a6 thru 0x30db55 (0xd3b0 bytes) 008000 1722238278.965896 mapread 0x01c33d thru 0x01c55b (0x21f bytes) 009000 1722238282.241182 mapwrite 0x04fdb4 thru 0x04ff08 (0x155 bytes) 010000 1722238285.391057 trunc from 0x4a6370 to 0x1b5d82 (0x2f05ed bytes) 014000 1722238298.354565 mapwrite 0x2c1495 thru 0x2c272d (0x1299 bytes) 016000 1722238304.430922 mapread 0x00002f thru 0x00252c (0x24fe bytes) 019000 1722238313.694650 read 0x0dc93a thru 0x0e9145 (0xc80c bytes) 020000 1722238316.709792 write 0x413ba5 thru 0x41bff1 (0x844d bytes) 021000 1722238319.679650 write 0x50f817 thru 0x512a5d (0x3247 bytes) 024000 1722238329.678852 write 0x1122ea thru 0x1177a2 (0x54b9 bytes) 026000 1722238336.506228 mapwrite 0x2d153a thru 0x2d25e7 (0x10ae bytes) 027000 1722238339.939219 read 0x39799d thru 0x3a2c10 (0xb274 bytes) 029000 1722238346.189703 write 0x02e943 thru 0x0392ee (0xa9ac bytes) 030000 1722238349.548963 mapwrite 0x214268 thru 0x21aad9 (0x6872 bytes) 031000 1722238353.531909 write 0x3ddeec thru 0x3dfbc9 (0x1cde bytes) 032000 1722238356.751609 mapread 0x095598 thru 0x09a7ff (0x5268 bytes) 033000 1722238359.998186 read 0x1dc246 thru 0x1e0eb5 (0x4c70 bytes) 035000 1722238366.831153 read 0x142f87 thru 0x145123 (0x219d bytes) 037000 1722238374.317447 mapwrite 0x3a90f0 thru 0x3b4012 (0xaf23 bytes) 039000 1722238381.472514 write 0x4cb2da thru 0x4cdd47 (0x2a6e bytes) 040000 1722238384.924309 read 0x2cb8a2 thru 0x2d340c (0x7b6b bytes) 042000 1722238391.845677 mapwrite 0x1e6002 thru 0x1e9831 (0x3830 bytes) 045000 1722238401.482307 trunc from 0x52af90 to 0x3d9636 (0x151959 bytes) 046000 1722238404.698229 read 0x359ebd thru 0x363f7d (0xa0c1 bytes) 049000 1722238415.196570 mapread 0x1843d0 thru 0x1915ff (0xd230 bytes) 050000 1722238418.998054 trunc from 0x4de1cc to 0x538e11 (0x5ac46 bytes) 052000 1722238425.756455 read 0x397c6a thru 0x3a0dc2 (0x9159 bytes) 055000 1722238435.840568 mapwrite 0x3dd725 thru 0x3ed62e (0xff0a bytes) 056000 1722238439.273451 mapread 0x087c43 thru 0x087f99 (0x357 bytes) 057000 1722238442.229843 write 0x30ed9e thru 0x317668 (0x88cb bytes) truncating to largest ever: 0x562d54 058000 1722238445.559115 mapread 0x07d74a thru 0x08a7c0 (0xd077 bytes) skipping zero size write 062000 1722238457.722319 mapread 0x40b4eb thru 0x415d9b (0xa8b1 bytes) 063000 1722238460.975934 mapread 0x1f5ce0 thru 0x205663 (0xf984 bytes) 064000 1722238464.214076 write 0x0ec9f7 thru 0x0f414c (0x7756 bytes) 065000 1722238467.910187 trunc from 0x01a6d7 to 0x1dc01a (0x1c1944 bytes) 067000 1722238475.248957 write 0x044fe6 thru 0x0538da (0xe8f5 bytes) 069000 1722238482.416469 read 0x03e8ee thru 0x04b2e9 (0xc9fc bytes) 070000 1722238485.578156 mapwrite 0x1f2716 thru 0x1f7d44 (0x562f bytes) 071000 1722238489.367024 write 0x215042 thru 0x21e390 (0x934f bytes) 073000 1722238495.952535 mapwrite 0x41da13 thru 0x428ee2 (0xb4d0 bytes) 075000 1722238502.475689 trunc from 0x17eabf to 0x027be0 (0x156ede bytes) 076000 1722238506.007330 mapwrite 0x23c558 thru 0x23d878 (0x1321 bytes) 077000 1722238509.458690 write 0x26b67e thru 0x26c76a (0x10ed bytes) 078000 1722238513.522571 trunc from 0x517112 to 0x424279 (0xf2e98 bytes) 080000 1722238520.536672 mapread 0x05b8f0 thru 0x05f32e (0x3a3f bytes) 081000 1722238523.944978 write 0x237e8e thru 0x23f832 (0x79a5 bytes) 082000 1722238527.267882 mapread 0x1089e9 thru 0x112a01 (0xa019 bytes) 083000 1722238530.184654 read 0x21f425 thru 0x22ace5 (0xb8c1 bytes) 084000 1722238533.314903 mapwrite 0x3700dc thru 0x37a1dc (0xa101 bytes) 086000 1722238539.603901 write 0x188e8c thru 0x1891e3 (0x358 bytes) 087000 1722238543.141574 trunc from 0x4e384f to 0x22190c (0x2c1f42 bytes) 088000 1722238546.523231 trunc from 0x3ee2dc to 0x2c9884 (0x124a57 bytes) 092000 1722238560.929721 trunc from 0x107fe6 to 0x36f412 (0x26742d bytes) 096000 1722238576.537966 read 0x2ba18d thru 0x2c71ec (0xd060 bytes) 098000 1722238584.355066 read 0x22e66f thru 0x232b17 (0x44a9 bytes) 099000 1722238588.441813 write 0x35a174 thru 0x35b762 (0x15ef bytes) 100000 1722238591.944070 mapwrite 0x3241ae thru 0x32ccb6 (0x8b09 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (342s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 03:36:33 (1722238593) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1722238621.321762 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1722238627.054265 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1722238636.202211 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1722238643.538221 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1722238653.203950 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1722238686.160076 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1722238691.818524 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1722238697.004583 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1722238708.990469 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1722238714.070249 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1722238719.139221 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1722238727.628227 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1722238731.780301 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1722238741.977938 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1722238746.173284 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1722238750.276120 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1722238760.632391 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1722238764.747000 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1722238776.154044 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1722238790.599206 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1722238794.743283 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1722238799.178695 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1722238804.036646 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1722238808.252004 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1722238836.955897 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1722238840.865610 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1722238850.359981 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1722238867.858889 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1722238886.027674 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1722238896.973303 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1722238902.168875 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1722238915.651255 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1722238928.712764 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1722238941.797835 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1722238947.801713 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1722238954.439685 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1722238979.927120 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1722238986.909445 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1722238992.266445 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1722239006.769851 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1722239020.434490 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1722239028.312562 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1722239050.876368 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1722239066.172023 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1722239073.098468 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1722239079.697348 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1722239084.546248 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1722239090.107575 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1722239095.939309 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1722239101.203177 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1722239126.364727 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1722239132.312280 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1722239142.634916 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (555s) == sanity-benchmark test complete, duration 1248 sec ===== 03:45:48 (1722239148)