-----============= acceptance-small: sanity-benchmark ============----- Fri Jul 19 05:37:42 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg331-client.virtnet: executing check_config_client /mnt/lustre oleg331-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg331-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5862800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5862800.idle_timeout=debug disable quota as required oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 05:37:51 (1721381871) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6834] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg331-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg331-client.virtnet at Fri Jul 19 05:37:51 EDT 2024 waiting for dbench pid 8760 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 209 163.98 MB/sec warmup 1 sec latency 106.007 ms 20 407 144.00 MB/sec warmup 2 sec latency 65.606 ms 20 663 140.95 MB/sec warmup 3 sec latency 190.719 ms 20 797 107.32 MB/sec warmup 4 sec latency 248.752 ms 20 978 87.68 MB/sec warmup 5 sec latency 96.903 ms 20 1227 77.81 MB/sec warmup 6 sec latency 101.939 ms 20 1534 74.52 MB/sec warmup 7 sec latency 112.117 ms 20 1800 65.77 MB/sec warmup 8 sec latency 69.785 ms 20 2072 59.13 MB/sec warmup 9 sec latency 57.317 ms 20 2402 56.12 MB/sec warmup 10 sec latency 109.077 ms 20 2790 57.69 MB/sec warmup 11 sec latency 140.737 ms 20 3265 58.52 MB/sec warmup 12 sec latency 127.784 ms 20 3694 59.86 MB/sec warmup 13 sec latency 114.971 ms 20 3955 57.23 MB/sec warmup 14 sec latency 21.625 ms 20 4180 53.52 MB/sec warmup 15 sec latency 168.184 ms 20 4340 50.62 MB/sec warmup 16 sec latency 162.970 ms 20 4511 48.31 MB/sec warmup 17 sec latency 95.495 ms 20 4776 47.47 MB/sec warmup 18 sec latency 115.570 ms 20 5043 47.54 MB/sec warmup 19 sec latency 98.296 ms 20 5205 45.31 MB/sec warmup 20 sec latency 94.044 ms 20 5410 43.31 MB/sec warmup 21 sec latency 65.907 ms 20 5664 41.64 MB/sec warmup 22 sec latency 74.952 ms 20 5951 40.99 MB/sec warmup 23 sec latency 105.320 ms 20 6671 77.10 MB/sec execute 1 sec latency 133.796 ms 20 7082 74.97 MB/sec execute 2 sec latency 105.866 ms 20 7353 63.58 MB/sec execute 3 sec latency 33.639 ms 20 7538 49.13 MB/sec execute 4 sec latency 27.231 ms 20 7721 39.70 MB/sec execute 5 sec latency 202.639 ms 20 7864 34.11 MB/sec execute 6 sec latency 151.814 ms 20 8045 30.70 MB/sec execute 7 sec latency 98.302 ms 20 8283 30.43 MB/sec execute 8 sec latency 92.437 ms 20 8594 33.18 MB/sec execute 9 sec latency 78.682 ms 20 8790 30.20 MB/sec execute 10 sec latency 81.711 ms 20 8974 27.74 MB/sec execute 11 sec latency 91.271 ms 20 9213 26.04 MB/sec execute 12 sec latency 78.719 ms 20 9472 25.95 MB/sec execute 13 sec latency 82.108 ms 20 9684 26.27 MB/sec execute 14 sec latency 130.802 ms 20 10074 29.59 MB/sec execute 15 sec latency 107.068 ms 20 10425 30.62 MB/sec execute 16 sec latency 123.838 ms 20 10746 32.54 MB/sec execute 17 sec latency 68.982 ms 20 10952 31.89 MB/sec execute 18 sec latency 32.392 ms 20 11111 30.48 MB/sec execute 19 sec latency 138.371 ms 20 11266 29.07 MB/sec execute 20 sec latency 134.048 ms 20 11418 27.97 MB/sec execute 21 sec latency 177.764 ms 20 11566 27.06 MB/sec execute 22 sec latency 175.335 ms 20 11762 26.83 MB/sec execute 23 sec latency 105.638 ms 20 12032 27.05 MB/sec execute 24 sec latency 95.115 ms 20 12277 27.33 MB/sec execute 25 sec latency 94.051 ms 20 12486 26.42 MB/sec execute 26 sec latency 70.385 ms 20 12717 25.71 MB/sec execute 27 sec latency 84.213 ms 20 12991 25.58 MB/sec execute 28 sec latency 77.697 ms 20 13281 26.20 MB/sec execute 29 sec latency 110.438 ms 20 13705 28.03 MB/sec execute 30 sec latency 109.733 ms 20 14079 28.77 MB/sec execute 31 sec latency 118.260 ms 20 14373 29.45 MB/sec execute 32 sec latency 64.327 ms 20 14561 29.03 MB/sec execute 33 sec latency 156.292 ms 20 14731 28.32 MB/sec execute 34 sec latency 106.462 ms 20 14925 27.65 MB/sec execute 35 sec latency 119.573 ms 20 15069 27.18 MB/sec execute 36 sec latency 126.414 ms 20 15252 26.85 MB/sec execute 37 sec latency 145.554 ms 20 15484 26.95 MB/sec execute 38 sec latency 101.063 ms 20 15752 27.30 MB/sec execute 39 sec latency 75.583 ms 20 15952 26.73 MB/sec execute 40 sec latency 67.184 ms 20 16122 26.19 MB/sec execute 41 sec latency 168.214 ms 20 16337 25.81 MB/sec execute 42 sec latency 63.597 ms 20 16603 25.78 MB/sec execute 43 sec latency 80.920 ms 20 16889 26.20 MB/sec execute 44 sec latency 108.718 ms 20 17250 27.12 MB/sec execute 45 sec latency 104.648 ms 20 17587 27.59 MB/sec execute 46 sec latency 140.756 ms 20 17892 28.14 MB/sec execute 47 sec latency 74.512 ms 20 18085 27.93 MB/sec execute 48 sec latency 111.473 ms 20 18256 27.46 MB/sec execute 49 sec latency 95.942 ms 20 18456 27.02 MB/sec execute 50 sec latency 120.169 ms 20 18630 26.73 MB/sec execute 51 sec latency 104.733 ms 20 18829 26.47 MB/sec execute 52 sec latency 89.184 ms 20 19119 26.62 MB/sec execute 53 sec latency 81.572 ms 20 19415 26.85 MB/sec execute 54 sec latency 61.570 ms 20 19663 26.54 MB/sec execute 55 sec latency 73.203 ms 20 19953 26.30 MB/sec execute 56 sec latency 51.189 ms 20 20228 26.25 MB/sec execute 57 sec latency 81.297 ms 20 20544 26.72 MB/sec execute 58 sec latency 115.508 ms 20 20961 27.46 MB/sec execute 59 sec latency 136.642 ms 20 21301 27.81 MB/sec execute 60 sec latency 119.929 ms 20 21568 28.06 MB/sec execute 61 sec latency 94.432 ms 20 21770 27.86 MB/sec execute 62 sec latency 87.918 ms 20 21964 27.51 MB/sec execute 63 sec latency 109.302 ms 20 22164 27.25 MB/sec execute 64 sec latency 208.390 ms 20 22328 26.97 MB/sec execute 65 sec latency 121.527 ms 20 22569 26.92 MB/sec execute 66 sec latency 109.410 ms 20 22879 27.20 MB/sec execute 67 sec latency 93.428 ms 20 23117 27.09 MB/sec execute 68 sec latency 75.012 ms 20 23343 26.84 MB/sec execute 69 sec latency 72.085 ms 20 23627 26.73 MB/sec execute 70 sec latency 72.439 ms 20 23884 26.72 MB/sec execute 71 sec latency 180.178 ms 20 24144 26.97 MB/sec execute 72 sec latency 171.508 ms 20 24532 27.46 MB/sec execute 73 sec latency 129.838 ms 20 24897 27.79 MB/sec execute 74 sec latency 105.807 ms 20 25174 27.98 MB/sec execute 75 sec latency 80.138 ms 20 25359 27.80 MB/sec execute 76 sec latency 99.618 ms 20 25547 27.55 MB/sec execute 77 sec latency 113.571 ms 20 25735 27.29 MB/sec execute 78 sec latency 109.579 ms 20 25908 27.08 MB/sec execute 79 sec latency 119.716 ms 20 26119 26.98 MB/sec execute 80 sec latency 98.862 ms 20 26395 27.08 MB/sec execute 81 sec latency 78.282 ms 20 26652 27.16 MB/sec execute 82 sec latency 82.210 ms 20 26891 26.96 MB/sec execute 83 sec latency 76.398 ms 20 27157 26.85 MB/sec execute 84 sec latency 73.247 ms 20 27428 26.81 MB/sec execute 85 sec latency 106.701 ms 20 27687 26.96 MB/sec execute 86 sec latency 132.256 ms 20 28068 27.41 MB/sec execute 87 sec latency 122.588 ms 20 28450 27.75 MB/sec execute 88 sec latency 122.677 ms 20 28724 27.88 MB/sec execute 89 sec latency 101.387 ms 20 28927 27.76 MB/sec execute 90 sec latency 153.960 ms 20 29118 27.53 MB/sec execute 91 sec latency 127.708 ms 20 29305 27.30 MB/sec execute 92 sec latency 156.726 ms 20 29482 27.13 MB/sec execute 93 sec latency 157.785 ms 20 29712 27.10 MB/sec execute 94 sec latency 108.087 ms 20 30030 27.30 MB/sec execute 95 sec latency 84.190 ms 20 30283 27.25 MB/sec execute 96 sec latency 70.097 ms 20 30519 27.09 MB/sec execute 97 sec latency 61.548 ms 20 30780 26.97 MB/sec execute 98 sec latency 102.001 ms 20 31069 27.05 MB/sec execute 99 sec latency 135.945 ms 20 31316 27.10 MB/sec execute 100 sec latency 163.697 ms 20 31662 27.48 MB/sec execute 101 sec latency 144.683 ms 20 32020 27.66 MB/sec execute 102 sec latency 127.922 ms 20 32282 27.80 MB/sec execute 103 sec latency 91.631 ms 20 32468 27.72 MB/sec execute 104 sec latency 106.865 ms 20 32643 27.51 MB/sec execute 105 sec latency 114.197 ms 20 32847 27.32 MB/sec execute 106 sec latency 109.039 ms 20 33004 27.14 MB/sec execute 107 sec latency 152.720 ms 20 33206 27.05 MB/sec execute 108 sec latency 121.047 ms 20 33466 27.09 MB/sec execute 109 sec latency 118.818 ms 20 33766 27.25 MB/sec execute 110 sec latency 109.102 ms 20 34026 27.15 MB/sec execute 111 sec latency 91.515 ms 20 34278 27.02 MB/sec execute 112 sec latency 86.269 ms 20 34559 27.00 MB/sec execute 113 sec latency 72.271 ms 20 34788 27.04 MB/sec execute 114 sec latency 114.254 ms 20 35112 27.30 MB/sec execute 115 sec latency 161.685 ms 20 35426 27.45 MB/sec execute 116 sec latency 126.059 ms 20 35744 27.69 MB/sec execute 117 sec latency 133.635 ms 20 35953 27.61 MB/sec execute 118 sec latency 100.132 ms 20 36120 27.48 MB/sec execute 119 sec latency 136.330 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 104055 12.173 62.724 Close 75737 2.672 20.597 Rename 4388 14.960 41.043 Unlink 21380 3.945 21.097 Qpathinfo 93479 2.653 49.064 Qfileinfo 16224 0.073 8.388 Qfsinfo 17567 0.029 6.115 Sfileinfo 8158 6.948 25.801 Find 36412 0.459 38.425 WriteX 50908 0.923 18.863 ReadX 164877 0.011 2.552 LockX 352 3.679 9.681 UnlockX 352 3.535 10.441 Flush 7196 56.011 208.384 Throughput 27.4783 MB/sec 20 clients 20 procs max_latency=208.390 ms stopping dbench on /mnt/lustre/d0.oleg331-client.virtnet at Fri Jul 19 05:40:16 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg331-client.virtnet /mnt/lustre/d0.oleg331-client.virtnet /mnt/lustre/d0.oleg331-client.virtnet removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg331-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 05:40:19 (1721382019) min OST has 3167232kB available, using 4750848kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6834] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4639] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg331-clien 4639M 145899 98 153333 98 316935 57 2370 138 Latency 3065us 37992us 48391us 290ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg331-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 414 17 3391 17 570 12 429 17 612 15 643 12 Latency 17455us 6340us 60024us 18672us 4398us 13967us 1.97,1.97,oleg331-client.virtnet,1,1721373433,4639M,,,,145899,98,153333,98,,,316935,57,2370,138,10,,,,,414,17,3391,17,570,12,429,17,612,15,643,12,,3065us,37992us,,48391us,290ms,17455us,6340us,60024us,18672us,4398us,13967us debug=0x33f0484 PASS bonnie (190s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 05:43:30 (1721382210) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 9750 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 9750 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0xe371f truncating to largest ever: 0x13afce truncating to largest ever: 0x29bbe4 truncating to largest ever: 0x5218c4 truncating to largest ever: 0x52b762 truncating to largest ever: 0x54b614 truncating to largest ever: 0x55224d 001000 1721382215.621272 trunc from 0x45f61c to 0x0c4f94 (0x39a687 bytes) truncating to largest ever: 0x55dde2 003000 1721382224.242782 trunc from 0x47e5bc to 0x007f9d (0x47661e bytes) truncating to largest ever: 0x55f4bb 005000 1721382231.692415 read 0x2aa842 thru 0x2adc33 (0x33f2 bytes) 006000 1721382235.022053 trunc from 0x46e88d to 0x2340d5 (0x23a7b7 bytes) 007000 1721382238.504257 mapread 0x0cdb09 thru 0x0d425c (0x6754 bytes) 008000 1721382241.487597 write 0x0f36bc thru 0x0ff643 (0xbf88 bytes) truncating to largest ever: 0x561f04 010000 1721382248.058568 mapread 0x25437b thru 0x25a27b (0x5f01 bytes) 016000 1721382266.975317 trunc from 0x3ed8ca to 0x39e391 (0x4f538 bytes) 019000 1721382275.892016 mapwrite 0x5384f5 thru 0x5480d3 (0xfbdf bytes) 020000 1721382278.696648 mapwrite 0x47becc thru 0x4883b2 (0xc4e7 bytes) truncating to largest ever: 0x562d27 024000 1721382290.614868 mapwrite 0x256a98 thru 0x26545b (0xe9c4 bytes) 025000 1721382293.339155 write 0x0d1626 thru 0x0e0887 (0xf262 bytes) 026000 1721382296.362729 mapwrite 0x301224 thru 0x30234f (0x112c bytes) 029000 1721382305.151356 write 0x12e2c1 thru 0x13dd75 (0xfab5 bytes) 031000 1721382312.027638 read 0x3122aa thru 0x32132a (0xf081 bytes) 033000 1721382319.086876 write 0x1b7f68 thru 0x1c5342 (0xd3db bytes) 035000 1721382326.975167 trunc from 0x546dac to 0x11ed31 (0x42807a bytes) 037000 1721382334.752398 write 0x0a6df4 thru 0x0acdba (0x5fc7 bytes) 040000 1721382344.238000 trunc from 0x0d5154 to 0x3886c7 (0x2b3574 bytes) 042000 1721382350.442618 trunc from 0x4e32da to 0x3e4f07 (0xfe3d2 bytes) 043000 1721382353.602041 read 0x45a902 thru 0x45c8eb (0x1fea bytes) 047000 1721382365.250075 write 0x1131ca thru 0x122966 (0xf79d bytes) 049000 1721382370.844671 mapread 0x1fa76e thru 0x1ff15b (0x49ee bytes) 050000 1721382373.360944 trunc from 0x2952a7 to 0x445f30 (0x1b0c8a bytes) 051000 1721382376.463368 mapwrite 0x1f25f8 thru 0x1f80e9 (0x5af2 bytes) 053000 1721382382.743629 write 0x2c50d1 thru 0x2c91e0 (0x4110 bytes) 055000 1721382389.100425 read 0x09bffa thru 0x09de80 (0x1e87 bytes) 056000 1721382392.242849 write 0x5196c0 thru 0x5230de (0x9a1f bytes) 058000 1721382398.388619 trunc from 0x2140a2 to 0x451682 (0x23d5e1 bytes) 060000 1721382404.546510 mapwrite 0x31eafe thru 0x32d0e2 (0xe5e5 bytes) 063000 1721382414.377253 read 0x07bbd9 thru 0x080263 (0x468b bytes) 064000 1721382417.559770 trunc from 0x4e0059 to 0x498c7b (0x473dd bytes) 066000 1721382423.942683 write 0x38dac8 thru 0x38f164 (0x169d bytes) 070000 1721382435.736131 trunc from 0x451572 to 0x2d3af3 (0x17da7e bytes) 074000 1721382447.864878 mapwrite 0x14ab6a thru 0x1541c0 (0x9657 bytes) 078000 1721382461.776710 write 0x5264d7 thru 0x52eb15 (0x863f bytes) 080000 1721382469.739420 write 0x30453e thru 0x30e5b1 (0xa074 bytes) 081000 1721382473.111813 trunc from 0x51050a to 0x2836ef (0x28ce1a bytes) 082000 1721382476.847666 mapwrite 0x173d26 thru 0x17575a (0x1a35 bytes) 083000 1721382480.259993 trunc from 0x245b91 to 0x3441fa (0xfe66a bytes) 084000 1721382483.792862 mapread 0x156b6a thru 0x1660b9 (0xf550 bytes) 085000 1721382487.375503 mapread 0x133c52 thru 0x134d9c (0x114b bytes) 086000 1721382491.203586 trunc from 0x390284 to 0x0ba235 (0x2d604e bytes) 087000 1721382494.680913 trunc from 0x4ef1aa to 0x1a45d8 (0x34abd1 bytes) 088000 1721382497.977032 mapread 0x404a3e thru 0x411938 (0xcefb bytes) skipping zero size write 089000 1721382501.603449 trunc from 0x125e6e to 0x236b79 (0x110d0c bytes) 091000 1721382509.254644 write 0x20b2f2 thru 0x213a06 (0x8715 bytes) 092000 1721382512.484928 mapread 0x3968c9 thru 0x3a0e04 (0xa53c bytes) 093000 1721382516.053614 trunc from 0x2b7d03 to 0x1d399f (0xe4363 bytes) 095000 1721382523.042511 write 0x14772b thru 0x14a46d (0x2d43 bytes) 096000 1721382526.833154 write 0x011db4 thru 0x0210ed (0xf33a bytes) 100000 1721382540.682185 write 0x2aeea9 thru 0x2bda7c (0xebd4 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (331s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 05:49:01 (1721382541) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1721382553.393835 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1721382556.456343 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1721382563.297046 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1721382567.260632 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1721382571.044737 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1721382592.268855 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1721382595.542059 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1721382599.180075 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1721382606.580320 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1721382610.116305 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1721382613.655782 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1721382621.210623 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1721382625.154925 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1721382633.096391 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1721382636.659266 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1721382640.042084 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1721382646.732852 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1721382650.367622 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1721382661.186198 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1721382675.979924 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1721382679.392572 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1721382683.119670 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1721382687.063468 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1721382690.655480 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1721382712.558313 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1721382716.197076 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1721382723.144143 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1721382738.046528 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1721382754.526152 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1721382762.904980 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1721382767.215797 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1721382774.849970 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1721382783.403088 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1721382791.279484 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1721382794.913059 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1721382798.848993 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1721382815.454442 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1721382818.879197 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1721382822.264498 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1721382829.676825 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1721382836.949470 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1721382840.823697 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1721382852.058236 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1721382859.003415 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1721382862.369627 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1721382866.418818 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1721382870.127720 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1721382874.165820 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1721382878.225613 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1721382881.906315 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1721382900.088556 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1721382904.431740 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1721382913.436914 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (377s) == sanity-benchmark test complete, duration 1056 sec ===== 05:55:18 (1721382918)