-----============= acceptance-small: sanity-benchmark ============----- Fri Jun 14 16:49:41 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg308-client.virtnet: executing check_config_client /mnt/lustre oleg308-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg308-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b040d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b040d000.idle_timeout=debug disable quota as required oleg308-server: oleg308-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 16:49:52 (1718398192) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7443] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg308-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg308-client.virtnet at Fri Jun 14 16:49:53 EDT 2024 waiting for dbench pid 9582 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 252 191.20 MB/sec warmup 1 sec latency 52.487 ms 20 476 166.39 MB/sec warmup 2 sec latency 41.177 ms 20 668 141.05 MB/sec warmup 3 sec latency 642.355 ms 20 888 108.35 MB/sec warmup 4 sec latency 724.759 ms 20 1174 92.04 MB/sec warmup 5 sec latency 26.587 ms 20 1517 86.89 MB/sec warmup 6 sec latency 39.035 ms 20 1840 75.27 MB/sec warmup 7 sec latency 24.282 ms 20 2215 67.49 MB/sec warmup 8 sec latency 19.821 ms 20 2536 64.20 MB/sec warmup 9 sec latency 24.569 ms 20 3152 68.33 MB/sec warmup 10 sec latency 29.158 ms 20 3679 70.52 MB/sec warmup 11 sec latency 23.398 ms 20 3946 66.71 MB/sec warmup 12 sec latency 30.657 ms 20 4207 61.85 MB/sec warmup 13 sec latency 52.855 ms 20 4445 58.27 MB/sec warmup 14 sec latency 32.855 ms 20 4729 56.28 MB/sec warmup 15 sec latency 29.808 ms 20 5090 56.50 MB/sec warmup 16 sec latency 32.036 ms 20 5330 53.41 MB/sec warmup 17 sec latency 30.839 ms 20 5620 50.82 MB/sec warmup 18 sec latency 53.904 ms 20 5925 49.45 MB/sec warmup 19 sec latency 157.620 ms 20 6321 49.97 MB/sec warmup 20 sec latency 249.419 ms 20 6862 52.30 MB/sec warmup 21 sec latency 114.869 ms 20 7224 52.41 MB/sec warmup 22 sec latency 102.661 ms 20 7424 50.88 MB/sec warmup 23 sec latency 615.781 ms 20 7783 17.21 MB/sec execute 1 sec latency 2616.021 ms 20 7913 19.17 MB/sec execute 2 sec latency 3616.272 ms 20 7974 13.15 MB/sec execute 3 sec latency 4616.548 ms 20 8068 10.31 MB/sec execute 4 sec latency 5617.118 ms 20 8144 8.55 MB/sec execute 5 sec latency 6617.807 ms 20 8198 7.36 MB/sec execute 6 sec latency 7618.127 ms 20 8240 6.48 MB/sec execute 7 sec latency 8619.441 ms 20 8283 5.99 MB/sec execute 8 sec latency 9622.357 ms 20 8328 5.94 MB/sec execute 9 sec latency 10622.782 ms 20 8375 5.78 MB/sec execute 10 sec latency 11625.666 ms 20 8417 5.75 MB/sec execute 11 sec latency 12625.750 ms 20 8475 5.85 MB/sec execute 12 sec latency 13625.847 ms 20 8541 6.71 MB/sec execute 13 sec latency 14626.047 ms 20 8633 7.32 MB/sec execute 14 sec latency 15629.907 ms 20 8704 7.30 MB/sec execute 15 sec latency 16630.109 ms 20 8795 7.55 MB/sec execute 16 sec latency 17633.203 ms 20 8891 8.25 MB/sec execute 17 sec latency 18634.055 ms 20 8963 8.49 MB/sec execute 18 sec latency 19634.579 ms 20 9014 8.42 MB/sec execute 19 sec latency 20634.691 ms 20 9063 8.22 MB/sec execute 20 sec latency 21636.206 ms 20 9102 7.92 MB/sec execute 21 sec latency 22636.320 ms 20 9136 7.62 MB/sec execute 22 sec latency 23636.474 ms 20 9173 7.30 MB/sec execute 23 sec latency 24639.110 ms 20 9213 7.13 MB/sec execute 24 sec latency 25640.328 ms 20 9258 6.88 MB/sec execute 25 sec latency 26640.458 ms 20 9310 6.80 MB/sec execute 26 sec latency 27642.137 ms 20 9354 6.61 MB/sec execute 27 sec latency 28642.460 ms 20 9414 6.53 MB/sec execute 28 sec latency 29642.585 ms 20 9458 6.42 MB/sec execute 29 sec latency 30642.690 ms 20 9521 6.41 MB/sec execute 30 sec latency 31642.822 ms 20 9588 6.33 MB/sec execute 31 sec latency 32643.222 ms 20 9681 6.88 MB/sec execute 32 sec latency 33643.336 ms 20 9740 6.69 MB/sec execute 33 sec latency 34643.570 ms 20 9849 6.63 MB/sec execute 34 sec latency 35645.097 ms 20 10024 6.55 MB/sec execute 35 sec latency 36645.198 ms 20 10185 6.78 MB/sec execute 36 sec latency 37645.476 ms 20 10355 7.37 MB/sec execute 37 sec latency 38645.777 ms 20 10496 7.86 MB/sec execute 38 sec latency 39645.884 ms 20 10634 8.06 MB/sec execute 39 sec latency 40645.993 ms 20 10744 8.47 MB/sec execute 40 sec latency 41647.917 ms 20 10829 8.43 MB/sec execute 41 sec latency 42648.227 ms 20 10911 8.51 MB/sec execute 42 sec latency 43648.382 ms 20 10976 8.40 MB/sec execute 43 sec latency 44648.620 ms 20 11041 8.29 MB/sec execute 44 sec latency 45649.101 ms 20 11128 8.35 MB/sec execute 45 sec latency 46649.194 ms 20 11208 8.26 MB/sec execute 46 sec latency 47649.616 ms 20 11277 8.17 MB/sec execute 47 sec latency 48651.315 ms 20 11358 8.19 MB/sec execute 48 sec latency 49653.326 ms 20 11450 8.25 MB/sec execute 49 sec latency 50655.781 ms 20 11579 8.53 MB/sec execute 50 sec latency 51656.335 ms 20 11712 8.60 MB/sec execute 51 sec latency 52657.193 ms 20 11817 8.49 MB/sec execute 52 sec latency 53657.573 ms 20 11956 8.42 MB/sec execute 53 sec latency 54657.719 ms 20 12085 8.47 MB/sec execute 54 sec latency 55658.394 ms 20 12194 8.58 MB/sec execute 55 sec latency 56658.514 ms 20 12389 9.04 MB/sec execute 56 sec latency 57658.843 ms 20 12588 9.35 MB/sec execute 57 sec latency 58658.937 ms 20 12728 9.62 MB/sec execute 58 sec latency 59659.398 ms 20 12821 9.60 MB/sec execute 59 sec latency 60659.663 ms 20 12908 9.55 MB/sec execute 60 sec latency 61659.859 ms 20 13012 9.46 MB/sec execute 61 sec latency 62660.019 ms 20 13115 9.41 MB/sec execute 62 sec latency 63660.413 ms 20 13245 9.43 MB/sec execute 63 sec latency 64660.556 ms 20 13369 9.50 MB/sec execute 64 sec latency 65660.874 ms 20 13473 9.68 MB/sec execute 65 sec latency 66661.002 ms 20 13547 9.60 MB/sec execute 66 sec latency 67661.210 ms 20 13614 9.49 MB/sec execute 67 sec latency 68663.627 ms 20 13691 9.38 MB/sec execute 68 sec latency 69664.108 ms 20 13774 9.27 MB/sec execute 69 sec latency 70664.295 ms 20 13870 9.22 MB/sec execute 70 sec latency 71664.410 ms 20 13963 9.24 MB/sec execute 71 sec latency 72664.547 ms 20 14047 9.24 MB/sec execute 72 sec latency 73664.684 ms 20 14159 9.40 MB/sec execute 73 sec latency 74664.843 ms 20 14262 9.50 MB/sec execute 74 sec latency 75666.304 ms 20 14367 9.53 MB/sec execute 75 sec latency 76666.491 ms 20 14471 9.64 MB/sec execute 76 sec latency 77667.002 ms 20 14560 9.72 MB/sec execute 77 sec latency 78667.324 ms 20 14625 9.68 MB/sec execute 78 sec latency 79669.897 ms 20 14675 9.61 MB/sec execute 79 sec latency 80670.058 ms 20 14733 9.53 MB/sec execute 80 sec latency 81670.166 ms 20 14773 9.42 MB/sec execute 81 sec latency 82670.269 ms 20 14829 9.34 MB/sec execute 82 sec latency 83670.383 ms 20 14926 9.32 MB/sec execute 83 sec latency 84670.581 ms 20 15005 9.30 MB/sec execute 84 sec latency 85670.823 ms 20 15096 9.28 MB/sec execute 85 sec latency 86671.538 ms 20 15204 9.32 MB/sec execute 86 sec latency 87671.614 ms 20 15308 9.42 MB/sec execute 87 sec latency 88671.764 ms 20 15412 9.50 MB/sec execute 88 sec latency 89672.162 ms 20 15505 9.45 MB/sec execute 89 sec latency 90672.273 ms 20 15618 9.43 MB/sec execute 90 sec latency 91672.351 ms 20 15730 9.40 MB/sec execute 91 sec latency 92672.461 ms 20 15855 9.41 MB/sec execute 92 sec latency 93672.692 ms 20 15977 9.49 MB/sec execute 93 sec latency 94673.132 ms 20 16158 9.76 MB/sec execute 94 sec latency 95673.273 ms 20 16329 9.87 MB/sec execute 95 sec latency 96673.550 ms 20 16490 10.11 MB/sec execute 96 sec latency 97673.754 ms 20 16588 10.09 MB/sec execute 97 sec latency 98673.888 ms 20 16673 10.03 MB/sec execute 98 sec latency 99674.205 ms 20 16755 9.94 MB/sec execute 99 sec latency 100674.315 ms 20 16862 9.89 MB/sec execute 100 sec latency 101676.024 ms 20 16945 9.84 MB/sec execute 101 sec latency 102676.107 ms 20 17058 9.84 MB/sec execute 102 sec latency 103676.648 ms 20 17164 9.89 MB/sec execute 103 sec latency 104677.076 ms 20 17283 9.95 MB/sec execute 104 sec latency 105677.180 ms 20 17397 9.91 MB/sec execute 105 sec latency 106677.510 ms 20 17526 9.86 MB/sec execute 106 sec latency 107677.840 ms 20 17691 9.91 MB/sec execute 107 sec latency 108678.390 ms 20 17875 10.05 MB/sec execute 108 sec latency 109678.839 ms 20 18193 10.40 MB/sec execute 109 sec latency 110679.100 ms 20 18394 10.59 MB/sec execute 110 sec latency 111679.199 ms 20 18537 10.58 MB/sec execute 111 sec latency 112679.597 ms 20 18700 10.52 MB/sec execute 112 sec latency 113679.686 ms 20 18895 10.59 MB/sec execute 113 sec latency 114679.783 ms 20 19079 10.75 MB/sec execute 114 sec latency 115679.893 ms 20 19226 10.73 MB/sec execute 115 sec latency 116680.011 ms 20 19385 10.71 MB/sec execute 116 sec latency 117680.507 ms 20 19612 10.81 MB/sec execute 117 sec latency 118680.876 ms 20 19755 10.87 MB/sec execute 118 sec latency 119680.973 ms 20 19992 11.12 MB/sec execute 119 sec latency 120681.332 ms 20 cleanup 120 sec 16 cleanup 121 sec 8 cleanup 122 sec 2 cleanup 123 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 43396 30.379 123300.152 Close 32119 17.402 124142.481 Rename 1840 26.262 671.998 Unlink 8526 17.590 41194.089 Qpathinfo 39546 3.660 86.696 Qfileinfo 6974 0.114 11.442 Qfsinfo 7134 0.077 9.135 Sfileinfo 3593 17.174 927.129 Find 15312 0.696 88.611 WriteX 21526 2.506 65.239 ReadX 68674 0.021 7.006 LockX 142 7.709 167.344 UnlockX 142 6.764 70.087 Flush 3011 20.180 417.727 Throughput 11.1153 MB/sec 20 clients 20 procs max_latency=120681.332 ms stopping dbench on /mnt/lustre/d0.oleg308-client.virtnet at Fri Jun 14 16:52:20 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg308-client.virtnet /mnt/lustre/d0.oleg308-client.virtnet /mnt/lustre/d0.oleg308-client.virtnet removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg308-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (153s) == sanity-benchmark test bonnie: bonnie++ ================ 16:52:25 (1718398345) min OST has 3548152kB available, using 5322228kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7443] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5197] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg308-clien 5197M 102101 75 79717 66 180815 38 1471 188 Latency 18347us 250ms 89593us 11347us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg308-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 181 17 1875 16 285 15 209 17 222 15 379 15 Latency 39151us 16812us 34193us 23683us 17353us 36486us 1.97,1.97,oleg308-client.virtnet,1,1718388726,5197M,,,,102101,75,79717,66,,,180815,38,1471,188,10,,,,,181,17,1875,16,285,15,209,17,222,15,379,15,,18347us,250ms,,89593us,11347us,39151us,16812us,34193us,23683us,17353us,36486us debug=0x33f0484 PASS bonnie (379s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 16:58:44 (1718398724) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 31150 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 31150 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x2874ec fallocating to largest ever: 0x2f5599 truncating to largest ever: 0x37046c fallocating to largest ever: 0x3ae23d truncating to largest ever: 0x524b13 001000 1718398729.507339 mapread 0x19c7d6 thru 0x1a7ced (0xb518 bytes) fallocating to largest ever: 0x527079 fallocating to largest ever: 0x528540 003000 1718398738.592466 read 0x35cd20 thru 0x36b8a0 (0xeb81 bytes) 005000 1718398747.957630 read 0x2f068f thru 0x2f2a9f (0x2411 bytes) 006000 1718398753.789712 write 0x3d555c thru 0x3d9ed5 (0x497a bytes) 007000 1718398758.598078 mapread 0x03e5be thru 0x0497ba (0xb1fd bytes) 008000 1718398763.010148 mapwrite 0x2cf254 thru 0x2ddbef (0xe99c bytes) 010000 1718398773.104903 write 0x11f50e thru 0x124551 (0x5044 bytes) 013000 1718398784.981972 fallocate 0x199fcf thru 0x1a5311 (0xb343 bytes) 014000 1718398789.104106 read 0x20c87a thru 0x21a540 (0xdcc7 bytes) 015000 1718398793.589041 trunc from 0x4982e4 to 0x2b9050 (0x1df293 bytes) 016000 1718398797.985243 read 0x299a52 thru 0x2a30e4 (0x9693 bytes) 017000 1718398802.608735 trunc from 0x4a1012 to 0x458ba7 (0x4846a bytes) 018000 1718398806.123089 read 0x07fbbf thru 0x081c4e (0x2090 bytes) 019000 1718398809.890413 mapwrite 0x4eb969 thru 0x4ed5f9 (0x1c91 bytes) 021000 1718398819.225816 trunc from 0x4a7108 to 0x0e9b7c (0x3bd58b bytes) 022000 1718398824.100388 fallocate 0x4f2e4e thru 0x4fe2a2 (0xb455 bytes) 023000 1718398828.984973 mapwrite 0x30d1b1 thru 0x310788 (0x35d8 bytes) 024000 1718398832.796362 write 0x3e1b25 thru 0x3ecc3b (0xb117 bytes) 025000 1718398838.078770 mapread 0x2218da thru 0x22bd4f (0xa476 bytes) 026000 1718398843.094957 mapread 0x055a80 thru 0x062b46 (0xd0c7 bytes) 027000 1718398848.502364 punch from 0x4345ef to 0x43d1b2 (0x8bc4 bytes) 028000 1718398853.678917 fallocate 0x1b2940 thru 0x1c217c (0xf83d bytes) 029000 1718398858.219199 read 0x03b872 thru 0x047125 (0xb8b4 bytes) 031000 1718398867.217553 punch from 0x3416a7 to 0x344365 (0x2cbf bytes) 032000 1718398871.544137 punch from 0x0fb648 to 0x103dc7 (0x8780 bytes) 033000 1718398875.789354 fallocate 0x48494c thru 0x48d942 (0x8ff7 bytes) 035000 1718398882.151821 punch from 0x333af2 to 0x341d9e (0xe2ad bytes) 036000 1718398885.303331 write 0x1aa82e thru 0x1b0e26 (0x65f9 bytes) 037000 1718398888.960170 mapread 0x2fd1d0 thru 0x303ff9 (0x6e2a bytes) 038000 1718398893.066891 fallocate 0x15da2f thru 0x16a4c9 (0xca9b bytes) 039000 1718398896.085345 read 0x1a7a57 thru 0x1b0df0 (0x939a bytes) 040000 1718398899.705613 trunc from 0x2756d4 to 0x326c6e (0xb159b bytes) 042000 1718398905.568607 fallocate 0x12d8ac thru 0x1381ba (0xa90f bytes) 044000 1718398912.804214 fallocate 0x33cc28 thru 0x34b42e (0xe807 bytes) 045000 1718398916.498451 mapwrite 0x4ff09f thru 0x502c1f (0x3b81 bytes) 046000 1718398920.205297 mapread 0x4503b2 thru 0x453fd1 (0x3c20 bytes) 047000 1718398923.310554 trunc from 0x3edec8 to 0x28c677 (0x161850 bytes) 048000 1718398926.371021 mapread 0x07e2ed thru 0x082b9a (0x48ae bytes) 049000 1718398929.486715 write 0x1197af thru 0x11cc23 (0x3475 bytes) 050000 1718398932.539923 mapwrite 0x46a513 thru 0x46cf32 (0x2a20 bytes) 052000 1718398938.688529 mapwrite 0x1d0433 thru 0x1da0b5 (0x9c83 bytes) 054000 1718398945.621464 read 0x0ae05a thru 0x0afe4c (0x1df3 bytes) 055000 1718398949.289207 mapread 0x02705f thru 0x02c890 (0x5832 bytes) 057000 1718398956.450002 mapwrite 0x08949c thru 0x08ba7a (0x25df bytes) 059000 1718398962.712166 write 0x3d5cb5 thru 0x3d7fa9 (0x22f5 bytes) 060000 1718398965.985600 fallocate 0x0f4372 thru 0x0fd578 (0x9207 bytes) 061000 1718398969.849736 punch from 0x06e249 to 0x075668 (0x7420 bytes) 062000 1718398973.119646 fallocate 0x5164d9 thru 0x519577 (0x309f bytes) 063000 1718398976.148590 mapwrite 0x03e434 thru 0x04b35b (0xcf28 bytes) 064000 1718398979.858988 punch from 0x0e9d5f to 0x0efe98 (0x613a bytes) 067000 1718398999.434015 punch from 0x3f2181 to 0x3f5afe (0x397e bytes) 068000 1718399007.775135 write 0x21c08d thru 0x220367 (0x42db bytes) 070000 1718399019.287562 mapread 0x2bbee9 thru 0x2c2ccd (0x6de5 bytes) 071000 1718399026.227667 mapread 0x23e778 thru 0x24bf65 (0xd7ee bytes) 072000 1718399031.181080 mapread 0x301d5f thru 0x302863 (0xb05 bytes) 075000 1718399054.350371 punch from 0x0816f0 to 0x084a4a (0x335b bytes) 080000 1718399078.985091 fallocate 0x112b71 thru 0x118aca (0x5f5a bytes) 081000 1718399084.158569 mapread 0x245abc thru 0x249aba (0x3fff bytes) 082000 1718399089.132140 punch from 0x016eb1 to 0x025099 (0xe1e9 bytes) 083000 1718399092.852553 mapread 0x15c293 thru 0x167444 (0xb1b2 bytes) 084000 1718399097.925248 write 0x2d920c thru 0x2e838a (0xf17f bytes) 086000 1718399109.831448 mapread 0x04ad68 thru 0x055b9e (0xae37 bytes) 087000 1718399116.033023 mapwrite 0x04feb4 thru 0x05c901 (0xca4e bytes) 088000 1718399122.055047 mapread 0x2d3f6b thru 0x2e289b (0xe931 bytes) 089000 1718399127.601389 mapwrite 0x31d8d0 thru 0x324791 (0x6ec2 bytes) 090000 1718399132.748109 mapwrite 0x3e89be thru 0x3effa3 (0x75e6 bytes) 091000 1718399137.796928 punch from 0x06d79c to 0x06f7ef (0x2054 bytes) 092000 1718399142.217343 read 0x15db2d thru 0x16993a (0xbe0e bytes) 093000 1718399147.411786 mapwrite 0x104abd thru 0x10b909 (0x6e4d bytes) 096000 1718399160.719850 punch from 0x346724 to 0x3519e9 (0xb2c6 bytes) 098000 1718399171.555952 write 0x0a72a2 thru 0x0b5cdf (0xea3e bytes) 099000 1718399177.131026 trunc from 0x05c82d to 0x086455 (0x29c29 bytes) 100000 1718399184.739171 read 0x1f46bc thru 0x1f682b (0x2170 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (462s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:06:26 (1718399186) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1718399193.317484 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1718399199.719356 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1718399225.838534 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1718399230.920426 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1718399237.555027 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1718399245.288615 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1718399251.056395 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1718399259.935555 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1718399264.078579 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1718399272.984930 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1718399281.308515 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1718399295.266833 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1718399301.409858 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1718399316.353308 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1718399323.081656 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1718399328.220086 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1718399333.079427 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1718399336.724203 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1718399341.866273 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1718399348.189881 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1718399354.102608 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1718399365.638437 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1718399372.122206 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1718399379.218215 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1718399386.294395 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1718399394.086808 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1718399400.535201 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1718399406.692616 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1718399411.673984 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1718399418.380441 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1718399423.983168 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1718399431.104308 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1718399443.425260 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1718399448.970343 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1718399454.113501 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1718399459.935491 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1718399481.842111 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1718399488.640511 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1718399494.542172 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1718399499.898759 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1718399504.742159 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1718399510.561720 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1718399521.581430 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1718399526.904600 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1718399533.138972 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1718399545.928479 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1718399554.880882 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1718399558.341039 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1718399562.249352 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1718399568.522915 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1718399575.460776 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1718399579.106758 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1718399582.233318 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1718399588.231244 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1718399591.005363 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1718399594.340971 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1718399597.033822 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1718399599.918824 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1718399602.964957 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1718399608.340046 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1718399614.153255 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1718399617.053404 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1718399619.760409 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1718399622.868004 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1718399628.652539 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1718399635.122907 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1718399641.224960 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1718399644.078046 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1718399647.109158 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1718399650.007827 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1718399652.751064 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1718399658.219472 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1718399660.746170 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1718399663.703237 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1718399669.621305 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (484s) == sanity-benchmark test complete, duration 1488 sec ===== 17:14:30 (1718399670)