-----============= acceptance-small: sanity-benchmark ============----- Fri Jun 14 16:51:57 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg146-client.virtnet: executing check_config_client /mnt/lustre oleg146-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg146-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff880136857800.idle_timeout=debug osc.lustre-OST0001-osc-ffff880136857800.idle_timeout=debug disable quota as required oleg146-server: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 16:52:09 (1718398329) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7446] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg146-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg146-client.virtnet at Fri Jun 14 16:52:10 EDT 2024 waiting for dbench pid 9587 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 12 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 142 122.82 MB/sec warmup 1 sec latency 67.628 ms 20 281 104.85 MB/sec warmup 2 sec latency 65.321 ms 20 446 104.46 MB/sec warmup 3 sec latency 48.932 ms 20 657 105.49 MB/sec warmup 4 sec latency 346.341 ms 20 735 85.24 MB/sec warmup 5 sec latency 841.658 ms 20 909 72.35 MB/sec warmup 6 sec latency 38.299 ms 20 1054 65.38 MB/sec warmup 7 sec latency 49.103 ms 20 1225 57.99 MB/sec warmup 8 sec latency 46.713 ms 20 1489 57.85 MB/sec warmup 9 sec latency 44.952 ms 20 1694 52.43 MB/sec warmup 10 sec latency 39.079 ms 20 1901 48.00 MB/sec warmup 11 sec latency 39.914 ms 20 2095 44.39 MB/sec warmup 12 sec latency 39.777 ms 20 2348 42.72 MB/sec warmup 13 sec latency 29.338 ms 20 2540 41.19 MB/sec warmup 14 sec latency 37.586 ms 20 2953 44.47 MB/sec warmup 15 sec latency 38.092 ms 20 3297 43.88 MB/sec warmup 16 sec latency 64.407 ms 20 3677 45.54 MB/sec warmup 17 sec latency 32.541 ms 20 3897 44.38 MB/sec warmup 18 sec latency 35.936 ms 20 4090 42.18 MB/sec warmup 19 sec latency 36.712 ms 20 4297 40.38 MB/sec warmup 20 sec latency 197.829 ms 20 4483 38.97 MB/sec warmup 21 sec latency 458.904 ms 20 4684 37.93 MB/sec warmup 22 sec latency 1199.579 ms 20 4878 37.82 MB/sec warmup 23 sec latency 881.264 ms 20 5268 15.11 MB/sec execute 1 sec latency 887.333 ms 20 5507 16.12 MB/sec execute 2 sec latency 1716.250 ms 20 5674 15.55 MB/sec execute 3 sec latency 2716.374 ms 20 5921 23.39 MB/sec execute 4 sec latency 3716.456 ms 20 6222 28.55 MB/sec execute 5 sec latency 4716.697 ms 20 6373 26.20 MB/sec execute 6 sec latency 5717.128 ms 20 6451 22.81 MB/sec execute 7 sec latency 6717.281 ms 20 6554 20.53 MB/sec execute 8 sec latency 7717.476 ms 20 6683 18.69 MB/sec execute 9 sec latency 8717.755 ms 20 6781 17.50 MB/sec execute 10 sec latency 9717.869 ms 20 6971 18.02 MB/sec execute 11 sec latency 10718.124 ms 20 7230 19.73 MB/sec execute 12 sec latency 11718.245 ms 20 7467 19.24 MB/sec execute 13 sec latency 12718.365 ms 20 7710 18.93 MB/sec execute 14 sec latency 13718.636 ms 20 7944 19.55 MB/sec execute 15 sec latency 14718.759 ms 20 8307 22.17 MB/sec execute 16 sec latency 15718.894 ms 20 8670 24.41 MB/sec execute 17 sec latency 16719.072 ms 20 8854 24.19 MB/sec execute 18 sec latency 17719.474 ms 20 9040 23.23 MB/sec execute 19 sec latency 18719.583 ms 20 9201 22.49 MB/sec execute 20 sec latency 19719.676 ms 20 9384 22.24 MB/sec execute 21 sec latency 20719.920 ms 20 9592 22.75 MB/sec execute 22 sec latency 21720.284 ms 20 9748 21.89 MB/sec execute 23 sec latency 22720.398 ms 20 9962 21.50 MB/sec execute 24 sec latency 23720.485 ms 20 10158 21.30 MB/sec execute 25 sec latency 24720.655 ms 20 10466 22.70 MB/sec execute 26 sec latency 25720.749 ms 20 10724 22.85 MB/sec execute 27 sec latency 26720.883 ms 20 10917 23.21 MB/sec execute 28 sec latency 27720.971 ms 20 11032 22.73 MB/sec execute 29 sec latency 28721.132 ms 20 11139 22.30 MB/sec execute 30 sec latency 29721.228 ms 20 11242 21.80 MB/sec execute 31 sec latency 30721.398 ms 20 11352 21.47 MB/sec execute 32 sec latency 31721.706 ms 20 11461 21.18 MB/sec execute 33 sec latency 32722.000 ms 20 11614 21.08 MB/sec execute 34 sec latency 33722.095 ms 20 11772 21.02 MB/sec execute 35 sec latency 34722.183 ms 20 11928 21.06 MB/sec execute 36 sec latency 35722.302 ms 20 12062 20.88 MB/sec execute 37 sec latency 36722.438 ms 20 12193 20.59 MB/sec execute 38 sec latency 37722.572 ms 20 12298 20.22 MB/sec execute 39 sec latency 38722.750 ms 20 12424 19.90 MB/sec execute 40 sec latency 39722.894 ms 20 12580 19.84 MB/sec execute 41 sec latency 40722.986 ms 20 12762 19.89 MB/sec execute 42 sec latency 41723.128 ms 20 12933 19.98 MB/sec execute 43 sec latency 42723.282 ms 20 13071 19.89 MB/sec execute 44 sec latency 43723.492 ms 20 13257 19.93 MB/sec execute 45 sec latency 44723.630 ms 20 13429 19.83 MB/sec execute 46 sec latency 45723.736 ms 20 13601 19.64 MB/sec execute 47 sec latency 46723.872 ms 20 13797 19.71 MB/sec execute 48 sec latency 47723.979 ms 20 14014 19.79 MB/sec execute 49 sec latency 48724.144 ms 20 14245 20.00 MB/sec execute 50 sec latency 49724.254 ms 20 14431 19.99 MB/sec execute 51 sec latency 50724.374 ms 20 14611 19.94 MB/sec execute 52 sec latency 51724.456 ms 20 14817 19.99 MB/sec execute 53 sec latency 52724.591 ms 20 15020 20.08 MB/sec execute 54 sec latency 53724.695 ms 20 15181 20.09 MB/sec execute 55 sec latency 54724.954 ms 20 15320 19.93 MB/sec execute 56 sec latency 55725.106 ms 20 15467 19.70 MB/sec execute 57 sec latency 56725.207 ms 20 15618 19.60 MB/sec execute 58 sec latency 57725.297 ms 20 15807 19.72 MB/sec execute 59 sec latency 58725.398 ms 20 16002 19.87 MB/sec execute 60 sec latency 59725.509 ms 20 16214 19.93 MB/sec execute 61 sec latency 60725.606 ms 20 16374 19.88 MB/sec execute 62 sec latency 61725.729 ms 20 16540 19.76 MB/sec execute 63 sec latency 62725.976 ms 20 16698 19.68 MB/sec execute 64 sec latency 63726.067 ms 20 16862 19.70 MB/sec execute 65 sec latency 64726.179 ms 20 17037 19.70 MB/sec execute 66 sec latency 65726.284 ms 20 17177 19.55 MB/sec execute 67 sec latency 66726.431 ms 20 17314 19.42 MB/sec execute 68 sec latency 67726.736 ms 20 17479 19.40 MB/sec execute 69 sec latency 68726.880 ms 20 17636 19.36 MB/sec execute 70 sec latency 69726.995 ms 20 17799 19.42 MB/sec execute 71 sec latency 70727.114 ms 20 17922 19.41 MB/sec execute 72 sec latency 71727.217 ms 20 18055 19.42 MB/sec execute 73 sec latency 72727.366 ms 20 18215 19.41 MB/sec execute 74 sec latency 73727.529 ms 20 18348 19.29 MB/sec execute 75 sec latency 74727.626 ms 20 18501 19.19 MB/sec execute 76 sec latency 75728.059 ms 20 18657 19.16 MB/sec execute 77 sec latency 76728.231 ms 20 18804 19.08 MB/sec execute 78 sec latency 77728.373 ms 20 18950 19.07 MB/sec execute 79 sec latency 78728.476 ms 20 19120 19.10 MB/sec execute 80 sec latency 79728.579 ms 20 19255 18.99 MB/sec execute 81 sec latency 80728.676 ms 20 19395 18.90 MB/sec execute 82 sec latency 81728.761 ms 20 19542 18.80 MB/sec execute 83 sec latency 82728.867 ms 20 19695 18.78 MB/sec execute 84 sec latency 83728.981 ms 20 19862 18.88 MB/sec execute 85 sec latency 84729.213 ms 20 20009 18.91 MB/sec execute 86 sec latency 85729.363 ms 20 20139 18.77 MB/sec execute 87 sec latency 86729.582 ms 20 20266 18.66 MB/sec execute 88 sec latency 87729.674 ms 20 20400 18.58 MB/sec execute 89 sec latency 88729.821 ms 20 20585 18.62 MB/sec execute 90 sec latency 89730.355 ms 20 20748 18.64 MB/sec execute 91 sec latency 90730.582 ms 20 20918 18.69 MB/sec execute 92 sec latency 91730.677 ms 20 21085 18.67 MB/sec execute 93 sec latency 92730.763 ms 20 21264 18.74 MB/sec execute 94 sec latency 93730.911 ms 20 21403 18.69 MB/sec execute 95 sec latency 94731.009 ms 20 21523 18.61 MB/sec execute 96 sec latency 95731.194 ms 20 21640 18.55 MB/sec execute 97 sec latency 96731.755 ms 20 21757 18.43 MB/sec execute 98 sec latency 97731.985 ms 20 21871 18.35 MB/sec execute 99 sec latency 98732.280 ms 20 22002 18.30 MB/sec execute 100 sec latency 99732.483 ms 20 22137 18.25 MB/sec execute 101 sec latency 100732.634 ms 20 22296 18.27 MB/sec execute 102 sec latency 101732.754 ms 20 22415 18.25 MB/sec execute 103 sec latency 102732.910 ms 20 22551 18.27 MB/sec execute 104 sec latency 103733.133 ms 20 22699 18.24 MB/sec execute 105 sec latency 104733.249 ms 20 22805 18.15 MB/sec execute 106 sec latency 105733.564 ms 20 22902 18.08 MB/sec execute 107 sec latency 106733.706 ms 20 23022 18.01 MB/sec execute 108 sec latency 107733.823 ms 20 23179 17.98 MB/sec execute 109 sec latency 108733.967 ms 20 23324 17.93 MB/sec execute 110 sec latency 109734.081 ms 20 23451 17.89 MB/sec execute 111 sec latency 110734.184 ms 20 23569 17.83 MB/sec execute 112 sec latency 111734.364 ms 20 23716 17.85 MB/sec execute 113 sec latency 112734.472 ms 20 23866 17.81 MB/sec execute 114 sec latency 113734.559 ms 20 24046 17.88 MB/sec execute 115 sec latency 114734.651 ms 20 24183 17.84 MB/sec execute 116 sec latency 115734.747 ms 20 24337 17.80 MB/sec execute 117 sec latency 116734.871 ms 20 24515 17.80 MB/sec execute 118 sec latency 117735.040 ms 20 24746 17.89 MB/sec execute 119 sec latency 118735.138 ms 20 cleanup 120 sec 6 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 68741 14.968 118884.404 Close 50638 14.380 92905.942 Rename 2906 17.419 1627.259 Unlink 13667 13.449 56459.142 Qpathinfo 62464 1.636 142.461 Qfileinfo 10997 0.066 8.309 Qfsinfo 11400 0.033 3.261 Sfileinfo 5504 39.671 120540.131 Find 24196 0.332 39.766 WriteX 34000 1.059 31.257 ReadX 109201 0.015 7.005 LockX 232 5.628 225.870 UnlockX 232 6.137 94.875 Flush 4730 8.450 152.510 Throughput 17.889 MB/sec 20 clients 20 procs max_latency=118735.138 ms stopping dbench on /mnt/lustre/d0.oleg146-client.virtnet at Fri Jun 14 16:54:36 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg146-client.virtnet /mnt/lustre/d0.oleg146-client.virtnet /mnt/lustre/d0.oleg146-client.virtnet removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg146-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 16:54:39 (1718398479) min OST has 3478944kB available, using 5218416kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7446] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5096] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg146-clien 5096M 131263 98 111237 95 250677 66 4764 242 Latency 6853us 116ms 110ms 29199us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg146-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 338 17 3138 17 464 13 267 18 380 15 572 14 Latency 19411us 5598us 23648us 31303us 11446us 35305us 1.97,1.97,oleg146-client.virtnet,1,1718387796,5096M,,,,131263,98,111237,95,,,250677,66,4764,242,10,,,,,338,17,3138,17,464,13,267,18,380,15,572,14,,6853us,116ms,,110ms,29199us,19411us,5598us,23648us,31303us,11446us,35305us debug=0x33f0484 PASS bonnie (254s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 16:58:54 (1718398734) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 13468 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 13468 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read fallocating to largest ever: 0x379959 skipping zero length punch hole truncating to largest ever: 0x453a1c truncating to largest ever: 0x49eeff fallocating to largest ever: 0x50bf45 fallocating to largest ever: 0x51719f fallocating to largest ever: 0x5242f0 fallocating to largest ever: 0x528540 003000 1718398744.075487 fallocate 0x345589 thru 0x351d4e (0xc7c6 bytes) 004000 1718398747.228699 write 0x10942b thru 0x10d5df (0x41b5 bytes) 005000 1718398750.494466 fallocate 0x27350f thru 0x277149 (0x3c3b bytes) 006000 1718398754.529518 mapread 0x11dcb4 thru 0x12c71c (0xea69 bytes) 007000 1718398758.482257 mapwrite 0x0fb49e thru 0x0fca48 (0x15ab bytes) 008000 1718398761.592420 fallocate 0x216231 thru 0x221da3 (0xbb73 bytes) 012000 1718398774.038194 mapread 0x1d31a8 thru 0x1ded4d (0xbba6 bytes) 013000 1718398777.045721 mapwrite 0x2acee7 thru 0x2b55a4 (0x86be bytes) 015000 1718398782.936953 fallocate 0x2af580 thru 0x2b92a2 (0x9d23 bytes) 016000 1718398785.919559 fallocate 0x2e5a97 thru 0x2e9514 (0x3a7e bytes) 017000 1718398789.224164 fallocate 0x240b86 thru 0x24fcc2 (0xf13d bytes) 018000 1718398792.419657 read 0x00c800 thru 0x015594 (0x8d95 bytes) 022000 1718398806.407088 punch from 0x189b42 to 0x197606 (0xdac5 bytes) 024000 1718398812.664817 fallocate 0x4072c0 thru 0x409f09 (0x2c4a bytes) 025000 1718398816.411193 mapwrite 0x3acccd thru 0x3b1e32 (0x5166 bytes) 027000 1718398823.884543 fallocate 0x1cbe8a thru 0x1ccc9b (0xe12 bytes) 028000 1718398828.332020 fallocate 0x3969f4 thru 0x39f736 (0x8d43 bytes) 030000 1718398835.498250 fallocate 0x51b305 thru 0x5255bb (0xa2b7 bytes) 031000 1718398839.125172 mapread 0x2b996f thru 0x2be9fa (0x508c bytes) 032000 1718398842.412192 fallocate 0x29b2a8 thru 0x2a53d3 (0xa12c bytes) 034000 1718398848.668412 mapread 0x0ff9c5 thru 0x10b2d3 (0xb90f bytes) 035000 1718398852.694001 trunc from 0x1d049e to 0x0cef0c (0x101591 bytes) 036000 1718398856.696596 mapread 0x14da08 thru 0x159710 (0xbd09 bytes) 037000 1718398860.416073 trunc from 0x269383 to 0x3cbc8b (0x162909 bytes) 038000 1718398864.091824 mapread 0x003bd9 thru 0x012d60 (0xf188 bytes) 039000 1718398867.471526 mapwrite 0x0d22ef thru 0x0d5d4d (0x3a5f bytes) 040000 1718398870.991053 write 0x4e2374 thru 0x4ee412 (0xc09f bytes) 041000 1718398873.793550 mapread 0x32aced thru 0x336a78 (0xbd8c bytes) 042000 1718398876.473975 punch from 0x25d560 to 0x2683d4 (0xae75 bytes) 043000 1718398879.447327 trunc from 0x4fcaa2 to 0x385c0a (0x176e97 bytes) 044000 1718398882.698308 fallocate 0x3341b1 thru 0x335180 (0xfd0 bytes) 045000 1718398886.093497 punch from 0x0a64d9 to 0x0a878e (0x22b6 bytes) 046000 1718398889.683478 read 0x2467db thru 0x24fd22 (0x9548 bytes) 047000 1718398892.994708 read 0x0ec66b thru 0x0f5e1b (0x97b1 bytes) 048000 1718398896.317752 trunc from 0x1c3555 to 0x01d093 (0x1a64c1 bytes) 049000 1718398899.428958 fallocate 0x2b7070 thru 0x2c4236 (0xd1c7 bytes) 050000 1718398902.459032 mapread 0x070d23 thru 0x080c61 (0xff3f bytes) 052000 1718398907.657328 read 0x107e27 thru 0x10f4b2 (0x768c bytes) 053000 1718398910.958142 write 0x16de1e thru 0x172e78 (0x505b bytes) 054000 1718398914.036532 trunc from 0x504dd1 to 0x1cd47a (0x337956 bytes) 055000 1718398917.093329 fallocate 0x3a6a92 thru 0x3ab815 (0x4d84 bytes) 057000 1718398923.300360 mapread 0x0072db thru 0x008436 (0x115c bytes) 059000 1718398929.066172 punch from 0x056fe5 to 0x066843 (0xf85f bytes) 060000 1718398932.222932 fallocate 0x2f71cd thru 0x2f8935 (0x1769 bytes) 061000 1718398935.678911 fallocate 0x4ce12c thru 0x4d0e3a (0x2d0f bytes) 063000 1718398941.552663 mapwrite 0x4cefb2 thru 0x4dd516 (0xe565 bytes) 066000 1718398949.806118 fallocate 0x2a27a2 thru 0x2aa9af (0x820e bytes) 069000 1718398959.019440 mapwrite 0x1ddefe thru 0x1e70ca (0x91cd bytes) 070000 1718398961.727003 read 0x34faaf thru 0x350eab (0x13fd bytes) 071000 1718398964.378495 mapread 0x0be82e thru 0x0c6aa5 (0x8278 bytes) 072000 1718398967.072827 fallocate 0x311c36 thru 0x317eba (0x6285 bytes) 073000 1718398969.737324 write 0x2a5ecf thru 0x2a61f0 (0x322 bytes) 074000 1718398972.708956 mapwrite 0x0d0603 thru 0x0d9c3a (0x9638 bytes) 075000 1718398975.773308 write 0x4713ed thru 0x47cfad (0xbbc1 bytes) 076000 1718398979.060917 read 0x1c945c thru 0x1cb72c (0x22d1 bytes) 077000 1718398981.769936 trunc from 0x4f1511 to 0x52645d (0x34f4d bytes) 078000 1718398986.020425 fallocate 0x3d1f63 thru 0x3dbfaa (0xa048 bytes) 081000 1718399015.678259 mapread 0x1f1b47 thru 0x1f609e (0x4558 bytes) 082000 1718399023.525981 trunc from 0x44aad7 to 0x358868 (0xf226e bytes) 083000 1718399030.719449 fallocate 0x4a07bb thru 0x4a2fb6 (0x27fc bytes) 084000 1718399037.737102 read 0x4a88f9 thru 0x4b0e21 (0x8529 bytes) 085000 1718399043.902377 mapread 0x22de98 thru 0x239a19 (0xbb82 bytes) 086000 1718399050.265185 fallocate 0x249ff9 thru 0x254260 (0xa268 bytes) 088000 1718399064.231782 write 0x33f82c thru 0x33fbd8 (0x3ad bytes) 089000 1718399072.462719 write 0x4fbc61 thru 0x5044c9 (0x8869 bytes) 090000 1718399079.842105 trunc from 0x4a34f3 to 0x04b79f (0x457d53 bytes) 091000 1718399087.440047 mapread 0x4f09da thru 0x4fcd47 (0xc36e bytes) 092000 1718399095.347585 punch from 0x01a591 to 0x01fefd (0x596d bytes) skipping zero length punch hole 093000 1718399103.845853 read 0x30b5d1 thru 0x30c46a (0xe9a bytes) 094000 1718399108.831453 punch from 0x09e484 to 0x0a8a45 (0xa5c2 bytes) 095000 1718399116.181930 write 0x0cc41b thru 0x0d23a9 (0x5f8f bytes) 097000 1718399130.647209 write 0x24a8de thru 0x25a83e (0xff61 bytes) 098000 1718399136.759367 trunc from 0x20c31b to 0x36ab27 (0x15e80d bytes) 100000 1718399152.981290 fallocate 0x175ada thru 0x1768d8 (0xdff bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (421s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:05:55 (1718399155) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1718399165.149425 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1718399172.285604 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1718399207.163432 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1718399215.638857 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1718399226.565309 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1718399236.189119 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1718399245.417238 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1718399262.577409 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1718399270.152351 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1718399285.954710 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1718399295.365934 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1718399310.376846 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1718399317.269451 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1718399334.195539 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1718399341.572047 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1718399348.611429 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1718399356.013022 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1718399362.049504 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1718399369.864618 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1718399377.617298 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1718399386.783089 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1718399404.568103 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1718399413.564156 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1718399421.046011 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1718399429.630458 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1718399438.468631 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1718399444.942841 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1718399452.634531 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1718399461.399226 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1718399471.955126 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1718399480.737165 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1718399489.090031 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1718399504.682099 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1718399513.745600 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1718399523.559079 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1718399532.177530 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1718399557.599549 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1718399565.081383 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1718399571.936357 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1718399579.276364 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1718399585.653615 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1718399591.529970 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1718399603.364459 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1718399608.559564 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1718399613.685297 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1718399627.482393 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1718399635.165913 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1718399638.378180 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1718399641.678739 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1718399647.038133 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1718399653.159523 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1718399656.256281 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1718399659.392528 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1718399665.227004 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1718399667.732161 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1718399670.513152 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1718399673.147088 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1718399675.809368 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1718399678.370948 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1718399683.868695 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1718399689.177831 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1718399691.455775 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1718399693.672967 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1718399696.453234 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1718399701.618601 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1718399707.230299 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1718399712.550797 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1718399714.944805 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1718399717.587492 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1718399719.989507 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1718399722.520330 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1718399727.859752 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1718399730.216303 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1718399732.779146 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1718399738.382077 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (584s) == sanity-benchmark test complete, duration 1422 sec ===== 17:15:39 (1718399739)