-----============= acceptance-small: sanity-benchmark ============----- Wed Jul 17 08:00:24 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg201-client.virtnet: executing check_config_client /mnt/lustre oleg201-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg201-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aac11800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aac11800.idle_timeout=debug disable quota as required oleg201-server: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 08:00:35 (1721217635) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6827] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg201-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg201-client.virtnet at Wed Jul 17 08:00:36 EDT 2024 waiting for dbench pid 8757 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 190 151.68 MB/sec warmup 1 sec latency 72.094 ms 20 454 159.19 MB/sec warmup 2 sec latency 40.340 ms 20 726 141.93 MB/sec warmup 3 sec latency 367.623 ms 20 951 108.94 MB/sec warmup 4 sec latency 95.749 ms 20 1250 92.33 MB/sec warmup 5 sec latency 60.141 ms 20 1596 87.15 MB/sec warmup 6 sec latency 183.280 ms 20 1859 75.29 MB/sec warmup 7 sec latency 118.978 ms 20 2165 66.79 MB/sec warmup 8 sec latency 93.678 ms 20 2438 62.57 MB/sec warmup 9 sec latency 149.525 ms 20 2854 64.92 MB/sec warmup 10 sec latency 155.515 ms 20 3275 63.60 MB/sec warmup 11 sec latency 117.650 ms 20 3693 64.86 MB/sec warmup 12 sec latency 82.618 ms 20 3937 61.62 MB/sec warmup 13 sec latency 25.526 ms 20 4165 57.34 MB/sec warmup 14 sec latency 270.857 ms 20 4310 53.92 MB/sec warmup 15 sec latency 235.710 ms 20 4487 51.08 MB/sec warmup 16 sec latency 126.701 ms 20 4777 49.80 MB/sec warmup 17 sec latency 126.879 ms 20 5110 50.23 MB/sec warmup 18 sec latency 102.538 ms 20 5363 47.82 MB/sec warmup 19 sec latency 91.298 ms 20 5683 45.83 MB/sec warmup 20 sec latency 63.921 ms 20 5978 44.96 MB/sec warmup 21 sec latency 123.227 ms 20 6357 46.30 MB/sec warmup 22 sec latency 113.526 ms 20 6822 46.95 MB/sec warmup 23 sec latency 175.773 ms 20 7484 23.33 MB/sec execute 1 sec latency 133.006 ms 20 7702 12.85 MB/sec execute 2 sec latency 217.973 ms 20 7871 10.75 MB/sec execute 3 sec latency 192.536 ms 20 8048 10.67 MB/sec execute 4 sec latency 139.390 ms 20 8351 15.03 MB/sec execute 5 sec latency 138.018 ms 20 8681 21.27 MB/sec execute 6 sec latency 87.274 ms 20 8942 18.87 MB/sec execute 7 sec latency 90.233 ms 20 9296 17.88 MB/sec execute 8 sec latency 87.298 ms 20 9585 19.54 MB/sec execute 9 sec latency 131.521 ms 20 10030 26.64 MB/sec execute 10 sec latency 231.637 ms 20 10505 30.37 MB/sec execute 11 sec latency 124.621 ms 20 10869 32.95 MB/sec execute 12 sec latency 65.957 ms 20 11093 31.26 MB/sec execute 13 sec latency 24.805 ms 20 11330 29.33 MB/sec execute 14 sec latency 210.937 ms 20 11465 27.81 MB/sec execute 15 sec latency 159.265 ms 20 11687 27.12 MB/sec execute 16 sec latency 107.214 ms 20 12091 29.88 MB/sec execute 17 sec latency 106.896 ms 20 12338 28.45 MB/sec execute 18 sec latency 73.382 ms 20 12605 27.19 MB/sec execute 19 sec latency 64.690 ms 20 12957 26.76 MB/sec execute 20 sec latency 69.056 ms 20 13263 27.95 MB/sec execute 21 sec latency 154.101 ms 20 13735 30.33 MB/sec execute 22 sec latency 154.764 ms 20 14176 32.08 MB/sec execute 23 sec latency 120.369 ms 20 14479 32.68 MB/sec execute 24 sec latency 25.198 ms 20 14694 31.57 MB/sec execute 25 sec latency 202.753 ms 20 14897 30.55 MB/sec execute 26 sec latency 261.514 ms 20 15048 29.68 MB/sec execute 27 sec latency 125.772 ms 20 15272 29.22 MB/sec execute 28 sec latency 127.290 ms 20 15610 30.07 MB/sec execute 29 sec latency 102.150 ms 20 15873 29.80 MB/sec execute 30 sec latency 88.008 ms 20 16120 28.98 MB/sec execute 31 sec latency 73.009 ms 20 16433 28.56 MB/sec execute 32 sec latency 69.367 ms 20 16704 28.65 MB/sec execute 33 sec latency 147.902 ms 20 17090 30.19 MB/sec execute 34 sec latency 148.280 ms 20 17538 31.07 MB/sec execute 35 sec latency 146.311 ms 20 17883 31.97 MB/sec execute 36 sec latency 132.573 ms 20 18116 31.59 MB/sec execute 37 sec latency 28.231 ms 20 18304 30.86 MB/sec execute 38 sec latency 219.642 ms 20 18496 30.22 MB/sec execute 39 sec latency 285.768 ms 20 18654 29.70 MB/sec execute 40 sec latency 132.491 ms 20 18933 29.79 MB/sec execute 41 sec latency 109.499 ms 20 19270 30.33 MB/sec execute 42 sec latency 89.017 ms 20 19524 29.72 MB/sec execute 43 sec latency 103.795 ms 20 19837 29.24 MB/sec execute 44 sec latency 76.701 ms 20 20135 29.03 MB/sec execute 45 sec latency 101.997 ms 20 20459 29.71 MB/sec execute 46 sec latency 128.287 ms 20 20911 30.70 MB/sec execute 47 sec latency 143.768 ms 20 21305 31.29 MB/sec execute 48 sec latency 102.356 ms 20 21606 31.58 MB/sec execute 49 sec latency 106.649 ms 20 21803 31.10 MB/sec execute 50 sec latency 201.886 ms 20 22003 30.56 MB/sec execute 51 sec latency 255.500 ms 20 22172 30.12 MB/sec execute 52 sec latency 125.304 ms 20 22387 29.91 MB/sec execute 53 sec latency 125.934 ms 20 22695 30.08 MB/sec execute 54 sec latency 107.346 ms 20 22977 30.17 MB/sec execute 55 sec latency 93.897 ms 20 23248 29.72 MB/sec execute 56 sec latency 73.484 ms 20 23572 29.51 MB/sec execute 57 sec latency 66.129 ms 20 23906 29.82 MB/sec execute 58 sec latency 129.977 ms 20 24359 30.72 MB/sec execute 59 sec latency 164.322 ms 20 24756 31.11 MB/sec execute 60 sec latency 180.391 ms 20 25107 31.54 MB/sec execute 61 sec latency 86.699 ms 20 25339 31.25 MB/sec execute 62 sec latency 236.684 ms 20 25549 30.82 MB/sec execute 63 sec latency 159.834 ms 20 25732 30.47 MB/sec execute 64 sec latency 186.823 ms 20 26006 30.49 MB/sec execute 65 sec latency 127.951 ms 20 26338 30.68 MB/sec execute 66 sec latency 126.804 ms 20 26634 30.50 MB/sec execute 67 sec latency 79.569 ms 20 26941 30.20 MB/sec execute 68 sec latency 65.915 ms 20 27318 30.32 MB/sec execute 69 sec latency 91.011 ms 20 27680 30.73 MB/sec execute 70 sec latency 154.289 ms 20 28134 31.29 MB/sec execute 71 sec latency 115.745 ms 20 28528 31.91 MB/sec execute 72 sec latency 113.134 ms 20 28780 31.72 MB/sec execute 73 sec latency 26.672 ms 20 28971 31.37 MB/sec execute 74 sec latency 227.706 ms 20 29175 31.03 MB/sec execute 75 sec latency 176.008 ms 20 29357 30.79 MB/sec execute 76 sec latency 149.139 ms 20 29624 30.82 MB/sec execute 77 sec latency 175.030 ms 20 29970 31.06 MB/sec execute 78 sec latency 77.714 ms 20 30239 30.73 MB/sec execute 79 sec latency 66.625 ms 20 30538 30.51 MB/sec execute 80 sec latency 75.318 ms 20 30912 30.61 MB/sec execute 81 sec latency 81.377 ms 20 31259 30.93 MB/sec execute 82 sec latency 136.411 ms 20 31688 31.46 MB/sec execute 83 sec latency 118.406 ms 20 32059 31.78 MB/sec execute 84 sec latency 155.122 ms 20 32328 31.75 MB/sec execute 85 sec latency 169.652 ms 20 32531 31.44 MB/sec execute 86 sec latency 133.749 ms 20 32722 31.16 MB/sec execute 87 sec latency 151.252 ms 20 32902 30.94 MB/sec execute 88 sec latency 127.284 ms 20 33151 30.90 MB/sec execute 89 sec latency 105.762 ms 20 33497 31.12 MB/sec execute 90 sec latency 93.293 ms 20 33771 30.88 MB/sec execute 91 sec latency 75.701 ms 20 34072 30.70 MB/sec execute 92 sec latency 93.282 ms 20 34431 30.73 MB/sec execute 93 sec latency 91.751 ms 20 34788 30.97 MB/sec execute 94 sec latency 132.850 ms 20 35195 31.46 MB/sec execute 95 sec latency 128.942 ms 20 35595 31.74 MB/sec execute 96 sec latency 121.071 ms 20 35853 31.74 MB/sec execute 97 sec latency 150.447 ms 20 36042 31.50 MB/sec execute 98 sec latency 151.403 ms 20 36262 31.24 MB/sec execute 99 sec latency 163.410 ms 20 36454 31.10 MB/sec execute 100 sec latency 110.986 ms 20 36691 30.96 MB/sec execute 101 sec latency 135.059 ms 20 37036 31.12 MB/sec execute 102 sec latency 83.418 ms 20 37321 31.03 MB/sec execute 103 sec latency 83.039 ms 20 37644 30.91 MB/sec execute 104 sec latency 77.461 ms 20 37968 30.86 MB/sec execute 105 sec latency 138.539 ms 20 38297 31.07 MB/sec execute 106 sec latency 119.267 ms 20 38717 31.45 MB/sec execute 107 sec latency 133.651 ms 20 39102 31.66 MB/sec execute 108 sec latency 150.339 ms 20 39387 31.73 MB/sec execute 109 sec latency 144.348 ms 20 39592 31.55 MB/sec execute 110 sec latency 180.200 ms 20 39802 31.34 MB/sec execute 111 sec latency 242.962 ms 20 39984 31.18 MB/sec execute 112 sec latency 197.325 ms 20 40206 31.02 MB/sec execute 113 sec latency 112.023 ms 20 40500 31.03 MB/sec execute 114 sec latency 88.774 ms 20 40817 31.14 MB/sec execute 115 sec latency 102.329 ms 20 41100 31.00 MB/sec execute 116 sec latency 84.549 ms 20 41449 30.91 MB/sec execute 117 sec latency 59.305 ms 20 41765 31.02 MB/sec execute 118 sec latency 193.910 ms 20 42171 31.38 MB/sec execute 119 sec latency 132.012 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 122683 9.804 53.073 Close 89883 2.116 16.687 Rename 5176 12.560 40.903 Unlink 24875 3.473 30.624 Qpathinfo 111106 2.183 45.813 Qfileinfo 19336 0.068 15.187 Qfsinfo 20172 0.025 3.813 Sfileinfo 10009 5.518 23.330 Find 42719 0.417 31.766 WriteX 60427 0.752 22.285 ReadX 191072 0.010 2.080 LockX 400 2.589 12.512 UnlockX 400 2.663 11.140 Flush 8592 56.444 285.761 Throughput 31.3754 MB/sec 20 clients 20 procs max_latency=285.768 ms stopping dbench on /mnt/lustre/d0.oleg201-client.virtnet at Wed Jul 17 08:03:01 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg201-client.virtnet /mnt/lustre/d0.oleg201-client.virtnet /mnt/lustre/d0.oleg201-client.virtnet removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg201-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 08:03:03 (1721217783) min OST has 3064832kB available, using 4597248kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6827] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4489] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg201-clien 4489M 154835 98 137709 98 327875 86 2446 123 Latency 3117us 39767us 37364us 203ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg201-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 492 15 3663 17 641 12 468 15 587 13 658 11 Latency 14666us 5041us 52490us 17173us 6237us 18301us 1.97,1.97,oleg201-client.virtnet,1,1721209984,4489M,,,,154835,98,137709,98,,,327875,86,2446,123,10,,,,,492,15,3663,17,641,12,468,15,587,13,658,11,,3117us,39767us,,37364us,203ms,14666us,5041us,52490us,17173us,6237us,18301us debug=0x33f0484 PASS bonnie (181s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 08:06:05 (1721217965) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 9663 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 9663 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x4f4d22 truncating to largest ever: 0x52bc44 001000 1721217969.227877 write 0x1b744d thru 0x1ba95d (0x3511 bytes) truncating to largest ever: 0x5561d2 truncating to largest ever: 0x561bd4 002000 1721217972.674184 trunc from 0x4f5355 to 0x4cfead (0x254a7 bytes) truncating to largest ever: 0x562acb 004000 1721217979.182602 mapread 0x159740 thru 0x15b992 (0x2253 bytes) 006000 1721217986.336019 write 0x4978d2 thru 0x4a0b40 (0x926f bytes) 009000 1721217997.297750 trunc from 0x41a8a3 to 0x41124f (0x9653 bytes) 017000 1721218024.848225 write 0x06f3ba thru 0x07be8b (0xcad2 bytes) 018000 1721218027.747195 mapwrite 0x116c85 thru 0x121b03 (0xae7f bytes) 019000 1721218031.318132 mapread 0x00c592 thru 0x01c0d4 (0xfb43 bytes) 022000 1721218041.601350 mapread 0x4534c1 thru 0x45377f (0x2bf bytes) truncating to largest ever: 0x562b09 026000 1721218055.680207 mapwrite 0x45dd1b thru 0x4618c2 (0x3ba8 bytes) 028000 1721218065.358737 write 0x0376af thru 0x046e73 (0xf7c5 bytes) 030000 1721218072.258647 mapread 0x3d7028 thru 0x3d851b (0x14f4 bytes) 033000 1721218082.400341 mapwrite 0x55a78f thru 0x5605a9 (0x5e1b bytes) 034000 1721218086.074286 mapwrite 0x477aae thru 0x480e2f (0x9382 bytes) 036000 1721218094.838416 mapwrite 0x3cf524 thru 0x3cfacb (0x5a8 bytes) 037000 1721218098.198773 read 0x3bd837 thru 0x3c875d (0xaf27 bytes) 041000 1721218112.123762 mapwrite 0x40c703 thru 0x40dc35 (0x1533 bytes) 044000 1721218122.426945 trunc from 0x4fc6e1 to 0x03d05c (0x4bf684 bytes) 045000 1721218126.405443 write 0x42af1c thru 0x439691 (0xe776 bytes) 046000 1721218130.963101 trunc from 0x48a85d to 0x145434 (0x345428 bytes) 048000 1721218138.572240 trunc from 0x415e68 to 0x23f512 (0x1d6955 bytes) 049000 1721218142.131179 trunc from 0x543683 to 0x045fcb (0x4fd6b7 bytes) 051000 1721218150.135295 write 0x32dc94 thru 0x338b0d (0xae7a bytes) 052000 1721218153.969993 mapwrite 0x39a446 thru 0x3aa365 (0xff20 bytes) 053000 1721218157.787112 write 0x3ca4c7 thru 0x3d463e (0xa178 bytes) 054000 1721218161.260599 mapwrite 0x1df617 thru 0x1e9633 (0xa01d bytes) 055000 1721218164.419597 mapread 0x3de9ac thru 0x3e083e (0x1e93 bytes) 059000 1721218179.829910 mapread 0x2f8bab thru 0x30473f (0xbb95 bytes) 060000 1721218183.317485 mapread 0x04c818 thru 0x04dddc (0x15c5 bytes) skipping zero size read 063000 1721218193.967439 write 0x519f8e thru 0x5241b2 (0xa225 bytes) 065000 1721218200.884134 mapread 0x495992 thru 0x4a4af4 (0xf163 bytes) 067000 1721218208.649844 trunc from 0x4b0a6d to 0x2b0e84 (0x1ffbe8 bytes) 069000 1721218218.670582 mapread 0x395dd1 thru 0x399766 (0x3996 bytes) skipping zero size write 078000 1721218255.564139 trunc from 0x552514 to 0x4e00dd (0x72436 bytes) 083000 1721218274.992403 read 0x158261 thru 0x15c138 (0x3ed8 bytes) 085000 1721218285.906575 mapread 0x098802 thru 0x0a611f (0xd91e bytes) 093000 1721218326.479613 write 0x40b2ce thru 0x414184 (0x8eb7 bytes) 095000 1721218336.008045 trunc from 0x4bd8cb to 0x1823c1 (0x33b509 bytes) 097000 1721218346.388550 read 0x0cdd53 thru 0x0d4254 (0x6502 bytes) 098000 1721218350.656209 trunc from 0x15de56 to 0x21704a (0xb91f5 bytes) 099000 1721218354.796658 read 0x0cabbb thru 0x0cf824 (0x4c6a bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (395s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 08:12:40 (1721218360) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1721218375.536372 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1721218380.737375 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1721218389.664508 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1721218394.419653 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1721218400.794940 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1721218436.654560 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1721218442.715037 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1721218449.104173 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1721218462.244481 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1721218469.208872 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1721218476.407202 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1721218487.914078 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1721218495.117924 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1721218509.002481 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1721218515.453058 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1721218521.670194 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1721218534.603939 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1721218540.921766 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1721218560.336759 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1721218587.808483 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1721218594.747440 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1721218602.357338 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1721218609.766993 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1721218616.235129 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1721218652.708955 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1721218658.573395 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1721218671.019978 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1721218698.384552 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1721218722.497440 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1721218735.918398 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1721218742.610223 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1721218755.836863 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1721218768.501553 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1721218779.088478 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1721218783.552682 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1721218787.512135 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1721218808.116254 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1721218814.448269 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1721218820.199307 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1721218834.063087 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1721218848.058466 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1721218854.092061 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1721218873.424154 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1721218886.150119 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1721218891.811665 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1721218898.592353 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1721218904.812968 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1721218912.156972 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1721218918.687207 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1721218925.368245 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1721218957.889844 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1721218964.465050 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1721218978.272051 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (626s) == sanity-benchmark test complete, duration 1361 sec ===== 08:23:06 (1721218986)