-----============= acceptance-small: sanity-benchmark ============----- Wed Jul 31 23:12:01 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg124-client.virtnet: executing check_config_client /mnt/lustre oleg124-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg124-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6161000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6161000.idle_timeout=debug disable quota as required oleg124-server: oleg124-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 23:12:11 (1722481931) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6824] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg124-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg124-client.virtnet at Wed Jul 31 23:12:11 EDT 2024 waiting for dbench pid 8753 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 224 173.27 MB/sec warmup 1 sec latency 66.956 ms 20 472 165.25 MB/sec warmup 2 sec latency 40.661 ms 20 712 141.56 MB/sec warmup 3 sec latency 207.564 ms 20 904 108.49 MB/sec warmup 4 sec latency 111.322 ms 20 1191 92.12 MB/sec warmup 5 sec latency 94.945 ms 20 1530 86.94 MB/sec warmup 6 sec latency 172.797 ms 20 1826 75.25 MB/sec warmup 7 sec latency 82.580 ms 20 2147 66.74 MB/sec warmup 8 sec latency 61.827 ms 20 2424 62.66 MB/sec warmup 9 sec latency 136.837 ms 20 2760 62.66 MB/sec warmup 10 sec latency 170.844 ms 20 3213 62.68 MB/sec warmup 11 sec latency 154.291 ms 20 3619 64.35 MB/sec warmup 12 sec latency 183.516 ms 20 3874 61.33 MB/sec warmup 13 sec latency 25.874 ms 20 4065 57.26 MB/sec warmup 14 sec latency 121.314 ms 20 4253 53.73 MB/sec warmup 15 sec latency 276.851 ms 20 4397 50.82 MB/sec warmup 16 sec latency 146.016 ms 20 4622 48.93 MB/sec warmup 17 sec latency 101.364 ms 20 4981 49.43 MB/sec warmup 18 sec latency 148.775 ms 20 5235 47.71 MB/sec warmup 19 sec latency 78.828 ms 20 5496 45.56 MB/sec warmup 20 sec latency 68.278 ms 20 5831 44.24 MB/sec warmup 21 sec latency 118.371 ms 20 6092 43.71 MB/sec warmup 22 sec latency 132.668 ms 20 6558 45.83 MB/sec warmup 23 sec latency 143.667 ms 20 7338 56.19 MB/sec execute 1 sec latency 135.251 ms 20 7554 32.95 MB/sec execute 2 sec latency 24.263 ms 20 7770 23.15 MB/sec execute 3 sec latency 179.791 ms 20 7909 19.03 MB/sec execute 4 sec latency 145.476 ms 20 8107 17.92 MB/sec execute 5 sec latency 140.128 ms 20 8449 23.02 MB/sec execute 6 sec latency 144.314 ms 20 8735 24.34 MB/sec execute 7 sec latency 105.646 ms 20 9001 21.87 MB/sec execute 8 sec latency 72.076 ms 20 9336 21.08 MB/sec execute 9 sec latency 81.628 ms 20 9614 22.12 MB/sec execute 10 sec latency 120.588 ms 20 10023 27.91 MB/sec execute 11 sec latency 257.854 ms 20 10494 31.15 MB/sec execute 12 sec latency 133.121 ms 20 10852 33.31 MB/sec execute 13 sec latency 86.933 ms 20 11080 32.02 MB/sec execute 14 sec latency 24.443 ms 20 11292 30.07 MB/sec execute 15 sec latency 267.663 ms 20 11467 28.69 MB/sec execute 16 sec latency 180.071 ms 20 11694 28.08 MB/sec execute 17 sec latency 109.577 ms 20 12052 29.60 MB/sec execute 18 sec latency 117.468 ms 20 12328 29.14 MB/sec execute 19 sec latency 73.066 ms 20 12596 27.92 MB/sec execute 20 sec latency 70.639 ms 20 12931 27.47 MB/sec execute 21 sec latency 76.308 ms 20 13195 27.81 MB/sec execute 22 sec latency 151.238 ms 20 13635 30.29 MB/sec execute 23 sec latency 162.909 ms 20 14059 31.59 MB/sec execute 24 sec latency 153.871 ms 20 14394 32.57 MB/sec execute 25 sec latency 98.471 ms 20 14618 31.95 MB/sec execute 26 sec latency 26.370 ms 20 14810 30.85 MB/sec execute 27 sec latency 307.428 ms 20 14965 29.97 MB/sec execute 28 sec latency 156.806 ms 20 15147 29.29 MB/sec execute 29 sec latency 122.749 ms 20 15405 29.28 MB/sec execute 30 sec latency 129.062 ms 20 15738 30.12 MB/sec execute 31 sec latency 78.903 ms 20 16007 29.32 MB/sec execute 32 sec latency 67.801 ms 20 16343 28.71 MB/sec execute 33 sec latency 76.992 ms 20 16654 28.91 MB/sec execute 34 sec latency 114.701 ms 20 17042 30.13 MB/sec execute 35 sec latency 147.689 ms 20 17478 31.04 MB/sec execute 36 sec latency 131.314 ms 20 17879 32.20 MB/sec execute 37 sec latency 106.176 ms 20 18128 31.87 MB/sec execute 38 sec latency 24.488 ms 20 18320 31.14 MB/sec execute 39 sec latency 236.105 ms 20 18500 30.52 MB/sec execute 40 sec latency 173.099 ms 20 18675 30.03 MB/sec execute 41 sec latency 127.529 ms 20 18970 30.15 MB/sec execute 42 sec latency 131.954 ms 20 19304 30.61 MB/sec execute 43 sec latency 106.672 ms 20 19561 30.02 MB/sec execute 44 sec latency 100.674 ms 20 19871 29.56 MB/sec execute 45 sec latency 71.443 ms 20 20209 29.59 MB/sec execute 46 sec latency 114.506 ms 20 20544 30.08 MB/sec execute 47 sec latency 153.482 ms 20 20994 31.12 MB/sec execute 48 sec latency 141.117 ms 20 21438 32.11 MB/sec execute 49 sec latency 119.661 ms 20 21700 31.87 MB/sec execute 50 sec latency 24.184 ms 20 21885 31.34 MB/sec execute 51 sec latency 205.317 ms 20 22089 30.86 MB/sec execute 52 sec latency 151.803 ms 20 22308 30.52 MB/sec execute 53 sec latency 91.126 ms 20 22622 30.68 MB/sec execute 54 sec latency 94.281 ms 20 22944 30.92 MB/sec execute 55 sec latency 75.210 ms 20 23223 30.47 MB/sec execute 56 sec latency 66.246 ms 20 23522 30.17 MB/sec execute 57 sec latency 77.826 ms 20 23868 30.40 MB/sec execute 58 sec latency 146.231 ms 20 24291 31.19 MB/sec execute 59 sec latency 119.774 ms 20 24761 31.91 MB/sec execute 60 sec latency 126.345 ms 20 25102 32.22 MB/sec execute 61 sec latency 120.532 ms 20 25310 31.91 MB/sec execute 62 sec latency 186.801 ms 20 25534 31.48 MB/sec execute 63 sec latency 157.115 ms 20 25723 31.15 MB/sec execute 64 sec latency 151.880 ms 20 25959 31.04 MB/sec execute 65 sec latency 129.170 ms 20 26316 31.20 MB/sec execute 66 sec latency 81.134 ms 20 26632 31.13 MB/sec execute 67 sec latency 105.416 ms 20 26943 30.84 MB/sec execute 68 sec latency 72.522 ms 20 27320 30.90 MB/sec execute 69 sec latency 85.506 ms 20 27665 31.27 MB/sec execute 70 sec latency 132.329 ms 20 28100 31.84 MB/sec execute 71 sec latency 171.378 ms 20 28551 32.48 MB/sec execute 72 sec latency 118.584 ms 20 28808 32.32 MB/sec execute 73 sec latency 128.535 ms 20 29014 31.95 MB/sec execute 74 sec latency 138.872 ms 20 29216 31.62 MB/sec execute 75 sec latency 142.576 ms 20 29433 31.47 MB/sec execute 76 sec latency 131.480 ms 20 29728 31.45 MB/sec execute 77 sec latency 80.800 ms 20 30059 31.62 MB/sec execute 78 sec latency 66.615 ms 20 30351 31.33 MB/sec execute 79 sec latency 68.737 ms 20 30726 31.26 MB/sec execute 80 sec latency 51.216 ms 20 31090 31.45 MB/sec execute 81 sec latency 107.011 ms 20 31546 32.10 MB/sec execute 82 sec latency 117.131 ms 20 31976 32.44 MB/sec execute 83 sec latency 155.744 ms 20 32291 32.59 MB/sec execute 84 sec latency 109.119 ms 20 32495 32.30 MB/sec execute 85 sec latency 143.859 ms 20 32742 32.03 MB/sec execute 86 sec latency 138.709 ms 20 32953 31.86 MB/sec execute 87 sec latency 116.517 ms 20 33252 31.84 MB/sec execute 88 sec latency 106.076 ms 20 33619 32.02 MB/sec execute 89 sec latency 73.658 ms 20 33891 31.79 MB/sec execute 90 sec latency 82.953 ms 20 34261 31.72 MB/sec execute 91 sec latency 61.204 ms 20 34625 31.86 MB/sec execute 92 sec latency 110.505 ms 20 34994 32.17 MB/sec execute 93 sec latency 108.618 ms 20 35460 32.59 MB/sec execute 94 sec latency 132.055 ms 20 35799 32.78 MB/sec execute 95 sec latency 82.496 ms 20 36021 32.58 MB/sec execute 96 sec latency 111.051 ms 20 36226 32.35 MB/sec execute 97 sec latency 118.622 ms 20 36440 32.16 MB/sec execute 98 sec latency 185.255 ms 20 36690 32.04 MB/sec execute 99 sec latency 157.900 ms 20 37001 32.07 MB/sec execute 100 sec latency 99.592 ms 20 37295 32.09 MB/sec execute 101 sec latency 94.003 ms 20 37598 31.95 MB/sec execute 102 sec latency 62.088 ms 20 37931 31.86 MB/sec execute 103 sec latency 86.327 ms 20 38270 31.99 MB/sec execute 104 sec latency 115.414 ms 20 38660 32.38 MB/sec execute 105 sec latency 148.999 ms 20 39048 32.51 MB/sec execute 106 sec latency 140.943 ms 20 39351 32.69 MB/sec execute 107 sec latency 96.937 ms 20 39560 32.51 MB/sec execute 108 sec latency 153.316 ms 20 39791 32.33 MB/sec execute 109 sec latency 188.716 ms 20 39995 32.12 MB/sec execute 110 sec latency 158.676 ms 20 40219 31.98 MB/sec execute 111 sec latency 99.443 ms 20 40515 31.97 MB/sec execute 112 sec latency 108.831 ms 20 40856 32.10 MB/sec execute 113 sec latency 73.758 ms 20 41154 31.96 MB/sec execute 114 sec latency 78.146 ms 20 41505 31.93 MB/sec execute 115 sec latency 88.855 ms 20 41813 31.97 MB/sec execute 116 sec latency 119.300 ms 20 42218 32.30 MB/sec execute 117 sec latency 116.524 ms 20 42653 32.55 MB/sec execute 118 sec latency 124.142 ms 20 42964 32.63 MB/sec execute 119 sec latency 115.645 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 126390 9.604 49.415 Close 92341 2.077 16.788 Rename 5309 12.132 42.051 Unlink 25815 3.417 31.738 Qpathinfo 113719 2.141 34.158 Qfileinfo 19581 0.067 9.967 Qfsinfo 20990 0.025 4.448 Sfileinfo 10115 5.419 20.438 Find 43633 0.408 32.525 WriteX 61674 0.735 17.220 ReadX 195416 0.010 3.045 LockX 400 2.766 12.322 UnlockX 400 2.631 9.094 Flush 8720 53.959 307.421 Throughput 32.6312 MB/sec 20 clients 20 procs max_latency=307.428 ms stopping dbench on /mnt/lustre/d0.oleg124-client.virtnet at Wed Jul 31 23:14:36 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg124-client.virtnet /mnt/lustre/d0.oleg124-client.virtnet /mnt/lustre/d0.oleg124-client.virtnet removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg124-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 23:14:40 (1722482080) min OST has 3152896kB available, using 4729344kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6824] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4618] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg124-clien 4618M 146785 98 134209 98 326626 84 2576 126 Latency 2233us 41944us 35659us 226ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg124-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 480 16 3730 18 658 12 462 15 582 14 668 12 Latency 15634us 6428us 49782us 18308us 4900us 12989us 1.97,1.97,oleg124-client.virtnet,1,1722473436,4618M,,,,146785,98,134209,98,,,326626,84,2576,126,10,,,,,480,16,3730,18,658,12,462,15,582,14,668,12,,2233us,41944us,,35659us,226ms,15634us,6428us,49782us,18308us,4900us,12989us debug=0x33f0484 PASS bonnie (186s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 23:17:47 (1722482267) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7944 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7944 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x493d5e truncating to largest ever: 0x4d77f4 truncating to largest ever: 0x505f0b truncating to largest ever: 0x52317a truncating to largest ever: 0x542b9e truncating to largest ever: 0x55b0cb truncating to largest ever: 0x561217 001000 1722482271.179724 mapwrite 0x2ce571 thru 0x2dc5b3 (0xe043 bytes) 002000 1722482274.368255 write 0x03f83f thru 0x04c208 (0xc9ca bytes) truncating to largest ever: 0x561ed9 004000 1722482281.117004 trunc from 0x2c54a1 to 0x493ee3 (0x1cea43 bytes) 005000 1722482284.472678 write 0x24d855 thru 0x2531c7 (0x5973 bytes) 007000 1722482290.938660 mapwrite 0x245159 thru 0x24aba0 (0x5a48 bytes) 008000 1722482294.641249 write 0x0236ee thru 0x032db5 (0xf6c8 bytes) 013000 1722482312.177325 read 0x1011aa thru 0x109e8b (0x8ce2 bytes) 015000 1722482319.386222 write 0x3792ff thru 0x37deac (0x4bae bytes) 018000 1722482330.826004 mapwrite 0x0f135e thru 0x0f16a7 (0x34a bytes) truncating to largest ever: 0x562512 019000 1722482334.046099 read 0x2042e5 thru 0x210509 (0xc225 bytes) 020000 1722482337.625739 write 0x03577f thru 0x03f553 (0x9dd5 bytes) 021000 1722482341.018739 trunc from 0x198bd4 to 0x42a9fc (0x291e29 bytes) 022000 1722482344.663840 write 0x511993 thru 0x520ebb (0xf529 bytes) 023000 1722482348.040165 write 0x05b63c thru 0x05ca1b (0x13e0 bytes) 025000 1722482355.181954 mapwrite 0x03c4bc thru 0x04b565 (0xf0aa bytes) 028000 1722482370.146131 trunc from 0x0a9310 to 0x0e8e67 (0x3fb58 bytes) 029000 1722482374.721543 read 0x3a2c97 thru 0x3a8f13 (0x627d bytes) 030000 1722482378.364623 trunc from 0x44c5a6 to 0x34f407 (0xfd19e bytes) 032000 1722482387.308566 mapread 0x1b243a thru 0x1bb68e (0x9255 bytes) 033000 1722482392.204769 trunc from 0x4130ab to 0x2c50de (0x14dfcc bytes) 034000 1722482396.547036 write 0x05444d thru 0x0559b7 (0x156b bytes) 035000 1722482400.258274 mapread 0x18e2f8 thru 0x198a08 (0xa711 bytes) 038000 1722482409.870147 write 0x4cb1dd thru 0x4d0f8b (0x5daf bytes) 040000 1722482418.000387 mapread 0x073c67 thru 0x07a458 (0x67f2 bytes) 041000 1722482422.559185 mapread 0x06225e thru 0x0634e6 (0x1289 bytes) 042000 1722482427.812019 mapread 0x39027e thru 0x39625b (0x5fde bytes) 043000 1722482431.765149 write 0x0e33c0 thru 0x0ea5c0 (0x7201 bytes) 048000 1722482457.553055 trunc from 0x0c08a9 to 0x304e6b (0x2445c3 bytes) 049000 1722482462.151059 read 0x1cb6fc thru 0x1d41b3 (0x8ab8 bytes) 050000 1722482465.644180 write 0x46ded4 thru 0x47404d (0x617a bytes) 051000 1722482470.615880 mapread 0x28df9a thru 0x29156a (0x35d1 bytes) 052000 1722482475.451708 mapread 0x1f513c thru 0x1fd790 (0x8655 bytes) 057000 1722482498.747325 mapread 0x4b2209 thru 0x4b6112 (0x3f0a bytes) 058000 1722482503.380453 trunc from 0x4d1cb3 to 0x13cad1 (0x3951e1 bytes) 059000 1722482508.937488 read 0x25a5dd thru 0x25fe8a (0x58ae bytes) 060000 1722482514.909330 write 0x312331 thru 0x31e743 (0xc413 bytes) 061000 1722482519.855465 mapwrite 0x434c97 thru 0x437d5f (0x30c9 bytes) 062000 1722482524.068189 mapwrite 0x413a48 thru 0x418a72 (0x502b bytes) 064000 1722482533.876813 read 0x134fa9 thru 0x13f3f0 (0xa448 bytes) 065000 1722482539.339119 mapread 0x1a7f73 thru 0x1b3f4c (0xbfda bytes) 071000 1722482569.853706 trunc from 0x395017 to 0x309198 (0x8be7e bytes) 073000 1722482582.115114 trunc from 0x2dbfa2 to 0x1cd4a9 (0x10eaf8 bytes) 075000 1722482594.763692 mapwrite 0x0962bf thru 0x09f062 (0x8da4 bytes) 077000 1722482605.183364 trunc from 0x28c3e3 to 0x55f91e (0x2d353c bytes) 080000 1722482621.303448 read 0x1fd5e1 thru 0x200bca (0x35ea bytes) 081000 1722482625.400850 mapread 0x09915f thru 0x09e4e5 (0x5387 bytes) 082000 1722482630.985066 write 0x11431e thru 0x11bd8b (0x7a6e bytes) 083000 1722482634.442384 read 0x494297 thru 0x49bdc5 (0x7b2f bytes) 084000 1722482640.983021 mapwrite 0x287730 thru 0x293f61 (0xc832 bytes) 089000 1722482668.071905 write 0x518d7b thru 0x519339 (0x5bf bytes) 094000 1722482690.250634 mapread 0x0d6c32 thru 0x0e20c6 (0xb495 bytes) 096000 1722482699.527119 mapwrite 0x0c829b thru 0x0c8591 (0x2f7 bytes) 099000 1722482713.367077 mapwrite 0x52373d thru 0x5260de (0x29a2 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (452s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 23:25:19 (1722482719) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1722482735.613564 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1722482739.429858 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1722482750.164021 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1722482756.634864 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1722482761.203086 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1722482790.282374 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1722482794.933333 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1722482799.994246 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1722482811.196365 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1722482817.580267 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1722482822.805846 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1722482833.723356 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1722482838.560184 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1722482850.978696 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1722482855.915927 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1722482861.483297 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1722482870.852387 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1722482876.682158 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1722482891.519136 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1722482911.000657 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1722482916.511285 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1722482922.442281 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1722482929.514310 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1722482935.548543 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1722482970.526226 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1722482976.449562 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1722482989.991259 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1722483010.545528 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1722483032.693243 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1722483044.663037 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1722483050.355557 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1722483062.274955 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1722483074.711557 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1722483086.776277 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1722483091.349445 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1722483096.825616 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1722483112.981148 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1722483116.724613 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1722483120.067226 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1722483127.598813 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1722483134.970367 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1722483140.895459 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1722483157.486133 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1722483168.743245 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1722483175.026019 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1722483181.772496 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1722483187.775032 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1722483194.868674 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1722483200.024836 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1722483203.968865 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1722483228.180557 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1722483232.997437 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1722483243.461392 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (530s) == sanity-benchmark test complete, duration 1328 sec ===== 23:34:09 (1722483249)