-----============= acceptance-small: sanity-benchmark ============----- Mon Apr 15 15:10:42 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 15:10:46 (1713208246) === oleg424-client.virtnet: executing check_config_client /mnt/lustre oleg424-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg424-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a6c3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a6c3000.idle_timeout=debug disable quota as required oleg424-server: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 15:10:53 (1713208253) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 15:10:54 (1713208254) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7659] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg424-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg424-client.virtnet at Mon Apr 15 15:10:55 EDT 2024 waiting for dbench pid 9776 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 151 126.31 MB/sec warmup 1 sec latency 63.466 ms 20 354 127.25 MB/sec warmup 2 sec latency 63.006 ms 20 583 128.77 MB/sec warmup 3 sec latency 213.263 ms 20 752 106.64 MB/sec warmup 4 sec latency 444.123 ms 20 922 87.26 MB/sec warmup 5 sec latency 160.644 ms 20 1197 77.23 MB/sec warmup 6 sec latency 173.471 ms 20 1512 74.44 MB/sec warmup 7 sec latency 189.741 ms 20 1824 65.84 MB/sec warmup 8 sec latency 86.530 ms 20 2166 59.55 MB/sec warmup 9 sec latency 138.301 ms 20 2425 56.22 MB/sec warmup 10 sec latency 192.761 ms 20 2852 58.76 MB/sec warmup 11 sec latency 150.732 ms 20 3311 59.02 MB/sec warmup 12 sec latency 155.642 ms 20 3761 60.63 MB/sec warmup 13 sec latency 84.493 ms 20 4014 57.24 MB/sec warmup 14 sec latency 183.049 ms 20 4247 53.72 MB/sec warmup 15 sec latency 342.491 ms 20 4390 50.77 MB/sec warmup 16 sec latency 153.983 ms 20 4659 49.63 MB/sec warmup 17 sec latency 121.349 ms 20 5055 50.18 MB/sec warmup 18 sec latency 96.087 ms 20 5357 47.81 MB/sec warmup 19 sec latency 108.457 ms 20 5719 45.87 MB/sec warmup 20 sec latency 96.638 ms 20 6013 45.25 MB/sec warmup 21 sec latency 155.049 ms 20 6475 47.36 MB/sec warmup 22 sec latency 153.385 ms 20 6889 47.56 MB/sec warmup 23 sec latency 155.722 ms 20 7500 21.82 MB/sec execute 1 sec latency 131.116 ms 20 7734 11.76 MB/sec execute 2 sec latency 263.387 ms 20 7850 9.75 MB/sec execute 3 sec latency 392.266 ms 20 8000 9.32 MB/sec execute 4 sec latency 141.425 ms 20 8196 12.80 MB/sec execute 5 sec latency 135.646 ms 20 8510 19.72 MB/sec execute 6 sec latency 105.696 ms 20 8739 18.02 MB/sec execute 7 sec latency 152.911 ms 20 8973 16.28 MB/sec execute 8 sec latency 101.361 ms 20 9271 15.34 MB/sec execute 9 sec latency 106.774 ms 20 9533 16.78 MB/sec execute 10 sec latency 236.081 ms 20 9919 22.49 MB/sec execute 11 sec latency 131.799 ms 20 10335 24.58 MB/sec execute 12 sec latency 134.851 ms 20 10741 28.96 MB/sec execute 13 sec latency 140.351 ms 20 10990 28.57 MB/sec execute 14 sec latency 27.083 ms 20 11181 26.97 MB/sec execute 15 sec latency 228.149 ms 20 11372 25.61 MB/sec execute 16 sec latency 310.347 ms 20 11489 24.51 MB/sec execute 17 sec latency 184.061 ms 20 11681 23.92 MB/sec execute 18 sec latency 128.462 ms 20 12034 25.74 MB/sec execute 19 sec latency 95.877 ms 20 12287 25.43 MB/sec execute 20 sec latency 116.857 ms 20 12542 24.43 MB/sec execute 21 sec latency 96.483 ms 20 12851 23.76 MB/sec execute 22 sec latency 85.266 ms 20 13111 24.11 MB/sec execute 23 sec latency 136.840 ms 20 13508 26.52 MB/sec execute 24 sec latency 148.994 ms 20 13948 27.61 MB/sec execute 25 sec latency 143.138 ms 20 14352 29.39 MB/sec execute 26 sec latency 69.354 ms 20 14607 29.13 MB/sec execute 27 sec latency 141.454 ms 20 14880 28.24 MB/sec execute 28 sec latency 224.325 ms 20 14989 27.44 MB/sec execute 29 sec latency 322.353 ms 20 15209 27.09 MB/sec execute 30 sec latency 110.820 ms 20 15605 28.16 MB/sec execute 31 sec latency 121.282 ms 20 15920 27.89 MB/sec execute 32 sec latency 110.260 ms 20 16238 27.26 MB/sec execute 33 sec latency 76.815 ms 20 16595 27.38 MB/sec execute 34 sec latency 109.679 ms 20 16882 27.88 MB/sec execute 35 sec latency 180.157 ms 20 17315 29.25 MB/sec execute 36 sec latency 189.811 ms 20 17768 30.75 MB/sec execute 37 sec latency 132.942 ms 20 18042 30.64 MB/sec execute 38 sec latency 24.002 ms 20 18266 29.98 MB/sec execute 39 sec latency 305.483 ms 20 18444 29.34 MB/sec execute 40 sec latency 385.757 ms 20 18562 28.77 MB/sec execute 41 sec latency 191.928 ms 20 18780 28.57 MB/sec execute 42 sec latency 115.154 ms 20 19196 29.54 MB/sec execute 43 sec latency 90.581 ms 20 19413 28.96 MB/sec execute 44 sec latency 158.113 ms 20 19673 28.42 MB/sec execute 45 sec latency 107.006 ms 20 20019 28.00 MB/sec execute 46 sec latency 61.022 ms 20 20265 28.18 MB/sec execute 47 sec latency 149.013 ms 20 20722 29.61 MB/sec execute 48 sec latency 187.540 ms 20 21145 29.89 MB/sec execute 49 sec latency 144.872 ms 20 21533 30.85 MB/sec execute 50 sec latency 60.383 ms 20 21765 30.43 MB/sec execute 51 sec latency 23.308 ms 20 22004 29.93 MB/sec execute 52 sec latency 199.023 ms 20 22119 29.46 MB/sec execute 53 sec latency 197.631 ms 20 22300 29.09 MB/sec execute 54 sec latency 167.200 ms 20 22672 29.60 MB/sec execute 55 sec latency 108.708 ms 20 22968 29.59 MB/sec execute 56 sec latency 213.107 ms 20 23258 29.16 MB/sec execute 57 sec latency 118.904 ms 20 23642 29.06 MB/sec execute 58 sec latency 103.612 ms 20 23874 29.10 MB/sec execute 59 sec latency 160.807 ms 20 24363 30.14 MB/sec execute 60 sec latency 185.301 ms 20 24815 30.82 MB/sec execute 61 sec latency 150.077 ms 20 25168 31.13 MB/sec execute 62 sec latency 21.212 ms 20 25419 30.72 MB/sec execute 63 sec latency 225.673 ms 20 25607 30.33 MB/sec execute 64 sec latency 275.065 ms 20 25764 29.98 MB/sec execute 65 sec latency 146.233 ms 20 26031 29.98 MB/sec execute 66 sec latency 146.329 ms 20 26390 30.40 MB/sec execute 67 sec latency 110.935 ms 20 26673 30.03 MB/sec execute 68 sec latency 134.024 ms 20 27015 29.72 MB/sec execute 69 sec latency 94.687 ms 20 27303 29.69 MB/sec execute 70 sec latency 164.981 ms 20 27734 30.51 MB/sec execute 71 sec latency 157.980 ms 20 28180 30.89 MB/sec execute 72 sec latency 161.373 ms 20 28561 31.40 MB/sec execute 73 sec latency 101.106 ms 20 28824 31.31 MB/sec execute 74 sec latency 25.199 ms 20 29080 30.94 MB/sec execute 75 sec latency 250.607 ms 20 29196 30.60 MB/sec execute 76 sec latency 402.881 ms 20 29359 30.32 MB/sec execute 77 sec latency 161.751 ms 20 29663 30.29 MB/sec execute 78 sec latency 124.535 ms 20 29994 30.64 MB/sec execute 79 sec latency 154.594 ms 20 30274 30.32 MB/sec execute 80 sec latency 100.557 ms 20 30630 30.06 MB/sec execute 81 sec latency 99.363 ms 20 30884 30.08 MB/sec execute 82 sec latency 184.227 ms 20 31356 30.93 MB/sec execute 83 sec latency 119.904 ms 20 31776 31.10 MB/sec execute 84 sec latency 147.257 ms 20 32190 31.64 MB/sec execute 85 sec latency 63.663 ms 20 32435 31.39 MB/sec execute 86 sec latency 74.852 ms 20 32650 31.08 MB/sec execute 87 sec latency 475.047 ms 20 32788 30.80 MB/sec execute 88 sec latency 143.301 ms 20 33054 30.78 MB/sec execute 89 sec latency 136.901 ms 20 33452 31.13 MB/sec execute 90 sec latency 89.448 ms 20 33742 30.84 MB/sec execute 91 sec latency 130.960 ms 20 34124 30.61 MB/sec execute 92 sec latency 80.172 ms 20 34429 30.65 MB/sec execute 93 sec latency 145.929 ms 20 34887 31.26 MB/sec execute 94 sec latency 150.378 ms 20 35316 31.52 MB/sec execute 95 sec latency 143.566 ms 20 35721 31.97 MB/sec execute 96 sec latency 104.262 ms 20 35952 31.77 MB/sec execute 97 sec latency 254.942 ms 20 36183 31.49 MB/sec execute 98 sec latency 318.390 ms 20 36292 31.22 MB/sec execute 99 sec latency 342.961 ms 20 36458 30.99 MB/sec execute 100 sec latency 137.469 ms 20 36749 30.99 MB/sec execute 101 sec latency 133.608 ms 20 37088 31.23 MB/sec execute 102 sec latency 110.574 ms 20 37356 30.97 MB/sec execute 103 sec latency 73.930 ms 20 37694 30.78 MB/sec execute 104 sec latency 87.106 ms 20 37962 30.77 MB/sec execute 105 sec latency 196.200 ms 20 38342 31.25 MB/sec execute 106 sec latency 155.780 ms 20 38735 31.37 MB/sec execute 107 sec latency 149.783 ms 20 39156 31.83 MB/sec execute 108 sec latency 119.739 ms 20 39411 31.75 MB/sec execute 109 sec latency 138.215 ms 20 39622 31.50 MB/sec execute 110 sec latency 239.481 ms 20 39792 31.27 MB/sec execute 111 sec latency 278.425 ms 20 39931 31.06 MB/sec execute 112 sec latency 149.762 ms 20 40133 30.97 MB/sec execute 113 sec latency 118.801 ms 20 40524 31.28 MB/sec execute 114 sec latency 116.893 ms 20 40789 31.05 MB/sec execute 115 sec latency 135.325 ms 20 41100 30.84 MB/sec execute 116 sec latency 112.938 ms 20 41468 30.86 MB/sec execute 117 sec latency 114.491 ms 20 41823 31.15 MB/sec execute 118 sec latency 167.136 ms 20 42287 31.43 MB/sec execute 119 sec latency 164.959 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 122744 9.066 73.760 Close 90141 2.155 29.571 Rename 5174 12.455 42.581 Unlink 24795 3.526 32.734 Qpathinfo 111148 2.132 45.239 Qfileinfo 19375 0.064 8.435 Qfsinfo 20379 0.028 8.194 Sfileinfo 10000 6.486 47.907 Find 42965 0.429 42.875 WriteX 60541 0.972 28.213 ReadX 192525 0.013 3.783 LockX 400 1.954 8.956 UnlockX 400 1.995 8.931 Flush 8600 64.157 475.036 Throughput 31.4261 MB/sec 20 clients 20 procs max_latency=475.047 ms stopping dbench on /mnt/lustre/d0.oleg424-client.virtnet at Mon Apr 15 15:13:19 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg424-client.virtnet /mnt/lustre/d0.oleg424-client.virtnet /mnt/lustre/d0.oleg424-client.virtnet removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg424-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 15:13:23 (1713208403) min OST has 3119104kB available, using 4678656kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7659] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4569] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg424-clien 4569M 111081 66 157315 95 404529 81 2235 120 Latency 28506us 30770us 26489us 342ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg424-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 531 16 8880 32 648 10 501 16 1264 13 603 10 Latency 20979us 12000us 133ms 53173us 4471us 22811us 1.97,1.97,oleg424-client.virtnet,1,1713198732,4569M,,,,111081,66,157315,95,,,404529,81,2235,120,10,,,,,531,16,8880,32,648,10,501,16,1264,13,603,10,,28506us,30770us,,26489us,342ms,20979us,12000us,133ms,53173us,4471us,22811us debug=0x33f0484 PASS bonnie (175s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 15:16:20 (1713208580) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 8440 -P /tmp -l 5647104 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 8440 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x109d95 truncating to largest ever: 0x22ac54 truncating to largest ever: 0x3011cd truncating to largest ever: 0x405285 truncating to largest ever: 0x4ba12d truncating to largest ever: 0x562ae0 002000 1713208587.458286 write 0x4aab2a thru 0x4acfb0 (0x2487 bytes) 003000 1713208590.289053 trunc from 0x1932d5 to 0x4426fa (0x2af426 bytes) 004000 1713208592.920717 mapwrite 0x11ee65 thru 0x123c49 (0x4de5 bytes) 007000 1713208601.701797 read 0x099b9b thru 0x0a407d (0xa4e3 bytes) 008000 1713208604.387197 mapread 0x1476ee thru 0x156bda (0xf4ed bytes) 009000 1713208607.539721 trunc from 0x4cfc36 to 0x2962d8 (0x23995d bytes) 010000 1713208610.362840 write 0x4eddf0 thru 0x4f4471 (0x6682 bytes) 013000 1713208619.075242 trunc from 0x2982cd to 0x4658b8 (0x1cd5ec bytes) 016000 1713208627.027608 trunc from 0x24d8e8 to 0x28bbc9 (0x3e2e2 bytes) 018000 1713208632.505016 read 0x0c6adc thru 0x0ca043 (0x3568 bytes) 020000 1713208638.381730 read 0x2a21d5 thru 0x2a3f29 (0x1d55 bytes) 021000 1713208640.647386 mapread 0x0aeb6c thru 0x0b20b2 (0x3547 bytes) 022000 1713208643.590110 read 0x3b9d01 thru 0x3c7d9a (0xe09a bytes) 023000 1713208646.083846 read 0x48b9ea thru 0x48d75a (0x1d71 bytes) 028000 1713208659.446867 write 0x22875c thru 0x22e45d (0x5d02 bytes) 029000 1713208662.157501 trunc from 0x197906 to 0x48c372 (0x2f4a6d bytes) 030000 1713208664.951091 trunc from 0x40be8a to 0x4b932b (0xad4a2 bytes) 032000 1713208670.647024 mapread 0x0c22ed thru 0x0d199b (0xf6af bytes) 034000 1713208676.112240 mapread 0x16708d thru 0x16bec7 (0x4e3b bytes) 038000 1713208687.797760 mapwrite 0x20c6b8 thru 0x214db6 (0x86ff bytes) 040000 1713208693.191456 write 0x25d347 thru 0x25d9d2 (0x68c bytes) 045000 1713208707.314289 read 0x204210 thru 0x2083ea (0x41db bytes) 046000 1713208709.735017 write 0x0de7ca thru 0x0ed192 (0xe9c9 bytes) 047000 1713208712.331539 mapread 0x388ff5 thru 0x38d6c2 (0x46ce bytes) 048000 1713208715.428389 read 0x27759d thru 0x28135d (0x9dc1 bytes) 053000 1713208729.584083 mapwrite 0x433903 thru 0x437265 (0x3963 bytes) 054000 1713208732.136526 write 0x01f6a3 thru 0x02e5c9 (0xef27 bytes) 055000 1713208735.268670 mapread 0x3ce796 thru 0x3d3ba9 (0x5414 bytes) 059000 1713208745.649152 write 0x551c3f thru 0x560178 (0xe53a bytes) 060000 1713208748.460530 trunc from 0x4efc82 to 0x1c8d49 (0x326f38 bytes) 061000 1713208751.459710 mapread 0x251f41 thru 0x25d1d4 (0xb294 bytes) 062000 1713208754.400017 write 0x03f9a4 thru 0x048083 (0x86e0 bytes) 065000 1713208763.000036 write 0x54cdc0 thru 0x55b9aa (0xebeb bytes) 066000 1713208765.705425 trunc from 0x31ce3c to 0x236c76 (0xe61c5 bytes) 073000 1713208785.468547 mapread 0x10bd48 thru 0x119eb4 (0xe16d bytes) 075000 1713208790.470606 mapwrite 0x0b24b5 thru 0x0b5725 (0x3271 bytes) 076000 1713208793.773371 write 0x163967 thru 0x169525 (0x5bbf bytes) 079000 1713208802.792338 trunc from 0x518672 to 0x500781 (0x17ef0 bytes) 081000 1713208808.198231 mapwrite 0x1741fe thru 0x1821bb (0xdfbe bytes) 082000 1713208811.047720 read 0x16e101 thru 0x17ad7a (0xcc7a bytes) 084000 1713208816.987801 mapread 0x0f8013 thru 0x107c29 (0xfc17 bytes) 086000 1713208822.338269 trunc from 0x4916a0 to 0x3caad1 (0xc6bce bytes) 090000 1713208833.079454 read 0x2f526e thru 0x2f6d2d (0x1ac0 bytes) 092000 1713208838.194039 mapread 0x43b3a2 thru 0x4463aa (0xb009 bytes) 095000 1713208846.547421 read 0x29dddf thru 0x2a81b3 (0xa3d5 bytes) 097000 1713208851.496438 write 0x4e7540 thru 0x4eb84c (0x430d bytes) 099000 1713208857.415023 mapwrite 0x0d3132 thru 0x0e292a (0xf7f9 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (281s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 15:21:02 (1713208862) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1713208872.969473 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1713208879.864261 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1713208883.245735 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1713208896.251164 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1713208899.123538 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1713208910.845128 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1713208913.746014 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1713208919.600517 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1713208925.785205 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1713208928.717065 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1713208934.542580 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1713208937.759988 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1713208949.549350 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1713208955.115559 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1713208964.469894 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1713208973.664073 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1713208976.442962 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1713208989.187230 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1713208992.756404 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1713209002.389320 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1713209005.370009 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1713209008.601863 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1713209017.229114 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1713209023.673270 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1713209030.180624 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1713209033.514164 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1713209070.880871 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1713209082.045248 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1713209086.299949 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1713209089.332804 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1713209092.360520 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1713209101.991233 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1713209105.334641 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1713209115.936138 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1713209119.735375 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1713209129.522253 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1713209140.209304 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1713209144.032162 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1713209154.471317 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1713209171.965150 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1713209175.191650 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1713209182.194038 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1713209189.709312 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (332s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 952 sec ====== 15:26:35 (1713209195) === sanity-benchmark: start cleanup 15:26:35 (1713209195) === === sanity-benchmark: finish cleanup 15:26:35 (1713209195) ===