-----============= acceptance-small: sanity-benchmark ============----- Fri Mar 22 03:09:51 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 03:09:53 (1711091393) === oleg453-client.virtnet: executing check_config_client /mnt/lustre oleg453-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg453-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5cb9800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5cb9800.idle_timeout=debug disable quota as required oleg453-server: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 03:10:00 (1711091400) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 03:10:01 (1711091401) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7336] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg453-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg453-client.virtnet at Fri Mar 22 03:10:01 EDT 2024 waiting for dbench pid 9470 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 292 216.37 MB/sec warmup 1 sec latency 44.950 ms 20 627 206.90 MB/sec warmup 2 sec latency 38.354 ms 20 936 145.15 MB/sec warmup 3 sec latency 26.178 ms 20 1325 122.27 MB/sec warmup 4 sec latency 25.375 ms 20 1704 104.92 MB/sec warmup 5 sec latency 28.257 ms 20 2095 88.77 MB/sec warmup 6 sec latency 25.016 ms 20 2490 81.87 MB/sec warmup 7 sec latency 21.963 ms 20 3074 84.67 MB/sec warmup 8 sec latency 35.430 ms 20 3639 85.98 MB/sec warmup 9 sec latency 30.931 ms 20 3941 80.10 MB/sec warmup 10 sec latency 21.962 ms 20 4202 73.07 MB/sec warmup 11 sec latency 40.480 ms 20 4486 68.22 MB/sec warmup 12 sec latency 34.089 ms 20 4827 65.79 MB/sec warmup 13 sec latency 24.409 ms 20 5198 64.70 MB/sec warmup 14 sec latency 25.988 ms 20 5541 60.80 MB/sec warmup 15 sec latency 22.747 ms 20 5952 58.96 MB/sec warmup 16 sec latency 21.284 ms 20 6436 60.80 MB/sec warmup 17 sec latency 33.171 ms 20 7054 62.90 MB/sec warmup 18 sec latency 26.964 ms 20 7393 62.02 MB/sec warmup 19 sec latency 31.525 ms 20 7616 59.20 MB/sec warmup 20 sec latency 40.277 ms 20 7900 56.82 MB/sec warmup 21 sec latency 44.782 ms 20 8221 55.54 MB/sec warmup 22 sec latency 31.038 ms 20 8585 55.81 MB/sec warmup 23 sec latency 33.943 ms 20 9282 10.48 MB/sec execute 1 sec latency 27.296 ms 20 9640 24.67 MB/sec execute 2 sec latency 25.522 ms 20 10223 51.60 MB/sec execute 3 sec latency 30.744 ms 20 10754 62.01 MB/sec execute 4 sec latency 24.873 ms 20 11026 54.91 MB/sec execute 5 sec latency 26.310 ms 20 11284 46.24 MB/sec execute 6 sec latency 44.750 ms 20 11542 41.36 MB/sec execute 7 sec latency 47.910 ms 20 11883 39.76 MB/sec execute 8 sec latency 21.791 ms 20 12252 42.14 MB/sec execute 9 sec latency 24.867 ms 20 12528 38.41 MB/sec execute 10 sec latency 24.016 ms 20 12895 36.29 MB/sec execute 11 sec latency 22.016 ms 20 13251 37.26 MB/sec execute 12 sec latency 25.839 ms 20 13850 42.10 MB/sec execute 13 sec latency 27.632 ms 20 14314 45.15 MB/sec execute 14 sec latency 26.574 ms 20 14569 43.76 MB/sec execute 15 sec latency 30.390 ms 20 14810 41.23 MB/sec execute 16 sec latency 48.884 ms 20 15056 39.43 MB/sec execute 17 sec latency 63.914 ms 20 15368 38.83 MB/sec execute 18 sec latency 27.805 ms 20 15739 40.04 MB/sec execute 19 sec latency 28.372 ms 20 16028 38.27 MB/sec execute 20 sec latency 26.306 ms 20 16357 36.85 MB/sec execute 21 sec latency 120.298 ms 20 16728 37.00 MB/sec execute 22 sec latency 23.543 ms 20 17324 40.03 MB/sec execute 23 sec latency 29.476 ms 20 17836 42.16 MB/sec execute 24 sec latency 25.642 ms 20 18117 41.55 MB/sec execute 25 sec latency 25.073 ms 20 18359 40.08 MB/sec execute 26 sec latency 74.200 ms 20 18629 39.03 MB/sec execute 27 sec latency 43.150 ms 20 18974 38.86 MB/sec execute 28 sec latency 24.157 ms 20 19354 39.45 MB/sec execute 29 sec latency 30.508 ms 20 19642 38.30 MB/sec execute 30 sec latency 29.704 ms 20 20000 37.50 MB/sec execute 31 sec latency 21.382 ms 20 20361 37.78 MB/sec execute 32 sec latency 25.312 ms 20 20975 39.75 MB/sec execute 33 sec latency 24.117 ms 20 21439 41.05 MB/sec execute 34 sec latency 25.921 ms 20 21713 40.65 MB/sec execute 35 sec latency 26.010 ms 20 21946 39.59 MB/sec execute 36 sec latency 57.045 ms 20 22227 38.87 MB/sec execute 37 sec latency 27.355 ms 20 22572 38.78 MB/sec execute 38 sec latency 24.985 ms 20 22960 39.18 MB/sec execute 39 sec latency 29.747 ms 20 23315 38.36 MB/sec execute 40 sec latency 29.729 ms 20 23633 37.96 MB/sec execute 41 sec latency 400.183 ms 20 24114 38.99 MB/sec execute 42 sec latency 21.920 ms 20 24747 40.62 MB/sec execute 43 sec latency 22.757 ms 20 25117 40.83 MB/sec execute 44 sec latency 26.885 ms 20 25369 40.13 MB/sec execute 45 sec latency 24.274 ms 20 25629 39.43 MB/sec execute 46 sec latency 35.747 ms 20 25973 39.19 MB/sec execute 47 sec latency 25.075 ms 20 26378 39.64 MB/sec execute 48 sec latency 25.675 ms 20 26705 39.06 MB/sec execute 49 sec latency 21.833 ms 20 27128 38.65 MB/sec execute 50 sec latency 20.710 ms 20 27568 39.21 MB/sec execute 51 sec latency 26.135 ms 20 28201 40.48 MB/sec execute 52 sec latency 27.115 ms 20 28602 41.01 MB/sec execute 53 sec latency 27.372 ms 20 28857 40.51 MB/sec execute 54 sec latency 22.417 ms 20 29095 39.87 MB/sec execute 55 sec latency 49.753 ms 20 29373 39.43 MB/sec execute 56 sec latency 27.238 ms 20 29729 39.59 MB/sec execute 57 sec latency 21.746 ms 20 30072 39.54 MB/sec execute 58 sec latency 26.012 ms 20 30399 38.97 MB/sec execute 59 sec latency 24.680 ms 20 30785 38.76 MB/sec execute 60 sec latency 18.220 ms 20 31251 39.55 MB/sec execute 61 sec latency 25.663 ms 20 31870 40.54 MB/sec execute 62 sec latency 24.138 ms 20 32225 40.67 MB/sec execute 63 sec latency 27.913 ms 20 32464 40.17 MB/sec execute 64 sec latency 24.247 ms 20 32710 39.66 MB/sec execute 65 sec latency 44.402 ms 20 32994 39.37 MB/sec execute 66 sec latency 27.722 ms 20 33366 39.67 MB/sec execute 67 sec latency 37.282 ms 20 33682 39.36 MB/sec execute 68 sec latency 22.809 ms 20 34016 38.89 MB/sec execute 69 sec latency 22.597 ms 20 34399 38.81 MB/sec execute 70 sec latency 23.333 ms 20 34922 39.59 MB/sec execute 71 sec latency 31.782 ms 20 35499 40.36 MB/sec execute 72 sec latency 35.762 ms 20 35814 40.39 MB/sec execute 73 sec latency 26.730 ms 20 36062 39.92 MB/sec execute 74 sec latency 41.770 ms 20 36335 39.52 MB/sec execute 75 sec latency 52.072 ms 20 36673 39.37 MB/sec execute 76 sec latency 31.103 ms 20 37073 39.69 MB/sec execute 77 sec latency 21.849 ms 20 37383 39.25 MB/sec execute 78 sec latency 25.688 ms 20 37792 39.02 MB/sec execute 79 sec latency 21.358 ms 20 38245 39.48 MB/sec execute 80 sec latency 23.116 ms 20 38813 40.06 MB/sec execute 81 sec latency 27.553 ms 20 39249 40.51 MB/sec execute 82 sec latency 24.430 ms 20 39511 40.19 MB/sec execute 83 sec latency 23.070 ms 20 39776 39.78 MB/sec execute 84 sec latency 60.521 ms 20 40049 39.54 MB/sec execute 85 sec latency 27.994 ms 20 40406 39.70 MB/sec execute 86 sec latency 25.311 ms 20 40709 39.54 MB/sec execute 87 sec latency 26.010 ms 20 41028 39.16 MB/sec execute 88 sec latency 24.815 ms 20 41402 38.99 MB/sec execute 89 sec latency 27.692 ms 20 41773 39.24 MB/sec execute 90 sec latency 26.085 ms 20 42438 40.09 MB/sec execute 91 sec latency 26.114 ms 20 42864 40.32 MB/sec execute 92 sec latency 25.069 ms 20 43167 39.98 MB/sec execute 93 sec latency 47.264 ms 20 43472 39.69 MB/sec execute 94 sec latency 50.082 ms 20 43931 39.96 MB/sec execute 95 sec latency 22.182 ms 20 44306 39.83 MB/sec execute 96 sec latency 24.189 ms 20 44729 39.52 MB/sec execute 97 sec latency 18.800 ms 20 45183 39.66 MB/sec execute 98 sec latency 19.907 ms 20 45925 40.55 MB/sec execute 99 sec latency 24.212 ms 20 46391 40.90 MB/sec execute 100 sec latency 22.933 ms 20 46663 40.60 MB/sec execute 101 sec latency 30.498 ms 20 46966 40.30 MB/sec execute 102 sec latency 40.085 ms 20 47357 40.29 MB/sec execute 103 sec latency 20.987 ms 20 47803 40.43 MB/sec execute 104 sec latency 20.286 ms 20 48190 40.12 MB/sec execute 105 sec latency 23.870 ms 20 48640 40.14 MB/sec execute 106 sec latency 21.866 ms 20 49302 40.84 MB/sec execute 107 sec latency 23.008 ms 20 49855 41.34 MB/sec execute 108 sec latency 19.633 ms 20 50144 41.12 MB/sec execute 109 sec latency 19.669 ms 20 50423 40.81 MB/sec execute 110 sec latency 35.565 ms 20 50734 40.65 MB/sec execute 111 sec latency 34.430 ms 20 51139 40.84 MB/sec execute 112 sec latency 24.391 ms 20 51496 40.62 MB/sec execute 113 sec latency 25.441 ms 20 51927 40.42 MB/sec execute 114 sec latency 18.424 ms 20 52368 40.66 MB/sec execute 115 sec latency 22.359 ms 20 53032 41.23 MB/sec execute 116 sec latency 22.789 ms 20 53459 41.47 MB/sec execute 117 sec latency 24.024 ms 20 53752 41.23 MB/sec execute 118 sec latency 22.818 ms 20 54030 40.96 MB/sec execute 119 sec latency 68.264 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 157048 8.769 68.259 Close 115204 2.088 24.029 Rename 6660 11.570 32.973 Unlink 32003 3.288 48.296 Qpathinfo 142387 2.090 48.968 Qfileinfo 24772 0.077 7.228 Qfsinfo 26338 0.062 6.571 Sfileinfo 12773 6.873 49.612 Find 55225 0.576 51.310 WriteX 77818 1.003 25.295 ReadX 247007 0.014 5.206 LockX 520 2.325 8.409 UnlockX 520 2.255 6.603 Flush 11113 7.974 400.175 Throughput 40.9605 MB/sec 20 clients 20 procs max_latency=400.183 ms stopping dbench on /mnt/lustre/d0.oleg453-client.virtnet at Fri Mar 22 03:12:26 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg453-client.virtnet /mnt/lustre/d0.oleg453-client.virtnet /mnt/lustre/d0.oleg453-client.virtnet removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg453-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 03:12:30 (1711091550) min OST has 3360892kB available, using 5041338kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7336] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4923] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg453-clien 4923M 158676 98 139098 93 359223 79 5825 289 Latency 4611us 34206us 47836us 4060us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg453-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 286 27 3187 56 316 36 313 25 609 42 353 34 Latency 34222us 16144us 24467us 17987us 4986us 20971us 1.97,1.97,oleg453-client.virtnet,1,1711081212,4923M,,,,158676,98,139098,93,,,359223,79,5825,289,10,,,,,286,27,3187,56,316,36,313,25,609,42,353,34,,4611us,34206us,,47836us,4060us,34222us,16144us,24467us,17987us,4986us,20971us debug=0x33f0484 PASS bonnie (239s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 03:16:32 (1711091792) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7289 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7289 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x269f3f fallocating to largest ever: 0x40713f truncating to largest ever: 0x525ec9 fallocating to largest ever: 0x5285f4 001000 1711091795.177494 mapread 0x39d136 thru 0x3a4b75 (0x7a40 bytes) 003000 1711091799.531052 mapread 0x2fe647 thru 0x30981d (0xb1d7 bytes) 004000 1711091801.710922 write 0x04fd0e thru 0x0599ed (0x9ce0 bytes) 005000 1711091804.099521 punch from 0x03d786 to 0x044ed3 (0x774e bytes) 006000 1711091806.717172 mapwrite 0x3ff271 thru 0x40cdbd (0xdb4d bytes) 008000 1711091811.485899 mapread 0x10bcc8 thru 0x11a178 (0xe4b1 bytes) 010000 1711091815.788102 mapread 0x057503 thru 0x05e42a (0x6f28 bytes) 011000 1711091817.579224 fallocate 0x304c44 thru 0x30c965 (0x7d22 bytes) 012000 1711091819.398604 mapwrite 0x058aa3 thru 0x062351 (0x98af bytes) 014000 1711091823.362910 punch from 0x1e37fd to 0x1e88df (0x50e3 bytes) 015000 1711091825.431898 write 0x355b1b thru 0x355f0f (0x3f5 bytes) 016000 1711091827.474027 mapread 0x0de427 thru 0x0e4927 (0x6501 bytes) 018000 1711091831.866194 mapread 0x088344 thru 0x08fcc9 (0x7986 bytes) 019000 1711091833.877456 write 0x3bd3fe thru 0x3caf22 (0xdb25 bytes) 021000 1711091838.257470 write 0x2e0bf3 thru 0x2edd68 (0xd176 bytes) 022000 1711091840.402735 write 0x03c227 thru 0x04108c (0x4e66 bytes) 023000 1711091842.569540 mapwrite 0x084e46 thru 0x08c192 (0x734d bytes) 024000 1711091844.848601 write 0x4749b5 thru 0x47fff6 (0xb642 bytes) 025000 1711091847.056186 write 0x22476f thru 0x2301dc (0xba6e bytes) 028000 1711091853.575361 mapread 0x06cbe8 thru 0x06e1b9 (0x15d2 bytes) 030000 1711091858.007317 mapread 0x2a67d7 thru 0x2b2331 (0xbb5b bytes) 032000 1711091862.360637 punch from 0x397eeb to 0x399162 (0x1278 bytes) 033000 1711091864.614028 fallocate 0x518224 thru 0x518f7e (0xd5b bytes) 034000 1711091866.737443 write 0x056329 thru 0x061739 (0xb411 bytes) 036000 1711091871.260364 trunc from 0x355eb5 to 0x2566ec (0xff7c8 bytes) 037000 1711091873.454731 punch from 0x052380 to 0x05ffc6 (0xdc47 bytes) 041000 1711091881.762700 mapread 0x042ed3 thru 0x04fdb8 (0xcee6 bytes) 042000 1711091883.873993 trunc from 0x4bdb43 to 0x444386 (0x797bc bytes) 043000 1711091886.286555 mapread 0x1b9abf thru 0x1be18f (0x46d1 bytes) 044000 1711091888.328317 read 0x241d7a thru 0x246690 (0x4917 bytes) 046000 1711091892.728614 mapread 0x2aa966 thru 0x2b863d (0xdcd8 bytes) 048000 1711091897.001815 punch from 0x06d2cc to 0x079aa5 (0xc7da bytes) 049000 1711091899.122751 mapread 0x085081 thru 0x091dd2 (0xcd52 bytes) 050000 1711091901.257435 fallocate 0x3efd96 thru 0x3fb818 (0xba83 bytes) 051000 1711091903.433947 mapread 0x36e706 thru 0x373b76 (0x5471 bytes) 053000 1711091908.246724 trunc from 0x00c463 to 0x045f15 (0x39ab3 bytes) 054000 1711091910.525033 trunc from 0x33ad5e to 0x2962cc (0xa4a91 bytes) 056000 1711091915.144093 fallocate 0x06e82b thru 0x077e00 (0x95d6 bytes) 057000 1711091917.465477 punch from 0x010bf6 to 0x015029 (0x4434 bytes) 058000 1711091919.577156 punch from 0x33ffda to 0x34df5f (0xdf86 bytes) 059000 1711091922.166209 fallocate 0x050e3d thru 0x0518fc (0xac0 bytes) 060000 1711091924.435151 read 0x03f908 thru 0x045eb7 (0x65b0 bytes) 061000 1711091926.858577 fallocate 0x2821fe thru 0x28c967 (0xa76a bytes) 062000 1711091929.030853 mapread 0x1ccf2a thru 0x1db863 (0xe93a bytes) 063000 1711091931.604674 write 0x0bfb9c thru 0x0c555d (0x59c2 bytes) 064000 1711091933.967302 punch from 0x0fd3c0 to 0x1038f7 (0x6538 bytes) skipping zero size read 068000 1711091943.208014 mapread 0x005262 thru 0x0090ef (0x3e8e bytes) 070000 1711091948.081818 punch from 0x3e8388 to 0x3eabae (0x2827 bytes) 071000 1711091950.434781 trunc from 0x42329f to 0x05210b (0x3d1193 bytes) 072000 1711091953.008457 write 0x2bce56 thru 0x2cc374 (0xf51f bytes) 073000 1711091955.098221 mapread 0x0c2461 thru 0x0cd9a9 (0xb549 bytes) 074000 1711091957.229684 write 0x39990e thru 0x3a331c (0x9a0f bytes) 076000 1711091961.187584 mapread 0x174457 thru 0x17c16a (0x7d14 bytes) 077000 1711091963.451995 mapread 0x1ced0d thru 0x1dbc79 (0xcf6d bytes) 078000 1711091965.412748 trunc from 0x1dc5ae to 0x0be772 (0x11de3b bytes) 079000 1711091967.512115 punch from 0x261b72 to 0x26e81f (0xccae bytes) 080000 1711091970.124527 write 0x185639 thru 0x188aaa (0x3472 bytes) 082000 1711091974.975378 read 0x168b0c thru 0x16b2a7 (0x279c bytes) 084000 1711091979.944400 mapwrite 0x4d3f09 thru 0x4d4716 (0x80e bytes) 087000 1711091986.290375 punch from 0x08ba2e to 0x095e44 (0xa417 bytes) 088000 1711091988.520297 trunc from 0x352570 to 0x2ef133 (0x6343c bytes) 089000 1711091990.713778 punch from 0x2f1e39 to 0x2f296e (0xb36 bytes) 090000 1711091993.089079 write 0x0bdcf2 thru 0x0cb6b2 (0xd9c1 bytes) 091000 1711091995.658324 punch from 0x21a501 to 0x21f155 (0x4c55 bytes) 092000 1711091997.901142 mapwrite 0x35f3b3 thru 0x36ce23 (0xda71 bytes) 094000 1711092002.846169 fallocate 0x4ed452 thru 0x4efb32 (0x26e1 bytes) 097000 1711092009.355052 trunc from 0x105184 to 0x45f581 (0x35a3fe bytes) 098000 1711092011.537452 trunc from 0x48d5af to 0x3eaa1d (0xa2b91 bytes) 099000 1711092013.896756 mapwrite 0x3d957d thru 0x3d9e33 (0x8b7 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (225s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 03:20:18 (1711092018) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1711092021.985090 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1711092024.744862 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1711092027.510917 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1711092030.223127 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1711092035.473945 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1711092038.058255 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1711092040.836484 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1711092043.475428 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1711092046.017241 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1711092048.393293 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1711092051.009449 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1711092053.510152 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1711092055.695609 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1711092058.218511 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1711092060.779154 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1711092063.034121 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1711092065.708137 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1711092068.329917 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1711092070.789710 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1711092078.987420 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1711092081.693358 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1711092084.417489 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1711092087.009332 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1711092092.132157 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1711092097.282955 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1711092099.732420 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1711092102.464113 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1711092108.181472 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1711092111.197337 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1711092116.195849 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1711092118.872372 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1711092121.474785 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1711092124.183954 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1711092127.046371 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1711092132.209082 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1711092139.585252 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1711092147.017989 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1711092152.092648 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1711092154.684711 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1711092157.462631 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1711092164.627818 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1711092167.213221 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1711092169.763487 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1711092172.396223 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1711092175.080092 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1711092177.451406 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1711092179.816202 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1711092182.353007 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1711092184.993964 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1711092189.688035 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1711092192.413193 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1711092194.744284 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1711092197.154088 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1711092199.761454 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1711092204.663526 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1711092212.442086 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1711092217.839373 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1711092220.470122 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1711092222.869085 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1711092228.106288 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1711092230.685714 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1711092235.450748 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1711092237.981593 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1711092242.928862 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1711092247.945167 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1711092253.312072 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1711092255.819912 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1711092258.063345 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1711092260.253507 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1711092265.337526 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1711092267.984350 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1711092273.227098 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1711092275.968139 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (258s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 886 sec ====== 03:24:37 (1711092277) === sanity-benchmark: start cleanup 03:24:37 (1711092277) === === sanity-benchmark: finish cleanup 03:24:37 (1711092277) ===