-----============= acceptance-small: sanity-benchmark ============----- Fri Jul 19 12:19:51 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg232-client.virtnet: executing check_config_client /mnt/lustre oleg232-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg232-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012aadd000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aadd000.idle_timeout=debug disable quota as required oleg232-server: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 12:20:00 (1721406000) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7451] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg232-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg232-client.virtnet at Fri Jul 19 12:20:01 EDT 2024 waiting for dbench pid 9590 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 261 196.67 MB/sec warmup 1 sec latency 59.914 ms 20 565 193.75 MB/sec warmup 2 sec latency 38.173 ms 20 721 141.83 MB/sec warmup 3 sec latency 722.307 ms 20 1068 114.52 MB/sec warmup 4 sec latency 21.043 ms 20 1475 104.13 MB/sec warmup 5 sec latency 49.019 ms 20 1840 87.81 MB/sec warmup 6 sec latency 24.968 ms 20 2272 77.99 MB/sec warmup 7 sec latency 16.080 ms 20 2713 77.01 MB/sec warmup 8 sec latency 20.774 ms 20 3383 79.96 MB/sec warmup 9 sec latency 29.465 ms 20 3810 79.51 MB/sec warmup 10 sec latency 25.459 ms 20 4065 72.85 MB/sec warmup 11 sec latency 23.684 ms 20 4344 67.52 MB/sec warmup 12 sec latency 51.762 ms 20 4661 64.55 MB/sec warmup 13 sec latency 27.215 ms 20 5041 64.51 MB/sec warmup 14 sec latency 34.725 ms 20 5343 60.55 MB/sec warmup 15 sec latency 29.294 ms 20 5730 57.43 MB/sec warmup 16 sec latency 18.485 ms 20 6075 56.30 MB/sec warmup 17 sec latency 25.303 ms 20 6674 59.06 MB/sec warmup 18 sec latency 27.223 ms 20 7220 60.99 MB/sec warmup 19 sec latency 21.521 ms 20 7487 59.15 MB/sec warmup 20 sec latency 24.905 ms 20 7749 56.51 MB/sec warmup 21 sec latency 53.839 ms 20 8038 54.57 MB/sec warmup 22 sec latency 35.319 ms 20 8441 54.64 MB/sec warmup 23 sec latency 29.704 ms 20 9207 9.13 MB/sec execute 1 sec latency 23.200 ms 20 9638 28.36 MB/sec execute 2 sec latency 19.271 ms 20 10263 54.51 MB/sec execute 3 sec latency 28.496 ms 20 10788 63.38 MB/sec execute 4 sec latency 28.950 ms 20 11032 55.03 MB/sec execute 5 sec latency 25.733 ms 20 11252 46.53 MB/sec execute 6 sec latency 64.165 ms 20 11523 41.51 MB/sec execute 7 sec latency 44.790 ms 20 11832 40.21 MB/sec execute 8 sec latency 23.142 ms 20 12175 41.85 MB/sec execute 9 sec latency 30.071 ms 20 12486 38.48 MB/sec execute 10 sec latency 23.448 ms 20 12871 36.39 MB/sec execute 11 sec latency 20.001 ms 20 13219 36.96 MB/sec execute 12 sec latency 27.158 ms 20 13745 41.35 MB/sec execute 13 sec latency 25.402 ms 20 14275 44.84 MB/sec execute 14 sec latency 27.547 ms 20 14540 43.67 MB/sec execute 15 sec latency 25.668 ms 20 14756 41.29 MB/sec execute 16 sec latency 50.022 ms 20 15013 39.40 MB/sec execute 17 sec latency 45.487 ms 20 15316 38.70 MB/sec execute 18 sec latency 28.416 ms 20 15679 39.63 MB/sec execute 19 sec latency 31.227 ms 20 15977 38.31 MB/sec execute 20 sec latency 27.530 ms 20 16357 37.11 MB/sec execute 21 sec latency 24.045 ms 20 16771 37.88 MB/sec execute 22 sec latency 19.300 ms 20 17388 40.83 MB/sec execute 23 sec latency 25.478 ms 20 17864 42.26 MB/sec execute 24 sec latency 24.880 ms 20 18135 41.56 MB/sec execute 25 sec latency 28.065 ms 20 18418 40.24 MB/sec execute 26 sec latency 54.836 ms 20 18732 39.49 MB/sec execute 27 sec latency 29.507 ms 20 19090 39.83 MB/sec execute 28 sec latency 24.982 ms 20 19431 39.55 MB/sec execute 29 sec latency 25.951 ms 20 19788 38.47 MB/sec execute 30 sec latency 23.848 ms 20 20160 38.15 MB/sec execute 31 sec latency 20.916 ms 20 20675 39.70 MB/sec execute 32 sec latency 21.210 ms 20 21264 41.53 MB/sec execute 33 sec latency 22.386 ms 20 21596 41.62 MB/sec execute 34 sec latency 23.212 ms 20 21845 40.73 MB/sec execute 35 sec latency 46.194 ms 20 22134 39.88 MB/sec execute 36 sec latency 56.182 ms 20 22478 39.76 MB/sec execute 37 sec latency 26.001 ms 20 22865 40.06 MB/sec execute 38 sec latency 27.935 ms 20 23250 39.35 MB/sec execute 39 sec latency 24.111 ms 20 23696 39.12 MB/sec execute 40 sec latency 19.117 ms 20 24225 40.37 MB/sec execute 41 sec latency 29.215 ms 20 24809 41.75 MB/sec execute 42 sec latency 26.631 ms 20 25159 41.85 MB/sec execute 43 sec latency 24.629 ms 20 25439 41.12 MB/sec execute 44 sec latency 30.468 ms 20 25703 40.42 MB/sec execute 45 sec latency 73.138 ms 20 26052 40.34 MB/sec execute 46 sec latency 23.541 ms 20 26436 40.54 MB/sec execute 47 sec latency 22.508 ms 20 26785 39.94 MB/sec execute 48 sec latency 23.042 ms 20 27193 39.65 MB/sec execute 49 sec latency 22.370 ms 20 27702 40.51 MB/sec execute 50 sec latency 22.550 ms 20 28296 41.67 MB/sec execute 51 sec latency 25.587 ms 20 28634 41.82 MB/sec execute 52 sec latency 32.062 ms 20 28883 41.32 MB/sec execute 53 sec latency 49.178 ms 20 29161 40.69 MB/sec execute 54 sec latency 54.038 ms 20 29463 40.36 MB/sec execute 55 sec latency 27.306 ms 20 29812 40.58 MB/sec execute 56 sec latency 26.588 ms 20 30118 40.27 MB/sec execute 57 sec latency 28.054 ms 20 30435 39.73 MB/sec execute 58 sec latency 26.946 ms 20 30805 39.59 MB/sec execute 59 sec latency 24.642 ms 20 31269 40.19 MB/sec execute 60 sec latency 26.892 ms 20 31761 40.84 MB/sec execute 61 sec latency 28.172 ms 20 32125 41.10 MB/sec execute 62 sec latency 30.048 ms 20 32394 40.79 MB/sec execute 63 sec latency 28.852 ms 20 32632 40.27 MB/sec execute 64 sec latency 56.909 ms 20 32883 39.88 MB/sec execute 65 sec latency 36.247 ms 20 33220 39.92 MB/sec execute 66 sec latency 24.292 ms 20 33527 39.85 MB/sec execute 67 sec latency 26.145 ms 20 33860 39.43 MB/sec execute 68 sec latency 22.630 ms 20 34247 39.20 MB/sec execute 69 sec latency 80.330 ms 20 34731 39.66 MB/sec execute 70 sec latency 22.215 ms 20 35279 40.39 MB/sec execute 71 sec latency 25.677 ms 20 35693 40.74 MB/sec execute 72 sec latency 26.520 ms 20 35973 40.47 MB/sec execute 73 sec latency 51.986 ms 20 36226 40.02 MB/sec execute 74 sec latency 51.170 ms 20 36524 39.75 MB/sec execute 75 sec latency 31.975 ms 20 36884 39.85 MB/sec execute 76 sec latency 27.282 ms 20 37243 39.75 MB/sec execute 77 sec latency 27.752 ms 20 37660 39.46 MB/sec execute 78 sec latency 24.253 ms 20 38131 39.71 MB/sec execute 79 sec latency 25.127 ms 20 38708 40.49 MB/sec execute 80 sec latency 24.748 ms 20 39206 40.91 MB/sec execute 81 sec latency 22.784 ms 20 39495 40.66 MB/sec execute 82 sec latency 28.299 ms 20 39754 40.29 MB/sec execute 83 sec latency 47.073 ms 20 40079 40.04 MB/sec execute 84 sec latency 25.596 ms 20 40442 40.12 MB/sec execute 85 sec latency 22.796 ms 20 40803 40.04 MB/sec execute 86 sec latency 22.677 ms 20 41154 39.75 MB/sec execute 87 sec latency 23.798 ms 20 41511 39.73 MB/sec execute 88 sec latency 23.563 ms 20 42006 40.14 MB/sec execute 89 sec latency 26.799 ms 20 42533 40.66 MB/sec execute 90 sec latency 22.041 ms 20 42886 40.76 MB/sec execute 91 sec latency 24.854 ms 20 43146 40.45 MB/sec execute 92 sec latency 51.691 ms 20 43414 40.15 MB/sec execute 93 sec latency 48.649 ms 20 43721 40.03 MB/sec execute 94 sec latency 22.330 ms 20 44025 39.95 MB/sec execute 95 sec latency 28.379 ms 20 44391 39.86 MB/sec execute 96 sec latency 30.779 ms 20 44739 39.62 MB/sec execute 97 sec latency 26.174 ms 20 45172 39.78 MB/sec execute 98 sec latency 23.497 ms 20 45651 40.15 MB/sec execute 99 sec latency 55.935 ms 20 46146 40.51 MB/sec execute 100 sec latency 23.102 ms 20 46489 40.54 MB/sec execute 101 sec latency 24.197 ms 20 46740 40.25 MB/sec execute 102 sec latency 63.939 ms 20 47006 40.00 MB/sec execute 103 sec latency 44.538 ms 20 47335 39.97 MB/sec execute 104 sec latency 27.797 ms 20 47669 39.88 MB/sec execute 105 sec latency 26.542 ms 20 48048 39.74 MB/sec execute 106 sec latency 22.593 ms 20 48421 39.59 MB/sec execute 107 sec latency 23.479 ms 20 48898 39.81 MB/sec execute 108 sec latency 25.360 ms 20 49443 40.37 MB/sec execute 109 sec latency 23.435 ms 20 49880 40.54 MB/sec execute 110 sec latency 30.392 ms 20 50187 40.40 MB/sec execute 111 sec latency 32.977 ms 20 50473 40.16 MB/sec execute 112 sec latency 42.378 ms 20 50841 40.13 MB/sec execute 113 sec latency 22.848 ms 20 51196 40.04 MB/sec execute 114 sec latency 25.043 ms 20 51573 39.96 MB/sec execute 115 sec latency 22.741 ms 20 51933 39.81 MB/sec execute 116 sec latency 20.967 ms 20 52417 40.01 MB/sec execute 117 sec latency 26.191 ms 20 52895 40.37 MB/sec execute 118 sec latency 24.255 ms 20 53339 40.58 MB/sec execute 119 sec latency 25.566 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 154584 9.041 63.932 Close 113680 2.096 18.040 Rename 6546 12.551 40.265 Unlink 31132 2.992 41.768 Qpathinfo 140534 2.014 47.062 Qfileinfo 24594 0.064 5.835 Qfsinfo 25814 0.027 5.775 Sfileinfo 12341 6.700 29.801 Find 54438 0.395 41.314 WriteX 76526 1.212 29.985 ReadX 245172 0.011 3.574 LockX 520 2.134 6.375 UnlockX 520 2.107 5.641 Flush 10677 8.980 80.325 Throughput 40.5811 MB/sec 20 clients 20 procs max_latency=80.330 ms stopping dbench on /mnt/lustre/d0.oleg232-client.virtnet at Fri Jul 19 12:22:26 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg232-client.virtnet /mnt/lustre/d0.oleg232-client.virtnet /mnt/lustre/d0.oleg232-client.virtnet removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg232-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 12:22:28 (1721406148) min OST has 3356396kB available, using 5034594kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7451] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4916] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg232-clien 4916M 157549 98 140193 98 272179 55 6452 281 Latency 4005us 71027us 47893us 3472us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg232-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 558 18 4227 18 756 14 513 17 553 15 713 14 Latency 24106us 12284us 60189us 17361us 16653us 17704us 1.97,1.97,oleg232-client.virtnet,1,1721416463,4916M,,,,157549,98,140193,98,,,272179,55,6452,281,10,,,,,558,18,4227,18,756,14,513,17,553,15,713,14,,4005us,71027us,,47893us,3472us,24106us,12284us,60189us,17361us,16653us,17704us debug=0x33f0484 PASS bonnie (182s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 12:25:30 (1721406330) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 20032 -P /tmp -l 5397360 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 20032 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x4af4b3 fallocating to largest ever: 0x50c797 truncating to largest ever: 0x516918 truncating to largest ever: 0x51ea97 truncating to largest ever: 0x51f662 001000 1721406334.173931 write 0x320f9c thru 0x32d6f9 (0xc75e bytes) fallocating to largest ever: 0x525b70 003000 1721406339.889106 write 0x019f1f thru 0x01cc5f (0x2d41 bytes) 004000 1721406342.218879 read 0x03f396 thru 0x04b0de (0xbd49 bytes) 007000 1721406349.119925 mapwrite 0x4983b7 thru 0x49bd2b (0x3975 bytes) 008000 1721406351.391384 punch from 0x23a0e7 to 0x2448ea (0xa804 bytes) 009000 1721406353.613709 write 0x2fa8f4 thru 0x309faa (0xf6b7 bytes) 010000 1721406355.740475 punch from 0x132f7e to 0x1336af (0x732 bytes) 011000 1721406357.905886 mapwrite 0x302715 thru 0x30cc91 (0xa57d bytes) 012000 1721406359.924616 write 0x0a61ea thru 0x0afa25 (0x983c bytes) 013000 1721406362.439828 fallocate 0x339f85 thru 0x33dac1 (0x3b3d bytes) 014000 1721406364.681214 fallocate 0x36b0d7 thru 0x3759b9 (0xa8e3 bytes) 015000 1721406367.200339 fallocate 0x14d771 thru 0x15885d (0xb0ed bytes) 017000 1721406371.417742 fallocate 0x1176a6 thru 0x11de12 (0x676d bytes) 019000 1721406375.210031 write 0x32b08d thru 0x32ee35 (0x3da9 bytes) 020000 1721406377.200256 mapwrite 0x4a0152 thru 0x4a5fec (0x5e9b bytes) 024000 1721406385.121131 write 0x2dcfa9 thru 0x2dde4f (0xea7 bytes) 025000 1721406387.216952 trunc from 0x525b70 to 0x3c66f4 (0x15f47b bytes) 027000 1721406391.060085 read 0x26e2c4 thru 0x273721 (0x545e bytes) 028000 1721406392.897401 mapread 0x1740aa thru 0x1770fc (0x3053 bytes) 029000 1721406394.865946 write 0x4d5999 thru 0x4d6551 (0xbb9 bytes) 031000 1721406399.082508 punch from 0x0ced5a to 0x0d8343 (0x95ea bytes) 032000 1721406400.839801 write 0x43078d thru 0x4397e3 (0x9057 bytes) 033000 1721406402.897330 read 0x171ca3 thru 0x1758f5 (0x3c53 bytes) 034000 1721406404.666668 read 0x0f04ab thru 0x0f85ae (0x8104 bytes) 035000 1721406406.703052 mapwrite 0x285fc8 thru 0x295663 (0xf69c bytes) 036000 1721406408.979518 read 0x382a10 thru 0x391009 (0xe5fa bytes) 037000 1721406410.943430 fallocate 0x14a1c5 thru 0x14b3ee (0x122a bytes) 038000 1721406413.186789 punch from 0x2bf4e7 to 0x2c48d5 (0x53ef bytes) 039000 1721406415.563183 trunc from 0x505d4d to 0x18bfbe (0x379d8e bytes) 040000 1721406418.293456 fallocate 0x2c901b thru 0x2d1bbb (0x8ba1 bytes) 042000 1721406423.121109 write 0x39a3ea thru 0x3a20d7 (0x7cee bytes) 044000 1721406427.841336 mapread 0x28b5ac thru 0x296ac1 (0xb516 bytes) 045000 1721406430.541560 trunc from 0x41ca2a to 0x2a1a06 (0x17b023 bytes) 046000 1721406433.013958 read 0x43e8c7 thru 0x43fcd4 (0x140e bytes) 048000 1721406437.610724 fallocate 0x2b917d thru 0x2c1aae (0x8932 bytes) 049000 1721406440.091261 fallocate 0x0316aa thru 0x034dcf (0x3726 bytes) 050000 1721406442.577283 read 0x38d6fe thru 0x39412e (0x6a31 bytes) 051000 1721406445.310033 punch from 0x1d8c50 to 0x1e568f (0xca40 bytes) 052000 1721406447.817192 mapread 0x02749d thru 0x0317dd (0xa341 bytes) 053000 1721406450.520801 mapread 0x3165cb thru 0x3185cc (0x2002 bytes) 054000 1721406452.415401 read 0x17edae thru 0x1813b7 (0x260a bytes) 055000 1721406454.974391 trunc from 0x51d718 to 0x27b9a8 (0x2a1d6f bytes) 056000 1721406457.568882 write 0x226a4f thru 0x22dac8 (0x707a bytes) 058000 1721406462.375362 fallocate 0x269518 thru 0x26a698 (0x1181 bytes) 059000 1721406464.640211 trunc from 0x3b68e5 to 0x1778b4 (0x23f030 bytes) 061000 1721406469.300325 read 0x3efc5b thru 0x3f1da7 (0x214d bytes) 062000 1721406471.627235 trunc from 0x1f388d to 0x3e476a (0x1f0ede bytes) 063000 1721406474.163998 mapwrite 0x481e5a thru 0x4896db (0x7882 bytes) 064000 1721406476.676874 trunc from 0x2967d5 to 0x1e02e4 (0xb64f0 bytes) 065000 1721406479.049327 mapwrite 0x416ebb thru 0x421e73 (0xafb9 bytes) 066000 1721406481.691101 punch from 0x1560c0 to 0x15d8c5 (0x7806 bytes) 068000 1721406485.685681 mapwrite 0x24b45a thru 0x2551bf (0x9d66 bytes) 069000 1721406487.479417 trunc from 0x12ca59 to 0x342d8a (0x216332 bytes) 070000 1721406489.292650 mapread 0x3d2d18 thru 0x3dcf66 (0xa24f bytes) 071000 1721406491.376176 read 0x11ee6a thru 0x122d89 (0x3f20 bytes) 072000 1721406493.455566 write 0x12d1de thru 0x138bad (0xb9d0 bytes) 073000 1721406495.760804 mapread 0x1eb5da thru 0x1f2f84 (0x79ab bytes) 074000 1721406497.883372 mapwrite 0x2d079d thru 0x2ddc1e (0xd482 bytes) 075000 1721406499.958198 write 0x4aa3d3 thru 0x4ac25c (0x1e8a bytes) 076000 1721406502.336748 read 0x215d35 thru 0x220c3a (0xaf06 bytes) 077000 1721406504.320815 read 0x3d6e3c thru 0x3e3ef7 (0xd0bc bytes) 078000 1721406506.441977 read 0x05dc1e thru 0x06c65d (0xea40 bytes) 079000 1721406508.693760 mapwrite 0x1c715a thru 0x1d0397 (0x923e bytes) 080000 1721406510.994248 mapwrite 0x4ad1b5 thru 0x4bb71e (0xe56a bytes) 081000 1721406513.323389 mapwrite 0x145934 thru 0x1503ff (0xaacc bytes) 082000 1721406515.852612 trunc from 0x2fd31e to 0x03a294 (0x2c3089 bytes) 083000 1721406518.407089 fallocate 0x06c3bc thru 0x076d5b (0xa9a0 bytes) 085000 1721406522.949249 trunc from 0x47ebe1 to 0x4446df (0x3a501 bytes) 086000 1721406524.894156 fallocate 0x0bc492 thru 0x0c5d7e (0x98ed bytes) 087000 1721406527.015744 write 0x416339 thru 0x41c140 (0x5e08 bytes) 088000 1721406529.107884 mapwrite 0x3eba55 thru 0x3f9e14 (0xe3c0 bytes) 090000 1721406533.610140 mapread 0x25889b thru 0x25f399 (0x6aff bytes) 091000 1721406536.087183 write 0x3f6767 thru 0x405db9 (0xf653 bytes) 092000 1721406538.182001 read 0x14ccd4 thru 0x1572b6 (0xa5e3 bytes) 093000 1721406540.229289 mapread 0x219369 thru 0x2246aa (0xb342 bytes) 094000 1721406542.066788 trunc from 0x419dff to 0x43441a (0x1a61c bytes) 095000 1721406543.997817 mapread 0x3c3003 thru 0x3c81f7 (0x51f5 bytes) 096000 1721406545.835076 mapread 0x048990 thru 0x054c03 (0xc274 bytes) 099000 1721406552.333096 punch from 0x054c4e to 0x05dd55 (0x9108 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (225s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 12:29:15 (1721406555) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1721406558.928033 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1721406561.319141 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1721406571.687614 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1721406574.325128 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1721406576.998182 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1721406579.663125 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1721406582.468695 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1721406587.321140 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1721406589.905512 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1721406594.970629 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1721406597.864154 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1721406603.505331 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1721406605.860044 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1721406611.922453 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1721406614.641018 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1721406617.133552 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1721406619.968993 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1721406622.426095 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1721406625.313054 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1721406628.588797 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1721406631.128082 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1721406636.638038 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1721406639.358897 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1721406642.146233 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1721406645.104617 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1721406647.946209 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1721406650.639923 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1721406653.463080 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1721406656.253477 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1721406659.442958 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1721406662.429823 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1721406665.110815 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1721406670.529272 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1721406673.291814 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1721406675.795246 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1721406678.486475 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1721406686.849463 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1721406689.883293 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1721406692.673961 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1721406695.507432 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1721406698.777492 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1721406701.380621 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1721406706.846974 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1721406709.481417 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1721406712.228715 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1721406721.050249 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1721406727.256749 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1721406730.039217 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1721406732.764243 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1721406738.435063 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1721406745.293388 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1721406748.980625 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1721406752.879356 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1721406760.408154 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1721406763.115510 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1721406766.648562 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1721406769.767511 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1721406773.344582 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1721406776.863810 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1721406783.176058 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1721406789.601744 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1721406792.175056 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1721406794.656141 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1721406797.616864 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1721406802.889452 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1721406808.522720 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1721406814.450355 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1721406817.065068 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1721406820.174536 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1721406822.821889 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1721406825.673603 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1721406831.155262 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1721406834.451807 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1721406838.729288 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1721406845.928379 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (292s) == sanity-benchmark test complete, duration 856 sec ====== 12:34:07 (1721406847)