-----============= acceptance-small: sanity-benchmark ============----- Tue Jan 7 09:49:47 EST 2025 excepting tests: skipping tests SLOW=no: iozone oleg412-client.virtnet: executing check_config_client /mnt/lustre oleg412-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg412-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5c9c800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c9c800.idle_timeout=debug disable quota as required oleg412-server: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 09:49:57 (1736261397) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7432] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg412-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg412-client.virtnet at Tue Jan 7 09:49:58 EST 2025 waiting for dbench pid 9571 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 255 192.84 MB/sec warmup 1 sec latency 52.521 ms 20 513 178.22 MB/sec warmup 2 sec latency 38.568 ms 20 698 141.26 MB/sec warmup 3 sec latency 683.740 ms 20 982 109.62 MB/sec warmup 4 sec latency 23.746 ms 20 1422 104.03 MB/sec warmup 5 sec latency 20.443 ms 20 1771 87.61 MB/sec warmup 6 sec latency 37.136 ms 20 2185 76.56 MB/sec warmup 7 sec latency 16.457 ms 20 2604 73.95 MB/sec warmup 8 sec latency 25.541 ms 20 3285 77.49 MB/sec warmup 9 sec latency 26.040 ms 20 3771 78.97 MB/sec warmup 10 sec latency 24.498 ms 20 4005 72.83 MB/sec warmup 11 sec latency 25.060 ms 20 4255 67.14 MB/sec warmup 12 sec latency 62.267 ms 20 4544 63.43 MB/sec warmup 13 sec latency 27.661 ms 20 4952 63.45 MB/sec warmup 14 sec latency 33.669 ms 20 5271 60.46 MB/sec warmup 15 sec latency 30.229 ms 20 5635 57.14 MB/sec warmup 16 sec latency 21.039 ms 20 6048 56.08 MB/sec warmup 17 sec latency 21.396 ms 20 6599 58.51 MB/sec warmup 18 sec latency 30.114 ms 20 7150 60.52 MB/sec warmup 19 sec latency 25.386 ms 20 7443 59.02 MB/sec warmup 20 sec latency 24.664 ms 20 7693 56.46 MB/sec warmup 21 sec latency 70.725 ms 20 7934 54.31 MB/sec warmup 22 sec latency 67.262 ms 20 8272 53.37 MB/sec warmup 23 sec latency 25.152 ms 20 8989 5.97 MB/sec execute 1 sec latency 34.269 ms 20 9396 13.30 MB/sec execute 2 sec latency 18.798 ms 20 9855 33.11 MB/sec execute 3 sec latency 23.227 ms 20 10472 50.21 MB/sec execute 4 sec latency 24.209 ms 20 10892 53.54 MB/sec execute 5 sec latency 24.091 ms 20 11155 46.72 MB/sec execute 6 sec latency 72.507 ms 20 11429 41.14 MB/sec execute 7 sec latency 65.047 ms 20 11735 38.76 MB/sec execute 8 sec latency 27.617 ms 20 12098 40.17 MB/sec execute 9 sec latency 67.316 ms 20 12446 38.67 MB/sec execute 10 sec latency 26.865 ms 20 12827 36.63 MB/sec execute 11 sec latency 22.116 ms 20 13267 38.50 MB/sec execute 12 sec latency 22.995 ms 20 13829 43.31 MB/sec execute 13 sec latency 22.846 ms 20 14324 45.55 MB/sec execute 14 sec latency 23.951 ms 20 14597 43.94 MB/sec execute 15 sec latency 45.682 ms 20 14845 41.69 MB/sec execute 16 sec latency 52.751 ms 20 15137 40.21 MB/sec execute 17 sec latency 47.675 ms 20 15472 40.22 MB/sec execute 18 sec latency 35.803 ms 20 15855 40.35 MB/sec execute 19 sec latency 33.098 ms 20 16242 39.02 MB/sec execute 20 sec latency 22.365 ms 20 16714 39.66 MB/sec execute 21 sec latency 20.523 ms 20 17259 41.93 MB/sec execute 22 sec latency 21.272 ms 20 17760 43.22 MB/sec execute 23 sec latency 25.353 ms 20 18109 43.26 MB/sec execute 24 sec latency 41.226 ms 20 18394 42.05 MB/sec execute 25 sec latency 34.472 ms 20 18698 41.24 MB/sec execute 26 sec latency 59.032 ms 20 19026 40.97 MB/sec execute 27 sec latency 32.352 ms 20 19412 40.95 MB/sec execute 28 sec latency 26.987 ms 20 19776 40.09 MB/sec execute 29 sec latency 24.828 ms 20 20196 40.10 MB/sec execute 30 sec latency 23.533 ms 20 20676 40.88 MB/sec execute 31 sec latency 24.292 ms 20 21193 42.28 MB/sec execute 32 sec latency 30.013 ms 20 21618 42.82 MB/sec execute 33 sec latency 52.925 ms 20 21898 42.11 MB/sec execute 34 sec latency 69.827 ms 20 22194 41.41 MB/sec execute 35 sec latency 59.548 ms 20 22527 41.11 MB/sec execute 36 sec latency 35.742 ms 20 22901 40.96 MB/sec execute 37 sec latency 22.610 ms 20 23292 40.69 MB/sec execute 38 sec latency 25.438 ms 20 23715 40.73 MB/sec execute 39 sec latency 28.512 ms 20 24219 41.27 MB/sec execute 40 sec latency 18.449 ms 20 24692 42.19 MB/sec execute 41 sec latency 28.017 ms 20 25146 42.62 MB/sec execute 42 sec latency 44.701 ms 20 25452 42.24 MB/sec execute 43 sec latency 30.062 ms 20 25747 41.74 MB/sec execute 44 sec latency 44.032 ms 20 26093 41.36 MB/sec execute 45 sec latency 28.797 ms 20 26471 41.20 MB/sec execute 46 sec latency 21.970 ms 20 26849 41.12 MB/sec execute 47 sec latency 22.813 ms 20 27321 41.29 MB/sec execute 48 sec latency 22.076 ms 20 27803 41.67 MB/sec execute 49 sec latency 21.666 ms 20 28242 42.18 MB/sec execute 50 sec latency 28.589 ms 20 28705 42.56 MB/sec execute 51 sec latency 45.201 ms 20 29012 42.32 MB/sec execute 52 sec latency 26.093 ms 20 29330 42.04 MB/sec execute 53 sec latency 37.330 ms 20 29643 41.54 MB/sec execute 54 sec latency 36.554 ms 20 30037 41.40 MB/sec execute 55 sec latency 28.792 ms 20 30422 41.47 MB/sec execute 56 sec latency 29.724 ms 20 30909 41.66 MB/sec execute 57 sec latency 22.740 ms 20 31336 41.74 MB/sec execute 58 sec latency 26.178 ms 20 31738 42.09 MB/sec execute 59 sec latency 27.812 ms 20 32222 42.47 MB/sec execute 60 sec latency 63.466 ms 20 32546 42.32 MB/sec execute 61 sec latency 29.636 ms 20 32850 42.14 MB/sec execute 62 sec latency 27.427 ms 20 33130 41.63 MB/sec execute 63 sec latency 77.556 ms 20 33518 41.33 MB/sec execute 64 sec latency 20.474 ms 20 33982 41.73 MB/sec execute 65 sec latency 25.089 ms 20 34390 41.75 MB/sec execute 66 sec latency 29.202 ms 20 34715 41.61 MB/sec execute 67 sec latency 24.613 ms 20 34933 41.32 MB/sec execute 68 sec latency 38.009 ms 20 35130 41.08 MB/sec execute 69 sec latency 66.455 ms 20 35355 41.04 MB/sec execute 70 sec latency 76.639 ms 20 35630 40.84 MB/sec execute 71 sec latency 43.037 ms 20 35856 40.79 MB/sec execute 72 sec latency 42.609 ms 20 36058 40.57 MB/sec execute 73 sec latency 38.247 ms 20 36283 40.37 MB/sec execute 74 sec latency 36.354 ms 20 36493 39.99 MB/sec execute 75 sec latency 69.691 ms 20 36667 39.53 MB/sec execute 76 sec latency 53.638 ms 20 36845 39.09 MB/sec execute 77 sec latency 43.090 ms 20 37047 38.83 MB/sec execute 78 sec latency 41.603 ms 20 37242 38.59 MB/sec execute 79 sec latency 42.265 ms 20 37519 38.71 MB/sec execute 80 sec latency 49.815 ms 20 37792 38.62 MB/sec execute 81 sec latency 45.627 ms 20 38019 38.41 MB/sec execute 82 sec latency 38.872 ms 20 38244 38.21 MB/sec execute 83 sec latency 35.316 ms 20 38455 37.98 MB/sec execute 84 sec latency 35.872 ms 20 38673 37.76 MB/sec execute 85 sec latency 34.509 ms 20 39120 38.02 MB/sec execute 86 sec latency 47.733 ms 20 39593 38.40 MB/sec execute 87 sec latency 26.088 ms 20 39915 38.41 MB/sec execute 88 sec latency 28.099 ms 20 40187 38.03 MB/sec execute 89 sec latency 48.221 ms 20 40476 37.75 MB/sec execute 90 sec latency 30.104 ms 20 40747 37.65 MB/sec execute 91 sec latency 33.346 ms 20 41142 37.98 MB/sec execute 92 sec latency 27.369 ms 20 41543 38.06 MB/sec execute 93 sec latency 24.785 ms 20 41866 37.86 MB/sec execute 94 sec latency 34.819 ms 20 42162 37.70 MB/sec execute 95 sec latency 51.607 ms 20 42606 37.96 MB/sec execute 96 sec latency 30.353 ms 20 43118 38.38 MB/sec execute 97 sec latency 26.058 ms 20 43478 38.40 MB/sec execute 98 sec latency 20.529 ms 20 43758 38.06 MB/sec execute 99 sec latency 67.727 ms 20 44111 37.88 MB/sec execute 100 sec latency 25.166 ms 20 44580 38.25 MB/sec execute 101 sec latency 29.110 ms 20 45053 38.47 MB/sec execute 102 sec latency 23.330 ms 20 45413 38.28 MB/sec execute 103 sec latency 20.340 ms 20 45712 38.10 MB/sec execute 104 sec latency 43.315 ms 20 46096 38.28 MB/sec execute 105 sec latency 30.723 ms 20 46542 38.55 MB/sec execute 106 sec latency 27.552 ms 20 46876 38.64 MB/sec execute 107 sec latency 26.641 ms 20 47100 38.39 MB/sec execute 108 sec latency 34.640 ms 20 47303 38.07 MB/sec execute 109 sec latency 61.799 ms 20 47541 37.82 MB/sec execute 110 sec latency 33.236 ms 20 47785 37.74 MB/sec execute 111 sec latency 36.619 ms 20 48121 37.87 MB/sec execute 112 sec latency 37.951 ms 20 48460 37.99 MB/sec execute 113 sec latency 38.112 ms 20 48686 37.83 MB/sec execute 114 sec latency 37.414 ms 20 48886 37.59 MB/sec execute 115 sec latency 35.086 ms 20 49136 37.36 MB/sec execute 116 sec latency 43.841 ms 20 49385 37.22 MB/sec execute 117 sec latency 33.363 ms 20 49711 37.34 MB/sec execute 118 sec latency 36.413 ms 20 50093 37.53 MB/sec execute 119 sec latency 35.386 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 143928 9.759 76.634 Close 106087 2.209 32.894 Rename 6105 13.488 53.623 Unlink 28773 3.203 62.140 Qpathinfo 130797 2.168 49.382 Qfileinfo 22969 0.068 13.066 Qfsinfo 23946 0.029 6.743 Sfileinfo 11592 7.028 43.805 Find 50679 0.423 47.664 WriteX 71376 1.294 39.052 ReadX 228042 0.011 2.605 LockX 480 2.315 8.339 UnlockX 480 2.429 33.194 Flush 10020 9.523 77.547 Throughput 37.5332 MB/sec 20 clients 20 procs max_latency=77.556 ms stopping dbench on /mnt/lustre/d0.oleg412-client.virtnet at Tue Jan 7 09:52:23 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg412-client.virtnet /mnt/lustre/d0.oleg412-client.virtnet /mnt/lustre/d0.oleg412-client.virtnet removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg412-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 09:52:25 (1736261545) min OST has 3389980kB available, using 5084970kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7432] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4965] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg412-clien 4965M 153982 98 138982 97 235428 46 3126 235 Latency 4641us 97056us 60420us 8116us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg412-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 335 17 2566 17 529 15 391 18 523 16 746 14 Latency 17940us 8881us 22447us 22696us 6904us 31058us 1.97,1.97,oleg412-client.virtnet,1,1736250910,4965M,,,,153982,98,138982,97,,,235428,46,3126,235,10,,,,,335,17,2566,17,529,15,391,18,523,16,746,14,,4641us,97056us,,60420us,8116us,17940us,8881us,22447us,22696us,6904us,31058us debug=0x33f0484 PASS bonnie (214s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 09:56:00 (1736261760) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 24222 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 24222 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x30703c fallocating to largest ever: 0x34098c fallocating to largest ever: 0x480b57 truncating to largest ever: 0x4ac3f2 truncating to largest ever: 0x4bda37 truncating to largest ever: 0x4ef700 truncating to largest ever: 0x50892a fallocating to largest ever: 0x50bfb1 fallocating to largest ever: 0x519221 fallocating to largest ever: 0x528540 001000 1736261764.018163 mapread 0x0bb282 thru 0x0bdf3a (0x2cb9 bytes) 002000 1736261767.024313 read 0x1efb6e thru 0x1fac91 (0xb124 bytes) 004000 1736261773.181367 write 0x4f651e thru 0x4ff3a5 (0x8e88 bytes) 005000 1736261776.671193 read 0x00f3eb thru 0x01e0fa (0xed10 bytes) 007000 1736261782.710995 read 0x319570 thru 0x32920d (0xfc9e bytes) 008000 1736261785.943082 mapwrite 0x264632 thru 0x26eaf7 (0xa4c6 bytes) 009000 1736261789.012632 fallocate 0x2e6a63 thru 0x2ed5a9 (0x6b47 bytes) 010000 1736261792.076950 mapread 0x1729bb thru 0x18211f (0xf765 bytes) 011000 1736261795.760755 write 0x2376da thru 0x2474e6 (0xfe0d bytes) 012000 1736261799.165997 mapread 0x05aace thru 0x061a10 (0x6f43 bytes) 013000 1736261802.238117 trunc from 0x302bc4 to 0x065cad (0x29cf16 bytes) 015000 1736261808.875821 write 0x143f8b thru 0x152efb (0xef71 bytes) 016000 1736261811.611669 mapread 0x2d5a0c thru 0x2e4037 (0xe62c bytes) 017000 1736261814.792561 punch from 0x021484 to 0x022629 (0x11a6 bytes) 019000 1736261821.564617 mapwrite 0x39911d thru 0x39ca46 (0x392a bytes) 020000 1736261825.047688 mapread 0x16e08e thru 0x1772cb (0x923e bytes) 021000 1736261828.281163 write 0x217e41 thru 0x224fdc (0xd19c bytes) 023000 1736261833.983349 read 0x14d366 thru 0x153ff6 (0x6c91 bytes) 024000 1736261836.507460 read 0x2e91b2 thru 0x2efc55 (0x6aa4 bytes) 025000 1736261839.210519 fallocate 0x444206 thru 0x450ecb (0xccc6 bytes) 026000 1736261842.406702 punch from 0x1cff6f to 0x1dbe3d (0xbecf bytes) 027000 1736261845.480178 punch from 0x024775 to 0x02c624 (0x7eb0 bytes) 029000 1736261851.078386 fallocate 0x33063c thru 0x33f78b (0xf150 bytes) 030000 1736261853.440382 punch from 0x139a87 to 0x13d816 (0x3d90 bytes) 032000 1736261858.314641 fallocate 0x387487 thru 0x38a02c (0x2ba6 bytes) 035000 1736261865.555243 punch from 0x21f3ae to 0x227b5b (0x87ae bytes) 036000 1736261868.546315 mapwrite 0x262ae7 thru 0x267872 (0x4d8c bytes) 037000 1736261871.176145 read 0x5189de thru 0x52268b (0x9cae bytes) 038000 1736261873.649666 mapread 0x282992 thru 0x28ebe6 (0xc255 bytes) 039000 1736261876.370286 punch from 0x0b9ea8 to 0x0c6480 (0xc5d9 bytes) 040000 1736261879.149928 write 0x228dff thru 0x2315d2 (0x87d4 bytes) 041000 1736261881.969736 write 0x4503df thru 0x45a3cf (0x9ff1 bytes) 042000 1736261885.242062 mapread 0x1dff91 thru 0x1e9cfe (0x9d6e bytes) 043000 1736261888.247373 write 0x22bae8 thru 0x235dc7 (0xa2e0 bytes) 045000 1736261893.774442 fallocate 0x021db2 thru 0x022af5 (0xd44 bytes) 046000 1736261896.698787 read 0x36138a thru 0x363047 (0x1cbe bytes) 047000 1736261899.556684 trunc from 0x528540 to 0x3e4e40 (0x1436ff bytes) 048000 1736261901.863711 mapread 0x1bebc7 thru 0x1cbfd3 (0xd40d bytes) 050000 1736261907.376177 trunc from 0x525420 to 0x320fa1 (0x20447e bytes) 052000 1736261912.884589 fallocate 0x3c2967 thru 0x3c2ebc (0x556 bytes) 053000 1736261915.877190 read 0x060de5 thru 0x0628d9 (0x1af5 bytes) 054000 1736261918.767801 fallocate 0x0723fd thru 0x07f0df (0xcce3 bytes) 055000 1736261921.966934 punch from 0x1a831d to 0x1afa60 (0x7744 bytes) 056000 1736261924.748529 read 0x30b02d thru 0x316b0c (0xbae0 bytes) 057000 1736261927.290045 mapwrite 0x3d5fba thru 0x3dd87c (0x78c3 bytes) 058000 1736261930.459944 write 0x0a66be thru 0x0ad682 (0x6fc5 bytes) 059000 1736261933.099814 punch from 0x0d0de3 to 0x0d8979 (0x7b97 bytes) 060000 1736261936.169094 mapwrite 0x2444be thru 0x245767 (0x12aa bytes) 062000 1736261941.357557 write 0x3f9b41 thru 0x408c47 (0xf107 bytes) 063000 1736261944.406916 write 0x011918 thru 0x01c90a (0xaff3 bytes) 064000 1736261947.036244 trunc from 0x4d0197 to 0x04b434 (0x484d62 bytes) 065000 1736261949.814124 fallocate 0x19d1e7 thru 0x1a4fc1 (0x7ddb bytes) 066000 1736261952.837333 fallocate 0x4d415f thru 0x4df6a3 (0xb545 bytes) 067000 1736261955.304237 fallocate 0x41ebec thru 0x4271de (0x85f3 bytes) 068000 1736261958.031097 mapwrite 0x02d4cc thru 0x039f01 (0xca36 bytes) 069000 1736261960.628729 mapread 0x32718b thru 0x336499 (0xf30f bytes) 070000 1736261963.340629 write 0x1f1511 thru 0x1f1bfc (0x6ec bytes) 071000 1736261965.976100 trunc from 0x33bd93 to 0x4e5927 (0x1a9b95 bytes) 072000 1736261968.509937 trunc from 0x427d22 to 0x007240 (0x420ae1 bytes) 073000 1736261971.193814 write 0x4425a4 thru 0x44b1c0 (0x8c1d bytes) 074000 1736261973.450951 punch from 0x38f6d2 to 0x39078e (0x10bd bytes) 075000 1736261975.881574 mapread 0x08537b thru 0x090a54 (0xb6da bytes) 077000 1736261980.487820 fallocate 0x4e3e7b thru 0x4ec624 (0x87aa bytes) 078000 1736261983.045447 mapwrite 0x00d7f2 thru 0x0187d6 (0xafe5 bytes) 079000 1736261985.571487 write 0x4d56f1 thru 0x4dcb30 (0x7440 bytes) 080000 1736261987.870166 mapwrite 0x124d11 thru 0x133e38 (0xf128 bytes) 082000 1736261993.074940 mapread 0x0703ca thru 0x074796 (0x43cd bytes) 084000 1736261998.019685 mapwrite 0x06bc26 thru 0x06bed5 (0x2b0 bytes) 085000 1736262000.586023 mapwrite 0x3c8893 thru 0x3d0cb6 (0x8424 bytes) 086000 1736262003.461565 read 0x15b7b9 thru 0x167512 (0xbd5a bytes) 087000 1736262005.866106 punch from 0x336abb to 0x336eb5 (0x3fb bytes) 088000 1736262007.914687 mapread 0x01c439 thru 0x029ebe (0xda86 bytes) 090000 1736262012.585197 trunc from 0x260fc8 to 0x01028e (0x250d39 bytes) 091000 1736262014.765264 write 0x2b3104 thru 0x2bb7d0 (0x86cd bytes) 092000 1736262016.857598 mapread 0x03aa20 thru 0x03b325 (0x906 bytes) 093000 1736262019.254925 fallocate 0x4e7d0e thru 0x4f07e9 (0x8adc bytes) 094000 1736262021.319922 read 0x11511c thru 0x123f61 (0xee46 bytes) 096000 1736262026.051454 fallocate 0x4dc205 thru 0x4e3445 (0x7241 bytes) 097000 1736262028.487588 fallocate 0x390a8c thru 0x39bad9 (0xb04e bytes) 098000 1736262031.009724 punch from 0x0eec3f to 0x0f2cc0 (0x4082 bytes) 099000 1736262033.193183 fallocate 0x06ac13 thru 0x06e213 (0x3601 bytes) 100000 1736262035.222908 fallocate 0x3a3e22 thru 0x3a99d9 (0x5bb8 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (276s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 10:00:36 (1736262036) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1736262039.631133 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1736262042.130639 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1736262052.546091 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1736262055.051723 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1736262057.582912 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1736262060.169940 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1736262062.853034 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1736262067.685807 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1736262070.206349 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1736262075.346636 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1736262078.194070 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1736262083.576999 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1736262085.869816 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1736262091.975920 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1736262094.496091 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1736262096.979190 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1736262099.883080 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1736262102.354074 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1736262105.009688 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1736262107.549082 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1736262110.075177 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1736262115.591115 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1736262118.386227 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1736262121.087588 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1736262123.884974 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1736262126.574212 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1736262129.107501 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1736262131.772872 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1736262134.549759 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1736262137.296940 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1736262139.829688 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1736262142.238615 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1736262146.811758 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1736262149.406317 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1736262151.854562 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1736262154.320478 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1736262161.725006 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1736262164.067686 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1736262166.334391 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1736262168.659866 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1736262170.805561 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1736262173.218192 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1736262178.726700 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1736262181.410001 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1736262184.269576 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1736262193.253666 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1736262199.224478 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1736262202.099886 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1736262204.929647 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1736262210.469464 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1736262216.097250 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1736262219.203391 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1736262222.372437 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1736262228.124744 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1736262230.892677 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1736262234.021257 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1736262236.641977 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1736262239.376166 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1736262242.130384 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1736262247.572611 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1736262253.105179 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1736262255.593296 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1736262257.979600 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1736262260.872012 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1736262265.977562 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1736262271.774098 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1736262277.579500 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1736262280.854036 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1736262284.843115 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1736262288.764358 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1736262293.893907 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1736262300.234768 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1736262303.369935 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1736262306.714380 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1736262312.236506 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (277s) == sanity-benchmark test complete, duration 925 sec ====== 10:05:13 (1736262313)