-----============= acceptance-small: sanity-benchmark ============----- Wed May 8 17:13:51 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg331-client.virtnet: executing check_config_client /mnt/lustre oleg331-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg331-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a66e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a66e000.idle_timeout=debug disable quota as required oleg331-server: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 17:14:01 (1715202841) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7459] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg331-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg331-client.virtnet at Wed May 8 17:14:02 EDT 2024 waiting for dbench pid 9598 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 264 198.78 MB/sec warmup 1 sec latency 45.808 ms 20 529 183.17 MB/sec warmup 2 sec latency 38.525 ms 20 710 141.28 MB/sec warmup 3 sec latency 557.531 ms 20 992 110.04 MB/sec warmup 4 sec latency 23.724 ms 20 1346 99.67 MB/sec warmup 5 sec latency 27.718 ms 20 1701 87.42 MB/sec warmup 6 sec latency 43.480 ms 20 2119 76.18 MB/sec warmup 7 sec latency 22.486 ms 20 2491 71.47 MB/sec warmup 8 sec latency 27.538 ms 20 3082 75.14 MB/sec warmup 9 sec latency 25.906 ms 20 3695 77.67 MB/sec warmup 10 sec latency 22.262 ms 20 3959 72.83 MB/sec warmup 11 sec latency 25.768 ms 20 4225 67.01 MB/sec warmup 12 sec latency 47.576 ms 20 4497 62.88 MB/sec warmup 13 sec latency 35.599 ms 20 4834 61.14 MB/sec warmup 14 sec latency 24.912 ms 20 5198 60.39 MB/sec warmup 15 sec latency 26.971 ms 20 5497 56.93 MB/sec warmup 16 sec latency 26.044 ms 20 5943 55.38 MB/sec warmup 17 sec latency 22.810 ms 20 6418 57.58 MB/sec warmup 18 sec latency 28.344 ms 20 7033 59.30 MB/sec warmup 19 sec latency 26.237 ms 20 7365 58.74 MB/sec warmup 20 sec latency 143.493 ms 20 7599 56.40 MB/sec warmup 21 sec latency 297.768 ms 20 7818 54.17 MB/sec warmup 22 sec latency 1297.896 ms 20 8137 53.60 MB/sec warmup 23 sec latency 2004.161 ms 20 8742 21.91 MB/sec execute 1 sec latency 1822.764 ms 20 9089 41.23 MB/sec execute 2 sec latency 917.231 ms 20 9536 50.39 MB/sec execute 3 sec latency 1917.336 ms 20 9804 42.56 MB/sec execute 4 sec latency 2917.503 ms 20 10070 35.46 MB/sec execute 5 sec latency 3917.649 ms 20 10332 32.86 MB/sec execute 6 sec latency 4917.750 ms 20 10637 34.63 MB/sec execute 7 sec latency 5917.843 ms 20 10962 33.89 MB/sec execute 8 sec latency 6392.863 ms 20 11306 33.39 MB/sec execute 9 sec latency 436.192 ms 20 11654 35.81 MB/sec execute 10 sec latency 1095.715 ms 20 12083 38.57 MB/sec execute 11 sec latency 1129.585 ms 20 12338 38.18 MB/sec execute 12 sec latency 1424.348 ms 20 12543 35.74 MB/sec execute 13 sec latency 2424.433 ms 20 12739 33.96 MB/sec execute 14 sec latency 3424.533 ms 20 12973 33.48 MB/sec execute 15 sec latency 4424.597 ms 20 13227 32.85 MB/sec execute 16 sec latency 5424.707 ms 20 13505 31.91 MB/sec execute 17 sec latency 6424.786 ms 20 13797 32.40 MB/sec execute 18 sec latency 7424.870 ms 20 14155 33.57 MB/sec execute 19 sec latency 8424.966 ms 20 14382 33.33 MB/sec execute 20 sec latency 9425.058 ms 20 14590 32.01 MB/sec execute 21 sec latency 10425.239 ms 20 14803 31.26 MB/sec execute 22 sec latency 11425.522 ms 20 15050 31.48 MB/sec execute 23 sec latency 12425.684 ms 20 15288 30.67 MB/sec execute 24 sec latency 13425.808 ms 20 15604 30.27 MB/sec execute 25 sec latency 14426.248 ms 20 15930 31.25 MB/sec execute 26 sec latency 15426.377 ms 20 16353 32.57 MB/sec execute 27 sec latency 16426.457 ms 20 16585 32.35 MB/sec execute 28 sec latency 17426.546 ms 20 16815 31.52 MB/sec execute 29 sec latency 18426.750 ms 20 17059 31.26 MB/sec execute 30 sec latency 19426.849 ms 20 17313 31.31 MB/sec execute 31 sec latency 20427.188 ms 20 17540 30.59 MB/sec execute 32 sec latency 21427.391 ms 20 17817 30.29 MB/sec execute 33 sec latency 22427.584 ms 20 18257 31.51 MB/sec execute 34 sec latency 23427.777 ms 20 18609 32.07 MB/sec execute 35 sec latency 24427.949 ms 20 18866 31.53 MB/sec execute 36 sec latency 25428.066 ms 20 19162 31.37 MB/sec execute 37 sec latency 26428.140 ms 20 19471 31.22 MB/sec execute 38 sec latency 27428.217 ms 20 19805 31.05 MB/sec execute 39 sec latency 28428.313 ms 20 20246 31.98 MB/sec execute 40 sec latency 29428.375 ms 20 20679 32.92 MB/sec execute 41 sec latency 30428.449 ms 20 20930 32.41 MB/sec execute 42 sec latency 31428.535 ms 20 21207 32.20 MB/sec execute 43 sec latency 32428.644 ms 20 21500 32.24 MB/sec execute 44 sec latency 33428.719 ms 20 21839 31.84 MB/sec execute 45 sec latency 34428.830 ms 20 22218 32.44 MB/sec execute 46 sec latency 35428.990 ms 20 22664 33.18 MB/sec execute 47 sec latency 36429.108 ms 20 22918 32.93 MB/sec execute 48 sec latency 37429.198 ms 20 23176 32.59 MB/sec execute 49 sec latency 38429.274 ms 20 23485 32.80 MB/sec execute 50 sec latency 39429.375 ms 20 23749 32.32 MB/sec execute 51 sec latency 40429.482 ms 20 24042 32.10 MB/sec execute 52 sec latency 41429.754 ms 20 24457 32.73 MB/sec execute 53 sec latency 42429.884 ms 20 24758 32.98 MB/sec execute 54 sec latency 43429.962 ms 20 24972 32.57 MB/sec execute 55 sec latency 44430.084 ms 20 25222 32.37 MB/sec execute 56 sec latency 45430.574 ms 20 25530 32.59 MB/sec execute 57 sec latency 46430.682 ms 20 25751 32.22 MB/sec execute 58 sec latency 47430.897 ms 20 26011 31.91 MB/sec execute 59 sec latency 48430.971 ms 20 26317 32.20 MB/sec execute 60 sec latency 49431.066 ms 20 26738 32.69 MB/sec execute 61 sec latency 50431.167 ms 20 26962 32.55 MB/sec execute 62 sec latency 51431.290 ms 20 27211 32.29 MB/sec execute 63 sec latency 52431.382 ms 20 27469 32.20 MB/sec execute 64 sec latency 53431.477 ms 20 27761 32.20 MB/sec execute 65 sec latency 54431.633 ms 20 28080 31.92 MB/sec execute 66 sec latency 55431.848 ms 20 28469 32.40 MB/sec execute 67 sec latency 56431.919 ms 20 28888 32.85 MB/sec execute 68 sec latency 57431.986 ms 20 29121 32.53 MB/sec execute 69 sec latency 58432.099 ms 20 29412 32.30 MB/sec execute 70 sec latency 59432.193 ms 20 29750 32.47 MB/sec execute 71 sec latency 60432.290 ms 20 30076 32.20 MB/sec execute 72 sec latency 61432.409 ms 20 30470 32.59 MB/sec execute 73 sec latency 62432.498 ms 20 30939 33.12 MB/sec execute 74 sec latency 63432.872 ms 20 31167 32.91 MB/sec execute 75 sec latency 64432.937 ms 20 31444 32.70 MB/sec execute 76 sec latency 65433.004 ms 20 31752 32.82 MB/sec execute 77 sec latency 66433.095 ms 20 32044 32.60 MB/sec execute 78 sec latency 67433.249 ms 20 32383 32.59 MB/sec execute 79 sec latency 68433.650 ms 20 32802 32.99 MB/sec execute 80 sec latency 69433.745 ms 20 33114 33.18 MB/sec execute 81 sec latency 70434.062 ms 20 33377 32.95 MB/sec execute 82 sec latency 71434.150 ms 20 33643 32.77 MB/sec execute 83 sec latency 72434.224 ms 20 33951 32.82 MB/sec execute 84 sec latency 73434.340 ms 20 34319 32.68 MB/sec execute 85 sec latency 74434.429 ms 20 34769 33.13 MB/sec execute 86 sec latency 75434.585 ms 20 35191 33.45 MB/sec execute 87 sec latency 76434.921 ms 20 35423 33.29 MB/sec execute 88 sec latency 77434.993 ms 20 35694 33.15 MB/sec execute 89 sec latency 78435.120 ms 20 36006 33.23 MB/sec execute 90 sec latency 79435.455 ms 20 36311 32.97 MB/sec execute 91 sec latency 80435.582 ms 20 36667 33.05 MB/sec execute 92 sec latency 81435.782 ms 20 37129 33.51 MB/sec execute 93 sec latency 82435.884 ms 20 37367 33.36 MB/sec execute 94 sec latency 83435.986 ms 20 37603 33.13 MB/sec execute 95 sec latency 84436.102 ms 20 37898 33.16 MB/sec execute 96 sec latency 85436.353 ms 20 38186 33.10 MB/sec execute 97 sec latency 86436.463 ms 20 38514 32.97 MB/sec execute 98 sec latency 87436.539 ms 20 38901 33.23 MB/sec execute 99 sec latency 88436.699 ms 20 39313 33.53 MB/sec execute 100 sec latency 89436.792 ms 20 39538 33.29 MB/sec execute 101 sec latency 90437.008 ms 20 39812 33.18 MB/sec execute 102 sec latency 91437.111 ms 20 40162 33.32 MB/sec execute 103 sec latency 92437.195 ms 20 40481 33.13 MB/sec execute 104 sec latency 93437.289 ms 20 40862 33.30 MB/sec execute 105 sec latency 94437.354 ms 20 41360 33.76 MB/sec execute 106 sec latency 95437.452 ms 20 41636 33.66 MB/sec execute 107 sec latency 96437.557 ms 20 41906 33.50 MB/sec execute 108 sec latency 97437.739 ms 20 42206 33.56 MB/sec execute 109 sec latency 98437.827 ms 20 42466 33.31 MB/sec execute 110 sec latency 99437.909 ms 20 42794 33.29 MB/sec execute 111 sec latency 100437.991 ms 20 43295 33.75 MB/sec execute 112 sec latency 101438.075 ms 20 43634 33.72 MB/sec execute 113 sec latency 102438.162 ms 20 43972 33.61 MB/sec execute 114 sec latency 103438.252 ms 20 44327 33.69 MB/sec execute 115 sec latency 104438.375 ms 20 44739 33.61 MB/sec execute 116 sec latency 105438.508 ms 20 45235 33.98 MB/sec execute 117 sec latency 106438.593 ms 20 45629 34.20 MB/sec execute 118 sec latency 107438.867 ms 20 45919 34.02 MB/sec execute 119 sec latency 108439.050 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 130683 9.048 108378.262 Close 96171 6.910 109915.892 Rename 5576 11.469 5784.285 Unlink 26319 3.991 3881.839 Qpathinfo 118821 1.458 44.838 Qfileinfo 20709 0.056 3.444 Qfsinfo 21775 0.026 3.910 Sfileinfo 10745 6.493 2774.833 Find 45892 0.312 44.232 WriteX 64769 0.904 16.982 ReadX 205501 0.011 3.444 LockX 426 3.275 360.482 UnlockX 426 3.147 58.871 Flush 9140 6.644 58.202 Throughput 34.0233 MB/sec 20 clients 20 procs max_latency=108439.050 ms stopping dbench on /mnt/lustre/d0.oleg331-client.virtnet at Wed May 8 17:16:27 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg331-client.virtnet /mnt/lustre/d0.oleg331-client.virtnet /mnt/lustre/d0.oleg331-client.virtnet removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg331-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) == sanity-benchmark test bonnie: bonnie++ ================ 17:16:29 (1715202989) min OST has 3551116kB available, using 5326674kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7459] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5201] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg331-clien 5201M 150003 98 115933 87 213499 43 1648 190 Latency 9912us 72649us 91928us 13368us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg331-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 446 18 4150 17 738 14 350 18 300 16 537 15 Latency 17744us 7116us 97124us 18475us 15741us 47982us 1.97,1.97,oleg331-client.virtnet,1,1715192266,5201M,,,,150003,98,115933,87,,,213499,43,1648,190,10,,,,,446,18,4150,17,738,14,350,18,300,16,537,15,,9912us,72649us,,91928us,13368us,17744us,7116us,97124us,18475us,15741us,47982us debug=0x33f0484 PASS bonnie (238s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 17:20:28 (1715203228) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 14809 -P /tmp -l 5401776 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 14809 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read fallocating to largest ever: 0x9eeee fallocating to largest ever: 0x3e3539 truncating to largest ever: 0x47119a truncating to largest ever: 0x49a54d truncating to largest ever: 0x4e877c truncating to largest ever: 0x4f9f34 fallocating to largest ever: 0x526cb0 001000 1715203232.655768 fallocate 0x3c9bfd thru 0x3cf33a (0x573e bytes) 003000 1715203239.468155 mapwrite 0x354d30 thru 0x355020 (0x2f1 bytes) 004000 1715203242.921658 mapwrite 0x01cd20 thru 0x025498 (0x8779 bytes) 005000 1715203245.549104 fallocate 0x3a89d3 thru 0x3aca4a (0x4078 bytes) 006000 1715203248.393047 mapwrite 0x3a305e thru 0x3af436 (0xc3d9 bytes) 007000 1715203251.575117 mapread 0x3f5c9e thru 0x3ffe2a (0xa18d bytes) 008000 1715203254.626057 fallocate 0x1c19e8 thru 0x1c8395 (0x69ae bytes) 010000 1715203260.580522 write 0x02dd67 thru 0x03aa1a (0xccb4 bytes) 011000 1715203263.156308 punch from 0x084413 to 0x08e3e7 (0x9fd5 bytes) 012000 1715203265.800309 write 0x3e3378 thru 0x3ee974 (0xb5fd bytes) 013000 1715203268.575697 punch from 0x0b1808 to 0x0b38a0 (0x2099 bytes) 014000 1715203271.848156 mapwrite 0x47738e thru 0x4781aa (0xe1d bytes) 015000 1715203275.244779 mapwrite 0x17a55e thru 0x18956f (0xf012 bytes) 016000 1715203278.455843 write 0x4e7a74 thru 0x4f7672 (0xfbff bytes) 017000 1715203281.261629 punch from 0x0e1373 to 0x0ee592 (0xd220 bytes) 018000 1715203284.316320 trunc from 0x49734e to 0x0eed46 (0x3a8607 bytes) 020000 1715203291.623559 read 0x1a42d8 thru 0x1b2ad1 (0xe7fa bytes) 021000 1715203294.557076 trunc from 0x52311e to 0x0aed82 (0x47439b bytes) 022000 1715203297.547222 mapwrite 0x491fed thru 0x49a9c2 (0x89d6 bytes) 023000 1715203300.544587 trunc from 0x1e3032 to 0x001185 (0x1e1eac bytes) 024000 1715203304.294085 write 0x383bf1 thru 0x39027b (0xc68b bytes) 025000 1715203308.169025 punch from 0x408637 to 0x4110b2 (0x8a7c bytes) 026000 1715203311.118901 fallocate 0x1f1209 thru 0x1fc420 (0xb218 bytes) 027000 1715203314.174120 read 0x0caf5e thru 0x0d0424 (0x54c7 bytes) 028000 1715203317.020237 trunc from 0x449872 to 0x37d2a0 (0xcc5d1 bytes) 031000 1715203325.097093 mapwrite 0x51a3c7 thru 0x524af9 (0xa733 bytes) 033000 1715203330.013855 fallocate 0x20d1ad thru 0x219ee3 (0xcd37 bytes) 035000 1715203335.800717 punch from 0x07f79c to 0x08b2b8 (0xbb1d bytes) 036000 1715203338.786009 write 0x185cce thru 0x18ce8f (0x71c2 bytes) 037000 1715203342.206119 trunc from 0x4cdf0a to 0x4206e1 (0xad828 bytes) 040000 1715203351.290965 write 0x289bc1 thru 0x28cdcd (0x320d bytes) 041000 1715203354.261902 punch from 0x40d5db to 0x4127ab (0x51d1 bytes) 042000 1715203357.522058 mapread 0x21df68 thru 0x2239b7 (0x5a50 bytes) 044000 1715203363.215814 mapwrite 0x2bcb7e thru 0x2c700a (0xa48d bytes) 045000 1715203365.999183 write 0x04aa46 thru 0x04e06e (0x3629 bytes) 046000 1715203368.775265 mapread 0x1515c2 thru 0x15d9f8 (0xc437 bytes) 047000 1715203372.123741 write 0x184f4d thru 0x18af6b (0x601f bytes) 049000 1715203378.534474 trunc from 0x2d2dfd to 0x51b003 (0x248207 bytes) 050000 1715203381.822928 mapwrite 0x3a56f1 thru 0x3aae75 (0x5785 bytes) 053000 1715203391.736007 punch from 0x07f451 to 0x08a9a5 (0xb555 bytes) 054000 1715203395.194180 trunc from 0x4f34da to 0x454049 (0x9f490 bytes) 055000 1715203398.396793 punch from 0x13ae2c to 0x143b9f (0x8d74 bytes) 056000 1715203401.436400 write 0x3eebe1 thru 0x3efe19 (0x1239 bytes) 057000 1715203404.490630 write 0x443c5f thru 0x44e83c (0xabde bytes) 058000 1715203407.257589 read 0x1c6c46 thru 0x1cb359 (0x4714 bytes) 059000 1715203409.904443 mapread 0x43d428 thru 0x4403a5 (0x2f7e bytes) 060000 1715203412.626711 mapread 0x0f0389 thru 0x0fc376 (0xbfee bytes) 063000 1715203420.426614 punch from 0x38f1f9 to 0x38f220 (0x28 bytes) 064000 1715203422.922245 punch from 0x1f008e to 0x1ff57b (0xf4ee bytes) 065000 1715203425.376940 read 0x407a49 thru 0x411958 (0x9f10 bytes) 066000 1715203428.344988 mapread 0x0ee3c6 thru 0x0f1f1f (0x3b5a bytes) skipping zero size write 067000 1715203431.153493 read 0x233ded thru 0x2351b1 (0x13c5 bytes) 069000 1715203436.523399 trunc from 0x33509f to 0x0c2427 (0x272c77 bytes) 070000 1715203439.542006 read 0x091152 thru 0x09601a (0x4ec9 bytes) 071000 1715203442.559483 punch from 0x15e479 to 0x16a12c (0xbcb4 bytes) 072000 1715203445.119670 mapread 0x16bdc5 thru 0x177af4 (0xbd30 bytes) 073000 1715203447.824524 punch from 0x0044e6 to 0x00692e (0x2449 bytes) 074000 1715203450.959282 read 0x02bdea thru 0x02d325 (0x153c bytes) 075000 1715203453.592260 read 0x2e54d5 thru 0x2e5a83 (0x5af bytes) 077000 1715203458.902486 write 0x3c63f3 thru 0x3d4d54 (0xe962 bytes) 078000 1715203461.414783 mapwrite 0x47c1ac thru 0x4809b3 (0x4808 bytes) 079000 1715203463.985623 mapread 0x1e68a8 thru 0x1ee793 (0x7eec bytes) 081000 1715203468.858458 read 0x26c612 thru 0x27a12c (0xdb1b bytes) 083000 1715203474.576834 read 0x021db1 thru 0x0231ce (0x141e bytes) 084000 1715203477.570342 mapwrite 0x37ce58 thru 0x38200d (0x51b6 bytes) 085000 1715203480.834554 punch from 0x0dab57 to 0x0df847 (0x4cf1 bytes) 087000 1715203485.767643 trunc from 0x5268d1 to 0x324992 (0x201f3e bytes) 088000 1715203488.064191 mapwrite 0x2dc3f3 thru 0x2dc6f2 (0x300 bytes) 089000 1715203490.647729 fallocate 0x029a48 thru 0x02f23a (0x57f3 bytes) 091000 1715203495.458446 mapwrite 0x49ebc2 thru 0x4a8880 (0x9cbf bytes) 092000 1715203497.701898 write 0x50a53f thru 0x515e06 (0xb8c8 bytes) 093000 1715203500.915101 mapread 0x18ce44 thru 0x18f997 (0x2b54 bytes) 094000 1715203503.863158 write 0x50f487 thru 0x510e7d (0x19f7 bytes) 097000 1715203511.699586 write 0x2bf602 thru 0x2cbae6 (0xc4e5 bytes) 098000 1715203514.525046 punch from 0x3272ed to 0x3346f1 (0xd405 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (292s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:25:20 (1715203520) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1715203523.423552 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1715203526.140299 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1715203536.572648 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1715203539.279751 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1715203542.124814 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1715203544.643149 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1715203547.663136 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1715203553.190681 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1715203556.059906 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1715203561.785358 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1715203564.984626 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1715203571.190145 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1715203573.651934 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1715203579.524282 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1715203582.144308 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1715203584.661048 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1715203587.609577 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1715203590.182363 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1715203593.333047 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1715203596.588281 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1715203599.643794 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1715203606.412210 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1715203609.724715 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1715203613.020374 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1715203616.197319 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1715203619.296127 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1715203622.053132 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1715203625.384883 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1715203628.170927 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1715203631.377918 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1715203634.160294 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1715203636.724873 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1715203641.860629 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1715203644.501854 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1715203647.279195 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1715203649.873231 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1715203658.384747 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1715203661.246959 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1715203664.209733 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1715203667.051290 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1715203669.634207 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1715203672.114463 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1715203677.769255 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1715203680.477881 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1715203683.320714 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1715203692.673212 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1715203698.611859 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1715203701.327893 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1715203703.826255 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1715203709.163283 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1715203714.625747 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1715203717.431972 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1715203720.159233 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1715203725.603994 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1715203728.060715 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1715203730.727171 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1715203733.041522 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1715203735.610012 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1715203738.359576 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1715203744.278026 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1715203749.814521 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1715203752.234831 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1715203754.777490 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1715203757.656150 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1715203762.726236 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1715203768.097223 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1715203773.161221 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1715203775.840126 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1715203778.591389 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1715203781.309008 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1715203783.865804 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1715203789.215025 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1715203791.930891 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1715203794.852386 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1715203800.810956 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (281s) == sanity-benchmark test complete, duration 970 sec ====== 17:30:01 (1715203801)