-----============= acceptance-small: sanity-benchmark ============----- Thu Apr 4 20:05:26 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 20:05:28 (1712275528) === oleg434-client.virtnet: executing check_config_client /mnt/lustre oleg434-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg434-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5c3b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c3b800.idle_timeout=debug disable quota as required oleg434-server: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 20:05:35 (1712275535) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 20:05:36 (1712275536) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6741] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg434-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg434-client.virtnet at Thu Apr 4 20:05:37 EDT 2024 waiting for dbench pid 8668 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 187 150.12 MB/sec warmup 1 sec latency 88.101 ms 20 411 145.21 MB/sec warmup 2 sec latency 55.390 ms 20 665 140.98 MB/sec warmup 3 sec latency 385.994 ms 20 804 107.37 MB/sec warmup 4 sec latency 153.547 ms 20 980 87.90 MB/sec warmup 5 sec latency 123.042 ms 20 1242 77.88 MB/sec warmup 6 sec latency 124.316 ms 20 1544 74.55 MB/sec warmup 7 sec latency 201.128 ms 20 1817 65.80 MB/sec warmup 8 sec latency 94.443 ms 20 2118 59.26 MB/sec warmup 9 sec latency 106.396 ms 20 2398 55.98 MB/sec warmup 10 sec latency 133.902 ms 20 2734 56.78 MB/sec warmup 11 sec latency 151.424 ms 20 3202 57.36 MB/sec warmup 12 sec latency 134.776 ms 20 3616 59.30 MB/sec warmup 13 sec latency 126.580 ms 20 3852 56.86 MB/sec warmup 14 sec latency 27.597 ms 20 4029 53.41 MB/sec warmup 15 sec latency 27.408 ms 20 4220 50.25 MB/sec warmup 16 sec latency 403.855 ms 20 4337 47.64 MB/sec warmup 17 sec latency 209.805 ms 20 4503 45.49 MB/sec warmup 18 sec latency 93.934 ms 20 4764 44.67 MB/sec warmup 19 sec latency 104.629 ms 20 5060 45.17 MB/sec warmup 20 sec latency 113.482 ms 20 5249 43.18 MB/sec warmup 21 sec latency 90.895 ms 20 5447 41.37 MB/sec warmup 22 sec latency 64.749 ms 20 5741 39.95 MB/sec warmup 23 sec latency 80.718 ms 20 6367 78.04 MB/sec execute 1 sec latency 119.877 ms 20 6855 71.40 MB/sec execute 2 sec latency 131.139 ms 20 7244 71.91 MB/sec execute 3 sec latency 92.921 ms 20 7487 59.04 MB/sec execute 4 sec latency 23.648 ms 20 7681 47.74 MB/sec execute 5 sec latency 150.712 ms 20 7877 40.98 MB/sec execute 6 sec latency 105.914 ms 20 8061 36.69 MB/sec execute 7 sec latency 86.941 ms 20 8351 36.76 MB/sec execute 8 sec latency 134.299 ms 20 8665 37.82 MB/sec execute 9 sec latency 63.624 ms 20 8905 34.46 MB/sec execute 10 sec latency 113.712 ms 20 9201 32.08 MB/sec execute 11 sec latency 46.420 ms 20 9534 32.33 MB/sec execute 12 sec latency 97.471 ms 20 9912 34.73 MB/sec execute 13 sec latency 126.996 ms 20 10358 37.44 MB/sec execute 14 sec latency 128.372 ms 20 10728 39.29 MB/sec execute 15 sec latency 101.477 ms 20 10954 38.45 MB/sec execute 16 sec latency 28.489 ms 20 11135 36.47 MB/sec execute 17 sec latency 203.429 ms 20 11340 34.69 MB/sec execute 18 sec latency 174.905 ms 20 11503 33.31 MB/sec execute 19 sec latency 123.759 ms 20 11741 32.77 MB/sec execute 20 sec latency 82.853 ms 20 12092 33.94 MB/sec execute 21 sec latency 92.558 ms 20 12348 32.96 MB/sec execute 22 sec latency 61.500 ms 20 12607 31.74 MB/sec execute 23 sec latency 65.784 ms 20 12885 30.99 MB/sec execute 24 sec latency 85.026 ms 20 13163 31.22 MB/sec execute 25 sec latency 88.935 ms 20 13549 32.78 MB/sec execute 26 sec latency 135.979 ms 20 13930 33.79 MB/sec execute 27 sec latency 123.492 ms 20 14271 34.75 MB/sec execute 28 sec latency 130.088 ms 20 14497 34.37 MB/sec execute 29 sec latency 29.829 ms 20 14677 33.42 MB/sec execute 30 sec latency 145.199 ms 20 14850 32.44 MB/sec execute 31 sec latency 136.701 ms 20 15004 31.63 MB/sec execute 32 sec latency 133.300 ms 20 15187 31.09 MB/sec execute 33 sec latency 159.311 ms 20 15449 31.24 MB/sec execute 34 sec latency 103.596 ms 20 15747 31.50 MB/sec execute 35 sec latency 77.080 ms 20 15991 30.82 MB/sec execute 36 sec latency 58.777 ms 20 16271 30.22 MB/sec execute 37 sec latency 60.857 ms 20 16565 30.10 MB/sec execute 38 sec latency 77.371 ms 20 16903 30.78 MB/sec execute 39 sec latency 128.838 ms 20 17313 31.75 MB/sec execute 40 sec latency 185.622 ms 20 17696 32.43 MB/sec execute 41 sec latency 127.418 ms 20 17991 32.68 MB/sec execute 42 sec latency 52.002 ms 20 18192 32.20 MB/sec execute 43 sec latency 162.307 ms 20 18364 31.53 MB/sec execute 44 sec latency 190.872 ms 20 18531 30.97 MB/sec execute 45 sec latency 162.570 ms 20 18722 30.57 MB/sec execute 46 sec latency 104.570 ms 20 18994 30.63 MB/sec execute 47 sec latency 107.747 ms 20 19280 30.92 MB/sec execute 48 sec latency 89.466 ms 20 19488 30.42 MB/sec execute 49 sec latency 77.068 ms 20 19728 29.90 MB/sec execute 50 sec latency 59.678 ms 20 19976 29.54 MB/sec execute 51 sec latency 60.134 ms 20 20237 29.59 MB/sec execute 52 sec latency 113.244 ms 20 20568 30.14 MB/sec execute 53 sec latency 126.053 ms 20 20986 30.79 MB/sec execute 54 sec latency 149.844 ms 20 21363 31.54 MB/sec execute 55 sec latency 99.596 ms 20 21608 31.46 MB/sec execute 56 sec latency 25.440 ms 20 21796 31.02 MB/sec execute 57 sec latency 140.015 ms 20 21992 30.54 MB/sec execute 58 sec latency 199.519 ms 20 22148 30.15 MB/sec execute 59 sec latency 210.857 ms 20 22366 29.93 MB/sec execute 60 sec latency 97.659 ms 20 22698 30.18 MB/sec execute 61 sec latency 77.347 ms 20 22982 30.20 MB/sec execute 62 sec latency 63.418 ms 20 23234 29.80 MB/sec execute 63 sec latency 96.968 ms 20 23554 29.55 MB/sec execute 64 sec latency 65.841 ms 20 23860 29.75 MB/sec execute 65 sec latency 101.746 ms 20 24297 30.56 MB/sec execute 66 sec latency 142.477 ms 20 24727 30.95 MB/sec execute 67 sec latency 153.709 ms 20 25065 31.38 MB/sec execute 68 sec latency 103.849 ms 20 25283 31.14 MB/sec execute 69 sec latency 167.048 ms 20 25467 30.75 MB/sec execute 70 sec latency 222.201 ms 20 25646 30.41 MB/sec execute 71 sec latency 256.780 ms 20 25843 30.18 MB/sec execute 72 sec latency 121.937 ms 20 26144 30.25 MB/sec execute 73 sec latency 97.611 ms 20 26454 30.46 MB/sec execute 74 sec latency 71.276 ms 20 26690 30.11 MB/sec execute 75 sec latency 82.810 ms 20 26957 29.81 MB/sec execute 76 sec latency 65.934 ms 20 27288 29.82 MB/sec execute 77 sec latency 85.909 ms 20 27592 30.09 MB/sec execute 78 sec latency 130.784 ms 20 28005 30.64 MB/sec execute 79 sec latency 126.450 ms 20 28416 31.11 MB/sec execute 80 sec latency 114.560 ms 20 28689 31.18 MB/sec execute 81 sec latency 27.233 ms 20 28867 30.89 MB/sec execute 82 sec latency 181.482 ms 20 29041 30.55 MB/sec execute 83 sec latency 142.892 ms 20 29209 30.27 MB/sec execute 84 sec latency 193.843 ms 20 29405 30.10 MB/sec execute 85 sec latency 133.063 ms 20 29705 30.18 MB/sec execute 86 sec latency 103.945 ms 20 30019 30.30 MB/sec execute 87 sec latency 87.483 ms 20 30271 30.02 MB/sec execute 88 sec latency 69.902 ms 20 30567 29.80 MB/sec execute 89 sec latency 59.433 ms 20 30877 29.85 MB/sec execute 90 sec latency 114.719 ms 20 31189 30.08 MB/sec execute 91 sec latency 149.339 ms 20 31577 30.49 MB/sec execute 92 sec latency 134.431 ms 20 31985 30.87 MB/sec execute 93 sec latency 121.741 ms 20 32246 30.92 MB/sec execute 94 sec latency 27.084 ms 20 32423 30.69 MB/sec execute 95 sec latency 195.892 ms 20 32616 30.40 MB/sec execute 96 sec latency 154.722 ms 20 32760 30.16 MB/sec execute 97 sec latency 140.659 ms 20 32938 29.97 MB/sec execute 98 sec latency 149.872 ms 20 33181 29.98 MB/sec execute 99 sec latency 113.683 ms 20 33469 30.16 MB/sec execute 100 sec latency 143.646 ms 20 33667 29.91 MB/sec execute 101 sec latency 111.250 ms 20 33876 29.66 MB/sec execute 102 sec latency 90.498 ms 20 34141 29.51 MB/sec execute 103 sec latency 61.902 ms 20 34442 29.54 MB/sec execute 104 sec latency 107.749 ms 20 34756 29.74 MB/sec execute 105 sec latency 158.259 ms 20 35157 30.10 MB/sec execute 106 sec latency 132.593 ms 20 35515 30.34 MB/sec execute 107 sec latency 101.665 ms 20 35772 30.42 MB/sec execute 108 sec latency 157.724 ms 20 35945 30.26 MB/sec execute 109 sec latency 123.246 ms 20 36112 30.00 MB/sec execute 110 sec latency 157.542 ms 20 36288 29.79 MB/sec execute 111 sec latency 175.390 ms 20 36453 29.63 MB/sec execute 112 sec latency 163.303 ms 20 36697 29.59 MB/sec execute 113 sec latency 139.203 ms 20 37014 29.73 MB/sec execute 114 sec latency 129.433 ms 20 37282 29.61 MB/sec execute 115 sec latency 75.420 ms 20 37569 29.47 MB/sec execute 116 sec latency 47.921 ms 20 37908 29.43 MB/sec execute 117 sec latency 81.035 ms 20 38232 29.65 MB/sec execute 118 sec latency 153.398 ms 20 38648 29.98 MB/sec execute 119 sec latency 160.224 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 112853 10.684 52.699 Close 82845 2.484 19.902 Rename 4866 14.016 48.199 Unlink 22792 4.306 36.065 Qpathinfo 102289 2.466 32.363 Qfileinfo 18117 0.075 9.878 Qfsinfo 19141 0.074 4.507 Sfileinfo 9144 6.680 23.338 Find 40121 0.584 30.784 WriteX 56315 0.825 28.478 ReadX 182976 0.012 5.286 LockX 400 2.961 8.422 UnlockX 400 2.958 8.607 Flush 7938 53.873 256.774 Throughput 29.9838 MB/sec 20 clients 20 procs max_latency=256.780 ms stopping dbench on /mnt/lustre/d0.oleg434-client.virtnet at Thu Apr 4 20:08:01 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg434-client.virtnet /mnt/lustre/d0.oleg434-client.virtnet /mnt/lustre/d0.oleg434-client.virtnet removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg434-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 20:08:05 (1712275685) min OST has 3059712kB available, using 4589568kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6741] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4482] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg434-clien 4482M 159361 99 152290 95 390460 80 2373 121 Latency 14838us 23401us 29743us 353ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg434-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 312 29 3216 51 347 36 352 26 650 40 311 36 Latency 14375us 14071us 65873us 13923us 5000us 21385us 1.97,1.97,oleg434-client.virtnet,1,1712285325,4482M,,,,159361,99,152290,95,,,390460,80,2373,121,10,,,,,312,29,3216,51,347,36,352,26,650,40,311,36,,14838us,23401us,,29743us,353ms,14375us,14071us,65873us,13923us,5000us,21385us debug=0x33f0484 PASS bonnie (223s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 20:11:50 (1712275910) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 817 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 817 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0xe3a25 truncating to largest ever: 0x303785 truncating to largest ever: 0x4e0d20 truncating to largest ever: 0x5409de truncating to largest ever: 0x545dcd truncating to largest ever: 0x54f8a7 truncating to largest ever: 0x5518e7 truncating to largest ever: 0x56205e 002000 1712275916.707104 write 0x3322ff thru 0x3356e9 (0x33eb bytes) 007000 1712275929.632389 mapwrite 0x2f4187 thru 0x2f9bac (0x5a26 bytes) 008000 1712275932.365601 trunc from 0x53005e to 0x242972 (0x2ed6eb bytes) 009000 1712275935.460217 read 0x341848 thru 0x34a092 (0x884b bytes) 010000 1712275938.220584 mapwrite 0x2e67b5 thru 0x2ec550 (0x5d9c bytes) 013000 1712275947.709314 read 0x2dbf2c thru 0x2e82aa (0xc37f bytes) 014000 1712275950.387628 mapwrite 0x53b1c8 thru 0x5408a6 (0x56df bytes) 015000 1712275953.758020 read 0x04e095 thru 0x059761 (0xb6cd bytes) 016000 1712275957.161205 read 0x0f0f09 thru 0x0f3875 (0x296d bytes) 019000 1712275966.618808 write 0x053b4a thru 0x056895 (0x2d4c bytes) 020000 1712275969.711287 write 0x2dc0de thru 0x2df713 (0x3636 bytes) 021000 1712275972.809656 trunc from 0x33a7b1 to 0x4e141a (0x1a6c6a bytes) 022000 1712275975.462561 read 0x078f9a thru 0x07ae99 (0x1f00 bytes) 023000 1712275978.116764 trunc from 0x52cce5 to 0x3df426 (0x14d8be bytes) 024000 1712275980.756443 read 0x23ceb2 thru 0x24586b (0x89ba bytes) 027000 1712275989.327315 write 0x48284b thru 0x48cf94 (0xa74a bytes) 028000 1712275991.909637 mapread 0x2cb2ed thru 0x2d113c (0x5e50 bytes) 030000 1712275997.387755 mapwrite 0x445d6a thru 0x4548fa (0xeb91 bytes) 032000 1712276003.255347 write 0x4b6e38 thru 0x4c3c91 (0xce5a bytes) 034000 1712276009.109279 read 0x2ab563 thru 0x2b99cb (0xe469 bytes) 035000 1712276012.027873 mapread 0x2afca7 thru 0x2b0e08 (0x1162 bytes) 038000 1712276021.103283 mapwrite 0x554d8a thru 0x562dff (0xe076 bytes) 041000 1712276029.344001 mapread 0x2c580a thru 0x2c85b6 (0x2dad bytes) 044000 1712276038.297253 mapwrite 0x19d6e0 thru 0x1abab4 (0xe3d5 bytes) truncating to largest ever: 0x5627f2 045000 1712276041.583802 trunc from 0x49d27f to 0x3aea62 (0xee81c bytes) 046000 1712276044.383846 trunc from 0x316389 to 0x1b5e61 (0x160527 bytes) 047000 1712276046.939885 read 0x007d09 thru 0x00e7c0 (0x6ab8 bytes) 049000 1712276052.180093 read 0x215f57 thru 0x217e80 (0x1f2a bytes) 051000 1712276058.443489 read 0x13cb7c thru 0x13d888 (0xd0d bytes) 053000 1712276064.285151 mapwrite 0x489b16 thru 0x49623b (0xc726 bytes) 054000 1712276066.982957 mapwrite 0x3088dd thru 0x3143ac (0xbad0 bytes) 055000 1712276069.927584 write 0x11bb66 thru 0x11ef15 (0x33b0 bytes) 057000 1712276076.069282 write 0x4faaba thru 0x5063ac (0xb8f3 bytes) 059000 1712276082.185700 write 0x0bec52 thru 0x0ce20e (0xf5bd bytes) 061000 1712276087.932966 read 0x08e7b3 thru 0x093b95 (0x53e3 bytes) 062000 1712276090.641145 mapread 0x4418aa thru 0x446a0c (0x5163 bytes) 065000 1712276099.116875 read 0x00833d thru 0x017809 (0xf4cd bytes) 066000 1712276102.013747 mapwrite 0x0e85bd thru 0x0ed190 (0x4bd4 bytes) 067000 1712276105.295053 trunc from 0x4582c6 to 0x4b972a (0x61465 bytes) 072000 1712276119.255967 mapwrite 0x083f83 thru 0x093900 (0xf97e bytes) truncating to largest ever: 0x562ba1 074000 1712276124.606571 read 0x160625 thru 0x16dbf8 (0xd5d4 bytes) 075000 1712276127.255529 trunc from 0x349de7 to 0x1513e7 (0x1f89ff bytes) 077000 1712276132.787837 read 0x321cd5 thru 0x32d941 (0xbc6d bytes) 078000 1712276135.518294 mapwrite 0x11eb7b thru 0x120981 (0x1e07 bytes) 079000 1712276138.690327 mapread 0x241820 thru 0x243312 (0x1af3 bytes) 083000 1712276150.368523 trunc from 0x3ff56d to 0x070f97 (0x38e5d5 bytes) 084000 1712276153.427291 mapread 0x350ac8 thru 0x352cbb (0x21f4 bytes) 086000 1712276159.256017 write 0x06bbf4 thru 0x07301b (0x7428 bytes) 087000 1712276161.828418 trunc from 0x45638c to 0x1c6795 (0x28fbf6 bytes) 088000 1712276164.317300 write 0x4aeaaa thru 0x4bde19 (0xf370 bytes) 089000 1712276167.383684 read 0x276f54 thru 0x27ad1d (0x3dca bytes) 090000 1712276169.874231 write 0x4a475b thru 0x4a6709 (0x1faf bytes) 093000 1712276177.794928 read 0x0a7ea2 thru 0x0b5ba2 (0xdd01 bytes) 094000 1712276180.426780 mapwrite 0x233f87 thru 0x239acb (0x5b45 bytes) 100000 1712276196.402747 trunc from 0x328671 to 0x001018 (0x327658 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (287s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 20:16:38 (1712276198) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1712276208.264331 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1712276215.153691 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1712276218.571162 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1712276231.701901 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1712276234.705716 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1712276246.601888 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1712276249.523263 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1712276255.633376 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1712276262.188851 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1712276265.351504 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1712276271.373543 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1712276274.693997 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1712276288.449574 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1712276294.275776 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1712276305.025324 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1712276317.861257 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1712276321.060495 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1712276336.871278 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1712276342.752583 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1712276354.552226 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1712276358.180152 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1712276363.351497 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1712276377.336360 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1712276385.848653 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1712276394.708599 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1712276398.451466 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1712276436.991674 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1712276449.183367 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1712276452.764544 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1712276455.799313 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1712276459.371279 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1712276474.314025 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1712276477.680268 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1712276492.787186 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1712276497.156904 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1712276508.389858 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1712276517.733108 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1712276520.762234 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1712276529.160704 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1712276543.802258 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1712276546.735712 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1712276552.620400 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1712276561.640174 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (369s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1041 sec ===== 20:22:48 (1712276568) === sanity-benchmark: start cleanup 20:22:49 (1712276569) === === sanity-benchmark: finish cleanup 20:22:49 (1712276569) ===