-----============= acceptance-small: sanity-benchmark ============----- Fri Jun 14 16:52:09 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg237-client.virtnet: executing check_config_client /mnt/lustre oleg237-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg237-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aa4ba000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aa4ba000.idle_timeout=debug disable quota as required oleg237-server: oleg237-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 == sanity-benchmark test dbench: dbench ================== 16:52:20 (1718398340) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6871] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg237-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg237-client.virtnet at Fri Jun 14 16:52:21 EDT 2024 waiting for dbench pid 8802 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 176 143.51 MB/sec warmup 1 sec latency 126.903 ms 20 322 117.27 MB/sec warmup 2 sec latency 70.059 ms 20 472 110.17 MB/sec warmup 3 sec latency 66.742 ms 20 660 105.64 MB/sec warmup 4 sec latency 263.358 ms 20 725 85.17 MB/sec warmup 5 sec latency 291.602 ms 20 797 71.55 MB/sec warmup 6 sec latency 268.945 ms 20 887 61.90 MB/sec warmup 7 sec latency 194.874 ms 20 955 54.51 MB/sec warmup 8 sec latency 261.712 ms 20 1066 50.54 MB/sec warmup 9 sec latency 466.364 ms 20 1222 47.09 MB/sec warmup 10 sec latency 1232.370 ms 20 1312 44.47 MB/sec warmup 11 sec latency 2232.554 ms 20 1357 41.26 MB/sec warmup 12 sec latency 3233.215 ms 20 1403 38.15 MB/sec warmup 13 sec latency 4233.486 ms 20 1452 35.48 MB/sec warmup 14 sec latency 5233.610 ms 20 1496 33.18 MB/sec warmup 15 sec latency 6233.845 ms 20 1549 31.24 MB/sec warmup 16 sec latency 7234.000 ms 20 1630 29.85 MB/sec warmup 17 sec latency 8234.113 ms 20 1757 29.30 MB/sec warmup 18 sec latency 9234.244 ms 20 1852 28.46 MB/sec warmup 19 sec latency 10234.434 ms 20 1934 27.63 MB/sec warmup 20 sec latency 11234.568 ms 20 2004 26.81 MB/sec warmup 21 sec latency 12234.688 ms 20 2070 25.85 MB/sec warmup 22 sec latency 13234.909 ms 20 2126 25.10 MB/sec warmup 23 sec latency 14235.245 ms 20 2224 6.00 MB/sec execute 1 sec latency 16235.842 ms 20 2263 4.51 MB/sec execute 2 sec latency 17237.606 ms 20 2317 5.04 MB/sec execute 3 sec latency 18237.926 ms 20 2373 5.13 MB/sec execute 4 sec latency 19238.027 ms 20 2427 5.57 MB/sec execute 5 sec latency 20238.256 ms 20 2472 5.19 MB/sec execute 6 sec latency 21238.511 ms 20 2520 5.29 MB/sec execute 7 sec latency 22238.661 ms 20 2568 5.56 MB/sec execute 8 sec latency 23238.749 ms 20 2607 5.07 MB/sec execute 9 sec latency 24238.853 ms 20 2647 4.64 MB/sec execute 10 sec latency 25239.983 ms 20 2677 4.35 MB/sec execute 11 sec latency 26240.141 ms 20 2725 4.40 MB/sec execute 12 sec latency 27240.268 ms 20 2804 4.66 MB/sec execute 13 sec latency 28240.382 ms 20 2879 4.83 MB/sec execute 14 sec latency 29240.521 ms 20 2939 5.03 MB/sec execute 15 sec latency 30241.107 ms 20 2982 4.90 MB/sec execute 16 sec latency 31241.217 ms 20 3039 5.00 MB/sec execute 17 sec latency 32241.422 ms 20 3101 5.10 MB/sec execute 18 sec latency 33241.596 ms 20 3176 5.33 MB/sec execute 19 sec latency 34241.742 ms 20 3245 5.41 MB/sec execute 20 sec latency 35241.907 ms 20 3297 5.44 MB/sec execute 21 sec latency 36242.055 ms 20 3347 5.46 MB/sec execute 22 sec latency 37242.152 ms 20 3413 5.57 MB/sec execute 23 sec latency 38242.308 ms 20 3465 5.58 MB/sec execute 24 sec latency 39242.703 ms 20 3509 5.56 MB/sec execute 25 sec latency 40243.242 ms 20 3547 5.48 MB/sec execute 26 sec latency 41243.515 ms 20 3597 5.50 MB/sec execute 27 sec latency 42243.685 ms 20 3649 5.53 MB/sec execute 28 sec latency 43244.110 ms 20 3710 5.61 MB/sec execute 29 sec latency 44244.244 ms 20 3764 5.60 MB/sec execute 30 sec latency 45244.396 ms 20 3809 5.59 MB/sec execute 31 sec latency 46244.654 ms 20 3847 5.54 MB/sec execute 32 sec latency 47245.230 ms 20 3895 5.54 MB/sec execute 33 sec latency 48245.359 ms 20 3943 5.51 MB/sec execute 34 sec latency 49245.598 ms 20 3993 5.40 MB/sec execute 35 sec latency 50245.700 ms 20 4059 5.55 MB/sec execute 36 sec latency 51245.808 ms 20 4112 5.46 MB/sec execute 37 sec latency 52245.940 ms 20 4164 5.51 MB/sec execute 38 sec latency 53246.103 ms 20 4218 5.57 MB/sec execute 39 sec latency 54246.263 ms 20 4278 5.54 MB/sec execute 40 sec latency 55246.435 ms 20 4330 5.59 MB/sec execute 41 sec latency 56246.557 ms 20 4377 5.59 MB/sec execute 42 sec latency 57247.571 ms 20 4407 5.53 MB/sec execute 43 sec latency 58248.025 ms 20 4436 5.44 MB/sec execute 44 sec latency 59248.411 ms 20 4475 5.35 MB/sec execute 45 sec latency 60248.554 ms 20 4544 5.45 MB/sec execute 46 sec latency 61248.718 ms 20 4603 5.42 MB/sec execute 47 sec latency 62248.859 ms 20 4691 5.59 MB/sec execute 48 sec latency 63249.240 ms 20 4782 5.69 MB/sec execute 49 sec latency 64249.423 ms 20 4849 5.81 MB/sec execute 50 sec latency 65249.717 ms 20 4905 5.79 MB/sec execute 51 sec latency 66249.903 ms 20 4945 5.71 MB/sec execute 52 sec latency 67250.025 ms 20 4984 5.62 MB/sec execute 53 sec latency 68250.898 ms 20 5034 5.56 MB/sec execute 54 sec latency 69251.091 ms 20 5078 5.53 MB/sec execute 55 sec latency 70251.204 ms 20 5130 5.53 MB/sec execute 56 sec latency 71251.322 ms 20 5201 5.58 MB/sec execute 57 sec latency 72251.447 ms 20 5265 5.55 MB/sec execute 58 sec latency 73251.587 ms 20 5350 5.68 MB/sec execute 59 sec latency 74251.711 ms 20 5420 5.73 MB/sec execute 60 sec latency 75253.121 ms 20 5462 5.68 MB/sec execute 61 sec latency 76253.335 ms 20 5508 5.63 MB/sec execute 62 sec latency 77253.499 ms 20 5583 5.69 MB/sec execute 63 sec latency 78253.645 ms 20 5656 5.74 MB/sec execute 64 sec latency 79253.904 ms 20 5722 5.78 MB/sec execute 65 sec latency 80254.048 ms 20 5800 5.89 MB/sec execute 66 sec latency 81254.234 ms 20 5864 5.91 MB/sec execute 67 sec latency 82254.492 ms 20 5928 5.99 MB/sec execute 68 sec latency 83255.162 ms 20 5979 5.99 MB/sec execute 69 sec latency 84255.275 ms 20 6024 5.95 MB/sec execute 70 sec latency 85255.544 ms 20 6055 5.87 MB/sec execute 71 sec latency 86255.764 ms 20 6103 5.87 MB/sec execute 72 sec latency 87256.064 ms 20 6139 5.80 MB/sec execute 73 sec latency 88256.333 ms 20 6175 5.75 MB/sec execute 74 sec latency 89256.546 ms 20 6215 5.71 MB/sec execute 75 sec latency 90256.663 ms 20 6254 5.70 MB/sec execute 76 sec latency 91257.058 ms 20 6301 5.70 MB/sec execute 77 sec latency 92257.157 ms 20 6344 5.70 MB/sec execute 78 sec latency 93257.259 ms 20 6392 5.73 MB/sec execute 79 sec latency 94257.828 ms 20 6438 5.72 MB/sec execute 80 sec latency 95258.135 ms 20 6479 5.73 MB/sec execute 81 sec latency 96258.700 ms 20 6520 5.71 MB/sec execute 82 sec latency 97259.143 ms 20 6564 5.67 MB/sec execute 83 sec latency 98259.437 ms 20 6603 5.62 MB/sec execute 84 sec latency 99259.563 ms 20 6638 5.58 MB/sec execute 85 sec latency 100259.667 ms 20 6684 5.59 MB/sec execute 86 sec latency 101259.784 ms 20 6741 5.58 MB/sec execute 87 sec latency 102260.169 ms 20 6801 5.61 MB/sec execute 88 sec latency 103260.782 ms 20 6862 5.65 MB/sec execute 89 sec latency 104260.929 ms 20 6914 5.67 MB/sec execute 90 sec latency 105261.109 ms 20 6956 5.64 MB/sec execute 91 sec latency 106261.237 ms 20 7003 5.62 MB/sec execute 92 sec latency 107261.387 ms 20 7054 5.67 MB/sec execute 93 sec latency 108261.597 ms 20 7112 5.66 MB/sec execute 94 sec latency 109261.987 ms 20 7188 5.75 MB/sec execute 95 sec latency 110262.100 ms 20 7242 5.72 MB/sec execute 96 sec latency 111262.596 ms 20 7289 5.70 MB/sec execute 97 sec latency 112262.933 ms 20 7344 5.72 MB/sec execute 98 sec latency 113263.057 ms 20 7392 5.69 MB/sec execute 99 sec latency 114263.373 ms 20 7433 5.65 MB/sec execute 100 sec latency 115263.661 ms 20 7499 5.66 MB/sec execute 101 sec latency 116263.938 ms 20 7566 5.70 MB/sec execute 102 sec latency 117264.037 ms 20 7607 5.66 MB/sec execute 103 sec latency 118264.215 ms 20 7658 5.68 MB/sec execute 104 sec latency 119264.344 ms 20 7709 5.68 MB/sec execute 105 sec latency 120264.457 ms 20 7767 5.64 MB/sec execute 106 sec latency 121264.591 ms 20 7843 5.63 MB/sec execute 107 sec latency 122264.698 ms 20 7902 5.65 MB/sec execute 108 sec latency 123264.788 ms 20 7979 5.72 MB/sec execute 109 sec latency 124264.958 ms 20 8060 5.74 MB/sec execute 110 sec latency 125265.067 ms 20 8123 5.76 MB/sec execute 111 sec latency 126265.363 ms 20 8200 5.81 MB/sec execute 112 sec latency 127265.454 ms 20 8260 5.80 MB/sec execute 113 sec latency 128265.821 ms 20 8313 5.78 MB/sec execute 114 sec latency 129266.187 ms 20 8375 5.76 MB/sec execute 115 sec latency 130266.437 ms 20 8419 5.72 MB/sec execute 116 sec latency 131266.547 ms 20 8473 5.71 MB/sec execute 117 sec latency 132266.801 ms 20 8557 5.79 MB/sec execute 118 sec latency 133266.950 ms 20 8630 5.78 MB/sec execute 119 sec latency 134267.050 ms 20 cleanup 120 sec 17 cleanup 121 sec 11 cleanup 122 sec 7 cleanup 123 sec 0 cleanup 124 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 22667 51.755 138484.588 Close 16688 51.800 136086.375 Rename 958 166.099 138545.144 Unlink 4567 17.101 6217.558 Qpathinfo 20563 1.863 34.341 Qfileinfo 3553 0.075 6.865 Qfsinfo 3750 0.056 4.209 Sfileinfo 1878 96.778 137652.989 Find 7949 0.397 24.220 WriteX 11142 0.903 13.704 ReadX 35163 0.017 2.963 LockX 70 6.355 25.467 UnlockX 70 10.846 211.434 Flush 1607 46.091 185.984 Throughput 5.78452 MB/sec 20 clients 20 procs max_latency=134267.050 ms stopping dbench on /mnt/lustre/d0.oleg237-client.virtnet at Fri Jun 14 16:54:49 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg237-client.virtnet /mnt/lustre/d0.oleg237-client.virtnet /mnt/lustre/d0.oleg237-client.virtnet removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg237-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (153s) == sanity-benchmark test bonnie: bonnie++ ================ 16:54:53 (1718398493) min OST has 3345408kB available, using 5018112kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6871] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4900] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg237-clien 4900M 130314 95 117853 92 242717 52 921.2 132 Latency 8665us 79005us 84433us 288ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg237-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 207 17 1908 15 339 13 213 17 260 15 364 14 Latency 19734us 12682us 65406us 24049us 11440us 15290us 1.97,1.97,oleg237-client.virtnet,1,1718388232,4900M,,,,130314,95,117853,92,,,242717,52,921.2,132,10,,,,,207,17,1908,15,339,13,213,17,260,15,364,14,,8665us,79005us,,84433us,288ms,19734us,12682us,65406us,24049us,11440us,15290us debug=0x33f0484 PASS bonnie (316s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 17:00:10 (1718398810) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 13586 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 13586 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x4307ff truncating to largest ever: 0x43fda6 truncating to largest ever: 0x4b70dc truncating to largest ever: 0x4d562a truncating to largest ever: 0x50b826 truncating to largest ever: 0x52360d truncating to largest ever: 0x53c588 truncating to largest ever: 0x5478ba truncating to largest ever: 0x55e92d 001000 1718398817.521902 mapread 0x3a20b5 thru 0x3aeb3a (0xca86 bytes) truncating to largest ever: 0x55f811 002000 1718398823.602558 read 0x0d0710 thru 0x0dc7ec (0xc0dd bytes) truncating to largest ever: 0x55f9f5 006000 1718398849.153661 write 0x27681f thru 0x285144 (0xe926 bytes) truncating to largest ever: 0x5629e6 007000 1718398855.606728 write 0x08ad60 thru 0x0991c7 (0xe468 bytes) 008000 1718398861.799109 read 0x1600a4 thru 0x16908e (0x8feb bytes) 009000 1718398867.483578 read 0x1e34ab thru 0x1f2605 (0xf15b bytes) 011000 1718398879.959670 mapread 0x02f83f thru 0x039d68 (0xa52a bytes) 012000 1718398884.787432 mapread 0x1d1bf5 thru 0x1d7dad (0x61b9 bytes) 013000 1718398889.794799 write 0x05ccfc thru 0x062419 (0x571e bytes) 014000 1718398894.399264 read 0x1aff22 thru 0x1bce11 (0xcef0 bytes) 015000 1718398899.986128 mapread 0x1133e8 thru 0x1212ad (0xdec6 bytes) 016000 1718398904.529523 write 0x37ae2b thru 0x37df14 (0x30ea bytes) 020000 1718398924.930599 read 0x044694 thru 0x0544a5 (0xfe12 bytes) 021000 1718398930.632078 trunc from 0x43fac0 to 0x2334bb (0x20c604 bytes) 024000 1718398948.431988 mapwrite 0x27842c thru 0x2873ac (0xef81 bytes) 026000 1718398958.284212 write 0x06e3e8 thru 0x07aaa9 (0xc6c2 bytes) skipping zero size read 029000 1718398972.809639 read 0x2297b6 thru 0x2349f1 (0xb23c bytes) 030000 1718398977.554550 mapwrite 0x085169 thru 0x0864ce (0x1366 bytes) 031000 1718398983.468040 write 0x3e479c thru 0x3e6ee3 (0x2748 bytes) 035000 1718399035.578754 write 0x352ddb thru 0x35c687 (0x98ad bytes) 039000 1718399086.532638 mapwrite 0x337725 thru 0x337ad2 (0x3ae bytes) 040000 1718399100.503753 write 0x2b2964 thru 0x2c16ef (0xed8c bytes) 042000 1718399122.459957 mapwrite 0x0b95a7 thru 0x0c20df (0x8b39 bytes) 043000 1718399133.741828 mapread 0x1520d6 thru 0x15bcfd (0x9c28 bytes) 045000 1718399156.916904 mapread 0x228db6 thru 0x22cf6b (0x41b6 bytes) 047000 1718399177.801271 trunc from 0x3811a7 to 0x127456 (0x259d50 bytes) 049000 1718399199.830544 write 0x40df4a thru 0x41a9d5 (0xca8c bytes) 050000 1718399211.968078 read 0x238a54 thru 0x243d42 (0xb2ef bytes) 054000 1718399263.056330 trunc from 0x1827d4 to 0x447381 (0x2c4bae bytes) truncating to largest ever: 0x562be4 055000 1718399276.567758 mapread 0x4f86bf thru 0x502a7e (0xa3c0 bytes) 057000 1718399304.022840 read 0x0109d3 thru 0x016121 (0x574f bytes) 062000 1718399365.065660 write 0x0b7298 thru 0x0bab93 (0x38fc bytes) 063000 1718399374.523522 trunc from 0x007113 to 0x4c4f10 (0x4bddfe bytes) 064000 1718399384.174447 trunc from 0x461098 to 0x353215 (0x10de82 bytes) 065000 1718399393.484206 mapwrite 0x334192 thru 0x338e3f (0x4cae bytes) 066000 1718399404.048702 mapread 0x3c9318 thru 0x3cd71a (0x4403 bytes) 069000 1718399444.457648 read 0x10a705 thru 0x10b3ec (0xce8 bytes) 070000 1718399459.310770 read 0x058526 thru 0x0647e8 (0xc2c3 bytes) 071000 1718399473.776824 write 0x54fd8d thru 0x559e60 (0xa0d4 bytes) 072000 1718399487.047239 trunc from 0x36950b to 0x13c1bb (0x22d34f bytes) 073000 1718399500.294051 read 0x1abd43 thru 0x1b3b0b (0x7dc9 bytes) 075000 1718399523.500075 write 0x386492 thru 0x3924e1 (0xc050 bytes) 076000 1718399531.266987 read 0x2285a3 thru 0x2324f9 (0x9f57 bytes) 077000 1718399540.578814 read 0x121a81 thru 0x1245c8 (0x2b48 bytes) 079000 1718399560.694724 mapread 0x1604d4 thru 0x169f3a (0x9a67 bytes) 086000 1718399634.790892 trunc from 0x279f2f to 0x067d81 (0x2121ad bytes) 089000 1718399656.925152 write 0x4ea3f3 thru 0x4efaca (0x56d8 bytes) 090000 1718399661.570648 mapwrite 0x33d7cd thru 0x34d0de (0xf912 bytes) 091000 1718399665.928377 trunc from 0x46a1a9 to 0x34f066 (0x11b142 bytes) 095000 1718399684.379027 mapwrite 0x00250c thru 0x005ef8 (0x39ed bytes) 096000 1718399689.367917 read 0x40c69c thru 0x40eddf (0x2744 bytes) 100000 1718399706.604956 write 0x00a7a8 thru 0x00ff29 (0x5782 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (897s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:15:07 (1718399707) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x26ae1d truncating to largest ever: 0x4a9675 truncating to largest ever: 0x4f0a2a truncating to largest ever: 0x527488 003000 1718399722.984015 write 0x4a9120 thru 0x4b141a (0x82fb bytes) 004000 1718399726.911261 write 0x5246d3 thru 0x5283bc (0x3cea bytes) 006000 1718399735.623517 read 0x24d5bf thru 0x24d5f3 (0x35 bytes) 007000 1718399740.447761 trunc from 0x391238 to 0x1089d2 (0x288865 bytes) 008000 1718399744.827160 mapwrite 0x1f65cb thru 0x1fc589 (0x5fbf bytes) truncating to largest ever: 0x527c29 014000 1718399768.880406 read 0x0370d7 thru 0x043542 (0xc46c bytes) 015000 1718399773.054298 write 0x48c1e9 thru 0x494f61 (0x8d79 bytes) 016000 1718399777.758557 read 0x3b6e81 thru 0x3c20a4 (0xb224 bytes) 018000 1718399787.113623 write 0x3e34ae thru 0x3f22e7 (0xee3a bytes) 019000 1718399791.658111 trunc from 0x0f96d5 to 0x2629fd (0x169329 bytes) 020000 1718399796.120483 mapwrite 0x25237b thru 0x2575b9 (0x523f bytes) 022000 1718399805.052654 write 0x4bc35b thru 0x4c3517 (0x71bd bytes) 023000 1718399810.109226 mapwrite 0x33cbcd thru 0x341fc2 (0x53f6 bytes) 025000 1718399818.889857 mapwrite 0x4849db thru 0x48ef4c (0xa572 bytes) 026000 1718399822.863890 write 0x01d31b thru 0x023fe7 (0x6ccd bytes) 027000 1718399826.640636 mapwrite 0x16ae5c thru 0x1706c2 (0x5867 bytes) truncating to largest ever: 0x52829f 029000 1718399834.165132 mapwrite 0x4d9bf2 thru 0x4e2771 (0x8b80 bytes) 030000 1718399838.255423 trunc from 0x4bf592 to 0x4b2698 (0xcef9 bytes) 033000 1718399849.893675 trunc from 0x4558dc to 0x4ad8ef (0x58014 bytes) 037000 1718399864.622047 trunc from 0x4b9d00 to 0x051641 (0x4686be bytes) 038000 1718399868.153757 mapread 0x22ce58 thru 0x23c4b4 (0xf65d bytes) 039000 1718399871.960069 write 0x4de796 thru 0x4dfd83 (0x15ee bytes) 040000 1718399875.813204 write 0x03a9e0 thru 0x040813 (0x5e34 bytes) 041000 1718399879.487003 write 0x0b6f90 thru 0x0bbe70 (0x4ee1 bytes) 047000 1718399903.486517 mapread 0x4993b2 thru 0x4a0cc0 (0x790f bytes) 048000 1718399906.899477 write 0x358c26 thru 0x364348 (0xb723 bytes) 050000 1718399913.691264 read 0x02cc22 thru 0x037337 (0xa716 bytes) 054000 1718399927.910777 mapread 0x0fa00d thru 0x0fc7e1 (0x27d5 bytes) 058000 1718399943.111952 read 0x30e518 thru 0x31df10 (0xf9f9 bytes) 060000 1718399950.968573 read 0x1bd0ee thru 0x1c23cd (0x52e0 bytes) 061000 1718399954.375761 trunc from 0x4526ec to 0x5010fd (0xaea12 bytes) 063000 1718399961.885902 trunc from 0x45243a to 0x2d8cdd (0x17975c bytes) 065000 1718399970.079446 mapread 0x10f3d5 thru 0x1144c1 (0x50ed bytes) 067000 1718399978.022159 read 0x0862fb thru 0x090f6f (0xac75 bytes) 068000 1718399981.951515 read 0x218541 thru 0x22314b (0xac0b bytes) 069000 1718399986.351532 write 0x032c9a thru 0x038697 (0x59fe bytes) 073000 1718400003.425638 mapread 0x44494b thru 0x44fd63 (0xb419 bytes) 074000 1718400007.126942 mapread 0x36b054 thru 0x36d3c8 (0x2375 bytes) 075000 1718400010.727151 mapread 0x04ae3e thru 0x055ffa (0xb1bd bytes) 077000 1718400018.532113 mapwrite 0x300ee3 thru 0x30a588 (0x96a6 bytes) 079000 1718400026.269703 mapread 0x2a36f1 thru 0x2ad2b8 (0x9bc8 bytes) 080000 1718400030.409239 mapwrite 0x0c8c0c thru 0x0d0dbb (0x81b0 bytes) 083000 1718400041.585079 trunc from 0x50fdc7 to 0x352dcf (0x1bcff7 bytes) 085000 1718400048.755996 mapread 0x0c135c thru 0x0c69c5 (0x566a bytes) 086000 1718400052.257072 write 0x30dd0d thru 0x3174d3 (0x97c7 bytes) 087000 1718400056.234033 read 0x270b39 thru 0x27d4b5 (0xc97d bytes) 088000 1718400059.780457 mapread 0x0a2961 thru 0x0a33e8 (0xa88 bytes) 089000 1718400063.811281 mapread 0x0683e9 thru 0x07203f (0x9c57 bytes) 090000 1718400067.529061 read 0x080253 thru 0x082eba (0x2c68 bytes) 091000 1718400071.175983 mapread 0x0d60ef thru 0x0da743 (0x4655 bytes) 096000 1718400089.268143 read 0x2a8a38 thru 0x2af48f (0x6a58 bytes) 097000 1718400093.267104 read 0x3b85c0 thru 0x3c4116 (0xbb57 bytes) 099000 1718400101.292973 mapwrite 0x11bf13 thru 0x127eda (0xbfc8 bytes) All operations completed A-OK! PASS fsx_partial_punch (398s) == sanity-benchmark test complete, duration 1775 sec ===== 17:21:45 (1718400105)