-----============= acceptance-small: sanity-benchmark ============----- Wed Jan 15 18:37:45 EST 2025 excepting tests: skipping tests SLOW=no: iozone oleg438-client.virtnet: executing check_config_client /mnt/lustre oleg438-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg438-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012e137800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012e137800.idle_timeout=debug disable quota as required oleg438-server: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 18:38:05 (1736984285) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7490] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg438-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg438-client.virtnet at Wed Jan 15 18:38:06 EST 2025 waiting for dbench pid 9637 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 17 51 41.54 MB/sec warmup 1 sec latency 96.758 ms 20 150 63.56 MB/sec warmup 2 sec latency 153.224 ms 20 229 58.77 MB/sec warmup 3 sec latency 114.319 ms 20 311 56.92 MB/sec warmup 4 sec latency 95.969 ms 20 407 57.49 MB/sec warmup 5 sec latency 82.304 ms 20 489 56.81 MB/sec warmup 6 sec latency 119.246 ms 20 607 58.45 MB/sec warmup 7 sec latency 208.323 ms 20 664 52.80 MB/sec warmup 8 sec latency 1089.795 ms 20 690 47.01 MB/sec warmup 9 sec latency 1228.947 ms 20 779 42.67 MB/sec warmup 10 sec latency 63.866 ms 20 876 39.33 MB/sec warmup 11 sec latency 68.990 ms 20 959 36.30 MB/sec warmup 12 sec latency 68.786 ms 20 1068 35.20 MB/sec warmup 13 sec latency 59.881 ms 20 1172 32.84 MB/sec warmup 14 sec latency 71.791 ms 20 1259 30.78 MB/sec warmup 15 sec latency 66.276 ms 20 1446 32.49 MB/sec warmup 16 sec latency 68.253 ms 20 1535 30.66 MB/sec warmup 17 sec latency 91.348 ms 20 1632 29.06 MB/sec warmup 18 sec latency 63.438 ms 20 1730 27.61 MB/sec warmup 19 sec latency 77.173 ms 20 1829 26.32 MB/sec warmup 20 sec latency 62.297 ms 20 1940 25.16 MB/sec warmup 21 sec latency 76.278 ms 20 2048 24.14 MB/sec warmup 22 sec latency 67.174 ms 20 2155 23.20 MB/sec warmup 23 sec latency 54.854 ms 20 2380 13.99 MB/sec execute 1 sec latency 84.453 ms 20 2472 11.61 MB/sec execute 2 sec latency 66.658 ms 20 2615 16.41 MB/sec execute 3 sec latency 63.455 ms 20 2765 20.25 MB/sec execute 4 sec latency 94.644 ms 20 2962 24.27 MB/sec execute 5 sec latency 86.584 ms 20 3128 22.96 MB/sec execute 6 sec latency 75.983 ms 20 3357 24.96 MB/sec execute 7 sec latency 69.489 ms 20 3499 24.94 MB/sec execute 8 sec latency 103.031 ms 20 3627 25.13 MB/sec execute 9 sec latency 84.942 ms 20 3722 23.82 MB/sec execute 10 sec latency 87.890 ms 20 3793 22.54 MB/sec execute 11 sec latency 135.216 ms 20 3857 20.94 MB/sec execute 12 sec latency 121.457 ms 20 3910 19.42 MB/sec execute 13 sec latency 113.568 ms 20 3965 18.27 MB/sec execute 14 sec latency 113.070 ms 20 4036 17.06 MB/sec execute 15 sec latency 86.406 ms 20 4123 16.06 MB/sec execute 16 sec latency 106.550 ms 20 4226 15.25 MB/sec execute 17 sec latency 97.811 ms 20 4318 14.63 MB/sec execute 18 sec latency 119.612 ms 20 4401 14.08 MB/sec execute 19 sec latency 80.766 ms 20 4497 13.66 MB/sec execute 20 sec latency 66.010 ms 20 4608 13.52 MB/sec execute 21 sec latency 58.563 ms 20 4714 13.49 MB/sec execute 22 sec latency 71.384 ms 20 4870 14.11 MB/sec execute 23 sec latency 55.823 ms 20 5010 14.66 MB/sec execute 24 sec latency 67.256 ms 20 5108 14.35 MB/sec execute 25 sec latency 71.762 ms 20 5210 13.87 MB/sec execute 26 sec latency 67.089 ms 20 5302 13.41 MB/sec execute 27 sec latency 70.986 ms 20 5401 12.99 MB/sec execute 28 sec latency 76.741 ms 20 5496 12.62 MB/sec execute 29 sec latency 65.800 ms 20 5592 12.26 MB/sec execute 30 sec latency 69.792 ms 20 5701 12.08 MB/sec execute 31 sec latency 71.039 ms 20 5820 11.95 MB/sec execute 32 sec latency 68.033 ms 20 5890 11.72 MB/sec execute 33 sec latency 77.677 ms 20 6000 11.86 MB/sec execute 34 sec latency 114.088 ms 20 6091 12.10 MB/sec execute 35 sec latency 99.338 ms 20 6195 12.20 MB/sec execute 36 sec latency 100.301 ms 20 6303 12.33 MB/sec execute 37 sec latency 85.400 ms 20 6448 12.65 MB/sec execute 38 sec latency 106.311 ms 20 6612 13.13 MB/sec execute 39 sec latency 110.862 ms 20 6730 13.29 MB/sec execute 40 sec latency 97.864 ms 20 6879 13.57 MB/sec execute 41 sec latency 99.939 ms 20 7018 13.62 MB/sec execute 42 sec latency 100.589 ms 20 7145 14.00 MB/sec execute 43 sec latency 127.232 ms 20 7234 14.04 MB/sec execute 44 sec latency 110.074 ms 20 7296 13.78 MB/sec execute 45 sec latency 109.496 ms 20 7370 13.70 MB/sec execute 46 sec latency 92.158 ms 20 7434 13.50 MB/sec execute 47 sec latency 127.544 ms 20 7498 13.25 MB/sec execute 48 sec latency 75.085 ms 20 7581 13.02 MB/sec execute 49 sec latency 98.690 ms 20 7650 12.80 MB/sec execute 50 sec latency 147.109 ms 20 7730 12.58 MB/sec execute 51 sec latency 75.024 ms 20 7832 12.39 MB/sec execute 52 sec latency 90.116 ms 20 7913 12.23 MB/sec execute 53 sec latency 83.338 ms 20 8005 12.14 MB/sec execute 54 sec latency 71.068 ms 20 8133 12.09 MB/sec execute 55 sec latency 62.288 ms 20 8243 12.04 MB/sec execute 56 sec latency 72.489 ms 20 8396 12.39 MB/sec execute 57 sec latency 65.381 ms 20 8522 12.38 MB/sec execute 58 sec latency 61.730 ms 20 8649 12.56 MB/sec execute 59 sec latency 67.396 ms 20 8743 12.37 MB/sec execute 60 sec latency 106.107 ms 20 8848 12.20 MB/sec execute 61 sec latency 55.226 ms 20 8980 12.04 MB/sec execute 62 sec latency 59.353 ms 20 9114 11.90 MB/sec execute 63 sec latency 42.250 ms 20 9275 11.90 MB/sec execute 64 sec latency 47.829 ms 20 9400 11.82 MB/sec execute 65 sec latency 48.569 ms 20 9540 11.87 MB/sec execute 66 sec latency 64.956 ms 20 9717 12.22 MB/sec execute 67 sec latency 56.492 ms 20 9831 12.30 MB/sec execute 68 sec latency 63.336 ms 20 10016 12.49 MB/sec execute 69 sec latency 73.253 ms 20 10199 12.87 MB/sec execute 70 sec latency 66.768 ms 20 10359 13.15 MB/sec execute 71 sec latency 67.332 ms 20 10547 13.21 MB/sec execute 72 sec latency 77.476 ms 20 10711 13.51 MB/sec execute 73 sec latency 100.795 ms 20 10823 13.53 MB/sec execute 74 sec latency 83.791 ms 20 10918 13.46 MB/sec execute 75 sec latency 63.313 ms 20 11007 13.38 MB/sec execute 76 sec latency 70.944 ms 20 11126 13.25 MB/sec execute 77 sec latency 58.677 ms 20 11211 13.11 MB/sec execute 78 sec latency 115.457 ms 20 11303 12.97 MB/sec execute 79 sec latency 58.582 ms 20 11420 12.86 MB/sec execute 80 sec latency 77.818 ms 20 11511 12.76 MB/sec execute 81 sec latency 67.202 ms 20 11620 12.74 MB/sec execute 82 sec latency 59.572 ms 20 11724 12.63 MB/sec execute 83 sec latency 63.658 ms 20 11889 12.92 MB/sec execute 84 sec latency 53.092 ms 20 12002 12.82 MB/sec execute 85 sec latency 68.444 ms 20 12127 12.87 MB/sec execute 86 sec latency 60.922 ms 20 12248 12.92 MB/sec execute 87 sec latency 75.724 ms 20 12336 12.79 MB/sec execute 88 sec latency 68.047 ms 20 12449 12.67 MB/sec execute 89 sec latency 72.359 ms 20 12576 12.56 MB/sec execute 90 sec latency 58.187 ms 20 12705 12.50 MB/sec execute 91 sec latency 52.279 ms 20 12847 12.45 MB/sec execute 92 sec latency 51.576 ms 20 12967 12.41 MB/sec execute 93 sec latency 63.820 ms 20 13134 12.60 MB/sec execute 94 sec latency 61.894 ms 20 13311 12.74 MB/sec execute 95 sec latency 60.192 ms 20 13542 12.87 MB/sec execute 96 sec latency 53.196 ms 20 13847 13.51 MB/sec execute 97 sec latency 39.896 ms 20 14111 13.63 MB/sec execute 98 sec latency 41.054 ms 20 14312 13.90 MB/sec execute 99 sec latency 72.680 ms 20 14460 13.89 MB/sec execute 100 sec latency 42.667 ms 20 14572 13.85 MB/sec execute 101 sec latency 60.326 ms 20 14682 13.75 MB/sec execute 102 sec latency 94.615 ms 20 14768 13.65 MB/sec execute 103 sec latency 85.998 ms 20 14845 13.54 MB/sec execute 104 sec latency 98.339 ms 20 14972 13.44 MB/sec execute 105 sec latency 70.999 ms 20 15080 13.41 MB/sec execute 106 sec latency 64.661 ms 20 15181 13.34 MB/sec execute 107 sec latency 71.580 ms 20 15289 13.33 MB/sec execute 108 sec latency 72.169 ms 20 15417 13.43 MB/sec execute 109 sec latency 67.093 ms 20 15544 13.38 MB/sec execute 110 sec latency 52.745 ms 20 15700 13.43 MB/sec execute 111 sec latency 51.357 ms 20 15852 13.46 MB/sec execute 112 sec latency 51.726 ms 20 16007 13.36 MB/sec execute 113 sec latency 52.044 ms 20 16153 13.27 MB/sec execute 114 sec latency 64.546 ms 20 16340 13.27 MB/sec execute 115 sec latency 34.846 ms 20 16513 13.25 MB/sec execute 116 sec latency 44.328 ms 20 16747 13.51 MB/sec execute 117 sec latency 43.191 ms 20 17003 13.63 MB/sec execute 118 sec latency 42.502 ms 20 17299 14.06 MB/sec execute 119 sec latency 40.846 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 51389 26.765 147.103 Close 37921 6.675 49.051 Rename 2308 36.520 115.909 Unlink 10370 8.400 52.997 Qpathinfo 47286 5.938 106.234 Qfileinfo 8519 0.121 13.995 Qfsinfo 8889 0.091 19.146 Sfileinfo 4292 20.368 88.288 Find 18468 0.992 91.056 WriteX 26245 3.867 78.864 ReadX 85368 0.017 14.360 LockX 200 7.056 16.920 UnlockX 200 7.224 23.995 Flush 3632 28.698 116.906 Throughput 14.0633 MB/sec 20 clients 20 procs max_latency=147.109 ms stopping dbench on /mnt/lustre/d0.oleg438-client.virtnet at Wed Jan 15 18:40:32 EST 2025 with return code 0 clean dbench files on /mnt/lustre/d0.oleg438-client.virtnet /mnt/lustre/d0.oleg438-client.virtnet /mnt/lustre/d0.oleg438-client.virtnet removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg438-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (152s) == sanity-benchmark test bonnie: bonnie++ ================ 18:40:37 (1736984437) min OST has 3519020kB available, using 5278530kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7490] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5154] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg438-clien 5154M 93682 68 78628 63 181750 35 1963 222 Latency 19046us 83220us 124ms 13643us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg438-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 206 19 1540 14 351 15 234 19 208 15 200 12 Latency 44666us 15820us 90241us 38800us 34588us 72736us 1.97,1.97,oleg438-client.virtnet,1,1736994474,5154M,,,,93682,68,78628,63,,,181750,35,1963,222,10,,,,,206,19,1540,14,351,15,234,19,208,15,200,12,,19046us,83220us,,124ms,13643us,44666us,15820us,90241us,38800us,34588us,72736us debug=0x33f0484 PASS bonnie (396s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 18:47:14 (1736984834) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 29455 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 29455 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x2a340c fallocating to largest ever: 0x4fa714 fallocating to largest ever: 0x528540 001000 1736984843.353461 mapwrite 0x05f03a thru 0x0642d7 (0x529e bytes) 002000 1736984849.799940 mapread 0x35c3b1 thru 0x364c95 (0x88e5 bytes) 004000 1736984862.028925 mapwrite 0x520050 thru 0x527467 (0x7418 bytes) 005000 1736984869.314032 trunc from 0x4edc96 to 0x36dfb7 (0x17fcde bytes) 007000 1736984886.712867 trunc from 0x4a11a0 to 0x2c0e0d (0x1e0392 bytes) 008000 1736984893.868815 trunc from 0x453673 to 0x497268 (0x43bf6 bytes) 009000 1736984900.013728 fallocate 0x243993 thru 0x248944 (0x4fb2 bytes) 010000 1736984905.081886 mapwrite 0x4dbcb8 thru 0x4e9af8 (0xde41 bytes) 011000 1736984911.751482 mapread 0x077179 thru 0x07f09f (0x7f27 bytes) skipping zero size read 014000 1736984930.992789 write 0x05b606 thru 0x0617ea (0x61e5 bytes) 015000 1736984937.798154 mapwrite 0x49b5c3 thru 0x4a2c0e (0x764c bytes) 016000 1736984943.457860 write 0x26963e thru 0x275e8c (0xc84f bytes) 017000 1736984949.099229 mapread 0x0ecc23 thru 0x0f4675 (0x7a53 bytes) 019000 1736984961.351021 mapwrite 0x155b65 thru 0x161310 (0xb7ac bytes) 020000 1736984967.882787 read 0x1ff33f thru 0x1ffcf8 (0x9ba bytes) 021000 1736984974.609849 fallocate 0x455860 thru 0x45b6ca (0x5e6b bytes) 022000 1736984981.572672 punch from 0x0ad04b to 0x0b1bc4 (0x4b7a bytes) 023000 1736984988.890272 trunc from 0x3de521 to 0x2ff75e (0xdedc2 bytes) 024000 1736984996.446043 mapread 0x0c9f73 thru 0x0cfffe (0x608c bytes) 025000 1736985003.948435 mapwrite 0x03426f thru 0x03e474 (0xa206 bytes) 026000 1736985009.867424 punch from 0x21cc6a to 0x21dc12 (0xfa9 bytes) 027000 1736985015.941842 fallocate 0x05a733 thru 0x0628dc (0x81aa bytes) 029000 1736985029.871572 mapread 0x2ac98a thru 0x2b5e2f (0x94a6 bytes) 030000 1736985036.801148 read 0x3f9758 thru 0x4008c6 (0x716f bytes) 031000 1736985043.119730 trunc from 0x4be245 to 0x20cbd3 (0x2b1671 bytes) 032000 1736985048.881012 read 0x033f6a thru 0x0407dc (0xc873 bytes) 033000 1736985054.882956 trunc from 0x504f42 to 0x0f91fa (0x40bd47 bytes) 034000 1736985060.304379 read 0x3a2acf thru 0x3aa5cc (0x7afe bytes) 035000 1736985065.702536 punch from 0x058a3c to 0x05d224 (0x47e9 bytes) 037000 1736985076.045484 write 0x16787a thru 0x16c428 (0x4baf bytes) 039000 1736985086.685574 mapread 0x3dbf1a thru 0x3e0f6e (0x5055 bytes) 040000 1736985092.162682 fallocate 0x011745 thru 0x01e7f3 (0xd0af bytes) 041000 1736985097.170211 punch from 0x2bc367 to 0x2c2ff3 (0x6c8d bytes) 042000 1736985102.432028 mapread 0x1f15c0 thru 0x1f4c14 (0x3655 bytes) 043000 1736985107.845511 write 0x3f914b thru 0x3f9327 (0x1dd bytes) 044000 1736985113.346948 fallocate 0x3cd74b thru 0x3d4458 (0x6d0e bytes) 045000 1736985118.336176 mapwrite 0x35ac99 thru 0x35bc6a (0xfd2 bytes) 046000 1736985122.947041 mapwrite 0x3fd241 thru 0x3ff968 (0x2728 bytes) 047000 1736985128.288787 mapread 0x1ada14 thru 0x1b3e1a (0x6407 bytes) 048000 1736985133.826961 read 0x16f8a4 thru 0x172a74 (0x31d1 bytes) 049000 1736985139.977611 punch from 0x1de93f to 0x1dfcf7 (0x13b9 bytes) 050000 1736985146.876217 punch from 0x08b411 to 0x0962eb (0xaedb bytes) 051000 1736985153.794746 fallocate 0x0e3b3f thru 0x0e931d (0x57df bytes) 054000 1736985172.687853 mapwrite 0x25ee9d thru 0x2691e7 (0xa34b bytes) 055000 1736985179.480378 punch from 0x01150c to 0x011970 (0x465 bytes) 056000 1736985185.698499 trunc from 0x1e3eb1 to 0x3c3ac9 (0x1dfc19 bytes) 057000 1736985190.886166 punch from 0x1fefb4 to 0x209358 (0xa3a5 bytes) 058000 1736985196.437849 mapwrite 0x244589 thru 0x2516a6 (0xd11e bytes) 059000 1736985201.787983 mapwrite 0x3e9b61 thru 0x3f13a3 (0x7843 bytes) 060000 1736985207.397243 write 0x3398c6 thru 0x33fe92 (0x65cd bytes) 061000 1736985213.607465 fallocate 0x0291d2 thru 0x0324ba (0x92e9 bytes) 062000 1736985218.160855 punch from 0x19802e to 0x19c812 (0x47e5 bytes) 066000 1736985240.453380 write 0x08bc4d thru 0x08fd4a (0x40fe bytes) 067000 1736985244.448241 mapwrite 0x3e2037 thru 0x3e7dca (0x5d94 bytes) 068000 1736985249.564055 fallocate 0x147bdf thru 0x1515c1 (0x99e3 bytes) 069000 1736985255.288828 trunc from 0x2e68cd to 0x11bd61 (0x1cab6b bytes) 070000 1736985260.196268 punch from 0x0a2ae1 to 0x0a5a33 (0x2f53 bytes) 071000 1736985265.294911 write 0x07b471 thru 0x08982b (0xe3bb bytes) 072000 1736985270.112719 read 0x1f93c3 thru 0x1ff30b (0x5f49 bytes) 073000 1736985275.650332 mapread 0x3d915b thru 0x3e6cba (0xdb60 bytes) 075000 1736985285.991332 mapwrite 0x45032d thru 0x45f7a9 (0xf47d bytes) 076000 1736985291.210401 read 0x1f37b9 thru 0x1f9679 (0x5ec1 bytes) 077000 1736985297.420498 trunc from 0x4523a6 to 0x3f379a (0x5ec0b bytes) 078000 1736985302.817213 read 0x1e877a thru 0x1ef142 (0x69c9 bytes) 079000 1736985307.650727 punch from 0x0a37d1 to 0x0ab700 (0x7f30 bytes) 080000 1736985312.471580 punch from 0x190fc2 to 0x1912ee (0x32d bytes) 081000 1736985317.807370 read 0x003d31 thru 0x012f06 (0xf1d6 bytes) 082000 1736985322.858407 write 0x0958ae thru 0x099faf (0x4702 bytes) 083000 1736985328.780944 trunc from 0x40f2c0 to 0x16ea4f (0x2a0870 bytes) 084000 1736985335.402818 punch from 0x29dc35 to 0x2a7ee7 (0xa2b3 bytes) 086000 1736985346.126195 mapwrite 0x397a7c thru 0x3a005a (0x85df bytes) 087000 1736985351.710853 fallocate 0x1a8e42 thru 0x1b665f (0xd81e bytes) 089000 1736985361.150166 fallocate 0x490ad6 thru 0x495d46 (0x5271 bytes) 090000 1736985366.815452 write 0x038d99 thru 0x043d7b (0xafe3 bytes) 091000 1736985372.280230 punch from 0x2307e0 to 0x23e709 (0xdf2a bytes) 093000 1736985383.840018 mapread 0x0e8535 thru 0x0f089f (0x836b bytes) 094000 1736985389.565430 trunc from 0x4ed2e6 to 0x19df91 (0x34f354 bytes) 095000 1736985395.038078 mapwrite 0x3b2c5a thru 0x3b832a (0x56d1 bytes) 098000 1736985410.091559 write 0x07e685 thru 0x089a1f (0xb39b bytes) 100000 1736985421.233083 trunc from 0x4ea49b to 0x13a9ee (0x3afaac bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (588s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 18:57:02 (1736985422) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1736985427.666481 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1736985431.914432 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1736985450.062412 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1736985455.057721 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1736985459.821013 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1736985465.231253 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1736985470.527038 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1736985478.822084 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1736985482.284960 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1736985489.880663 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1736985494.102145 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1736985502.809892 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1736985506.237813 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1736985516.482538 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1736985520.887825 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1736985524.695088 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1736985528.509775 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1736985532.001040 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1736985536.356893 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1736985540.688135 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1736985544.640901 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1736985552.476700 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1736985556.922806 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1736985561.744921 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1736985566.127098 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1736985570.477659 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1736985574.765575 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1736985579.258040 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1736985583.716537 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1736985588.041991 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1736985591.893739 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1736985595.623624 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1736985603.827704 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1736985607.730553 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1736985611.515998 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1736985615.835555 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1736985629.860487 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1736985634.891570 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1736985639.310130 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1736985643.965876 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1736985647.957436 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1736985652.103926 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1736985661.025069 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1736985665.244882 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1736985669.124159 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1736985681.817769 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1736985690.693007 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1736985694.541703 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1736985698.467128 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1736985706.984390 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1736985715.002892 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1736985719.026456 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1736985722.974337 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1736985731.252568 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1736985735.094730 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1736985739.403009 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1736985743.157301 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1736985746.704226 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1736985750.117045 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1736985756.928805 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1736985764.934505 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1736985769.231631 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1736985773.351098 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1736985778.376863 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1736985786.601172 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1736985796.332200 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1736985805.111395 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1736985809.696868 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1736985813.939064 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1736985817.776133 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1736985822.008995 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1736985832.876452 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1736985837.162200 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1736985841.695432 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1736985850.770350 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (430s) == sanity-benchmark test complete, duration 1586 sec ===== 19:04:12 (1736985852)