== sanity test 398b: DIO and buffer IO race ============== 09:28:52 (1761312532) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.233569 s, 53.9 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=122498: Fri Oct 24 09:29:11 2025 read: IOPS=35, BW=141KiB/s (145kB/s)(1480KiB/10487msec) clat (usec): min=5, max=161669, avg=10377.84, stdev=15534.54 lat (usec): min=5, max=161671, avg=10379.49, stdev=15535.14 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 30], 40.00th=[ 48], 50.00th=[ 5997], 60.00th=[ 10552], | 70.00th=[ 15664], 80.00th=[ 19530], 90.00th=[ 25560], 95.00th=[ 31065], | 99.00th=[ 68682], 99.50th=[106431], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 40, max= 215, per=23.31%, avg=132.85, stdev=56.36, samples=20 iops : min= 10, max= 53, avg=32.85, stdev=13.90, samples=20 write: IOPS=37, BW=152KiB/s (155kB/s)(1592KiB/10487msec); 0 zone resets clat (usec): min=137, max=250348, avg=16450.84, stdev=24196.60 lat (usec): min=137, max=250349, avg=16456.08, stdev=24195.67 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 192], 10.00th=[ 233], 20.00th=[ 293], | 30.00th=[ 494], 40.00th=[ 3818], 50.00th=[ 8029], 60.00th=[ 11863], | 70.00th=[ 17957], 80.00th=[ 28967], 90.00th=[ 49021], 95.00th=[ 61604], | 99.00th=[102237], 99.50th=[125305], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 63, max= 232, per=24.16%, avg=144.95, stdev=51.19, samples=20 iops : min= 15, max= 58, avg=35.85, stdev=12.86, samples=20 lat (usec) : 10=1.56%, 20=7.16%, 50=10.55%, 100=2.60%, 250=7.68% lat (usec) : 500=8.85%, 750=0.65%, 1000=1.17% lat (msec) : 2=1.56%, 4=2.73%, 10=13.54%, 20=18.36%, 50=17.84% lat (msec) : 100=4.82%, 250=0.78%, 500=0.13% cpu : usr=0.10%, sys=3.32%, ctx=906, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122500: Fri Oct 24 09:29:11 2025 read: IOPS=34, BW=137KiB/s (140kB/s)(1436KiB/10492msec) clat (usec): min=6, max=139831, avg=10324.09, stdev=14565.02 lat (usec): min=6, max=139832, avg=10324.84, stdev=14565.03 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 33], 40.00th=[ 55], 50.00th=[ 7308], 60.00th=[ 11076], | 70.00th=[ 15008], 80.00th=[ 18482], 90.00th=[ 25560], 95.00th=[ 33424], | 99.00th=[ 67634], 99.50th=[ 91751], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 56, max= 199, per=24.02%, avg=136.90, stdev=40.43, samples=20 iops : min= 14, max= 49, avg=33.85, stdev=10.02, samples=20 write: IOPS=38, BW=156KiB/s (160kB/s)(1636KiB/10492msec); 0 zone resets clat (usec): min=177, max=146543, avg=16347.65, stdev=21548.65 lat (usec): min=177, max=146544, avg=16348.77, stdev=21548.55 clat percentiles (usec): | 1.00th=[ 194], 5.00th=[ 212], 10.00th=[ 245], 20.00th=[ 310], | 30.00th=[ 1205], 40.00th=[ 4621], 50.00th=[ 8586], 60.00th=[ 12649], | 70.00th=[ 19792], 80.00th=[ 27919], 90.00th=[ 45876], 95.00th=[ 60556], | 99.00th=[ 86508], 99.50th=[102237], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 63, max= 239, per=25.48%, avg=152.90, stdev=37.52, samples=20 iops : min= 15, max= 59, avg=37.85, stdev= 9.30, samples=20 lat (usec) : 10=1.56%, 20=5.47%, 50=10.94%, 100=2.73%, 250=6.51% lat (usec) : 500=8.72%, 750=0.65%, 1000=0.65% lat (msec) : 2=2.60%, 4=2.08%, 10=14.19%, 20=19.66%, 50=18.62% lat (msec) : 100=5.08%, 250=0.52% cpu : usr=0.17%, sys=3.49%, ctx=950, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122502: Fri Oct 24 09:29:11 2025 read: IOPS=38, BW=155KiB/s (159kB/s)(1564KiB/10094msec) clat (usec): min=6, max=138784, avg=9636.10, stdev=13991.20 lat (usec): min=6, max=138785, avg=9636.92, stdev=13991.23 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 43], 50.00th=[ 3916], 60.00th=[ 9765], | 70.00th=[ 14484], 80.00th=[ 19268], 90.00th=[ 24249], 95.00th=[ 31327], | 99.00th=[ 65799], 99.50th=[ 71828], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 47, max= 272, per=27.30%, avg=155.60, stdev=57.22, samples=20 iops : min= 11, max= 68, avg=38.55, stdev=14.31, samples=20 write: IOPS=37, BW=149KiB/s (153kB/s)(1508KiB/10094msec); 0 zone resets clat (usec): min=137, max=148685, avg=16667.17, stdev=23471.02 lat (usec): min=137, max=148687, avg=16668.12, stdev=23471.02 clat percentiles (usec): | 1.00th=[ 180], 5.00th=[ 219], 10.00th=[ 241], 20.00th=[ 302], | 30.00th=[ 502], 40.00th=[ 4555], 50.00th=[ 8356], 60.00th=[ 12125], | 70.00th=[ 18482], 80.00th=[ 28705], 90.00th=[ 48497], 95.00th=[ 65274], | 99.00th=[111674], 99.50th=[125305], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 87, max= 255, per=24.88%, avg=149.25, stdev=45.27, samples=20 iops : min= 21, max= 63, avg=36.95, stdev=11.28, samples=20 lat (usec) : 10=1.17%, 20=6.25%, 50=14.45%, 100=2.60%, 250=5.99% lat (usec) : 500=8.98%, 750=0.78%, 1000=1.04% lat (msec) : 2=2.08%, 4=1.56%, 10=13.02%, 20=19.79%, 50=16.93% lat (msec) : 100=4.30%, 250=1.04% cpu : usr=0.15%, sys=3.30%, ctx=843, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122505: Fri Oct 24 09:29:11 2025 read: IOPS=39, BW=157KiB/s (161kB/s)(1508KiB/9582msec) clat (usec): min=5, max=127055, avg=9062.76, stdev=13940.80 lat (usec): min=6, max=127055, avg=9063.51, stdev=13940.77 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 41], 50.00th=[ 63], 60.00th=[ 8717], | 70.00th=[ 13304], 80.00th=[ 18220], 90.00th=[ 24249], 95.00th=[ 31327], | 99.00th=[ 56361], 99.50th=[109577], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 63, max= 279, per=27.28%, avg=155.47, stdev=60.30, samples=19 iops : min= 15, max= 69, avg=38.53, stdev=15.03, samples=19 write: IOPS=40, BW=163KiB/s (167kB/s)(1564KiB/9582msec); 0 zone resets clat (usec): min=161, max=127485, avg=15598.69, stdev=22188.15 lat (usec): min=161, max=127486, avg=15599.64, stdev=22188.21 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 202], 10.00th=[ 223], 20.00th=[ 285], | 30.00th=[ 359], 40.00th=[ 3425], 50.00th=[ 7242], 60.00th=[ 11338], | 70.00th=[ 15401], 80.00th=[ 27395], 90.00th=[ 48497], 95.00th=[ 64750], | 99.00th=[101188], 99.50th=[123208], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 96, max= 295, per=27.11%, avg=162.63, stdev=57.91, samples=19 iops : min= 24, max= 73, avg=40.32, stdev=14.47, samples=19 lat (usec) : 10=1.43%, 20=6.25%, 50=14.45%, 100=3.26%, 250=8.07% lat (usec) : 500=9.38%, 750=0.39%, 1000=0.91% lat (msec) : 2=1.69%, 4=1.69%, 10=12.89%, 20=17.84%, 50=16.41% lat (msec) : 100=4.56%, 250=0.78% cpu : usr=0.18%, sys=3.26%, ctx=839, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=571KiB/s (584kB/s), 137KiB/s-157KiB/s (140kB/s-161kB/s), io=5988KiB (6132kB), run=9582-10492msec WRITE: bw=600KiB/s (615kB/s), 149KiB/s-163KiB/s (153kB/s-167kB/s), io=6300KiB (6451kB), run=9582-10492msec rand-rw: (groupid=0, jobs=1): err= 0: pid=122499: Fri Oct 24 09:29:38 2025 read: IOPS=10, BW=40.1KiB/s (41.1kB/s)(1480KiB/36903msec) clat (msec): min=2, max=140, avg=11.65, stdev=11.58 lat (msec): min=2, max=140, avg=11.65, stdev=11.58 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 21], 95.00th=[ 28], | 99.00th=[ 59], 99.50th=[ 91], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 7, max= 104, per=25.23%, avg=40.11, stdev=21.36, samples=72 iops : min= 1, max= 26, avg= 9.50, stdev= 5.38, samples=72 write: IOPS=10, BW=43.1KiB/s (44.2kB/s)(1592KiB/36903msec); 0 zone resets clat (msec): min=32, max=281, avg=81.81, stdev=34.15 lat (msec): min=32, max=281, avg=81.81, stdev=34.15 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 44], 10.00th=[ 50], 20.00th=[ 56], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 74], 60.00th=[ 84], | 70.00th=[ 93], 80.00th=[ 103], 90.00th=[ 118], 95.00th=[ 142], | 99.00th=[ 222], 99.50th=[ 257], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 16, max= 64, per=25.54%, avg=42.64, stdev=11.24, samples=73 iops : min= 4, max= 16, avg=10.12, stdev= 2.89, samples=73 lat (msec) : 4=1.17%, 10=27.60%, 20=14.19%, 50=10.16%, 100=35.55% lat (msec) : 250=11.07%, 500=0.26% cpu : usr=0.08%, sys=0.72%, ctx=845, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122501: Fri Oct 24 09:29:38 2025 read: IOPS=9, BW=38.1KiB/s (39.1kB/s)(1436KiB/37654msec) clat (msec): min=2, max=137, avg=12.44, stdev=15.04 lat (msec): min=2, max=137, avg=12.45, stdev=15.04 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 10], | 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 20], 95.00th=[ 36], | 99.00th=[ 83], 99.50th=[ 138], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 7, max= 95, per=24.14%, avg=38.39, stdev=20.85, samples=72 iops : min= 1, max= 23, avg= 9.07, stdev= 5.24, samples=72 write: IOPS=10, BW=43.4KiB/s (44.5kB/s)(1636KiB/37654msec); 0 zone resets clat (msec): min=28, max=225, avg=80.88, stdev=29.22 lat (msec): min=28, max=225, avg=80.89, stdev=29.22 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 44], 10.00th=[ 49], 20.00th=[ 57], | 30.00th=[ 64], 40.00th=[ 70], 50.00th=[ 77], 60.00th=[ 84], | 70.00th=[ 93], 80.00th=[ 102], 90.00th=[ 116], 95.00th=[ 133], | 99.00th=[ 176], 99.50th=[ 190], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 15, max= 71, per=25.58%, avg=42.72, stdev=11.29, samples=74 iops : min= 3, max= 17, avg=10.15, stdev= 2.90, samples=74 lat (msec) : 4=2.08%, 10=27.08%, 20=13.02%, 50=9.51%, 100=36.72% lat (msec) : 250=11.59% cpu : usr=0.07%, sys=0.69%, ctx=853, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122503: Fri Oct 24 09:29:38 2025 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(1564KiB/35507msec) clat (msec): min=3, max=196, avg=11.88, stdev=16.96 lat (msec): min=3, max=196, avg=11.88, stdev=16.96 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 20], 95.00th=[ 29], | 99.00th=[ 106], 99.50th=[ 153], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 7, max= 119, per=28.48%, avg=45.28, stdev=25.41, samples=68 iops : min= 1, max= 29, avg=10.79, stdev= 6.34, samples=68 write: IOPS=10, BW=42.5KiB/s (43.5kB/s)(1508KiB/35507msec); 0 zone resets clat (msec): min=28, max=414, avg=81.57, stdev=32.81 lat (msec): min=28, max=414, avg=81.58, stdev=32.81 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 45], 10.00th=[ 51], 20.00th=[ 59], | 30.00th=[ 65], 40.00th=[ 70], 50.00th=[ 75], 60.00th=[ 85], | 70.00th=[ 92], 80.00th=[ 102], 90.00th=[ 117], 95.00th=[ 128], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 15, max= 64, per=25.16%, avg=42.01, stdev=10.89, samples=70 iops : min= 3, max= 16, avg= 9.97, stdev= 2.79, samples=70 lat (msec) : 4=1.56%, 10=33.20%, 20=11.46%, 50=8.59%, 100=34.11% lat (msec) : 250=10.94%, 500=0.13% cpu : usr=0.06%, sys=0.77%, ctx=851, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122504: Fri Oct 24 09:29:38 2025 read: IOPS=10, BW=41.2KiB/s (42.2kB/s)(1508KiB/36587msec) clat (msec): min=2, max=158, avg=12.58, stdev=15.24 lat (msec): min=2, max=158, avg=12.58, stdev=15.24 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 10], | 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 20], 95.00th=[ 32], | 99.00th=[ 95], 99.50th=[ 108], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 7, max= 103, per=26.21%, avg=41.67, stdev=20.65, samples=70 iops : min= 1, max= 25, avg= 9.89, stdev= 5.18, samples=70 write: IOPS=10, BW=42.7KiB/s (43.8kB/s)(1564KiB/36587msec); 0 zone resets clat (msec): min=26, max=271, avg=81.14, stdev=31.12 lat (msec): min=26, max=271, avg=81.15, stdev=31.12 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 43], 10.00th=[ 49], 20.00th=[ 56], | 30.00th=[ 64], 40.00th=[ 71], 50.00th=[ 77], 60.00th=[ 85], | 70.00th=[ 91], 80.00th=[ 104], 90.00th=[ 114], 95.00th=[ 136], | 99.00th=[ 194], 99.50th=[ 203], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 71, per=25.37%, avg=42.36, stdev=11.75, samples=72 iops : min= 1, max= 17, avg=10.06, stdev= 2.99, samples=72 lat (msec) : 4=1.95%, 10=28.26%, 20=14.06%, 50=8.72%, 100=35.55% lat (msec) : 250=11.33%, 500=0.13% cpu : usr=0.10%, sys=0.65%, ctx=850, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (163kB/s), 38.1KiB/s-44.0KiB/s (39.1kB/s-45.1kB/s), io=5988KiB (6132kB), run=35507-37654msec WRITE: bw=167KiB/s (171kB/s), 42.5KiB/s-43.4KiB/s (43.5kB/s-44.5kB/s), io=6300KiB (6451kB), run=35507-37654msec