== sanity test 398b: DIO and buffer IO race ============== 04:42:36 (1722242556) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB) copied, 0.142785 s, 88.1 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=26773: Mon Jul 29 04:42:47 2024 read: IOPS=49, BW=197KiB/s (202kB/s)(1480KiB/7512msec) clat (usec): min=4, max=126406, avg=5725.74, stdev=12973.50 lat (usec): min=4, max=126406, avg=5726.81, stdev=12974.59 clat percentiles (usec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 23], 50.00th=[ 37], 60.00th=[ 685], | 70.00th=[ 7308], 80.00th=[ 10159], 90.00th=[ 14353], 95.00th=[ 18744], | 99.00th=[ 86508], 99.50th=[106431], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 16, max= 400, per=27.23%, avg=196.87, stdev=95.91, samples=15 iops : min= 4, max= 100, avg=48.87, stdev=23.93, samples=15 write: IOPS=52, BW=212KiB/s (217kB/s)(1592KiB/7512msec) clat (usec): min=111, max=184071, avg=13498.78, stdev=23562.50 lat (usec): min=111, max=184072, avg=13500.68, stdev=23562.08 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 141], 10.00th=[ 149], 20.00th=[ 169], | 30.00th=[ 210], 40.00th=[ 725], 50.00th=[ 2966], 60.00th=[ 5997], | 70.00th=[ 9503], 80.00th=[ 21103], 90.00th=[ 46924], 95.00th=[ 68682], | 99.00th=[105382], 99.50th=[112722], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 40, max= 360, per=27.80%, avg=211.27, stdev=74.27, samples=15 iops : min= 10, max= 90, avg=52.47, stdev=18.55, samples=15 lat (usec) : 10=7.81%, 20=9.51%, 50=8.59%, 100=1.30%, 250=18.88% lat (usec) : 500=1.56%, 750=2.34%, 1000=1.56% lat (msec) : 2=2.60%, 4=3.39%, 10=17.32%, 20=12.63%, 50=7.03% lat (msec) : 100=4.69%, 250=0.78% cpu : usr=0.19%, sys=4.83%, ctx=687, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=26774: Mon Jul 29 04:42:47 2024 read: IOPS=44, BW=176KiB/s (180kB/s)(1436KiB/8150msec) clat (usec): min=4, max=113716, avg=5113.74, stdev=10729.90 lat (usec): min=4, max=113716, avg=5114.57, stdev=10729.92 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 29], 60.00th=[ 1221], | 70.00th=[ 6128], 80.00th=[ 10814], 90.00th=[ 14484], 95.00th=[ 17171], | 99.00th=[ 61604], 99.50th=[102237], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 8, max= 295, per=24.15%, avg=174.62, stdev=76.04, samples=16 iops : min= 2, max= 73, avg=43.38, stdev=18.83, samples=16 write: IOPS=50, BW=201KiB/s (206kB/s)(1636KiB/8150msec) clat (usec): min=121, max=152849, avg=15376.71, stdev=26863.63 lat (usec): min=121, max=152850, avg=15378.74, stdev=26863.45 clat percentiles (usec): | 1.00th=[ 131], 5.00th=[ 139], 10.00th=[ 149], 20.00th=[ 167], | 30.00th=[ 196], 40.00th=[ 437], 50.00th=[ 2409], 60.00th=[ 5473], | 70.00th=[ 11207], 80.00th=[ 27132], 90.00th=[ 54264], 95.00th=[ 72877], | 99.00th=[113771], 99.50th=[143655], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 24, max= 319, per=25.92%, avg=197.00, stdev=82.43, samples=16 iops : min= 6, max= 79, avg=49.00, stdev=20.45, samples=16 lat (usec) : 10=8.07%, 20=12.11%, 50=6.51%, 100=0.39%, 250=19.66% lat (usec) : 500=2.60%, 750=1.43%, 1000=0.52% lat (msec) : 2=2.73%, 4=4.69%, 10=14.58%, 20=13.54%, 50=6.64% lat (msec) : 100=4.95%, 250=1.56% cpu : usr=0.18%, sys=4.69%, ctx=717, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=26775: Mon Jul 29 04:42:47 2024 read: IOPS=49, BW=199KiB/s (204kB/s)(1564KiB/7843msec) clat (usec): min=3, max=99702, avg=5742.20, stdev=11429.62 lat (usec): min=4, max=99703, avg=5743.13, stdev=11429.59 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 33], 60.00th=[ 3490], | 70.00th=[ 7701], 80.00th=[ 10552], 90.00th=[ 13960], 95.00th=[ 18744], | 99.00th=[ 72877], 99.50th=[ 79168], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 96, max= 295, per=27.25%, avg=197.00, stdev=66.17, samples=15 iops : min= 24, max= 73, avg=49.00, stdev=16.51, samples=15 write: IOPS=48, BW=192KiB/s (197kB/s)(1508KiB/7843msec) clat (usec): min=121, max=129021, avg=14747.95, stdev=25316.20 lat (usec): min=121, max=129023, avg=14749.84, stdev=25315.81 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 143], 10.00th=[ 149], 20.00th=[ 176], | 30.00th=[ 237], 40.00th=[ 791], 50.00th=[ 2442], 60.00th=[ 5342], | 70.00th=[ 11338], 80.00th=[ 25297], 90.00th=[ 52167], 95.00th=[ 79168], | 99.00th=[114820], 99.50th=[126354], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 120, max= 328, per=24.24%, avg=184.20, stdev=57.92, samples=15 iops : min= 30, max= 82, avg=45.80, stdev=14.33, samples=15 lat (usec) : 4=0.13%, 10=7.03%, 20=14.19%, 50=6.12%, 100=0.39% lat (usec) : 250=16.41%, 500=3.12%, 750=1.43%, 1000=2.08% lat (msec) : 2=2.99%, 4=4.17%, 10=15.62%, 20=13.15%, 50=6.90% lat (msec) : 100=5.60%, 250=0.65% cpu : usr=0.69%, sys=4.12%, ctx=721, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=26776: Mon Jul 29 04:42:47 2024 read: IOPS=45, BW=182KiB/s (186kB/s)(1508KiB/8282msec) clat (usec): min=3, max=142311, avg=5113.21, stdev=12295.08 lat (usec): min=3, max=142312, avg=5115.93, stdev=12295.81 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 24], 60.00th=[ 82], | 70.00th=[ 5735], 80.00th=[ 9634], 90.00th=[ 14484], 95.00th=[ 17695], | 99.00th=[ 72877], 99.50th=[109577], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 32, max= 392, per=23.40%, avg=169.19, stdev=82.18, samples=16 iops : min= 8, max= 98, avg=42.06, stdev=20.52, samples=16 write: IOPS=47, BW=189KiB/s (193kB/s)(1564KiB/8282msec) clat (usec): min=117, max=169156, avg=16159.44, stdev=28405.16 lat (usec): min=118, max=169156, avg=16161.29, stdev=28406.89 clat percentiles (usec): | 1.00th=[ 123], 5.00th=[ 137], 10.00th=[ 155], 20.00th=[ 180], | 30.00th=[ 221], 40.00th=[ 660], 50.00th=[ 3130], 60.00th=[ 6325], | 70.00th=[ 10814], 80.00th=[ 27919], 90.00th=[ 55837], 95.00th=[ 88605], | 99.00th=[123208], 99.50th=[143655], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 32, max= 440, per=23.31%, avg=177.19, stdev=89.35, samples=16 iops : min= 8, max= 110, avg=44.06, stdev=22.28, samples=16 lat (usec) : 4=0.39%, 10=8.85%, 20=13.67%, 50=5.99%, 100=0.65% lat (usec) : 250=17.32%, 500=2.47%, 750=1.95%, 1000=0.91% lat (msec) : 2=2.34%, 4=4.69%, 10=15.49%, 20=12.50%, 50=6.12% lat (msec) : 100=4.95%, 250=1.69% cpu : usr=0.00%, sys=4.37%, ctx=684, majf=0, minf=35 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=723KiB/s (740kB/s), 176KiB/s-199KiB/s (180kB/s-204kB/s), io=5988KiB (6132kB), run=7512-8282msec WRITE: bw=761KiB/s (779kB/s), 189KiB/s-212KiB/s (193kB/s-217kB/s), io=6300KiB (6451kB), run=7512-8282msec rand-rw: (groupid=0, jobs=1): err= 0: pid=26768: Mon Jul 29 04:43:17 2024 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(1480KiB/37688msec) clat (usec): min=1598, max=108018, avg=8108.81, stdev=10589.53 lat (usec): min=1599, max=108018, avg=8110.35, stdev=10589.52 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 5], 50.00th=[ 6], 60.00th=[ 7], | 70.00th=[ 8], 80.00th=[ 9], 90.00th=[ 13], 95.00th=[ 17], | 99.00th=[ 67], 99.50th=[ 105], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 7, max= 144, per=25.19%, avg=39.04, stdev=22.65, samples=74 iops : min= 1, max= 36, avg= 9.45, stdev= 5.71, samples=74 write: IOPS=10, BW=42.2KiB/s (43.3kB/s)(1592KiB/37688msec) clat (msec): min=38, max=227, avg=87.01, stdev=30.26 lat (msec): min=38, max=227, avg=87.02, stdev=30.26 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 48], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 84], 60.00th=[ 91], | 70.00th=[ 99], 80.00th=[ 109], 90.00th=[ 123], 95.00th=[ 148], | 99.00th=[ 184], 99.50th=[ 213], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 15, max= 64, per=25.52%, avg=41.60, stdev= 9.22, samples=75 iops : min= 3, max= 16, avg=10.08, stdev= 2.35, samples=75 lat (msec) : 2=0.13%, 4=10.42%, 10=29.82%, 20=5.60%, 50=5.08% lat (msec) : 100=34.24%, 250=14.71% cpu : usr=0.10%, sys=1.03%, ctx=828, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=26769: Mon Jul 29 04:43:17 2024 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(1436KiB/38533msec) clat (usec): min=1801, max=134470, avg=8204.41, stdev=13188.09 lat (usec): min=1803, max=134472, avg=8206.00, stdev=13188.04 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 5], 50.00th=[ 6], 60.00th=[ 6], | 70.00th=[ 7], 80.00th=[ 8], 90.00th=[ 12], 95.00th=[ 24], | 99.00th=[ 75], 99.50th=[ 129], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 7, max= 104, per=24.53%, avg=38.03, stdev=23.11, samples=73 iops : min= 1, max= 26, avg= 9.18, stdev= 5.79, samples=73 write: IOPS=10, BW=42.5KiB/s (43.5kB/s)(1636KiB/38533msec) clat (msec): min=29, max=355, avg=86.93, stdev=33.72 lat (msec): min=29, max=355, avg=86.94, stdev=33.72 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 43], 10.00th=[ 51], 20.00th=[ 62], | 30.00th=[ 68], 40.00th=[ 74], 50.00th=[ 83], 60.00th=[ 90], | 70.00th=[ 99], 80.00th=[ 110], 90.00th=[ 128], 95.00th=[ 142], | 99.00th=[ 190], 99.50th=[ 194], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 15, max= 87, per=25.31%, avg=41.25, stdev=11.41, samples=76 iops : min= 3, max= 21, avg= 9.99, stdev= 2.89, samples=76 lat (msec) : 2=0.26%, 4=12.63%, 10=27.86%, 20=3.65%, 50=6.51% lat (msec) : 100=33.46%, 250=15.49%, 500=0.13% cpu : usr=0.17%, sys=0.97%, ctx=835, majf=0, minf=30 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=26770: Mon Jul 29 04:43:17 2024 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(1564KiB/36484msec) clat (usec): min=1901, max=114529, avg=8132.77, stdev=11598.00 lat (usec): min=1903, max=114530, avg=8134.30, stdev=11597.97 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 7], | 70.00th=[ 8], 80.00th=[ 9], 90.00th=[ 11], 95.00th=[ 15], | 99.00th=[ 78], 99.50th=[ 81], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 7, max= 120, per=27.76%, avg=43.03, stdev=27.40, samples=72 iops : min= 1, max= 30, avg=10.53, stdev= 6.93, samples=72 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(1508KiB/36484msec) clat (msec): min=37, max=322, avg=88.23, stdev=33.49 lat (msec): min=37, max=322, avg=88.23, stdev=33.49 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 48], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 69], 40.00th=[ 78], 50.00th=[ 85], 60.00th=[ 92], | 70.00th=[ 100], 80.00th=[ 109], 90.00th=[ 125], 95.00th=[ 146], | 99.00th=[ 234], 99.50th=[ 245], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 23, max= 56, per=25.10%, avg=40.92, stdev= 8.33, samples=72 iops : min= 5, max= 14, avg=10.00, stdev= 2.18, samples=72 lat (msec) : 2=0.13%, 4=11.85%, 10=32.42%, 20=4.43%, 50=4.17% lat (msec) : 100=32.55%, 250=14.32%, 500=0.13% cpu : usr=0.00%, sys=1.18%, ctx=819, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=26772: Mon Jul 29 04:43:17 2024 read: IOPS=10, BW=40.1KiB/s (41.0kB/s)(1508KiB/37643msec) clat (usec): min=1829, max=102241, avg=8580.72, stdev=11323.90 lat (usec): min=1831, max=102242, avg=8582.21, stdev=11323.85 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 7], | 70.00th=[ 8], 80.00th=[ 10], 90.00th=[ 14], 95.00th=[ 21], | 99.00th=[ 75], 99.50th=[ 99], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 7, max= 104, per=25.80%, avg=39.99, stdev=24.49, samples=74 iops : min= 1, max= 26, avg= 9.74, stdev= 6.13, samples=74 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(1564KiB/37643msec) clat (msec): min=36, max=352, avg=87.91, stdev=33.55 lat (msec): min=36, max=352, avg=87.91, stdev=33.55 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 59], | 30.00th=[ 68], 40.00th=[ 78], 50.00th=[ 85], 60.00th=[ 92], | 70.00th=[ 103], 80.00th=[ 111], 90.00th=[ 126], 95.00th=[ 142], | 99.00th=[ 199], 99.50th=[ 224], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 15, max= 71, per=25.24%, avg=41.15, stdev=10.22, samples=75 iops : min= 3, max= 17, avg=10.03, stdev= 2.64, samples=75 lat (msec) : 2=0.13%, 4=10.94%, 10=29.69%, 20=5.86%, 50=5.47% lat (msec) : 100=31.77%, 250=16.02%, 500=0.13% cpu : usr=0.21%, sys=0.92%, ctx=826, majf=0, minf=33 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 37.3KiB/s-42.9KiB/s (38.2kB/s-43.9kB/s), io=5988KiB (6132kB), run=36484-38533msec WRITE: bw=163KiB/s (167kB/s), 41.3KiB/s-42.5KiB/s (42.3kB/s-43.5kB/s), io=6300KiB (6451kB), run=36484-38533msec