== sanity test 398b: DIO and buffer IO race ============== 07:50:14 (1764939014) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.27446 s, 45.8 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=123415: Fri Dec 5 07:50:35 2025 read: IOPS=30, BW=120KiB/s (123kB/s)(1480KiB/12308msec) clat (usec): min=7, max=123026, avg=12626.90, stdev=16544.93 lat (usec): min=7, max=123027, avg=12630.99, stdev=16542.86 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 27], | 30.00th=[ 38], 40.00th=[ 60], 50.00th=[ 6128], 60.00th=[ 13173], | 70.00th=[ 19530], 80.00th=[ 24511], 90.00th=[ 32375], 95.00th=[ 41681], | 99.00th=[ 71828], 99.50th=[ 76022], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 47, max= 212, per=24.87%, avg=119.12, stdev=44.97, samples=24 iops : min= 11, max= 53, avg=29.29, stdev=11.27, samples=24 write: IOPS=32, BW=129KiB/s (132kB/s)(1592KiB/12308msec); 0 zone resets clat (usec): min=172, max=121065, avg=19097.41, stdev=25962.82 lat (usec): min=173, max=121066, avg=19099.05, stdev=25963.50 clat percentiles (usec): | 1.00th=[ 188], 5.00th=[ 208], 10.00th=[ 239], 20.00th=[ 322], | 30.00th=[ 506], 40.00th=[ 5604], 50.00th=[ 8979], 60.00th=[ 14091], | 70.00th=[ 20317], 80.00th=[ 32637], 90.00th=[ 56886], 95.00th=[ 79168], | 99.00th=[112722], 99.50th=[119014], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 55, max= 192, per=25.50%, avg=128.54, stdev=36.07, samples=24 iops : min= 13, max= 48, avg=31.62, stdev= 9.10, samples=24 lat (usec) : 10=1.30%, 20=4.95%, 50=11.72%, 100=2.99%, 250=6.25% lat (usec) : 500=10.03%, 750=0.78%, 1000=0.78% lat (msec) : 2=1.95%, 4=2.08%, 10=10.55%, 20=16.41%, 50=22.79% lat (msec) : 100=5.99%, 250=1.43% cpu : usr=0.10%, sys=3.13%, ctx=948, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=123416: Fri Dec 5 07:50:35 2025 read: IOPS=28, BW=115KiB/s (118kB/s)(1436KiB/12482msec) clat (usec): min=7, max=142677, avg=12493.21, stdev=19692.20 lat (usec): min=7, max=142680, avg=12494.27, stdev=19692.22 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 26], | 30.00th=[ 35], 40.00th=[ 48], 50.00th=[ 388], 60.00th=[ 11863], | 70.00th=[ 17171], 80.00th=[ 23462], 90.00th=[ 32900], 95.00th=[ 41681], | 99.00th=[116917], 99.50th=[133694], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 26, max= 215, per=23.72%, avg=113.62, stdev=49.71, samples=24 iops : min= 6, max= 53, avg=27.88, stdev=12.36, samples=24 write: IOPS=32, BW=131KiB/s (134kB/s)(1636KiB/12482msec); 0 zone resets clat (usec): min=159, max=151891, avg=19404.95, stdev=26203.77 lat (usec): min=159, max=151892, avg=19416.85, stdev=26203.22 clat percentiles (usec): | 1.00th=[ 188], 5.00th=[ 208], 10.00th=[ 237], 20.00th=[ 310], | 30.00th=[ 445], 40.00th=[ 3884], 50.00th=[ 9503], 60.00th=[ 15139], | 70.00th=[ 22938], 80.00th=[ 33162], 90.00th=[ 58983], 95.00th=[ 78119], | 99.00th=[110625], 99.50th=[120062], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 71, max= 247, per=25.42%, avg=128.12, stdev=46.38, samples=24 iops : min= 17, max= 61, avg=31.54, stdev=11.55, samples=24 lat (usec) : 10=1.43%, 20=5.21%, 50=12.63%, 100=2.99%, 250=6.77% lat (usec) : 500=11.98%, 750=0.91%, 1000=0.26% lat (msec) : 2=1.04%, 4=2.34%, 10=7.68%, 20=18.36%, 50=20.18% lat (msec) : 100=6.51%, 250=1.69% cpu : usr=0.12%, sys=2.88%, ctx=849, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=123417: Fri Dec 5 07:50:35 2025 read: IOPS=31, BW=128KiB/s (131kB/s)(1564KiB/12260msec) clat (usec): min=7, max=102694, avg=11733.19, stdev=15080.04 lat (usec): min=7, max=102696, avg=11734.41, stdev=15080.16 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 20], 20.00th=[ 28], | 30.00th=[ 39], 40.00th=[ 62], 50.00th=[ 6783], 60.00th=[ 13698], | 70.00th=[ 17957], 80.00th=[ 22152], 90.00th=[ 32375], 95.00th=[ 41157], | 99.00th=[ 58459], 99.50th=[ 89654], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 55, max= 231, per=26.70%, avg=127.92, stdev=52.91, samples=24 iops : min= 13, max= 57, avg=31.50, stdev=13.24, samples=24 write: IOPS=30, BW=123KiB/s (126kB/s)(1508KiB/12260msec); 0 zone resets clat (usec): min=172, max=149827, avg=20245.53, stdev=28549.81 lat (usec): min=172, max=149829, avg=20246.79, stdev=28549.84 clat percentiles (usec): | 1.00th=[ 184], 5.00th=[ 212], 10.00th=[ 243], 20.00th=[ 297], | 30.00th=[ 437], 40.00th=[ 4080], 50.00th=[ 10290], 60.00th=[ 15008], | 70.00th=[ 21365], 80.00th=[ 31589], 90.00th=[ 62129], 95.00th=[ 83362], | 99.00th=[128451], 99.50th=[145753], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 62, max= 199, per=24.25%, avg=122.21, stdev=37.72, samples=24 iops : min= 15, max= 49, avg=30.00, stdev= 9.47, samples=24 lat (usec) : 10=1.56%, 20=4.17%, 50=12.63%, 100=3.78%, 250=6.38% lat (usec) : 500=10.94%, 750=0.65%, 1000=0.65% lat (msec) : 2=1.82%, 4=1.69%, 10=8.33%, 20=19.01%, 50=20.70% lat (msec) : 100=6.12%, 250=1.56% cpu : usr=0.12%, sys=2.81%, ctx=905, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=123418: Fri Dec 5 07:50:35 2025 read: IOPS=32, BW=130KiB/s (133kB/s)(1508KiB/11630msec) clat (usec): min=6, max=114449, avg=11562.45, stdev=16346.21 lat (usec): min=6, max=114450, avg=11564.81, stdev=16345.95 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 17], 20.00th=[ 27], | 30.00th=[ 36], 40.00th=[ 50], 50.00th=[ 200], 60.00th=[ 11731], | 70.00th=[ 17695], 80.00th=[ 23987], 90.00th=[ 30802], 95.00th=[ 38536], | 99.00th=[ 73925], 99.50th=[ 96994], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 39, max= 199, per=26.22%, avg=125.59, stdev=47.03, samples=22 iops : min= 9, max= 49, avg=30.82, stdev=11.76, samples=22 write: IOPS=33, BW=134KiB/s (138kB/s)(1564KiB/11630msec); 0 zone resets clat (usec): min=169, max=141658, avg=18477.64, stdev=25348.54 lat (usec): min=170, max=141659, avg=18478.87, stdev=25348.51 clat percentiles (usec): | 1.00th=[ 188], 5.00th=[ 215], 10.00th=[ 247], 20.00th=[ 330], | 30.00th=[ 465], 40.00th=[ 6128], 50.00th=[ 9765], 60.00th=[ 13829], | 70.00th=[ 20841], 80.00th=[ 32375], 90.00th=[ 52691], 95.00th=[ 74974], | 99.00th=[122160], 99.50th=[135267], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 46, max= 239, per=26.13%, avg=131.68, stdev=46.15, samples=22 iops : min= 11, max= 59, avg=32.36, stdev=11.50, samples=22 lat (usec) : 10=1.43%, 20=5.21%, 50=13.15%, 100=4.30%, 250=6.25% lat (usec) : 500=10.94%, 750=0.65%, 1000=0.26% lat (msec) : 2=1.82%, 4=1.30%, 10=9.64%, 20=16.67%, 50=21.88% lat (msec) : 100=5.21%, 250=1.30% cpu : usr=0.20%, sys=2.92%, ctx=857, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=480KiB/s (491kB/s), 115KiB/s-130KiB/s (118kB/s-133kB/s), io=5988KiB (6132kB), run=11630-12482msec WRITE: bw=505KiB/s (517kB/s), 123KiB/s-134KiB/s (126kB/s-138kB/s), io=6300KiB (6451kB), run=11630-12482msec rand-rw: (groupid=0, jobs=1): err= 0: pid=123410: Fri Dec 5 07:51:05 2025 read: IOPS=8, BW=35.2KiB/s (36.1kB/s)(1480KiB/42022msec) clat (msec): min=3, max=169, avg=15.14, stdev=16.12 lat (msec): min=3, max=169, avg=15.14, stdev=16.12 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 18], 90.00th=[ 25], 95.00th=[ 41], | 99.00th=[ 96], 99.50th=[ 115], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 7, max= 104, per=24.75%, avg=34.65, stdev=20.95, samples=83 iops : min= 1, max= 26, avg= 8.12, stdev= 5.31, samples=83 write: IOPS=9, BW=37.9KiB/s (38.8kB/s)(1592KiB/42022msec); 0 zone resets clat (msec): min=36, max=270, avg=91.32, stdev=32.14 lat (msec): min=36, max=270, avg=91.32, stdev=32.14 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 50], 10.00th=[ 59], 20.00th=[ 68], | 30.00th=[ 73], 40.00th=[ 79], 50.00th=[ 85], 60.00th=[ 93], | 70.00th=[ 103], 80.00th=[ 113], 90.00th=[ 131], 95.00th=[ 146], | 99.00th=[ 222], 99.50th=[ 228], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 15, max= 64, per=25.20%, avg=37.29, stdev=10.00, samples=83 iops : min= 3, max= 16, avg= 8.78, stdev= 2.54, samples=83 lat (msec) : 4=0.26%, 10=19.79%, 20=20.70%, 50=8.59%, 100=33.98% lat (msec) : 250=16.54%, 500=0.13% cpu : usr=0.09%, sys=0.68%, ctx=831, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=123411: Fri Dec 5 07:51:05 2025 read: IOPS=8, BW=33.8KiB/s (34.6kB/s)(1436KiB/42519msec) clat (msec): min=3, max=131, avg=15.27, stdev=15.89 lat (msec): min=3, max=131, avg=15.28, stdev=15.89 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 18], 90.00th=[ 29], 95.00th=[ 41], | 99.00th=[ 90], 99.50th=[ 130], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 7, max= 80, per=24.82%, avg=34.75, stdev=19.35, samples=80 iops : min= 1, max= 20, avg= 8.15, stdev= 4.87, samples=80 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(1636KiB/42519msec); 0 zone resets clat (msec): min=37, max=233, avg=90.45, stdev=30.81 lat (msec): min=37, max=233, avg=90.46, stdev=30.81 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 73], 40.00th=[ 79], 50.00th=[ 86], 60.00th=[ 92], | 70.00th=[ 101], 80.00th=[ 110], 90.00th=[ 128], 95.00th=[ 157], | 99.00th=[ 199], 99.50th=[ 220], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 15, max= 63, per=25.51%, avg=37.76, stdev=10.23, samples=84 iops : min= 3, max= 15, avg= 8.89, stdev= 2.62, samples=84 lat (msec) : 4=0.52%, 10=18.75%, 20=20.05%, 50=7.81%, 100=36.33% lat (msec) : 250=16.54% cpu : usr=0.11%, sys=0.78%, ctx=874, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=123412: Fri Dec 5 07:51:05 2025 read: IOPS=9, BW=38.6KiB/s (39.5kB/s)(1564KiB/40499msec) clat (msec): min=2, max=135, avg=14.61, stdev=14.49 lat (msec): min=2, max=135, avg=14.61, stdev=14.49 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 18], 90.00th=[ 22], 95.00th=[ 39], | 99.00th=[ 86], 99.50th=[ 134], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 7, max= 112, per=27.75%, avg=38.85, stdev=24.27, samples=79 iops : min= 1, max= 28, avg= 9.18, stdev= 6.11, samples=79 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(1508KiB/40499msec); 0 zone resets clat (msec): min=40, max=259, avg=92.07, stdev=33.38 lat (msec): min=40, max=259, avg=92.07, stdev=33.38 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 79], 50.00th=[ 86], 60.00th=[ 95], | 70.00th=[ 105], 80.00th=[ 113], 90.00th=[ 133], 95.00th=[ 157], | 99.00th=[ 218], 99.50th=[ 243], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 7, max= 55, per=24.81%, avg=36.71, stdev= 9.88, samples=80 iops : min= 1, max= 13, avg= 8.65, stdev= 2.56, samples=80 lat (msec) : 4=0.39%, 10=21.09%, 20=22.40%, 50=7.68%, 100=31.25% lat (msec) : 250=17.06%, 500=0.13% cpu : usr=0.10%, sys=0.74%, ctx=860, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=123413: Fri Dec 5 07:51:05 2025 read: IOPS=9, BW=36.5KiB/s (37.4kB/s)(1508KiB/41306msec) clat (msec): min=2, max=170, avg=14.66, stdev=16.18 lat (msec): min=2, max=170, avg=14.67, stdev=16.18 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 18], 90.00th=[ 26], 95.00th=[ 34], | 99.00th=[ 94], 99.50th=[ 138], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 7, max= 103, per=26.88%, avg=37.64, stdev=21.19, samples=77 iops : min= 1, max= 25, avg= 8.88, stdev= 5.31, samples=77 write: IOPS=9, BW=37.9KiB/s (38.8kB/s)(1564KiB/41306msec); 0 zone resets clat (msec): min=37, max=359, avg=91.26, stdev=31.99 lat (msec): min=37, max=359, avg=91.26, stdev=31.99 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 75], 40.00th=[ 82], 50.00th=[ 86], 60.00th=[ 92], | 70.00th=[ 102], 80.00th=[ 112], 90.00th=[ 133], 95.00th=[ 146], | 99.00th=[ 182], 99.50th=[ 262], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 15, max= 61, per=25.22%, avg=37.32, stdev= 9.79, samples=81 iops : min= 3, max= 15, avg= 8.80, stdev= 2.55, samples=81 lat (msec) : 4=0.91%, 10=21.09%, 20=20.05%, 50=7.81%, 100=33.33% lat (msec) : 250=16.54%, 500=0.26% cpu : usr=0.08%, sys=0.73%, ctx=842, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=141KiB/s (144kB/s), 33.8KiB/s-38.6KiB/s (34.6kB/s-39.5kB/s), io=5988KiB (6132kB), run=40499-42519msec WRITE: bw=148KiB/s (152kB/s), 37.2KiB/s-38.5KiB/s (38.1kB/s-39.4kB/s), io=6300KiB (6451kB), run=40499-42519msec