== sanity test 398b: DIO and buffer IO race ============== 09:38:33 (1761313113) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.18852 s, 66.7 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=122817: Fri Oct 24 09:38:52 2025 read: IOPS=37, BW=149KiB/s (153kB/s)(1480KiB/9934msec) clat (usec): min=6, max=142158, avg=11485.20, stdev=17664.71 lat (usec): min=7, max=142158, avg=11485.99, stdev=17664.74 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 39], 40.00th=[ 60], 50.00th=[ 7373], 60.00th=[ 11600], | 70.00th=[ 15270], 80.00th=[ 18482], 90.00th=[ 25560], 95.00th=[ 34341], | 99.00th=[101188], 99.50th=[122160], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 63, max= 320, per=25.32%, avg=148.63, stdev=71.18, samples=19 iops : min= 15, max= 80, avg=36.68, stdev=17.97, samples=19 write: IOPS=40, BW=160KiB/s (164kB/s)(1592KiB/9934msec); 0 zone resets clat (usec): min=164, max=105463, avg=14060.93, stdev=18576.90 lat (usec): min=165, max=105463, avg=14061.82, stdev=18576.91 clat percentiles (usec): | 1.00th=[ 174], 5.00th=[ 206], 10.00th=[ 225], 20.00th=[ 277], | 30.00th=[ 375], 40.00th=[ 4015], 50.00th=[ 7963], 60.00th=[ 11994], | 70.00th=[ 15795], 80.00th=[ 23200], 90.00th=[ 39060], 95.00th=[ 55313], | 99.00th=[ 86508], 99.50th=[ 90702], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 87, max= 256, per=26.16%, avg=161.42, stdev=50.90, samples=19 iops : min= 21, max= 64, avg=39.89, stdev=12.78, samples=19 lat (usec) : 10=1.56%, 20=5.08%, 50=10.81%, 100=2.34%, 250=9.24% lat (usec) : 500=8.33%, 750=1.17%, 1000=0.78% lat (msec) : 2=1.43%, 4=1.43%, 10=13.28%, 20=24.87%, 50=14.58% lat (msec) : 100=4.43%, 250=0.65% cpu : usr=0.13%, sys=3.65%, ctx=920, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122819: Fri Oct 24 09:38:52 2025 read: IOPS=35, BW=141KiB/s (144kB/s)(1436KiB/10201msec) clat (usec): min=6, max=173404, avg=11648.81, stdev=17594.86 lat (usec): min=6, max=173405, avg=11649.57, stdev=17594.92 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 26], | 30.00th=[ 38], 40.00th=[ 239], 50.00th=[ 8029], 60.00th=[ 12125], | 70.00th=[ 15664], 80.00th=[ 18744], 90.00th=[ 26870], 95.00th=[ 34866], | 99.00th=[ 84411], 99.50th=[126354], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 63, max= 207, per=23.99%, avg=140.85, stdev=36.11, samples=20 iops : min= 15, max= 51, avg=34.75, stdev= 9.15, samples=20 write: IOPS=40, BW=160KiB/s (164kB/s)(1636KiB/10201msec); 0 zone resets clat (usec): min=158, max=109917, avg=14548.08, stdev=18812.88 lat (usec): min=159, max=109917, avg=14548.98, stdev=18812.91 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 206], 10.00th=[ 219], 20.00th=[ 277], | 30.00th=[ 363], 40.00th=[ 3851], 50.00th=[ 6783], 60.00th=[ 12256], | 70.00th=[ 17433], 80.00th=[ 26608], 90.00th=[ 43254], 95.00th=[ 55313], | 99.00th=[ 72877], 99.50th=[ 91751], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 95, max= 223, per=26.15%, avg=161.35, stdev=37.70, samples=20 iops : min= 23, max= 55, avg=39.90, stdev= 9.50, samples=20 lat (usec) : 10=1.56%, 20=5.21%, 50=9.11%, 100=2.73%, 250=8.85% lat (usec) : 500=8.85%, 750=1.04%, 1000=0.91% lat (msec) : 2=1.56%, 4=2.08%, 10=13.54%, 20=22.14%, 50=17.19% lat (msec) : 100=4.56%, 250=0.65% cpu : usr=0.19%, sys=3.29%, ctx=933, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122821: Fri Oct 24 09:38:52 2025 read: IOPS=40, BW=163KiB/s (167kB/s)(1564KiB/9590msec) clat (usec): min=7, max=197505, avg=10843.26, stdev=16495.76 lat (usec): min=8, max=197506, avg=10843.98, stdev=16495.73 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 38], 40.00th=[ 65], 50.00th=[ 6325], 60.00th=[ 11469], | 70.00th=[ 15533], 80.00th=[ 19530], 90.00th=[ 24773], 95.00th=[ 30278], | 99.00th=[ 72877], 99.50th=[104334], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 80, max= 271, per=27.78%, avg=163.05, stdev=48.15, samples=19 iops : min= 20, max= 67, avg=40.32, stdev=12.01, samples=19 write: IOPS=39, BW=157KiB/s (161kB/s)(1508KiB/9590msec); 0 zone resets clat (usec): min=154, max=92927, avg=14126.28, stdev=19530.22 lat (usec): min=154, max=92928, avg=14127.39, stdev=19530.23 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 198], 10.00th=[ 219], 20.00th=[ 297], | 30.00th=[ 404], 40.00th=[ 3261], 50.00th=[ 7242], 60.00th=[10683], | 70.00th=[14353], 80.00th=[22938], 90.00th=[43254], 95.00th=[59507], | 99.00th=[86508], 99.50th=[91751], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 96, max= 256, per=25.38%, avg=156.58, stdev=46.33, samples=19 iops : min= 24, max= 64, avg=38.68, stdev=11.63, samples=19 lat (usec) : 10=0.78%, 20=5.34%, 50=12.37%, 100=2.60%, 250=7.68% lat (usec) : 500=9.51%, 750=0.26%, 1000=0.91% lat (msec) : 2=1.30%, 4=2.34%, 10=13.93%, 20=22.27%, 50=15.63% lat (msec) : 100=4.82%, 250=0.26% cpu : usr=0.09%, sys=3.52%, ctx=912, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122823: Fri Oct 24 09:38:52 2025 read: IOPS=37, BW=149KiB/s (152kB/s)(1508KiB/10126msec) clat (usec): min=5, max=110859, avg=10134.59, stdev=15271.43 lat (usec): min=6, max=110860, avg=10136.04, stdev=15272.63 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 31], 40.00th=[ 47], 50.00th=[ 5932], 60.00th=[ 10290], | 70.00th=[ 13698], 80.00th=[ 17957], 90.00th=[ 23200], 95.00th=[ 30540], | 99.00th=[ 93848], 99.50th=[102237], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 7, max= 320, per=25.07%, avg=147.15, stdev=63.41, samples=20 iops : min= 1, max= 80, avg=36.30, stdev=15.98, samples=20 write: IOPS=38, BW=154KiB/s (158kB/s)(1564KiB/10126msec); 0 zone resets clat (usec): min=151, max=175306, avg=15988.18, stdev=24536.07 lat (usec): min=152, max=175307, avg=15989.05, stdev=24536.13 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 200], 10.00th=[ 225], 20.00th=[ 289], | 30.00th=[ 420], 40.00th=[ 3294], 50.00th=[ 6783], 60.00th=[ 10945], | 70.00th=[ 16909], 80.00th=[ 26346], 90.00th=[ 39060], 95.00th=[ 77071], | 99.00th=[107480], 99.50th=[168821], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 29, max= 312, per=24.94%, avg=153.90, stdev=56.70, samples=20 iops : min= 7, max= 78, avg=38.00, stdev=14.21, samples=20 lat (usec) : 10=1.69%, 20=6.77%, 50=11.72%, 100=1.69%, 250=7.94% lat (usec) : 500=9.38%, 750=0.52%, 1000=0.65% lat (msec) : 2=1.56%, 4=2.60%, 10=14.06%, 20=19.66%, 50=16.80% lat (msec) : 100=4.17%, 250=0.78% cpu : usr=0.12%, sys=3.21%, ctx=868, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=587KiB/s (601kB/s), 141KiB/s-163KiB/s (144kB/s-167kB/s), io=5988KiB (6132kB), run=9590-10201msec WRITE: bw=618KiB/s (632kB/s), 154KiB/s-160KiB/s (158kB/s-164kB/s), io=6300KiB (6451kB), run=9590-10201msec rand-rw: (groupid=0, jobs=1): err= 0: pid=122818: Fri Oct 24 09:39:22 2025 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(1480KiB/39703msec) clat (msec): min=3, max=122, avg=15.34, stdev=14.84 lat (msec): min=3, max=122, avg=15.34, stdev=14.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 42], | 99.00th=[ 83], 99.50th=[ 101], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 7, max= 143, per=24.86%, avg=37.04, stdev=21.11, samples=76 iops : min= 1, max= 35, avg= 8.74, stdev= 5.28, samples=76 write: IOPS=10, BW=40.1KiB/s (41.1kB/s)(1592KiB/39703msec); 0 zone resets clat (msec): min=32, max=314, avg=85.24, stdev=30.08 lat (msec): min=32, max=314, avg=85.25, stdev=30.08 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 48], 10.00th=[ 55], 20.00th=[ 63], | 30.00th=[ 69], 40.00th=[ 75], 50.00th=[ 80], 60.00th=[ 88], | 70.00th=[ 96], 80.00th=[ 105], 90.00th=[ 117], 95.00th=[ 133], | 99.00th=[ 186], 99.50th=[ 241], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 21, max= 63, per=25.01%, avg=39.27, stdev= 8.47, samples=78 iops : min= 5, max= 15, avg= 9.29, stdev= 2.11, samples=78 lat (msec) : 4=0.78%, 10=22.40%, 20=14.97%, 50=11.72%, 100=36.72% lat (msec) : 250=13.28%, 500=0.13% cpu : usr=0.06%, sys=0.70%, ctx=911, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122820: Fri Oct 24 09:39:22 2025 read: IOPS=8, BW=35.8KiB/s (36.7kB/s)(1436KiB/40102msec) clat (usec): min=2922, max=99068, avg=14590.21, stdev=13104.07 lat (usec): min=2923, max=99068, avg=14591.58, stdev=13104.44 clat percentiles (usec): | 1.00th=[ 3621], 5.00th=[ 4424], 10.00th=[ 5342], 20.00th=[ 6390], | 30.00th=[ 7635], 40.00th=[ 8979], 50.00th=[10421], 60.00th=[12125], | 70.00th=[15401], 80.00th=[19530], 90.00th=[28443], 95.00th=[35914], | 99.00th=[78119], 99.50th=[91751], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 7, max= 119, per=23.46%, avg=34.95, stdev=22.14, samples=79 iops : min= 1, max= 29, avg= 8.22, stdev= 5.52, samples=79 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(1636KiB/40102msec); 0 zone resets clat (msec): min=31, max=260, avg=85.02, stdev=30.95 lat (msec): min=31, max=260, avg=85.02, stdev=30.95 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 60], | 30.00th=[ 68], 40.00th=[ 73], 50.00th=[ 80], 60.00th=[ 87], | 70.00th=[ 95], 80.00th=[ 110], 90.00th=[ 123], 95.00th=[ 144], | 99.00th=[ 180], 99.50th=[ 211], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 23, max= 64, per=25.34%, avg=39.78, stdev= 9.41, samples=79 iops : min= 5, max= 16, avg= 9.43, stdev= 2.40, samples=79 lat (msec) : 4=1.30%, 10=20.83%, 20=15.63%, 50=12.11%, 100=36.46% lat (msec) : 250=13.54%, 500=0.13% cpu : usr=0.07%, sys=0.72%, ctx=930, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122822: Fri Oct 24 09:39:22 2025 read: IOPS=10, BW=40.6KiB/s (41.5kB/s)(1564KiB/38546msec) clat (msec): min=2, max=152, avg=14.65, stdev=15.24 lat (msec): min=2, max=152, avg=14.65, stdev=15.24 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 28], 95.00th=[ 39], | 99.00th=[ 89], 99.50th=[ 107], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 8, max= 112, per=27.13%, avg=40.42, stdev=23.49, samples=76 iops : min= 2, max= 28, avg= 9.59, stdev= 5.91, samples=76 write: IOPS=9, BW=39.1KiB/s (40.1kB/s)(1508KiB/38546msec); 0 zone resets clat (msec): min=32, max=281, avg=86.80, stdev=32.68 lat (msec): min=32, max=281, avg=86.80, stdev=32.68 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 48], 10.00th=[ 55], 20.00th=[ 62], | 30.00th=[ 68], 40.00th=[ 74], 50.00th=[ 81], 60.00th=[ 88], | 70.00th=[ 97], 80.00th=[ 107], 90.00th=[ 128], 95.00th=[ 148], | 99.00th=[ 213], 99.50th=[ 262], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 16, max= 63, per=24.55%, avg=38.54, stdev= 8.32, samples=76 iops : min= 4, max= 15, avg= 9.12, stdev= 2.05, samples=76 lat (msec) : 4=1.82%, 10=22.27%, 20=17.32%, 50=11.33%, 100=33.33% lat (msec) : 250=13.67%, 500=0.26% cpu : usr=0.06%, sys=0.74%, ctx=926, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122824: Fri Oct 24 09:39:22 2025 read: IOPS=9, BW=38.3KiB/s (39.2kB/s)(1508KiB/39347msec) clat (msec): min=2, max=127, avg=15.00, stdev=16.55 lat (msec): min=2, max=127, avg=15.00, stdev=16.55 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 14], 80.00th=[ 19], 90.00th=[ 29], 95.00th=[ 46], | 99.00th=[ 94], 99.50th=[ 123], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 7, max= 87, per=25.87%, avg=38.55, stdev=20.11, samples=76 iops : min= 1, max= 21, avg= 9.12, stdev= 5.11, samples=76 write: IOPS=9, BW=39.7KiB/s (40.7kB/s)(1564KiB/39347msec); 0 zone resets clat (msec): min=30, max=323, avg=86.03, stdev=29.04 lat (msec): min=30, max=323, avg=86.04, stdev=29.04 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 49], 10.00th=[ 55], 20.00th=[ 64], | 30.00th=[ 70], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 91], | 70.00th=[ 97], 80.00th=[ 107], 90.00th=[ 121], 95.00th=[ 132], | 99.00th=[ 169], 99.50th=[ 251], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 8, max= 56, per=24.94%, avg=39.15, stdev= 9.47, samples=78 iops : min= 2, max= 14, avg= 9.27, stdev= 2.35, samples=78 lat (msec) : 4=1.43%, 10=23.31%, 20=16.15%, 50=8.98%, 100=36.46% lat (msec) : 250=13.41%, 500=0.26% cpu : usr=0.08%, sys=0.73%, ctx=937, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 35.8KiB/s-40.6KiB/s (36.7kB/s-41.5kB/s), io=5988KiB (6132kB), run=38546-40102msec WRITE: bw=157KiB/s (161kB/s), 39.1KiB/s-40.8KiB/s (40.1kB/s-41.8kB/s), io=6300KiB (6451kB), run=38546-40102msec