== sanity test 398b: DIO and buffer IO race ============== 15:20:54 (1776194454) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.28556 s, 44.1 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148303: Tue Apr 14 15:21:19 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(1480KiB/12978msec) clat (usec): min=7, max=227345, avg=19564.07, stdev=25078.61 lat (usec): min=7, max=227347, avg=19567.23, stdev=25080.12 clat percentiles (usec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 21], 20.00th=[ 31], | 30.00th=[ 41], 40.00th=[ 1926], 50.00th=[ 14484], 60.00th=[ 20317], | 70.00th=[ 28705], 80.00th=[ 35390], 90.00th=[ 46924], 95.00th=[ 60556], | 99.00th=[ 86508], 99.50th=[175113], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 192, per=26.14%, avg=110.56, stdev=35.84, samples=25 iops : min= 7, max= 48, avg=27.12, stdev= 9.06, samples=25 write: IOPS=30, BW=123KiB/s (126kB/s)(1592KiB/12978msec); 0 zone resets clat (usec): min=154, max=115723, avg=14136.57, stdev=18125.75 lat (usec): min=155, max=115723, avg=14142.39, stdev=18122.35 clat percentiles (usec): | 1.00th=[ 188], 5.00th=[ 210], 10.00th=[ 243], 20.00th=[ 297], | 30.00th=[ 523], 40.00th=[ 1205], 50.00th=[ 7242], 60.00th=[ 12125], | 70.00th=[ 19530], 80.00th=[ 27132], 90.00th=[ 41157], 95.00th=[ 51643], | 99.00th=[ 70779], 99.50th=[ 96994], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 47, max= 270, per=26.84%, avg=119.44, stdev=52.36, samples=25 iops : min= 11, max= 67, avg=29.36, stdev=13.21, samples=25 lat (usec) : 10=0.52%, 20=3.52%, 50=12.50%, 100=1.69%, 250=6.25% lat (usec) : 500=9.90%, 750=3.12%, 1000=1.82% lat (msec) : 2=2.08%, 4=1.95%, 10=7.16%, 20=14.45%, 50=27.34% lat (msec) : 100=7.16%, 250=0.52% cpu : usr=0.11%, sys=3.54%, ctx=816, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148304: Tue Apr 14 15:21:19 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(1436KiB/13204msec) clat (usec): min=6, max=159795, avg=21934.86, stdev=24531.45 lat (usec): min=6, max=159795, avg=21935.74, stdev=24531.43 clat percentiles (usec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 23], 20.00th=[ 31], | 30.00th=[ 43], 40.00th=[ 8455], 50.00th=[ 18220], 60.00th=[ 23462], | 70.00th=[ 30278], 80.00th=[ 39584], 90.00th=[ 53216], 95.00th=[ 67634], | 99.00th=[ 98042], 99.50th=[128451], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 63, max= 159, per=25.41%, avg=107.50, stdev=29.83, samples=26 iops : min= 15, max= 39, avg=26.38, stdev= 7.63, samples=26 write: IOPS=30, BW=124KiB/s (127kB/s)(1636KiB/13204msec); 0 zone resets clat (usec): min=173, max=105200, avg=12867.98, stdev=16266.84 lat (usec): min=174, max=105200, avg=12869.06, stdev=16266.77 clat percentiles (usec): | 1.00th=[ 182], 5.00th=[ 215], 10.00th=[ 247], 20.00th=[ 338], | 30.00th=[ 510], 40.00th=[ 1713], 50.00th=[ 6259], 60.00th=[ 11994], | 70.00th=[ 16712], 80.00th=[ 24249], 90.00th=[ 35914], 95.00th=[ 44303], | 99.00th=[ 69731], 99.50th=[ 77071], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 47, max= 200, per=27.61%, avg=122.85, stdev=41.89, samples=26 iops : min= 11, max= 50, avg=30.23, stdev=10.67, samples=26 lat (usec) : 10=0.65%, 20=3.65%, 50=10.94%, 100=1.43%, 250=5.73% lat (usec) : 500=10.42%, 750=2.73%, 1000=1.04% lat (msec) : 2=2.86%, 4=3.52%, 10=5.86%, 20=15.36%, 50=28.39% lat (msec) : 100=6.90%, 250=0.52% cpu : usr=0.20%, sys=3.29%, ctx=797, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148305: Tue Apr 14 15:21:19 2026 read: IOPS=27, BW=111KiB/s (113kB/s)(1564KiB/14153msec) clat (usec): min=6, max=114722, avg=21715.55, stdev=22191.21 lat (usec): min=6, max=114722, avg=21717.42, stdev=22191.75 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 32], | 30.00th=[ 47], 40.00th=[ 10945], 50.00th=[ 18482], 60.00th=[ 24773], | 70.00th=[ 31589], 80.00th=[ 39060], 90.00th=[ 53216], 95.00th=[ 62129], | 99.00th=[ 84411], 99.50th=[ 99091], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 55, max= 199, per=26.06%, avg=110.25, stdev=36.70, samples=28 iops : min= 13, max= 49, avg=27.07, stdev= 9.19, samples=28 write: IOPS=26, BW=107KiB/s (109kB/s)(1508KiB/14153msec); 0 zone resets clat (usec): min=167, max=87867, avg=14711.46, stdev=18051.42 lat (usec): min=167, max=87868, avg=14712.64, stdev=18051.48 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 219], 10.00th=[ 258], 20.00th=[ 367], | 30.00th=[ 750], 40.00th=[ 3032], 50.00th=[ 9110], 60.00th=[12256], | 70.00th=[17695], 80.00th=[26346], 90.00th=[41681], 95.00th=[53740], | 99.00th=[76022], 99.50th=[83362], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 32, max= 214, per=23.66%, avg=105.29, stdev=42.79, samples=28 iops : min= 8, max= 53, avg=25.86, stdev=10.68, samples=28 lat (usec) : 10=1.30%, 20=4.04%, 50=10.55%, 100=1.04%, 250=4.95% lat (usec) : 500=8.07%, 750=2.60%, 1000=1.04% lat (msec) : 2=2.60%, 4=2.47%, 10=6.51%, 20=16.67%, 50=29.30% lat (msec) : 100=8.72%, 250=0.13% cpu : usr=0.11%, sys=3.26%, ctx=928, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148307: Tue Apr 14 15:21:19 2026 read: IOPS=28, BW=115KiB/s (118kB/s)(1508KiB/13117msec) clat (usec): min=6, max=117016, avg=19982.73, stdev=22858.71 lat (usec): min=6, max=117017, avg=19983.63, stdev=22858.71 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 18], 20.00th=[ 27], | 30.00th=[ 37], 40.00th=[ 157], 50.00th=[ 14222], 60.00th=[ 21890], | 70.00th=[ 30802], 80.00th=[ 38536], 90.00th=[ 50070], 95.00th=[ 61080], | 99.00th=[ 99091], 99.50th=[112722], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 48, max= 205, per=27.07%, avg=114.50, stdev=39.86, samples=26 iops : min= 12, max= 51, avg=28.15, stdev=10.05, samples=26 write: IOPS=29, BW=119KiB/s (122kB/s)(1564KiB/13117msec); 0 zone resets clat (usec): min=178, max=94655, avg=13908.24, stdev=18465.82 lat (usec): min=178, max=94655, avg=13909.82, stdev=18465.41 clat percentiles (usec): | 1.00th=[ 186], 5.00th=[ 202], 10.00th=[ 241], 20.00th=[ 306], | 30.00th=[ 371], 40.00th=[ 840], 50.00th=[ 6325], 60.00th=[10945], | 70.00th=[17433], 80.00th=[25822], 90.00th=[41157], 95.00th=[51119], | 99.00th=[81265], 99.50th=[91751], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 47, max= 254, per=26.77%, avg=119.12, stdev=46.90, samples=26 iops : min= 11, max= 63, avg=29.31, stdev=11.74, samples=26 lat (usec) : 10=1.56%, 20=4.95%, 50=11.20%, 100=1.69%, 250=6.90% lat (usec) : 500=11.46%, 750=2.21%, 1000=0.65% lat (msec) : 2=1.30%, 4=1.82%, 10=7.42%, 20=14.71%, 50=26.43% lat (msec) : 100=7.29%, 250=0.39% cpu : usr=0.14%, sys=3.10%, ctx=811, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=423KiB/s (433kB/s), 109KiB/s-115KiB/s (111kB/s-118kB/s), io=5988KiB (6132kB), run=12978-14153msec WRITE: bw=445KiB/s (456kB/s), 107KiB/s-124KiB/s (109kB/s-127kB/s), io=6300KiB (6451kB), run=12978-14153msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148308: Tue Apr 14 15:21:27 2026 read: IOPS=16, BW=64.4KiB/s (65.9kB/s)(1480KiB/22991msec) clat (msec): min=3, max=203, avg=22.16, stdev=21.41 lat (msec): min=3, max=203, avg=22.16, stdev=21.40 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 47], 95.00th=[ 64], | 99.00th=[ 102], 99.50th=[ 161], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 15, max= 112, per=24.38%, avg=63.16, stdev=27.11, samples=45 iops : min= 3, max= 28, avg=15.18, stdev= 6.88, samples=45 write: IOPS=17, BW=69.2KiB/s (70.9kB/s)(1592KiB/22991msec); 0 zone resets clat (msec): min=6, max=130, avg=37.04, stdev=20.26 lat (msec): min=6, max=130, avg=37.05, stdev=20.26 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 67], 95.00th=[ 81], | 99.00th=[ 104], 99.50th=[ 112], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 24, max= 136, per=25.16%, avg=68.69, stdev=30.00, samples=45 iops : min= 6, max= 34, avg=16.58, stdev= 7.61, samples=45 lat (msec) : 4=0.13%, 10=12.50%, 20=27.21%, 50=45.18%, 100=13.93% lat (msec) : 250=1.04% cpu : usr=0.12%, sys=1.10%, ctx=878, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148309: Tue Apr 14 15:21:27 2026 read: IOPS=15, BW=62.3KiB/s (63.8kB/s)(1436KiB/23060msec) clat (msec): min=3, max=206, avg=21.34, stdev=21.19 lat (msec): min=3, max=206, avg=21.34, stdev=21.19 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 45], 95.00th=[ 63], | 99.00th=[ 95], 99.50th=[ 153], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 13, max= 144, per=23.81%, avg=61.67, stdev=30.50, samples=45 iops : min= 3, max= 36, avg=14.82, stdev= 7.76, samples=45 write: IOPS=17, BW=70.9KiB/s (72.6kB/s)(1636KiB/23060msec); 0 zone resets clat (msec): min=7, max=124, avg=37.52, stdev=20.67 lat (msec): min=7, max=124, avg=37.52, stdev=20.67 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 69], 95.00th=[ 84], | 99.00th=[ 101], 99.50th=[ 111], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 23, max= 159, per=25.52%, avg=69.67, stdev=30.03, samples=45 iops : min= 5, max= 39, avg=16.82, stdev= 7.58, samples=45 lat (msec) : 4=0.13%, 10=14.45%, 20=24.74%, 50=45.70%, 100=14.06% lat (msec) : 250=0.91% cpu : usr=0.10%, sys=1.11%, ctx=869, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148310: Tue Apr 14 15:21:27 2026 read: IOPS=17, BW=68.9KiB/s (70.6kB/s)(1564KiB/22699msec) clat (msec): min=3, max=121, avg=21.31, stdev=19.18 lat (msec): min=3, max=121, avg=21.31, stdev=19.18 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 66], | 99.00th=[ 113], 99.50th=[ 121], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 15, max= 182, per=26.51%, avg=68.66, stdev=36.20, samples=44 iops : min= 3, max= 45, avg=16.55, stdev= 9.09, samples=44 write: IOPS=16, BW=66.4KiB/s (68.0kB/s)(1508KiB/22699msec); 0 zone resets clat (msec): min=8, max=176, avg=37.89, stdev=21.44 lat (msec): min=8, max=176, avg=37.89, stdev=21.44 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 66], 95.00th=[ 79], | 99.00th=[ 117], 99.50th=[ 127], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 15, max= 128, per=23.88%, avg=65.20, stdev=28.49, samples=44 iops : min= 3, max= 32, avg=15.68, stdev= 7.23, samples=44 lat (msec) : 4=0.52%, 10=13.93%, 20=24.87%, 50=46.61%, 100=12.37% lat (msec) : 250=1.69% cpu : usr=0.13%, sys=1.20%, ctx=860, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148311: Tue Apr 14 15:21:27 2026 read: IOPS=16, BW=67.1KiB/s (68.7kB/s)(1508KiB/22465msec) clat (msec): min=3, max=119, avg=20.60, stdev=17.65 lat (msec): min=3, max=119, avg=20.61, stdev=17.65 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 59], | 99.00th=[ 90], 99.50th=[ 99], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 15, max= 143, per=25.51%, avg=66.07, stdev=30.24, samples=44 iops : min= 3, max= 35, avg=15.91, stdev= 7.60, samples=44 write: IOPS=17, BW=69.6KiB/s (71.3kB/s)(1564KiB/22465msec); 0 zone resets clat (msec): min=7, max=159, avg=37.39, stdev=22.11 lat (msec): min=7, max=159, avg=37.39, stdev=22.11 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 88], | 99.00th=[ 118], 99.50th=[ 140], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 23, max= 136, per=25.18%, avg=68.75, stdev=30.59, samples=44 iops : min= 5, max= 34, avg=16.57, stdev= 7.74, samples=44 lat (msec) : 4=0.26%, 10=14.19%, 20=25.65%, 50=45.96%, 100=12.37% lat (msec) : 250=1.56% cpu : usr=0.11%, sys=1.14%, ctx=850, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=260KiB/s (266kB/s), 62.3KiB/s-68.9KiB/s (63.8kB/s-70.6kB/s), io=5988KiB (6132kB), run=22465-23060msec WRITE: bw=273KiB/s (280kB/s), 66.4KiB/s-70.9KiB/s (68.0kB/s-72.6kB/s), io=6300KiB (6451kB), run=22465-23060msec