== sanity test 398b: DIO and buffer IO race ============== 21:41:10 (1781228470) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.40175 s, 14.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189266: Thu Jun 11 21:42:18 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(5992KiB/56268msec) clat (usec): min=45, max=756587, avg=20795.09, stdev=22064.85 lat (usec): min=45, max=756588, avg=20796.55, stdev=22064.94 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 7963], 10.00th=[ 9765], 20.00th=[ 11994], | 30.00th=[ 13960], 40.00th=[ 16057], 50.00th=[ 18220], 60.00th=[ 21103], | 70.00th=[ 23987], 80.00th=[ 27395], 90.00th=[ 33162], 95.00th=[ 39060], | 99.00th=[ 61080], 99.50th=[ 73925], 99.90th=[111674], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 24, max= 184, per=25.14%, avg=106.36, stdev=26.81, samples=112 iops : min= 6, max= 46, avg=26.17, stdev= 6.73, samples=112 write: IOPS=27, BW=112KiB/s (115kB/s)(6296KiB/56268msec); 0 zone resets clat (usec): min=776, max=94509, avg=15803.67, stdev=12955.53 lat (usec): min=777, max=94510, avg=15805.31, stdev=12955.56 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2040], 10.00th=[ 2606], 20.00th=[ 3752], | 30.00th=[ 6259], 40.00th=[10421], 50.00th=[13173], 60.00th=[16188], | 70.00th=[19792], 80.00th=[25560], 90.00th=[33162], 95.00th=[40633], | 99.00th=[55313], 99.50th=[68682], 99.90th=[87557], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 6, max= 192, per=25.21%, avg=111.67, stdev=31.25, samples=112 iops : min= 1, max= 48, avg=27.50, stdev= 7.83, samples=112 lat (usec) : 50=0.07%, 100=0.59%, 250=0.68%, 500=0.10%, 1000=0.16% lat (msec) : 2=2.25%, 4=8.89%, 10=12.53%, 20=38.38%, 50=34.57% lat (msec) : 100=1.69%, 250=0.07%, 1000=0.03% cpu : usr=0.12%, sys=19.35%, ctx=8387, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189267: Thu Jun 11 21:42:18 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(5940KiB/56663msec) clat (usec): min=40, max=86445, avg=20252.35, stdev=10634.03 lat (usec): min=40, max=86447, avg=20253.21, stdev=10634.05 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 7898], 10.00th=[ 9634], 20.00th=[11863], | 30.00th=[13698], 40.00th=[16057], 50.00th=[18744], 60.00th=[21103], | 70.00th=[24249], 80.00th=[27395], 90.00th=[32637], 95.00th=[39060], | 99.00th=[57934], 99.50th=[65274], 99.90th=[82314], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 13, max= 152, per=24.61%, avg=104.10, stdev=25.05, samples=112 iops : min= 3, max= 38, avg=25.61, stdev= 6.32, samples=112 write: IOPS=28, BW=112KiB/s (115kB/s)(6348KiB/56663msec); 0 zone resets clat (usec): min=1035, max=681887, avg=16607.28, stdev=21306.45 lat (usec): min=1037, max=681888, avg=16608.45, stdev=21306.46 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 2147], 10.00th=[ 2737], 20.00th=[ 3621], | 30.00th=[ 6128], 40.00th=[ 10421], 50.00th=[ 13566], 60.00th=[ 16712], | 70.00th=[ 20841], 80.00th=[ 26346], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 63177], 99.50th=[ 66323], 99.90th=[ 87557], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 34, max= 208, per=25.01%, avg=110.78, stdev=30.58, samples=112 iops : min= 8, max= 52, avg=27.28, stdev= 7.63, samples=112 lat (usec) : 50=0.03%, 100=0.49%, 250=0.72%, 500=0.10% lat (msec) : 2=2.12%, 4=10.06%, 10=12.08%, 20=36.26%, 50=36.26% lat (msec) : 100=1.86%, 750=0.03% cpu : usr=0.13%, sys=19.27%, ctx=8618, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189268: Thu Jun 11 21:42:18 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(6028KiB/56050msec) clat (usec): min=32, max=697113, avg=20559.45, stdev=20398.30 lat (usec): min=34, max=697114, avg=20560.49, stdev=20398.34 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 8160], 10.00th=[ 9765], 20.00th=[ 11994], | 30.00th=[ 13829], 40.00th=[ 16188], 50.00th=[ 18482], 60.00th=[ 20841], | 70.00th=[ 23725], 80.00th=[ 27132], 90.00th=[ 32900], 95.00th=[ 38536], | 99.00th=[ 58459], 99.50th=[ 62653], 99.90th=[ 90702], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 13, max= 175, per=25.33%, avg=107.14, stdev=26.41, samples=111 iops : min= 3, max= 43, avg=26.36, stdev= 6.57, samples=111 write: IOPS=27, BW=112KiB/s (114kB/s)(6260KiB/56050msec); 0 zone resets clat (usec): min=709, max=77903, avg=15865.51, stdev=13111.77 lat (usec): min=710, max=77904, avg=15872.32, stdev=13116.75 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2147], 10.00th=[ 2769], 20.00th=[ 3654], | 30.00th=[ 5604], 40.00th=[ 9765], 50.00th=[13042], 60.00th=[16319], | 70.00th=[20579], 80.00th=[25297], 90.00th=[34866], 95.00th=[41681], | 99.00th=[55837], 99.50th=[60556], 99.90th=[77071], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 27, max= 176, per=25.07%, avg=111.05, stdev=32.18, samples=111 iops : min= 6, max= 44, avg=27.34, stdev= 8.10, samples=111 lat (usec) : 50=0.07%, 100=0.49%, 250=0.91%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=1.73%, 4=9.90%, 10=13.09%, 20=37.08%, 50=34.54% lat (msec) : 100=1.95%, 750=0.03% cpu : usr=0.13%, sys=19.34%, ctx=8425, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189269: Thu Jun 11 21:42:18 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(6052KiB/56175msec) clat (usec): min=35, max=697085, avg=20202.86, stdev=20463.10 lat (usec): min=35, max=697086, avg=20204.71, stdev=20462.23 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 7439], 10.00th=[ 9372], 20.00th=[ 11731], | 30.00th=[ 13698], 40.00th=[ 15795], 50.00th=[ 18220], 60.00th=[ 20579], | 70.00th=[ 23462], 80.00th=[ 26870], 90.00th=[ 32113], 95.00th=[ 38011], | 99.00th=[ 57410], 99.50th=[ 70779], 99.90th=[ 87557], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 13, max= 175, per=25.39%, avg=107.41, stdev=25.62, samples=111 iops : min= 3, max= 43, avg=26.43, stdev= 6.41, samples=111 write: IOPS=27, BW=111KiB/s (114kB/s)(6236KiB/56175msec); 0 zone resets clat (usec): min=719, max=76468, avg=16267.82, stdev=12925.80 lat (usec): min=719, max=76470, avg=16269.16, stdev=12925.72 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2245], 10.00th=[ 2900], 20.00th=[ 3884], | 30.00th=[ 6718], 40.00th=[10683], 50.00th=[13173], 60.00th=[16712], | 70.00th=[20841], 80.00th=[26346], 90.00th=[34866], 95.00th=[41681], | 99.00th=[55837], 99.50th=[63177], 99.90th=[72877], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 27, max= 183, per=25.02%, avg=110.86, stdev=27.90, samples=111 iops : min= 6, max= 45, avg=27.29, stdev= 7.02, samples=111 lat (usec) : 50=0.10%, 100=1.04%, 250=0.78%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=1.79%, 4=8.56%, 10=12.79%, 20=37.86%, 50=34.99% lat (msec) : 100=1.86%, 750=0.03% cpu : usr=0.14%, sys=19.15%, ctx=8369, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=424KiB/s (434kB/s), 105KiB/s-108KiB/s (107kB/s-110kB/s), io=23.4MiB (24.6MB), run=56050-56663msec WRITE: bw=444KiB/s (454kB/s), 111KiB/s-112KiB/s (114kB/s-115kB/s), io=24.6MiB (25.7MB), run=56050-56663msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189271: Thu Jun 11 21:42:33 2026 read: IOPS=21, BW=84.3KiB/s (86.3kB/s)(5992KiB/71091msec) clat (msec): min=3, max=776, avg=19.34, stdev=24.28 lat (msec): min=3, max=776, avg=19.34, stdev=24.28 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 52], | 99.00th=[ 72], 99.50th=[ 79], 99.90th=[ 95], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 23, max= 247, per=25.18%, avg=84.36, stdev=46.91, samples=140 iops : min= 5, max= 61, avg=20.65, stdev=11.78, samples=140 write: IOPS=22, BW=88.6KiB/s (90.7kB/s)(6296KiB/71091msec); 0 zone resets clat (msec): min=6, max=119, avg=26.72, stdev=15.70 lat (msec): min=6, max=119, avg=26.72, stdev=15.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 56], | 99.00th=[ 83], 99.50th=[ 94], 99.90th=[ 117], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 24, max= 200, per=25.25%, avg=88.64, stdev=43.35, samples=140 iops : min= 6, max= 50, avg=21.72, stdev=10.90, samples=140 lat (msec) : 4=0.10%, 10=15.89%, 20=40.40%, 50=36.59%, 100=6.87% lat (msec) : 250=0.13%, 1000=0.03% cpu : usr=0.11%, sys=9.30%, ctx=5918, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189272: Thu Jun 11 21:42:33 2026 read: IOPS=20, BW=83.5KiB/s (85.5kB/s)(5940KiB/71161msec) clat (msec): min=3, max=705, avg=19.50, stdev=22.69 lat (msec): min=3, max=705, avg=19.51, stdev=22.69 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 69], 99.50th=[ 78], 99.90th=[ 104], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 16, max= 247, per=24.96%, avg=83.61, stdev=46.21, samples=140 iops : min= 4, max= 61, avg=20.46, stdev=11.59, samples=140 write: IOPS=22, BW=89.2KiB/s (91.3kB/s)(6348KiB/71161msec); 0 zone resets clat (msec): min=6, max=140, avg=26.55, stdev=16.10 lat (msec): min=6, max=140, avg=26.55, stdev=16.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 49], 95.00th=[ 57], | 99.00th=[ 84], 99.50th=[ 90], 99.90th=[ 110], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 15, max= 231, per=25.39%, avg=89.11, stdev=42.93, samples=140 iops : min= 3, max= 57, avg=21.84, stdev=10.79, samples=140 lat (msec) : 4=0.03%, 10=14.88%, 20=42.02%, 50=35.94%, 100=6.97% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.11%, sys=9.35%, ctx=5778, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189273: Thu Jun 11 21:42:33 2026 read: IOPS=21, BW=85.0KiB/s (87.1kB/s)(6028KiB/70909msec) clat (usec): min=3882, max=97518, avg=19435.61, stdev=14573.18 lat (usec): min=3883, max=97519, avg=19436.83, stdev=14573.18 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 5932], 10.00th=[ 6718], 20.00th=[ 8586], | 30.00th=[10552], 40.00th=[12518], 50.00th=[14484], 60.00th=[16909], | 70.00th=[20841], 80.00th=[28181], 90.00th=[40633], 95.00th=[51119], | 99.00th=[68682], 99.50th=[76022], 99.90th=[92799], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 23, max= 248, per=25.44%, avg=85.23, stdev=43.59, samples=140 iops : min= 5, max= 62, avg=20.86, stdev=10.93, samples=140 write: IOPS=22, BW=88.3KiB/s (90.4kB/s)(6260KiB/70909msec); 0 zone resets clat (msec): min=6, max=708, avg=26.55, stdev=23.10 lat (msec): min=6, max=708, avg=26.55, stdev=23.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 37], 90.00th=[ 47], 95.00th=[ 56], | 99.00th=[ 79], 99.50th=[ 95], 99.90th=[ 121], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 31, max= 223, per=25.21%, avg=88.48, stdev=44.31, samples=140 iops : min= 7, max= 55, avg=21.68, stdev=11.16, samples=140 lat (msec) : 4=0.07%, 10=15.59%, 20=40.82%, 50=36.91%, 100=6.48% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=9.34%, ctx=5840, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189274: Thu Jun 11 21:42:33 2026 read: IOPS=21, BW=84.6KiB/s (86.6kB/s)(6052KiB/71524msec) clat (msec): min=3, max=106, avg=19.24, stdev=14.78 lat (msec): min=3, max=106, avg=19.24, stdev=14.78 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 71], 99.50th=[ 79], 99.90th=[ 97], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 7, max= 215, per=25.16%, avg=84.27, stdev=45.70, samples=141 iops : min= 1, max= 53, avg=20.62, stdev=11.49, samples=141 write: IOPS=21, BW=87.2KiB/s (89.3kB/s)(6236KiB/71524msec); 0 zone resets clat (msec): min=6, max=703, avg=27.16, stdev=23.85 lat (msec): min=6, max=703, avg=27.17, stdev=23.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 58], | 99.00th=[ 85], 99.50th=[ 92], 99.90th=[ 148], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 15, max= 239, per=24.80%, avg=87.05, stdev=44.99, samples=141 iops : min= 3, max= 59, avg=21.32, stdev=11.31, samples=141 lat (msec) : 4=0.10%, 10=16.11%, 20=42.71%, 50=33.56%, 100=7.29% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.11%, sys=9.12%, ctx=5770, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=336KiB/s (344kB/s), 83.5KiB/s-85.0KiB/s (85.5kB/s-87.1kB/s), io=23.4MiB (24.6MB), run=70909-71524msec WRITE: bw=351KiB/s (360kB/s), 87.2KiB/s-89.2KiB/s (89.3kB/s-91.3kB/s), io=24.6MiB (25.7MB), run=70909-71524msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189303: Thu Jun 11 21:42:55 2026 read: IOPS=24, BW=389KiB/s (398kB/s)(5920KiB/15215msec) clat (usec): min=39, max=59870, avg=20815.96, stdev=11035.82 lat (usec): min=40, max=59870, avg=20816.93, stdev=11035.88 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 135], 10.00th=[ 9765], 20.00th=[12649], | 30.00th=[14877], 40.00th=[17171], 50.00th=[19530], 60.00th=[23200], | 70.00th=[26084], 80.00th=[28705], 90.00th=[33817], 95.00th=[40109], | 99.00th=[52167], 99.50th=[58983], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 223, max= 573, per=25.52%, avg=383.87, stdev=79.41, samples=30 iops : min= 13, max= 35, avg=23.43, stdev= 5.04, samples=30 write: IOPS=26, BW=419KiB/s (429kB/s)(6368KiB/15215msec); 0 zone resets clat (usec): min=1491, max=65945, avg=18813.82, stdev=13124.89 lat (usec): min=1492, max=65946, avg=18826.55, stdev=13124.40 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 3425], 10.00th=[ 4555], 20.00th=[ 6456], | 30.00th=[ 9634], 40.00th=[13042], 50.00th=[15401], 60.00th=[18482], | 70.00th=[24511], 80.00th=[29754], 90.00th=[38536], 95.00th=[45351], | 99.00th=[58459], 99.50th=[60556], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 191, max= 604, per=26.28%, avg=415.80, stdev=99.29, samples=30 iops : min= 11, max= 37, avg=25.43, stdev= 6.31, samples=30 lat (usec) : 50=0.39%, 100=0.65%, 250=2.47%, 500=0.26% lat (msec) : 2=0.52%, 4=2.73%, 10=13.80%, 20=37.37%, 50=39.58% lat (msec) : 100=2.21% cpu : usr=0.11%, sys=25.50%, ctx=2511, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189304: Thu Jun 11 21:42:55 2026 read: IOPS=22, BW=361KiB/s (369kB/s)(5744KiB/15922msec) clat (usec): min=59, max=92908, avg=22176.14, stdev=11636.49 lat (usec): min=61, max=92908, avg=22177.16, stdev=11636.47 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 208], 10.00th=[11469], 20.00th=[13566], | 30.00th=[16057], 40.00th=[18482], 50.00th=[20579], 60.00th=[23987], | 70.00th=[26608], 80.00th=[29754], 90.00th=[35914], 95.00th=[40633], | 99.00th=[60556], 99.50th=[70779], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 540, per=23.97%, avg=360.45, stdev=95.97, samples=31 iops : min= 9, max= 33, avg=21.90, stdev= 6.05, samples=31 write: IOPS=25, BW=411KiB/s (421kB/s)(6544KiB/15922msec); 0 zone resets clat (usec): min=1750, max=71418, avg=19427.24, stdev=13640.30 lat (usec): min=1752, max=71419, avg=19429.14, stdev=13640.35 clat percentiles (usec): | 1.00th=[ 2474], 5.00th=[ 3949], 10.00th=[ 4752], 20.00th=[ 6652], | 30.00th=[ 9634], 40.00th=[13042], 50.00th=[16319], 60.00th=[19530], | 70.00th=[25035], 80.00th=[31589], 90.00th=[39060], 95.00th=[45876], | 99.00th=[57934], 99.50th=[62129], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 191, max= 637, per=25.80%, avg=408.13, stdev=117.61, samples=31 iops : min= 11, max= 39, avg=24.90, stdev= 7.33, samples=31 lat (usec) : 100=0.65%, 250=1.82% lat (msec) : 2=0.26%, 4=2.60%, 10=14.84%, 20=34.51%, 50=42.97% lat (msec) : 100=2.34% cpu : usr=0.15%, sys=24.95%, ctx=2578, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189305: Thu Jun 11 21:42:55 2026 read: IOPS=24, BW=394KiB/s (404kB/s)(6256KiB/15861msec) clat (usec): min=70, max=95464, avg=21670.88, stdev=11844.69 lat (usec): min=71, max=95465, avg=21674.31, stdev=11840.77 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 137], 10.00th=[ 9765], 20.00th=[13042], | 30.00th=[16057], 40.00th=[18220], 50.00th=[20317], 60.00th=[22938], | 70.00th=[25560], 80.00th=[28705], 90.00th=[36439], 95.00th=[42730], | 99.00th=[61604], 99.50th=[71828], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 223, max= 572, per=26.34%, avg=396.23, stdev=85.66, samples=31 iops : min= 13, max= 35, avg=24.23, stdev= 5.38, samples=31 write: IOPS=23, BW=380KiB/s (389kB/s)(6032KiB/15861msec); 0 zone resets clat (usec): min=1637, max=76363, avg=19535.96, stdev=14127.40 lat (usec): min=1638, max=76365, avg=19538.35, stdev=14127.09 clat percentiles (usec): | 1.00th=[ 2180], 5.00th=[ 3949], 10.00th=[ 4817], 20.00th=[ 6587], | 30.00th=[10290], 40.00th=[13304], 50.00th=[16057], 60.00th=[21103], | 70.00th=[24249], 80.00th=[30016], 90.00th=[38011], 95.00th=[46924], | 99.00th=[66847], 99.50th=[69731], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 128, max= 576, per=23.88%, avg=377.74, stdev=106.90, samples=31 iops : min= 8, max= 36, avg=23.06, stdev= 6.69, samples=31 lat (usec) : 100=0.91%, 250=2.21%, 500=0.13% lat (msec) : 2=0.26%, 4=2.21%, 10=14.32%, 20=32.94%, 50=44.01% lat (msec) : 100=2.99% cpu : usr=0.15%, sys=24.76%, ctx=2560, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189306: Thu Jun 11 21:42:55 2026 read: IOPS=23, BW=380KiB/s (390kB/s)(6032KiB/15854msec) clat (usec): min=45, max=74023, avg=21612.46, stdev=12218.70 lat (usec): min=48, max=74024, avg=21613.51, stdev=12218.69 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 114], 10.00th=[ 8979], 20.00th=[12911], | 30.00th=[15533], 40.00th=[18482], 50.00th=[21103], 60.00th=[23200], | 70.00th=[25822], 80.00th=[29492], 90.00th=[36439], 95.00th=[44827], | 99.00th=[62129], 99.50th=[67634], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 223, max= 573, per=25.05%, avg=376.71, stdev=94.53, samples=31 iops : min= 13, max= 35, avg=23.03, stdev= 5.92, samples=31 write: IOPS=24, BW=395KiB/s (404kB/s)(6256KiB/15854msec); 0 zone resets clat (usec): min=1411, max=73852, avg=19640.45, stdev=15230.24 lat (usec): min=1413, max=73853, avg=19642.26, stdev=15230.28 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 3458], 10.00th=[ 4752], 20.00th=[ 5932], | 30.00th=[ 8848], 40.00th=[12649], 50.00th=[14746], 60.00th=[19268], | 70.00th=[25297], 80.00th=[31589], 90.00th=[40633], 95.00th=[49546], | 99.00th=[68682], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 222, max= 667, per=24.85%, avg=393.16, stdev=107.07, samples=31 iops : min= 13, max= 41, avg=24.06, stdev= 6.73, samples=31 lat (usec) : 50=0.13%, 100=1.56%, 250=2.60%, 500=0.13% lat (msec) : 2=0.26%, 4=3.26%, 10=14.71%, 20=30.86%, 50=42.84% lat (msec) : 100=3.65% cpu : usr=0.10%, sys=24.54%, ctx=2542, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1504KiB/s (1540kB/s), 361KiB/s-394KiB/s (369kB/s-404kB/s), io=23.4MiB (24.5MB), run=15215-15922msec WRITE: bw=1583KiB/s (1621kB/s), 380KiB/s-419KiB/s (389kB/s-429kB/s), io=24.6MiB (25.8MB), run=15215-15922msec fio: pid=189299, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=189298: Thu Jun 11 21:42:57 2026 read: IOPS=19, BW=315KiB/s (323kB/s)(5920KiB/18765msec) clat (usec): min=4050, max=81337, avg=20277.87, stdev=15885.46 lat (usec): min=4051, max=81338, avg=20278.86, stdev=15885.49 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5407], 10.00th=[ 6194], 20.00th=[ 7898], | 30.00th=[10028], 40.00th=[12256], 50.00th=[14091], 60.00th=[16909], | 70.00th=[21627], 80.00th=[32113], 90.00th=[47449], 95.00th=[57934], | 99.00th=[68682], 99.50th=[79168], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 96, max= 800, per=25.94%, avg=310.30, stdev=183.97, samples=37 iops : min= 6, max= 50, avg=18.97, stdev=11.57, samples=37 write: IOPS=21, BW=339KiB/s (347kB/s)(6368KiB/18765msec); 0 zone resets clat (msec): min=5, max=105, avg=28.18, stdev=17.68 lat (msec): min=5, max=105, avg=28.18, stdev=17.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 66], | 99.00th=[ 83], 99.50th=[ 87], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 64, max= 864, per=27.16%, avg=336.00, stdev=179.08, samples=37 iops : min= 4, max= 54, avg=20.59, stdev=11.21, samples=37 lat (msec) : 10=17.84%, 20=37.24%, 50=35.03%, 100=9.77%, 250=0.13% cpu : usr=0.12%, sys=11.37%, ctx=1618, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=189299: Thu Jun 11 21:42:57 2026 read: IOPS=16, BW=256KiB/s (262kB/s)(4240KiB/16584msec) clat (msec): min=5, max=112, avg=25.26, stdev=16.97 lat (msec): min=5, max=112, avg=25.26, stdev=16.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 53], 95.00th=[ 61], | 99.00th=[ 80], 99.50th=[ 83], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 96, max= 352, per=20.28%, avg=242.56, stdev=67.26, samples=32 iops : min= 6, max= 22, avg=14.72, stdev= 4.11, samples=32 write: IOPS=17, BW=275KiB/s (282kB/s)(4560KiB/16584msec); 0 zone resets clat (msec): min=9, max=107, avg=34.49, stdev=17.70 lat (msec): min=9, max=107, avg=34.49, stdev=17.70 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 69], | 99.00th=[ 99], 99.50th=[ 99], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 158, max= 481, per=21.77%, avg=269.28, stdev=68.63, samples=32 iops : min= 9, max= 30, avg=16.41, stdev= 4.32, samples=32 lat (msec) : 10=4.90%, 20=30.85%, 50=50.27%, 100=13.43%, 250=0.36% cpu : usr=0.11%, sys=10.54%, ctx=1127, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=266,285,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189300: Thu Jun 11 21:42:57 2026 read: IOPS=20, BW=333KiB/s (341kB/s)(6256KiB/18766msec) clat (msec): min=4, max=111, avg=20.93, stdev=15.85 lat (msec): min=4, max=111, avg=20.93, stdev=15.85 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 51], | 99.00th=[ 82], 99.50th=[ 83], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 96, max= 1056, per=27.85%, avg=333.05, stdev=204.88, samples=37 iops : min= 6, max= 66, avg=20.41, stdev=12.88, samples=37 write: IOPS=20, BW=321KiB/s (329kB/s)(6032KiB/18766msec); 0 zone resets clat (usec): min=7534, max=93658, avg=27902.59, stdev=16815.97 lat (usec): min=7536, max=93660, avg=27904.61, stdev=16816.07 clat percentiles (usec): | 1.00th=[ 8094], 5.00th=[ 9372], 10.00th=[10683], 20.00th=[13304], | 30.00th=[16057], 40.00th=[19268], 50.00th=[23200], 60.00th=[28443], | 70.00th=[32900], 80.00th=[41157], 90.00th=[53216], 95.00th=[60556], | 99.00th=[81265], 99.50th=[88605], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 95, max= 798, per=25.50%, avg=315.43, stdev=164.30, samples=37 iops : min= 5, max= 49, avg=19.30, stdev=10.27, samples=37 lat (msec) : 10=16.15%, 20=36.20%, 50=39.19%, 100=8.33%, 250=0.13% cpu : usr=0.10%, sys=11.59%, ctx=1625, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189301: Thu Jun 11 21:42:57 2026 read: IOPS=20, BW=323KiB/s (330kB/s)(6032KiB/18692msec) clat (usec): min=4275, max=86476, avg=19661.62, stdev=15481.92 lat (usec): min=4276, max=86478, avg=19662.56, stdev=15481.91 clat percentiles (usec): | 1.00th=[ 4883], 5.00th=[ 6128], 10.00th=[ 6587], 20.00th=[ 8094], | 30.00th=[10028], 40.00th=[11994], 50.00th=[14746], 60.00th=[16450], | 70.00th=[20579], 80.00th=[28443], 90.00th=[44827], 95.00th=[54789], | 99.00th=[76022], 99.50th=[78119], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 127, max= 1056, per=26.74%, avg=319.84, stdev=195.46, samples=37 iops : min= 7, max= 66, avg=19.57, stdev=12.26, samples=37 write: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18692msec); 0 zone resets clat (msec): min=7, max=102, avg=28.78, stdev=17.84 lat (msec): min=7, max=102, avg=28.79, stdev=17.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 56], 95.00th=[ 65], | 99.00th=[ 84], 99.50th=[ 91], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 128, max= 928, per=27.00%, avg=333.95, stdev=182.12, samples=37 iops : min= 8, max= 58, avg=20.46, stdev=11.42, samples=37 lat (msec) : 10=17.06%, 20=38.41%, 50=33.46%, 100=10.94%, 250=0.13% cpu : usr=0.12%, sys=11.37%, ctx=1670, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1196KiB/s (1225kB/s), 256KiB/s-333KiB/s (262kB/s-341kB/s), io=21.9MiB (22.0MB), run=16584-18766msec WRITE: bw=1237KiB/s (1267kB/s), 275KiB/s-339KiB/s (282kB/s-347kB/s), io=22.7MiB (23.8MB), run=16584-18766msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189314: Thu Jun 11 21:43:07 2026 read: IOPS=3, BW=3173KiB/s (3249kB/s)(7168KiB/2259msec) clat (msec): min=80, max=243, avg=131.08, stdev=53.93 lat (msec): min=80, max=243, avg=131.09, stdev=53.93 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 131], 80.00th=[ 144], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 1984, max= 5197, per=71.53%, avg=3674.33, stdev=1613.05, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2266KiB/s (2321kB/s)(5120KiB/2259msec); 0 zone resets clat (msec): min=146, max=431, avg=264.57, stdev=110.59 lat (msec): min=146, max=431, avg=264.64, stdev=110.57 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1921, max= 4096, per=37.08%, avg=2667.00, stdev=1237.95, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=66.67%, 500=16.67% cpu : usr=0.04%, sys=45.93%, ctx=662, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189315: Thu Jun 11 21:43:07 2026 read: IOPS=0, BW=514KiB/s (526kB/s)(2048KiB/3986msec) clat (msec): min=146, max=410, avg=278.32, stdev=186.78 lat (msec): min=146, max=410, avg=278.32, stdev=186.78 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1777, max= 1984, per=36.61%, avg=1880.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2569KiB/s (2631kB/s)(10.0MiB/3986msec); 0 zone resets clat (msec): min=123, max=1590, avg=339.32, stdev=442.68 lat (msec): min=123, max=1590, avg=339.43, stdev=442.68 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 197], 50.00th=[ 205], 60.00th=[ 209], | 70.00th=[ 232], 80.00th=[ 253], 90.00th=[ 296], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 4096, max= 5763, per=64.67%, avg=4651.67, stdev=962.44, samples=3 iops : min= 4, max= 5, avg= 4.33, stdev= 0.58, samples=3 lat (msec) : 250=66.67%, 500=25.00%, 2000=8.33% cpu : usr=0.03%, sys=35.86%, ctx=348, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189316: Thu Jun 11 21:43:07 2026 read: IOPS=2, BW=2794KiB/s (2861kB/s)(6144KiB/2199msec) clat (usec): min=541, max=196086, avg=117409.22, stdev=77524.48 lat (usec): min=541, max=196087, avg=117410.09, stdev=77524.64 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 53740], | 30.00th=[ 53740], 40.00th=[108528], 50.00th=[108528], 60.00th=[170918], | 70.00th=[175113], 80.00th=[175113], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 1984, max= 4096, per=64.38%, avg=3307.33, stdev=1153.06, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2794KiB/s (2861kB/s)(6144KiB/2199msec); 0 zone resets clat (msec): min=147, max=385, avg=242.35, stdev=85.26 lat (msec): min=147, max=385, avg=242.43, stdev=85.26 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 262], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1921, max= 3968, per=39.67%, avg=2853.50, stdev=1024.57, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=46.31%, ctx=667, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189317: Thu Jun 11 21:43:07 2026 read: IOPS=1, BW=1394KiB/s (1427kB/s)(5120KiB/3674msec) clat (usec): min=382, max=1378.4k, avg=318864.58, stdev=594781.14 lat (usec): min=383, max=1378.4k, avg=318865.71, stdev=594780.67 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], | 20.00th=[ 383], 30.00th=[ 545], 40.00th=[ 545], | 50.00th=[ 95945], 60.00th=[ 95945], 70.00th=[ 119014], | 80.00th=[ 119014], 90.00th=[1384121], 95.00th=[1384121], | 99.00th=[1384121], 99.50th=[1384121], 99.90th=[1384121], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 2048, max= 3968, per=52.33%, avg=2688.00, stdev=1108.51, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1951KiB/s (1998kB/s)(7168KiB/3674msec); 0 zone resets clat (msec): min=117, max=510, avg=289.30, stdev=137.70 lat (msec): min=117, max=510, avg=289.39, stdev=137.70 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 163], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 279], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 376], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1753, max= 4096, per=41.24%, avg=2966.50, stdev=1306.04, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=30.33%, ctx=692, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5138KiB/s (5261kB/s), 514KiB/s-3173KiB/s (526kB/s-3249kB/s), io=20.0MiB (20.0MB), run=2199-3986msec WRITE: bw=7193KiB/s (7366kB/s), 1951KiB/s-2794KiB/s (1998kB/s-2861kB/s), io=28.0MiB (29.4MB), run=2199-3986msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189319: Thu Jun 11 21:43:07 2026 read: IOPS=3, BW=3086KiB/s (3160kB/s)(7168KiB/2323msec) clat (msec): min=31, max=307, avg=119.42, stdev=91.16 lat (msec): min=31, max=307, avg=119.42, stdev=91.16 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 64], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 97], 60.00th=[ 123], | 70.00th=[ 123], 80.00th=[ 144], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1935, max= 5251, per=56.38%, avg=2820.50, stdev=1621.21, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=2, BW=2204KiB/s (2257kB/s)(5120KiB/2323msec); 0 zone resets clat (msec): min=101, max=502, avg=279.51, stdev=148.32 lat (msec): min=101, max=502, avg=279.60, stdev=148.31 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1935, max= 6144, per=57.67%, avg=4039.50, stdev=2976.21, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=20.97%, ctx=116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189320: Thu Jun 11 21:43:07 2026 read: IOPS=0, BW=500KiB/s (512kB/s)(2048KiB/4093msec) clat (msec): min=106, max=338, avg=222.44, stdev=164.65 lat (msec): min=106, max=338, avg=222.44, stdev=164.65 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1759, max= 2048, per=38.05%, avg=1903.50, stdev=204.35, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2502KiB/s (2562kB/s)(10.0MiB/4093msec); 0 zone resets clat (msec): min=108, max=1270, avg=355.37, stdev=347.87 lat (msec): min=108, max=1271, avg=355.50, stdev=347.94 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 126], 40.00th=[ 157], 50.00th=[ 207], 60.00th=[ 330], | 70.00th=[ 376], 80.00th=[ 422], 90.00th=[ 451], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1935, max= 4096, per=34.75%, avg=2434.00, stdev=930.34, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (msec) : 250=50.00%, 500=41.67%, 2000=8.33% cpu : usr=0.07%, sys=11.97%, ctx=161, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189321: Thu Jun 11 21:43:07 2026 read: IOPS=1, BW=1593KiB/s (1631kB/s)(6144KiB/3857msec) clat (msec): min=58, max=406, avg=160.48, stdev=134.30 lat (msec): min=58, max=406, avg=160.48, stdev=134.30 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 86], 50.00th=[ 86], 60.00th=[ 115], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 4096, max= 6144, per=100.00%, avg=5120.00, stdev=1448.15, samples=2 iops : min= 4, max= 6, avg= 5.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1593KiB/s (1631kB/s)(6144KiB/3857msec); 0 zone resets clat (msec): min=181, max=1462, avg=468.19, stdev=494.63 lat (msec): min=181, max=1462, avg=468.30, stdev=494.61 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 262], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1935, max= 3555, per=34.19%, avg=2395.25, stdev=774.92, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.08%, sys=15.22%, ctx=166, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189322: Thu Jun 11 21:43:07 2026 read: IOPS=1, BW=1252KiB/s (1282kB/s)(5120KiB/4089msec) clat (msec): min=36, max=1185, avg=402.46, stdev=455.85 lat (msec): min=36, max=1185, avg=402.47, stdev=455.85 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 37], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 2043, max= 2048, per=40.90%, avg=2046.33, stdev= 2.89, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1753KiB/s (1795kB/s)(7168KiB/4089msec); 0 zone resets clat (msec): min=48, max=491, avg=284.19, stdev=180.86 lat (msec): min=48, max=492, avg=284.30, stdev=180.85 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 91], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 321], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 477], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1790, max= 2048, per=27.91%, avg=1955.25, stdev=122.37, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 50=16.67%, 100=8.33%, 250=16.67%, 500=50.00%, 2000=8.33% cpu : usr=0.00%, sys=14.41%, ctx=137, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5004KiB/s (5124kB/s), 500KiB/s-3086KiB/s (512kB/s-3160kB/s), io=20.0MiB (20.0MB), run=2323-4093msec WRITE: bw=7005KiB/s (7173kB/s), 1593KiB/s-2502KiB/s (1631kB/s-2562kB/s), io=28.0MiB (29.4MB), run=2323-4093msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189328: Thu Jun 11 21:43:16 2026 read: IOPS=1, BW=6430KiB/s (6584kB/s)(12.0MiB/1911msec) clat (msec): min=126, max=986, avg=609.69, stdev=439.57 lat (msec): min=126, max=986, avg=609.69, stdev=439.57 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8175, max= 8175, per=95.36%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=12.09%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189329: Thu Jun 11 21:43:16 2026 read: IOPS=0, BW=2753KiB/s (2819kB/s)(4096KiB/1488msec) clat (nsec): min=145719k, max=145719k, avg=145718841.00, stdev= 0.00 lat (nsec): min=145723k, max=145723k, avg=145722709.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 7728, max= 7728, per=90.14%, avg=7728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5505KiB/s (5638kB/s)(8192KiB/1488msec); 0 zone resets clat (msec): min=491, max=806, avg=649.18, stdev=222.99 lat (msec): min=491, max=807, avg=649.47, stdev=223.09 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=45.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.13%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189330: Thu Jun 11 21:43:16 2026 write: IOPS=1, BW=6741KiB/s (6902kB/s)(12.0MiB/1823msec); 0 zone resets clat (msec): min=437, max=678, avg=589.24, stdev=132.25 lat (msec): min=437, max=679, avg=589.70, stdev=132.10 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7876, max= 8159, per=44.61%, avg=8017.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.11%, sys=13.17%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189331: Thu Jun 11 21:43:16 2026 write: IOPS=1, BW=7743KiB/s (7929kB/s)(12.0MiB/1587msec); 0 zone resets clat (msec): min=191, max=945, avg=516.99, stdev=387.27 lat (msec): min=193, max=945, avg=517.81, stdev=386.73 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8078, max= 8192, per=45.26%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=14.38%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8574KiB/s (8779kB/s), 2753KiB/s-6430KiB/s (2819kB/s-6584kB/s), io=16.0MiB (16.8MB), run=1488-1911msec WRITE: bw=17.6MiB/s (18.4MB/s), 5505KiB/s-7743KiB/s (5638kB/s-7929kB/s), io=32.0MiB (33.6MB), run=1488-1823msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189332: Thu Jun 11 21:43:16 2026 read: IOPS=1, BW=7447KiB/s (7626kB/s)(12.0MiB/1650msec) clat (msec): min=480, max=555, avg=512.95, stdev=38.65 lat (msec): min=480, max=555, avg=512.95, stdev=38.65 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 6050, max= 8175, per=94.73%, avg=7112.50, stdev=1502.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=42.51%, ctx=1189, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189333: Thu Jun 11 21:43:16 2026 read: IOPS=0, BW=1877KiB/s (1922kB/s)(4096KiB/2182msec) clat (nsec): min=532315k, max=532315k, avg=532315007.00, stdev= 0.00 lat (nsec): min=532318k, max=532318k, avg=532317807.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 6168, max= 6168, per=82.15%, avg=6168.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3754KiB/s (3844kB/s)(8192KiB/2182msec); 0 zone resets clat (msec): min=705, max=821, avg=763.31, stdev=81.90 lat (msec): min=705, max=821, avg=763.65, stdev=81.91 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8192, max= 8192, per=55.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.71%, ctx=567, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189334: Thu Jun 11 21:43:16 2026 write: IOPS=1, BW=5570KiB/s (5704kB/s)(12.0MiB/2206msec); 0 zone resets clat (msec): min=156, max=1225, avg=710.96, stdev=535.64 lat (msec): min=156, max=1225, avg=711.31, stdev=535.66 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8192, max= 8192, per=55.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.43%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189335: Thu Jun 11 21:43:16 2026 write: IOPS=1, BW=6044KiB/s (6189kB/s)(12.0MiB/2033msec); 0 zone resets clat (msec): min=162, max=863, avg=624.53, stdev=400.34 lat (msec): min=162, max=863, avg=624.94, stdev=400.32 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8175, max= 8175, per=55.04%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.45%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7509KiB/s (7689kB/s), 1877KiB/s-7447KiB/s (1922kB/s-7626kB/s), io=16.0MiB (16.8MB), run=1650-2182msec WRITE: bw=14.5MiB/s (15.2MB/s), 3754KiB/s-6044KiB/s (3844kB/s-6189kB/s), io=32.0MiB (33.6MB), run=2033-2206msec