== sanity test 398b: DIO and buffer IO race ============== 20:38:12 (1777423092) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.85159 s, 17.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153717: Tue Apr 28 20:39:14 2026 read: IOPS=27, BW=112KiB/s (114kB/s)(5992KiB/53644msec) clat (usec): min=143, max=797486, avg=19295.63, stdev=22948.29 lat (usec): min=144, max=797486, avg=19296.51, stdev=22948.33 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 6587], 10.00th=[ 8586], 20.00th=[ 10683], | 30.00th=[ 12387], 40.00th=[ 14746], 50.00th=[ 16909], 60.00th=[ 19006], | 70.00th=[ 21627], 80.00th=[ 25560], 90.00th=[ 31589], 95.00th=[ 39584], | 99.00th=[ 58983], 99.50th=[ 68682], 99.90th=[113771], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 6, max= 208, per=24.90%, avg=111.30, stdev=33.88, samples=106 iops : min= 1, max= 52, avg=27.46, stdev= 8.57, samples=106 write: IOPS=29, BW=117KiB/s (120kB/s)(6296KiB/53644msec); 0 zone resets clat (usec): min=792, max=101370, avg=15509.87, stdev=12022.11 lat (usec): min=793, max=101371, avg=15511.07, stdev=12022.11 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2835], 10.00th=[ 3392], 20.00th=[ 4883], | 30.00th=[ 7177], 40.00th=[ 10028], 50.00th=[ 12649], 60.00th=[ 16057], | 70.00th=[ 19530], 80.00th=[ 23987], 90.00th=[ 31589], 95.00th=[ 38011], | 99.00th=[ 50070], 99.50th=[ 61604], 99.90th=[ 98042], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 24, max= 208, per=25.43%, avg=119.01, stdev=32.94, samples=104 iops : min= 6, max= 52, avg=29.39, stdev= 8.29, samples=104 lat (usec) : 250=0.03%, 500=0.26%, 750=0.72%, 1000=0.65% lat (msec) : 2=1.04%, 4=7.29%, 10=18.68%, 20=39.26%, 50=30.57% lat (msec) : 100=1.40%, 250=0.07%, 1000=0.03% cpu : usr=0.12%, sys=28.68%, ctx=9918, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153718: Tue Apr 28 20:39:14 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(5940KiB/53317msec) clat (usec): min=261, max=106786, avg=18887.28, stdev=10589.20 lat (usec): min=262, max=106786, avg=18888.15, stdev=10589.37 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 7111], 10.00th=[ 8717], 20.00th=[ 10814], | 30.00th=[ 12649], 40.00th=[ 14877], 50.00th=[ 17171], 60.00th=[ 19268], | 70.00th=[ 22152], 80.00th=[ 25822], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 52167], 99.50th=[ 67634], 99.90th=[ 87557], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 6, max= 208, per=25.14%, avg=112.37, stdev=35.22, samples=105 iops : min= 1, max= 52, avg=27.73, stdev= 8.87, samples=105 write: IOPS=29, BW=119KiB/s (122kB/s)(6348KiB/53317msec); 0 zone resets clat (usec): min=794, max=792010, avg=15733.00, stdev=22906.14 lat (usec): min=795, max=792012, avg=15734.10, stdev=22906.15 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2769], 10.00th=[ 3359], 20.00th=[ 4686], | 30.00th=[ 6587], 40.00th=[ 9765], 50.00th=[ 12911], 60.00th=[ 16057], | 70.00th=[ 19268], 80.00th=[ 23200], 90.00th=[ 30278], 95.00th=[ 37487], | 99.00th=[ 57934], 99.50th=[ 67634], 99.90th=[133694], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 23, max= 224, per=25.69%, avg=120.25, stdev=36.19, samples=105 iops : min= 5, max= 56, avg=29.70, stdev= 9.12, samples=105 lat (usec) : 500=0.20%, 750=0.78%, 1000=0.23% lat (msec) : 2=1.20%, 4=7.13%, 10=19.08%, 20=38.96%, 50=30.92% lat (msec) : 100=1.40%, 250=0.07%, 1000=0.03% cpu : usr=0.11%, sys=28.87%, ctx=9945, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153719: Tue Apr 28 20:39:14 2026 read: IOPS=28, BW=114KiB/s (116kB/s)(6028KiB/53004msec) clat (usec): min=163, max=780979, avg=19201.94, stdev=22305.27 lat (usec): min=164, max=780980, avg=19202.89, stdev=22305.29 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 6063], 10.00th=[ 8356], 20.00th=[ 10421], | 30.00th=[ 12387], 40.00th=[ 14484], 50.00th=[ 16909], 60.00th=[ 19530], | 70.00th=[ 22414], 80.00th=[ 26084], 90.00th=[ 31851], 95.00th=[ 38536], | 99.00th=[ 51119], 99.50th=[ 58983], 99.90th=[ 98042], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 6, max= 184, per=25.41%, avg=113.57, stdev=32.23, samples=105 iops : min= 1, max= 46, avg=28.03, stdev= 8.13, samples=105 write: IOPS=29, BW=118KiB/s (121kB/s)(6260KiB/53004msec); 0 zone resets clat (usec): min=863, max=98865, avg=15183.18, stdev=11914.37 lat (usec): min=864, max=98867, avg=15184.61, stdev=11914.20 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2704], 10.00th=[ 3294], 20.00th=[ 4817], | 30.00th=[ 6980], 40.00th=[ 9765], 50.00th=[12518], 60.00th=[15533], | 70.00th=[19268], 80.00th=[23725], 90.00th=[30540], 95.00th=[36439], | 99.00th=[55313], 99.50th=[66847], 99.90th=[87557], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 7, max= 223, per=25.14%, avg=117.67, stdev=41.23, samples=105 iops : min= 1, max= 55, avg=29.06, stdev=10.37, samples=105 lat (usec) : 250=0.07%, 500=0.55%, 750=0.65%, 1000=0.65% lat (msec) : 2=1.50%, 4=7.13%, 10=18.98%, 20=37.34%, 50=31.80% lat (msec) : 100=1.30%, 1000=0.03% cpu : usr=0.11%, sys=28.91%, ctx=9862, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153720: Tue Apr 28 20:39:14 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(6052KiB/53626msec) clat (usec): min=152, max=774972, avg=19517.81, stdev=22529.36 lat (usec): min=153, max=774973, avg=19518.67, stdev=22529.39 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 6783], 10.00th=[ 8586], 20.00th=[ 10683], | 30.00th=[ 12649], 40.00th=[ 15008], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 21890], 80.00th=[ 25822], 90.00th=[ 31851], 95.00th=[ 38536], | 99.00th=[ 61604], 99.50th=[ 81265], 99.90th=[111674], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 6, max= 216, per=25.12%, avg=112.26, stdev=33.29, samples=106 iops : min= 1, max= 54, avg=27.71, stdev= 8.42, samples=106 write: IOPS=29, BW=116KiB/s (119kB/s)(6236KiB/53626msec); 0 zone resets clat (usec): min=736, max=80146, avg=15266.45, stdev=11612.05 lat (usec): min=737, max=80147, avg=15267.55, stdev=11612.09 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 2671], 10.00th=[ 3228], 20.00th=[ 4686], | 30.00th=[ 6915], 40.00th=[10028], 50.00th=[12649], 60.00th=[16057], | 70.00th=[19792], 80.00th=[24249], 90.00th=[30802], 95.00th=[36963], | 99.00th=[52167], 99.50th=[61604], 99.90th=[74974], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 27, max= 216, per=25.03%, avg=117.13, stdev=36.86, samples=105 iops : min= 6, max= 54, avg=28.92, stdev= 9.24, samples=105 lat (usec) : 250=0.03%, 500=0.29%, 750=0.78%, 1000=0.75% lat (msec) : 2=1.40%, 4=6.64%, 10=18.72%, 20=38.51%, 50=31.35% lat (msec) : 100=1.43%, 250=0.07%, 1000=0.03% cpu : usr=0.12%, sys=28.78%, ctx=9848, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=448KiB/s (458kB/s), 111KiB/s-114KiB/s (114kB/s-116kB/s), io=23.4MiB (24.6MB), run=53004-53644msec WRITE: bw=469KiB/s (480kB/s), 116KiB/s-119KiB/s (119kB/s-122kB/s), io=24.6MiB (25.7MB), run=53004-53644msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153722: Tue Apr 28 20:39:37 2026 read: IOPS=19, BW=78.5KiB/s (80.4kB/s)(5992KiB/76285msec) clat (msec): min=2, max=808, avg=15.95, stdev=25.33 lat (msec): min=2, max=808, avg=15.95, stdev=25.33 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 74], 99.50th=[ 92], 99.90th=[ 114], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 15, max= 216, per=25.02%, avg=78.57, stdev=43.12, samples=150 iops : min= 3, max= 54, avg=19.33, stdev=10.96, samples=150 write: IOPS=20, BW=82.5KiB/s (84.5kB/s)(6296KiB/76285msec); 0 zone resets clat (msec): min=13, max=141, avg=33.16, stdev=16.24 lat (msec): min=13, max=141, avg=33.17, stdev=16.24 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 54], 95.00th=[ 66], | 99.00th=[ 93], 99.50th=[ 102], 99.90th=[ 138], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 7, max= 168, per=25.05%, avg=82.41, stdev=39.88, samples=150 iops : min= 1, max= 42, avg=20.29, stdev=10.15, samples=150 lat (msec) : 4=3.48%, 10=21.26%, 20=19.89%, 50=46.32%, 100=8.69% lat (msec) : 250=0.33%, 1000=0.03% cpu : usr=0.10%, sys=11.00%, ctx=6369, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153723: Tue Apr 28 20:39:37 2026 read: IOPS=19, BW=77.8KiB/s (79.7kB/s)(5940KiB/76333msec) clat (msec): min=2, max=795, avg=15.53, stdev=24.58 lat (msec): min=2, max=795, avg=15.53, stdev=24.58 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 45], | 99.00th=[ 68], 99.50th=[ 75], 99.90th=[ 89], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 232, per=24.87%, avg=78.11, stdev=45.32, samples=151 iops : min= 1, max= 58, avg=19.22, stdev=11.49, samples=151 write: IOPS=20, BW=83.2KiB/s (85.2kB/s)(6348KiB/76333msec); 0 zone resets clat (msec): min=11, max=142, avg=33.45, stdev=16.74 lat (msec): min=11, max=142, avg=33.45, stdev=16.74 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 55], 95.00th=[ 63], | 99.00th=[ 97], 99.50th=[ 115], 99.90th=[ 136], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 23, max= 184, per=25.40%, avg=83.56, stdev=40.10, samples=151 iops : min= 5, max= 46, avg=20.58, stdev=10.21, samples=151 lat (msec) : 4=3.16%, 10=22.66%, 20=18.29%, 50=46.94%, 100=8.46% lat (msec) : 250=0.46%, 1000=0.03% cpu : usr=0.10%, sys=10.91%, ctx=6316, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153724: Tue Apr 28 20:39:37 2026 read: IOPS=19, BW=79.2KiB/s (81.1kB/s)(6028KiB/76091msec) clat (msec): min=2, max=107, avg=15.05, stdev=13.91 lat (msec): min=2, max=107, avg=15.06, stdev=13.91 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 42], | 99.00th=[ 69], 99.50th=[ 79], 99.90th=[ 103], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 15, max= 200, per=25.33%, avg=79.53, stdev=41.61, samples=150 iops : min= 3, max= 50, avg=19.57, stdev=10.56, samples=150 write: IOPS=20, BW=82.3KiB/s (84.2kB/s)(6260KiB/76091msec); 0 zone resets clat (msec): min=14, max=809, avg=34.00, stdev=25.49 lat (msec): min=14, max=809, avg=34.00, stdev=25.49 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 55], 95.00th=[ 65], | 99.00th=[ 97], 99.50th=[ 111], 99.90th=[ 163], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 31, max= 184, per=25.05%, avg=82.41, stdev=39.13, samples=150 iops : min= 7, max= 46, avg=20.29, stdev= 9.97, samples=150 lat (msec) : 4=3.22%, 10=21.68%, 20=19.53%, 50=47.53%, 100=7.55% lat (msec) : 250=0.46%, 1000=0.03% cpu : usr=0.11%, sys=11.04%, ctx=6286, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153725: Tue Apr 28 20:39:37 2026 read: IOPS=19, BW=79.8KiB/s (81.7kB/s)(6052KiB/75836msec) clat (msec): min=3, max=101, avg=15.26, stdev=14.52 lat (msec): min=3, max=101, avg=15.26, stdev=14.52 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 46], | 99.00th=[ 69], 99.50th=[ 77], 99.90th=[ 100], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 7, max= 224, per=25.72%, avg=80.77, stdev=43.57, samples=149 iops : min= 1, max= 56, avg=19.89, stdev=11.07, samples=149 write: IOPS=20, BW=82.2KiB/s (84.2kB/s)(6236KiB/75836msec); 0 zone resets clat (msec): min=13, max=825, avg=33.72, stdev=25.80 lat (msec): min=13, max=825, avg=33.72, stdev=25.80 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 32], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 55], 95.00th=[ 65], | 99.00th=[ 95], 99.50th=[ 120], 99.90th=[ 153], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 24, max= 176, per=25.11%, avg=82.63, stdev=39.08, samples=150 iops : min= 6, max= 44, avg=20.35, stdev= 9.95, samples=150 lat (msec) : 4=2.77%, 10=22.66%, 20=19.79%, 50=46.32%, 100=8.04% lat (msec) : 250=0.39%, 1000=0.03% cpu : usr=0.09%, sys=11.08%, ctx=6394, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=315KiB/s (322kB/s), 77.8KiB/s-79.8KiB/s (79.7kB/s-81.7kB/s), io=23.4MiB (24.6MB), run=75836-76333msec WRITE: bw=329KiB/s (337kB/s), 82.2KiB/s-83.2KiB/s (84.2kB/s-85.2kB/s), io=24.6MiB (25.7MB), run=75836-76333msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153751: Tue Apr 28 20:39:55 2026 read: IOPS=31, BW=502KiB/s (514kB/s)(5920KiB/11785msec) clat (usec): min=266, max=106544, avg=16522.45, stdev=11348.48 lat (usec): min=267, max=106545, avg=16527.32, stdev=11349.24 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 519], 10.00th=[ 717], 20.00th=[ 9765], | 30.00th=[ 11600], 40.00th=[ 13173], 50.00th=[ 15008], 60.00th=[ 16909], | 70.00th=[ 19530], 80.00th=[ 22676], 90.00th=[ 28443], 95.00th=[ 33162], | 99.00th=[ 61080], 99.50th=[ 70779], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 319, max= 734, per=25.67%, avg=501.35, stdev=120.95, samples=23 iops : min= 19, max= 45, avg=30.70, stdev= 7.59, samples=23 write: IOPS=33, BW=540KiB/s (553kB/s)(6368KiB/11785msec); 0 zone resets clat (usec): min=1689, max=75167, avg=14173.78, stdev=9676.18 lat (usec): min=1691, max=75168, avg=14175.29, stdev=9676.34 clat percentiles (usec): | 1.00th=[ 2474], 5.00th=[ 3720], 10.00th=[ 4293], 20.00th=[ 5276], | 30.00th=[ 7242], 40.00th=[ 9634], 50.00th=[12125], 60.00th=[14746], | 70.00th=[17695], 80.00th=[21627], 90.00th=[26608], 95.00th=[33162], | 99.00th=[44303], 99.50th=[48497], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 348, max= 702, per=26.34%, avg=541.26, stdev=104.74, samples=23 iops : min= 21, max= 43, avg=33.22, stdev= 6.61, samples=23 lat (usec) : 500=1.95%, 750=2.86%, 1000=0.26% lat (msec) : 2=0.91%, 4=2.86%, 10=22.79%, 20=41.41%, 50=26.17% lat (msec) : 100=0.65%, 250=0.13% cpu : usr=0.12%, sys=31.13%, ctx=2639, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153753: Tue Apr 28 20:39:55 2026 read: IOPS=29, BW=472KiB/s (484kB/s)(5744KiB/12161msec) clat (usec): min=419, max=73473, avg=17252.94, stdev=9884.47 lat (usec): min=420, max=73473, avg=17255.17, stdev=9882.47 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 611], 10.00th=[ 6915], 20.00th=[10552], | 30.00th=[12387], 40.00th=[13829], 50.00th=[16057], 60.00th=[18482], | 70.00th=[20579], 80.00th=[22938], 90.00th=[28705], 95.00th=[35390], | 99.00th=[49021], 99.50th=[66847], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 250, max= 702, per=24.10%, avg=470.58, stdev=128.86, samples=24 iops : min= 15, max= 43, avg=28.79, stdev= 8.13, samples=24 write: IOPS=33, BW=538KiB/s (551kB/s)(6544KiB/12161msec); 0 zone resets clat (usec): min=1101, max=64901, avg=14362.60, stdev=10997.04 lat (usec): min=1101, max=64902, avg=14364.13, stdev=10997.03 clat percentiles (usec): | 1.00th=[ 2311], 5.00th=[ 3654], 10.00th=[ 4228], 20.00th=[ 5342], | 30.00th=[ 7242], 40.00th=[ 9503], 50.00th=[11469], 60.00th=[13829], | 70.00th=[16450], 80.00th=[20841], 90.00th=[28967], 95.00th=[36439], | 99.00th=[60556], 99.50th=[64226], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 319, max= 960, per=26.21%, avg=538.54, stdev=152.25, samples=24 iops : min= 19, max= 60, avg=33.08, stdev= 9.56, samples=24 lat (usec) : 500=0.65%, 750=1.95%, 1000=0.39% lat (msec) : 2=0.78%, 4=4.04%, 10=23.57%, 20=41.80%, 50=25.91% lat (msec) : 100=0.91% cpu : usr=0.16%, sys=30.55%, ctx=2849, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153754: Tue Apr 28 20:39:55 2026 read: IOPS=31, BW=510KiB/s (523kB/s)(6256KiB/12259msec) clat (usec): min=282, max=65825, avg=16448.93, stdev=9273.43 lat (usec): min=284, max=65826, avg=16450.02, stdev=9273.39 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 594], 10.00th=[ 6390], 20.00th=[10683], | 30.00th=[11994], 40.00th=[13566], 50.00th=[15664], 60.00th=[17695], | 70.00th=[19792], 80.00th=[22152], 90.00th=[26346], 95.00th=[31327], | 99.00th=[47973], 99.50th=[54264], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 348, max= 736, per=25.95%, avg=506.79, stdev=99.08, samples=24 iops : min= 21, max= 46, avg=31.08, stdev= 6.38, samples=24 write: IOPS=30, BW=492KiB/s (504kB/s)(6032KiB/12259msec); 0 zone resets clat (usec): min=1331, max=71762, avg=15255.20, stdev=11307.48 lat (usec): min=1333, max=71765, avg=15257.21, stdev=11307.57 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3720], 10.00th=[ 4228], 20.00th=[ 5276], | 30.00th=[ 7046], 40.00th=[ 9503], 50.00th=[11863], 60.00th=[14877], | 70.00th=[19268], 80.00th=[23987], 90.00th=[30016], 95.00th=[36439], | 99.00th=[49546], 99.50th=[61080], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 223, max= 704, per=23.39%, avg=480.58, stdev=128.46, samples=24 iops : min= 13, max= 44, avg=29.42, stdev= 8.08, samples=24 lat (usec) : 500=1.17%, 750=2.86%, 1000=0.26% lat (msec) : 2=0.91%, 4=2.47%, 10=22.01%, 20=41.28%, 50=28.39% lat (msec) : 100=0.65% cpu : usr=0.11%, sys=30.04%, ctx=2747, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153755: Tue Apr 28 20:39:55 2026 read: IOPS=32, BW=521KiB/s (533kB/s)(6032KiB/11579msec) clat (usec): min=289, max=66745, avg=15960.90, stdev=9194.77 lat (usec): min=289, max=66746, avg=15968.22, stdev=9191.39 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 586], 10.00th=[ 1057], 20.00th=[10290], | 30.00th=[11731], 40.00th=[13304], 50.00th=[15139], 60.00th=[16909], | 70.00th=[20055], 80.00th=[22152], 90.00th=[26608], 95.00th=[32113], | 99.00th=[46400], 99.50th=[55313], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 381, max= 640, per=26.63%, avg=520.14, stdev=88.41, samples=22 iops : min= 23, max= 40, avg=31.86, stdev= 5.63, samples=22 write: IOPS=33, BW=540KiB/s (553kB/s)(6256KiB/11579msec); 0 zone resets clat (usec): min=1117, max=73689, avg=14015.47, stdev=10352.67 lat (usec): min=1118, max=73691, avg=14017.08, stdev=10352.76 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 3818], 10.00th=[ 4293], 20.00th=[ 5145], | 30.00th=[ 6652], 40.00th=[ 9372], 50.00th=[11207], 60.00th=[13435], | 70.00th=[16909], 80.00th=[22152], 90.00th=[27132], 95.00th=[33817], | 99.00th=[47449], 99.50th=[62129], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 348, max= 926, per=26.49%, avg=544.45, stdev=139.04, samples=22 iops : min= 21, max= 57, avg=33.36, stdev= 8.61, samples=22 lat (usec) : 500=1.30%, 750=2.47%, 1000=1.04% lat (msec) : 2=1.04%, 4=2.99%, 10=22.53%, 20=41.54%, 50=26.43% lat (msec) : 100=0.65% cpu : usr=0.15%, sys=31.58%, ctx=2731, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1954KiB/s (2001kB/s), 472KiB/s-521KiB/s (484kB/s-533kB/s), io=23.4MiB (24.5MB), run=11579-12259msec WRITE: bw=2056KiB/s (2105kB/s), 492KiB/s-540KiB/s (504kB/s-553kB/s), io=24.6MiB (25.8MB), run=11579-12259msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153748: Tue Apr 28 20:40:01 2026 read: IOPS=19, BW=312KiB/s (320kB/s)(5920KiB/18972msec) clat (usec): min=3201, max=99465, avg=14753.81, stdev=14294.66 lat (usec): min=3202, max=99466, avg=14754.94, stdev=14294.51 clat percentiles (usec): | 1.00th=[ 3392], 5.00th=[ 4293], 10.00th=[ 4883], 20.00th=[ 5735], | 30.00th=[ 7046], 40.00th=[ 8029], 50.00th=[ 9503], 60.00th=[11207], | 70.00th=[14484], 80.00th=[20317], 90.00th=[32900], 95.00th=[44827], | 99.00th=[77071], 99.50th=[93848], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 127, max= 768, per=23.92%, avg=301.86, stdev=135.78, samples=37 iops : min= 7, max= 48, avg=18.43, stdev= 8.69, samples=37 write: IOPS=20, BW=336KiB/s (344kB/s)(6368KiB/18972msec); 0 zone resets clat (msec): min=12, max=137, avg=33.77, stdev=16.31 lat (msec): min=12, max=137, avg=33.77, stdev=16.31 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 37], 80.00th=[ 43], 90.00th=[ 58], 95.00th=[ 67], | 99.00th=[ 96], 99.50th=[ 112], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 159, max= 608, per=24.84%, avg=329.86, stdev=141.43, samples=37 iops : min= 9, max= 38, avg=20.19, stdev= 9.10, samples=37 lat (msec) : 4=1.04%, 10=24.48%, 20=19.01%, 50=46.88%, 100=8.33% lat (msec) : 250=0.26% cpu : usr=0.13%, sys=10.70%, ctx=1719, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153749: Tue Apr 28 20:40:01 2026 read: IOPS=18, BW=303KiB/s (311kB/s)(5744KiB/18943msec) clat (usec): min=3263, max=83535, avg=14464.99, stdev=12744.53 lat (usec): min=3264, max=83536, avg=14466.03, stdev=12744.74 clat percentiles (usec): | 1.00th=[ 3621], 5.00th=[ 4424], 10.00th=[ 4948], 20.00th=[ 5866], | 30.00th=[ 7046], 40.00th=[ 8291], 50.00th=[10290], 60.00th=[12518], | 70.00th=[15139], 80.00th=[19792], 90.00th=[30540], 95.00th=[41681], | 99.00th=[64226], 99.50th=[82314], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 55, max= 640, per=24.58%, avg=310.19, stdev=152.31, samples=36 iops : min= 3, max= 40, avg=18.97, stdev= 9.67, samples=36 write: IOPS=21, BW=345KiB/s (354kB/s)(6544KiB/18943msec); 0 zone resets clat (msec): min=12, max=130, avg=33.43, stdev=15.21 lat (msec): min=12, max=130, avg=33.43, stdev=15.21 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 42], 90.00th=[ 50], 95.00th=[ 65], | 99.00th=[ 93], 99.50th=[ 94], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 191, max= 544, per=25.52%, avg=338.89, stdev=115.56, samples=37 iops : min= 11, max= 34, avg=20.76, stdev= 7.49, samples=37 lat (msec) : 4=1.04%, 10=21.74%, 20=20.31%, 50=50.39%, 100=6.25% lat (msec) : 250=0.26% cpu : usr=0.08%, sys=10.89%, ctx=1699, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153750: Tue Apr 28 20:40:01 2026 read: IOPS=21, BW=337KiB/s (345kB/s)(6256KiB/18574msec) clat (usec): min=3416, max=83403, avg=14990.11, stdev=13185.40 lat (usec): min=3417, max=83404, avg=14991.17, stdev=13185.47 clat percentiles (usec): | 1.00th=[ 3785], 5.00th=[ 4228], 10.00th=[ 4752], 20.00th=[ 5669], | 30.00th=[ 6849], 40.00th=[ 8094], 50.00th=[10552], 60.00th=[12911], | 70.00th=[16450], 80.00th=[21365], 90.00th=[31327], 95.00th=[45351], | 99.00th=[73925], 99.50th=[79168], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 94, max= 832, per=26.79%, avg=338.03, stdev=182.92, samples=36 iops : min= 5, max= 52, avg=20.69, stdev=11.59, samples=36 write: IOPS=20, BW=325KiB/s (333kB/s)(6032KiB/18574msec); 0 zone resets clat (msec): min=14, max=118, avg=33.64, stdev=15.17 lat (msec): min=14, max=118, avg=33.64, stdev=15.17 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 36], 80.00th=[ 42], 90.00th=[ 51], 95.00th=[ 62], | 99.00th=[ 97], 99.50th=[ 115], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 159, max= 608, per=24.11%, avg=320.17, stdev=121.22, samples=36 iops : min= 9, max= 38, avg=19.56, stdev= 7.83, samples=36 lat (msec) : 4=1.30%, 10=23.18%, 20=20.05%, 50=48.83%, 100=6.25% lat (msec) : 250=0.39% cpu : usr=0.11%, sys=10.81%, ctx=1693, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153752: Tue Apr 28 20:40:01 2026 read: IOPS=20, BW=321KiB/s (329kB/s)(6032KiB/18774msec) clat (usec): min=3041, max=97139, avg=14806.02, stdev=14326.99 lat (usec): min=3042, max=97140, avg=14806.89, stdev=14326.96 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 4424], 10.00th=[ 4817], 20.00th=[ 5800], | 30.00th=[ 7046], 40.00th=[ 8356], 50.00th=[ 9765], 60.00th=[11994], | 70.00th=[14222], 80.00th=[18744], 90.00th=[32900], 95.00th=[44827], | 99.00th=[79168], 99.50th=[94897], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 640, per=25.24%, avg=318.57, stdev=144.19, samples=37 iops : min= 3, max= 40, avg=19.49, stdev= 9.19, samples=37 write: IOPS=20, BW=333KiB/s (341kB/s)(6256KiB/18774msec); 0 zone resets clat (msec): min=14, max=117, avg=33.48, stdev=14.35 lat (msec): min=14, max=117, avg=33.49, stdev=14.35 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 30], 60.00th=[ 32], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 65], | 99.00th=[ 78], 99.50th=[ 96], 99.90th=[ 117], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 158, max= 576, per=25.01%, avg=332.19, stdev=129.17, samples=37 iops : min= 9, max= 36, avg=20.32, stdev= 8.31, samples=37 lat (msec) : 4=0.78%, 10=24.61%, 20=19.27%, 50=47.27%, 100=7.94% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=11.03%, ctx=1687, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1262KiB/s (1293kB/s), 303KiB/s-337KiB/s (311kB/s-345kB/s), io=23.4MiB (24.5MB), run=18574-18972msec WRITE: bw=1328KiB/s (1360kB/s), 325KiB/s-345KiB/s (333kB/s-354kB/s), io=24.6MiB (25.8MB), run=18574-18972msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153769: Tue Apr 28 20:40:11 2026 read: IOPS=2, BW=2332KiB/s (2388kB/s)(7168KiB/3074msec) clat (msec): min=156, max=436, avg=222.43, stdev=96.61 lat (msec): min=156, max=436, avg=222.43, stdev=96.61 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 169], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 201], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 213], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 2035, max= 4096, per=50.36%, avg=2753.75, stdev=970.07, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1666KiB/s (1706kB/s)(5120KiB/3074msec); 0 zone resets clat (msec): min=159, max=683, avg=302.42, stdev=216.74 lat (msec): min=159, max=684, avg=302.58, stdev=216.94 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2035, max= 3820, per=34.41%, avg=2634.33, stdev=1026.84, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=75.00%, 500=16.67%, 750=8.33% cpu : usr=0.03%, sys=34.23%, ctx=841, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153770: Tue Apr 28 20:40:11 2026 read: IOPS=0, BW=547KiB/s (560kB/s)(2048KiB/3745msec) clat (msec): min=215, max=283, avg=249.46, stdev=47.81 lat (msec): min=215, max=283, avg=249.46, stdev=47.81 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1426, max= 2035, per=31.65%, avg=1730.50, stdev=430.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2734KiB/s (2800kB/s)(10.0MiB/3745msec); 0 zone resets clat (msec): min=149, max=825, avg=324.02, stdev=197.09 lat (msec): min=149, max=825, avg=324.13, stdev=197.10 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 155], | 30.00th=[ 218], 40.00th=[ 249], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 351], 80.00th=[ 384], 90.00th=[ 409], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1426, max= 4096, per=29.53%, avg=2260.50, stdev=930.53, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.17, samples=6 lat (msec) : 250=41.67%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=30.82%, ctx=416, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153771: Tue Apr 28 20:40:11 2026 read: IOPS=2, BW=2216KiB/s (2269kB/s)(6144KiB/2773msec) clat (usec): min=1503, max=171115, avg=104191.89, stdev=69861.33 lat (usec): min=1505, max=171117, avg=104193.87, stdev=69861.47 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1500], 10.00th=[ 1500], 20.00th=[ 63177], | 30.00th=[ 63177], 40.00th=[ 68682], 50.00th=[ 68682], 60.00th=[154141], | 70.00th=[166724], 80.00th=[166724], 90.00th=[170918], 95.00th=[170918], | 99.00th=[170918], 99.50th=[170918], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 1910, max= 8192, per=92.37%, avg=5051.00, stdev=4442.04, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=2, BW=2216KiB/s (2269kB/s)(6144KiB/2773msec); 0 zone resets clat (msec): min=159, max=629, avg=357.25, stdev=158.24 lat (msec): min=159, max=629, avg=357.34, stdev=158.26 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 359], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1910, max= 4096, per=35.91%, avg=2749.00, stdev=1011.69, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 2=8.33%, 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.07%, sys=29.40%, ctx=225, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153772: Tue Apr 28 20:40:11 2026 read: IOPS=1, BW=1402KiB/s (1436kB/s)(5120KiB/3651msec) clat (usec): min=973, max=214928, avg=70757.40, stdev=93675.40 lat (usec): min=975, max=214930, avg=70759.32, stdev=93675.39 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 971], 10.00th=[ 971], 20.00th=[ 971], | 30.00th=[ 1057], 40.00th=[ 1057], 50.00th=[ 20579], 60.00th=[ 20579], | 70.00th=[115868], 80.00th=[115868], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1963KiB/s (2010kB/s)(7168KiB/3651msec); 0 zone resets clat (msec): min=173, max=1110, avg=470.44, stdev=347.39 lat (msec): min=173, max=1111, avg=470.55, stdev=347.41 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 347], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 776], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1434, max= 2048, per=24.75%, avg=1895.00, stdev=264.18, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=33.33%, 500=25.00%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=21.10%, ctx=193, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5469KiB/s (5600kB/s), 547KiB/s-2332KiB/s (560kB/s-2388kB/s), io=20.0MiB (20.0MB), run=2773-3745msec WRITE: bw=7656KiB/s (7840kB/s), 1666KiB/s-2734KiB/s (1706kB/s-2800kB/s), io=28.0MiB (29.4MB), run=2773-3745msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153764: Tue Apr 28 20:40:11 2026 read: IOPS=2, BW=2212KiB/s (2265kB/s)(7168KiB/3241msec) clat (msec): min=43, max=956, avg=295.62, stdev=340.34 lat (msec): min=43, max=956, avg=295.63, stdev=340.34 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 64], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 82], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 489], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1858, max= 7641, per=80.50%, avg=3847.33, stdev=3286.71, samples=3 iops : min= 1, max= 7, avg= 3.00, stdev= 3.46, samples=3 write: IOPS=1, BW=1580KiB/s (1618kB/s)(5120KiB/3241msec); 0 zone resets clat (msec): min=87, max=442, avg=228.03, stdev=138.74 lat (msec): min=87, max=443, avg=228.42, stdev=139.27 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1858, max= 4071, per=36.91%, avg=2469.50, stdev=1070.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=25.00%, 1000=8.33% cpu : usr=0.03%, sys=8.67%, ctx=144, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153765: Tue Apr 28 20:40:11 2026 read: IOPS=0, BW=478KiB/s (489kB/s)(2048KiB/4285msec) clat (msec): min=79, max=800, avg=439.63, stdev=509.90 lat (msec): min=79, max=800, avg=439.64, stdev=509.90 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1932, max= 1965, per=40.77%, avg=1948.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2390KiB/s (2447kB/s)(10.0MiB/4285msec); 0 zone resets clat (msec): min=92, max=1127, avg=333.71, stdev=307.35 lat (msec): min=92, max=1127, avg=333.89, stdev=307.30 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 105], | 30.00th=[ 125], 40.00th=[ 176], 50.00th=[ 271], 60.00th=[ 288], | 70.00th=[ 313], 80.00th=[ 330], 90.00th=[ 514], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1858, max= 4087, per=39.67%, avg=2654.33, stdev=1028.19, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.12%, sys=9.71%, ctx=113, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153766: Tue Apr 28 20:40:11 2026 read: IOPS=1, BW=1646KiB/s (1686kB/s)(6144KiB/3732msec) clat (msec): min=91, max=521, avg=244.58, stdev=157.85 lat (msec): min=91, max=521, avg=244.59, stdev=157.85 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 259], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1858, max= 2043, per=41.93%, avg=2003.60, stdev=81.46, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1646KiB/s (1686kB/s)(6144KiB/3732msec); 0 zone resets clat (msec): min=134, max=926, avg=364.62, stdev=291.13 lat (msec): min=134, max=926, avg=364.74, stdev=291.12 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 309], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1965, max= 3915, per=37.22%, avg=2490.50, stdev=950.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=9.25%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153767: Tue Apr 28 20:40:11 2026 read: IOPS=1, BW=1369KiB/s (1402kB/s)(5120KiB/3740msec) clat (msec): min=74, max=197, avg=143.41, stdev=55.44 lat (msec): min=74, max=197, avg=143.41, stdev=55.44 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 3716, max= 4071, per=81.47%, avg=3893.50, stdev=251.02, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1917KiB/s (1963kB/s)(7168KiB/3740msec); 0 zone resets clat (msec): min=136, max=949, avg=423.61, stdev=315.24 lat (msec): min=137, max=949, avg=423.69, stdev=315.23 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 163], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 317], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 718], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2035, max= 4087, per=45.48%, avg=3043.00, stdev=1159.78, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=8.67%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4779KiB/s (4894kB/s), 478KiB/s-2212KiB/s (489kB/s-2265kB/s), io=20.0MiB (20.0MB), run=3241-4285msec WRITE: bw=6691KiB/s (6852kB/s), 1580KiB/s-2390KiB/s (1618kB/s-2447kB/s), io=28.0MiB (29.4MB), run=3241-4285msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153778: Tue Apr 28 20:40:19 2026 read: IOPS=1, BW=7792KiB/s (7979kB/s)(12.0MiB/1577msec) clat (msec): min=454, max=562, avg=513.25, stdev=54.47 lat (msec): min=454, max=562, avg=513.25, stdev=54.47 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8159, max= 8192, per=81.34%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=30.96%, ctx=792, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153779: Tue Apr 28 20:40:19 2026 read: IOPS=0, BW=2513KiB/s (2573kB/s)(4096KiB/1630msec) clat (nsec): min=782352k, max=782352k, avg=782351955.00, stdev= 0.00 lat (nsec): min=782353k, max=782353k, avg=782353389.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8159, max= 8159, per=81.18%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5026KiB/s (5146kB/s)(8192KiB/1630msec); 0 zone resets clat (msec): min=219, max=596, avg=407.96, stdev=266.82 lat (msec): min=219, max=596, avg=408.24, stdev=266.84 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=50.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=18.60%, ctx=339, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153780: Tue Apr 28 20:40:19 2026 write: IOPS=1, BW=6144KiB/s (6291kB/s)(12.0MiB/2000msec); 0 zone resets clat (msec): min=206, max=1013, avg=654.12, stdev=410.57 lat (msec): min=207, max=1015, avg=654.82, stdev=411.13 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8192, max= 8192, per=50.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.15%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153782: Tue Apr 28 20:40:19 2026 write: IOPS=1, BW=6966KiB/s (7133kB/s)(12.0MiB/1764msec); 0 zone resets clat (msec): min=201, max=1109, avg=550.31, stdev=489.17 lat (msec): min=201, max=1109, avg=550.63, stdev=489.11 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 6491, max= 8159, per=44.71%, avg=7325.00, stdev=1179.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.91%, ctx=158, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9.82MiB/s (10.3MB/s), 2513KiB/s-7792KiB/s (2573kB/s-7979kB/s), io=16.0MiB (16.8MB), run=1577-1630msec WRITE: bw=16.0MiB/s (16.8MB/s), 5026KiB/s-6966KiB/s (5146kB/s-7133kB/s), io=32.0MiB (33.6MB), run=1630-2000msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153781: Tue Apr 28 20:40:19 2026 read: IOPS=1, BW=5665KiB/s (5801kB/s)(12.0MiB/2169msec) clat (msec): min=313, max=1168, avg=685.37, stdev=437.90 lat (msec): min=313, max=1168, avg=685.37, stdev=437.91 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.98%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153783: Tue Apr 28 20:40:19 2026 read: IOPS=0, BW=1824KiB/s (1868kB/s)(4096KiB/2245msec) clat (nsec): min=1146.3M, max=1146.3M, avg=1146281968.00, stdev= 0.00 lat (nsec): min=1146.3M, max=1146.3M, avg=1146284154.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3649KiB/s (3737kB/s)(8192KiB/2245msec); 0 zone resets clat (msec): min=442, max=615, avg=529.21, stdev=122.17 lat (msec): min=443, max=615, avg=529.49, stdev=122.18 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8192, max= 8192, per=60.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.33%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153784: Tue Apr 28 20:40:19 2026 write: IOPS=1, BW=5082KiB/s (5204kB/s)(12.0MiB/2418msec); 0 zone resets clat (msec): min=350, max=1479, avg=791.84, stdev=603.75 lat (msec): min=350, max=1480, avg=792.16, stdev=603.88 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8175, max= 8175, per=60.33%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.91%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153785: Tue Apr 28 20:40:19 2026 write: IOPS=1, BW=6927KiB/s (7093kB/s)(12.0MiB/1774msec); 0 zone resets clat (msec): min=397, max=688, avg=569.30, stdev=152.48 lat (msec): min=397, max=689, avg=569.61, stdev=152.63 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8159, max= 8192, per=60.33%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=8.35%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7298KiB/s (7473kB/s), 1824KiB/s-5665KiB/s (1868kB/s-5801kB/s), io=16.0MiB (16.8MB), run=2169-2245msec WRITE: bw=13.2MiB/s (13.9MB/s), 3649KiB/s-6927KiB/s (3737kB/s-7093kB/s), io=32.0MiB (33.6MB), run=1774-2418msec