== sanity test 398b: DIO and buffer IO race ============== 11:21:43 (1779981703) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.65091 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183440: Thu May 28 11:23:58 2026 read: IOPS=12, BW=51.9KiB/s (53.1kB/s)(5992KiB/115461msec) clat (usec): min=193, max=916359, avg=43023.03, stdev=34079.36 lat (usec): min=194, max=916361, avg=43032.31, stdev=34075.51 clat percentiles (usec): | 1.00th=[ 251], 5.00th=[ 12649], 10.00th=[ 17171], 20.00th=[ 22414], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[129500], 99.50th=[149947], 99.90th=[206570], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 103, per=25.52%, avg=51.55, stdev=18.18, samples=227 iops : min= 1, max= 25, avg=12.23, stdev= 4.57, samples=227 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6296KiB/115461msec); 0 zone resets clat (usec): min=1116, max=230611, avg=32102.94, stdev=32842.28 lat (usec): min=1117, max=230613, avg=32110.36, stdev=32840.55 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1434], 10.00th=[ 2008], 20.00th=[ 4080], | 30.00th=[ 7635], 40.00th=[ 14615], 50.00th=[ 23200], 60.00th=[ 30802], | 70.00th=[ 40633], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[183501], 99.90th=[221250], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 126, per=25.65%, avg=54.38, stdev=22.10, samples=226 iops : min= 1, max= 31, avg=12.95, stdev= 5.57, samples=226 lat (usec) : 250=0.46%, 500=0.68%, 750=0.10%, 1000=0.03% lat (msec) : 2=5.31%, 4=5.18%, 10=7.75%, 20=11.07%, 50=41.96% lat (msec) : 100=23.96%, 250=3.48%, 1000=0.03% cpu : usr=0.08%, sys=6.17%, ctx=6954, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183441: Thu May 28 11:23:58 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(5940KiB/117129msec) clat (usec): min=197, max=260100, avg=43653.21, stdev=27379.55 lat (usec): min=198, max=260101, avg=43655.14, stdev=27379.29 clat percentiles (usec): | 1.00th=[ 241], 5.00th=[ 11207], 10.00th=[ 17433], 20.00th=[ 23200], | 30.00th=[ 27919], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[164627], 99.90th=[221250], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 104, per=24.94%, avg=50.38, stdev=17.80, samples=229 iops : min= 1, max= 26, avg=11.94, stdev= 4.48, samples=229 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6348KiB/117129msec); 0 zone resets clat (usec): min=1119, max=879906, avg=32659.22, stdev=38109.85 lat (usec): min=1120, max=879908, avg=32664.72, stdev=38109.44 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1483], 10.00th=[ 2442], 20.00th=[ 4817], | 30.00th=[ 8586], 40.00th=[ 15401], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 41157], 80.00th=[ 54264], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[156238], 99.90th=[248513], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 15, max= 143, per=25.35%, avg=53.73, stdev=22.70, samples=229 iops : min= 3, max= 35, avg=12.78, stdev= 5.71, samples=229 lat (usec) : 250=0.55%, 500=0.91%, 750=0.23%, 1000=0.03% lat (msec) : 2=4.36%, 4=4.56%, 10=8.59%, 20=10.90%, 50=42.55% lat (msec) : 100=23.40%, 250=3.84%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=6.28%, ctx=7002, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183443: Thu May 28 11:23:58 2026 read: IOPS=12, BW=51.1KiB/s (52.3kB/s)(6028KiB/117952msec) clat (usec): min=189, max=887854, avg=43798.27, stdev=34469.88 lat (usec): min=190, max=887855, avg=43802.11, stdev=34469.43 clat percentiles (usec): | 1.00th=[ 249], 5.00th=[ 11207], 10.00th=[ 16909], 20.00th=[ 22938], | 30.00th=[ 27919], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[162530], 99.90th=[246416], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 103, per=25.12%, avg=50.75, stdev=17.91, samples=232 iops : min= 1, max= 25, avg=12.03, stdev= 4.47, samples=232 write: IOPS=13, BW=53.1KiB/s (54.3kB/s)(6260KiB/117952msec); 0 zone resets clat (usec): min=1147, max=224662, avg=32880.55, stdev=32433.35 lat (usec): min=1148, max=224663, avg=32885.53, stdev=32430.59 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1500], 10.00th=[ 2311], 20.00th=[ 4621], | 30.00th=[ 8225], 40.00th=[ 16188], 50.00th=[ 23725], 60.00th=[ 32637], | 70.00th=[ 43254], 80.00th=[ 57410], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[162530], 99.90th=[198181], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 7, max= 111, per=24.97%, avg=52.93, stdev=21.16, samples=231 iops : min= 1, max= 27, avg=12.58, stdev= 5.33, samples=231 lat (usec) : 250=0.52%, 500=0.94%, 750=0.03%, 1000=0.20% lat (msec) : 2=4.20%, 4=4.88%, 10=8.20%, 20=11.04%, 50=41.31% lat (msec) : 100=24.93%, 250=3.71%, 1000=0.03% cpu : usr=0.07%, sys=6.21%, ctx=7017, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183444: Thu May 28 11:23:58 2026 read: IOPS=12, BW=51.1KiB/s (52.3kB/s)(6052KiB/118453msec) clat (usec): min=188, max=215869, avg=42575.54, stdev=25989.73 lat (usec): min=189, max=215870, avg=42578.57, stdev=25991.07 clat percentiles (usec): | 1.00th=[ 225], 5.00th=[ 9503], 10.00th=[ 16712], 20.00th=[ 22676], | 30.00th=[ 27395], 40.00th=[ 32113], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[127402], 99.50th=[137364], 99.90th=[210764], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 7, max= 102, per=25.23%, avg=50.97, stdev=17.48, samples=232 iops : min= 1, max= 25, avg=12.09, stdev= 4.42, samples=232 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6236KiB/118453msec); 0 zone resets clat (usec): min=1089, max=904494, avg=34353.98, stdev=39542.67 lat (usec): min=1089, max=904496, avg=34358.34, stdev=39544.10 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1434], 10.00th=[ 2147], 20.00th=[ 4555], | 30.00th=[ 8717], 40.00th=[ 17433], 50.00th=[ 26084], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[175113], 99.90th=[242222], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 15, max= 148, per=24.61%, avg=52.17, stdev=21.23, samples=233 iops : min= 3, max= 37, avg=12.39, stdev= 5.35, samples=233 lat (usec) : 250=0.78%, 500=0.78%, 750=0.13%, 1000=0.16% lat (msec) : 2=4.98%, 4=4.69%, 10=7.36%, 20=9.83%, 50=42.38% lat (msec) : 100=24.93%, 250=3.94%, 1000=0.03% cpu : usr=0.08%, sys=6.11%, ctx=7029, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=203KiB/s (208kB/s), 50.7KiB/s-51.9KiB/s (51.9kB/s-53.1kB/s), io=23.4MiB (24.6MB), run=115461-118453msec WRITE: bw=212KiB/s (217kB/s), 52.6KiB/s-54.5KiB/s (53.9kB/s-55.8kB/s), io=24.6MiB (25.7MB), run=115461-118453msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183445: Thu May 28 11:24:40 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(5992KiB/160081msec) clat (msec): min=5, max=956, avg=42.59, stdev=40.96 lat (msec): min=5, max=956, avg=42.60, stdev=40.96 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 89], 95.00th=[ 112], | 99.00th=[ 163], 99.50th=[ 186], 99.90th=[ 330], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 111, per=25.45%, avg=37.93, stdev=22.10, samples=307 iops : min= 1, max= 27, avg= 8.81, stdev= 5.57, samples=307 write: IOPS=9, BW=39.3KiB/s (40.3kB/s)(6296KiB/160081msec); 0 zone resets clat (msec): min=11, max=327, avg=60.94, stdev=39.23 lat (msec): min=11, max=327, avg=60.94, stdev=39.23 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 70], 80.00th=[ 88], 90.00th=[ 111], 95.00th=[ 133], | 99.00th=[ 197], 99.50th=[ 259], 99.90th=[ 313], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 103, per=24.97%, avg=38.95, stdev=20.57, samples=314 iops : min= 1, max= 25, avg= 9.07, stdev= 5.18, samples=314 lat (msec) : 10=1.07%, 20=13.05%, 50=47.40%, 100=27.60%, 250=10.51% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=2.39%, ctx=5036, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183446: Thu May 28 11:24:40 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(5940KiB/159828msec) clat (msec): min=5, max=893, avg=42.29, stdev=39.38 lat (msec): min=5, max=893, avg=42.29, stdev=39.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 60], 90.00th=[ 87], 95.00th=[ 107], | 99.00th=[ 167], 99.50th=[ 180], 99.90th=[ 321], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 112, per=25.29%, avg=37.69, stdev=22.53, samples=307 iops : min= 1, max= 28, avg= 8.75, stdev= 5.67, samples=307 write: IOPS=9, BW=39.7KiB/s (40.7kB/s)(6348KiB/159828msec); 0 zone resets clat (msec): min=11, max=327, avg=60.80, stdev=38.86 lat (msec): min=11, max=327, avg=60.80, stdev=38.86 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 87], 90.00th=[ 111], 95.00th=[ 129], | 99.00th=[ 203], 99.50th=[ 257], 99.90th=[ 309], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=39.66, stdev=20.19, samples=312 iops : min= 1, max= 29, avg= 9.25, stdev= 5.06, samples=312 lat (msec) : 10=1.11%, 20=12.27%, 50=47.79%, 100=28.58%, 250=9.93% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=2.44%, ctx=5142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183447: Thu May 28 11:24:40 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160641msec) clat (msec): min=6, max=320, avg=42.45, stdev=34.70 lat (msec): min=6, max=320, avg=42.45, stdev=34.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 89], 95.00th=[ 114], | 99.00th=[ 163], 99.50th=[ 194], 99.90th=[ 305], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 127, per=25.16%, avg=37.49, stdev=22.10, samples=312 iops : min= 1, max= 31, avg= 8.70, stdev= 5.56, samples=312 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6260KiB/160641msec); 0 zone resets clat (msec): min=8, max=950, avg=61.46, stdev=44.59 lat (msec): min=8, max=950, avg=61.47, stdev=44.59 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 201], 99.50th=[ 230], 99.90th=[ 300], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 103, per=24.92%, avg=38.88, stdev=20.40, samples=312 iops : min= 1, max= 25, avg= 9.05, stdev= 5.14, samples=312 lat (msec) : 10=1.33%, 20=12.96%, 50=48.05%, 100=26.43%, 250=10.97% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=2.48%, ctx=5154, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183448: Thu May 28 11:24:40 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6052KiB/161128msec) clat (msec): min=5, max=289, avg=43.05, stdev=35.41 lat (msec): min=5, max=289, avg=43.05, stdev=35.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 91], 95.00th=[ 115], | 99.00th=[ 167], 99.50th=[ 199], 99.90th=[ 253], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 110, per=25.62%, avg=38.17, stdev=22.46, samples=307 iops : min= 1, max= 27, avg= 8.87, stdev= 5.64, samples=307 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6236KiB/161128msec); 0 zone resets clat (msec): min=9, max=1032, avg=61.29, stdev=45.49 lat (msec): min=9, max=1032, avg=61.30, stdev=45.50 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 222], 99.90th=[ 279], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 95, per=24.49%, avg=38.20, stdev=20.60, samples=316 iops : min= 1, max= 23, avg= 8.88, stdev= 5.18, samples=316 lat (msec) : 10=1.30%, 20=12.76%, 50=48.31%, 100=26.27%, 250=11.17% lat (msec) : 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=2.44%, ctx=5221, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 37.2KiB/s-37.6KiB/s (38.1kB/s-38.5kB/s), io=23.4MiB (24.6MB), run=159828-161128msec WRITE: bw=156KiB/s (160kB/s), 38.7KiB/s-39.7KiB/s (39.6kB/s-40.7kB/s), io=24.6MiB (25.7MB), run=159828-161128msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183492: Thu May 28 11:25:22 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(5920KiB/28957msec) clat (usec): min=218, max=197460, avg=43784.90, stdev=26385.42 lat (usec): min=218, max=197461, avg=43824.92, stdev=26390.15 clat percentiles (usec): | 1.00th=[ 241], 5.00th=[ 437], 10.00th=[ 17171], 20.00th=[ 25297], | 30.00th=[ 29754], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 60031], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[121111], 99.50th=[156238], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 63, max= 381, per=26.45%, avg=202.84, stdev=66.71, samples=56 iops : min= 3, max= 23, avg=11.86, stdev= 4.16, samples=56 write: IOPS=13, BW=220KiB/s (225kB/s)(6368KiB/28957msec); 0 zone resets clat (usec): min=1698, max=182376, avg=31242.75, stdev=29158.27 lat (usec): min=1699, max=182379, avg=31300.61, stdev=29177.16 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2409], 10.00th=[ 3326], 20.00th=[ 5866], | 30.00th=[ 9241], 40.00th=[ 15401], 50.00th=[ 23462], 60.00th=[ 30802], | 70.00th=[ 41681], 80.00th=[ 53740], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[121111], 99.50th=[175113], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 400, per=27.27%, avg=220.07, stdev=81.04, samples=56 iops : min= 1, max= 25, avg=12.95, stdev= 5.14, samples=56 lat (usec) : 250=0.78%, 500=1.95%, 750=0.26%, 1000=0.13% lat (msec) : 2=0.91%, 4=5.60%, 10=10.03%, 20=10.29%, 50=42.58% lat (msec) : 100=24.09%, 250=3.39% cpu : usr=0.08%, sys=6.83%, ctx=1812, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183493: Thu May 28 11:25:22 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(5744KiB/31218msec) clat (usec): min=234, max=196554, avg=45666.66, stdev=28278.14 lat (usec): min=235, max=196556, avg=45670.21, stdev=28276.55 clat percentiles (usec): | 1.00th=[ 258], 5.00th=[ 1106], 10.00th=[ 17171], 20.00th=[ 25297], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 55837], 80.00th=[ 64226], 90.00th=[ 78119], 95.00th=[100140], | 99.00th=[129500], 99.50th=[177210], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 22, max= 349, per=23.99%, avg=184.03, stdev=73.19, samples=61 iops : min= 1, max= 21, avg=10.67, stdev= 4.57, samples=61 write: IOPS=13, BW=210KiB/s (215kB/s)(6544KiB/31218msec); 0 zone resets clat (usec): min=1814, max=212082, avg=35615.46, stdev=33435.23 lat (usec): min=1816, max=212085, avg=35624.63, stdev=33434.41 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 13], 40.00th=[ 21], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 109], | 99.00th=[ 142], 99.50th=[ 153], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 88, max= 408, per=25.96%, avg=209.52, stdev=80.58, samples=61 iops : min= 5, max= 25, avg=12.28, stdev= 5.08, samples=61 lat (usec) : 250=0.39%, 500=1.43%, 750=0.26%, 1000=0.13% lat (msec) : 2=1.04%, 4=3.91%, 10=8.98%, 20=10.81%, 50=43.23% lat (msec) : 100=24.48%, 250=5.34% cpu : usr=0.07%, sys=6.89%, ctx=1928, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183494: Thu May 28 11:25:22 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30966msec) clat (usec): min=208, max=200354, avg=44312.01, stdev=25406.46 lat (usec): min=209, max=200355, avg=44313.28, stdev=25406.44 clat percentiles (usec): | 1.00th=[ 233], 5.00th=[ 1614], 10.00th=[ 21103], 20.00th=[ 26870], | 30.00th=[ 31327], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 60556], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[143655], 99.50th=[162530], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 94, max= 349, per=26.54%, avg=203.58, stdev=70.19, samples=60 iops : min= 5, max= 21, avg=11.92, stdev= 4.39, samples=60 write: IOPS=12, BW=195KiB/s (199kB/s)(6032KiB/30966msec); 0 zone resets clat (usec): min=1620, max=175403, avg=35979.49, stdev=32328.64 lat (usec): min=1622, max=175405, avg=35981.78, stdev=32328.78 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2868], 10.00th=[ 4490], 20.00th=[ 6849], | 30.00th=[ 12256], 40.00th=[ 22152], 50.00th=[ 28967], 60.00th=[ 37487], | 70.00th=[ 44303], 80.00th=[ 55313], 90.00th=[ 79168], 95.00th=[105382], | 99.00th=[152044], 99.50th=[154141], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 415, per=23.88%, avg=192.72, stdev=75.91, samples=60 iops : min= 1, max= 25, avg=11.22, stdev= 4.74, samples=60 lat (usec) : 250=0.52%, 500=1.04%, 750=0.52% lat (msec) : 2=1.69%, 4=3.39%, 10=8.72%, 20=6.64%, 50=48.05% lat (msec) : 100=25.26%, 250=4.17% cpu : usr=0.07%, sys=6.82%, ctx=1939, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183495: Thu May 28 11:25:22 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29788msec) clat (usec): min=207, max=187060, avg=43262.17, stdev=28766.85 lat (usec): min=208, max=187062, avg=43263.37, stdev=28766.86 clat percentiles (usec): | 1.00th=[ 229], 5.00th=[ 343], 10.00th=[ 1663], 20.00th=[ 21890], | 30.00th=[ 28443], 40.00th=[ 33162], 50.00th=[ 38011], 60.00th=[ 46400], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[137364], 99.50th=[156238], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 345, per=26.23%, avg=201.16, stdev=59.44, samples=58 iops : min= 3, max= 21, avg=11.76, stdev= 3.73, samples=58 write: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29788msec); 0 zone resets clat (usec): min=1455, max=184990, avg=33753.70, stdev=31150.75 lat (usec): min=1456, max=184993, avg=33755.99, stdev=31150.67 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2769], 10.00th=[ 4228], 20.00th=[ 6849], | 30.00th=[ 9765], 40.00th=[ 17171], 50.00th=[ 24773], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 57410], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[129500], 99.50th=[168821], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 412, per=26.04%, avg=210.12, stdev=81.81, samples=58 iops : min= 1, max= 25, avg=12.33, stdev= 5.13, samples=58 lat (usec) : 250=1.43%, 500=2.08%, 750=0.91%, 1000=0.26% lat (msec) : 2=1.17%, 4=4.04%, 10=10.68%, 20=8.46%, 50=41.80% lat (msec) : 100=24.22%, 250=4.95% cpu : usr=0.06%, sys=7.11%, ctx=1852, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=767KiB/s (786kB/s), 184KiB/s-204KiB/s (188kB/s-209kB/s), io=23.4MiB (24.5MB), run=28957-31218msec WRITE: bw=807KiB/s (827kB/s), 195KiB/s-220KiB/s (199kB/s-225kB/s), io=24.6MiB (25.8MB), run=28957-31218msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183496: Thu May 28 11:25:34 2026 read: IOPS=8, BW=139KiB/s (143kB/s)(5920KiB/42532msec) clat (msec): min=8, max=242, avg=44.23, stdev=34.06 lat (msec): min=8, max=242, avg=44.24, stdev=34.06 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 126], | 99.00th=[ 161], 99.50th=[ 163], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 383, per=24.62%, avg=137.62, stdev=78.75, samples=82 iops : min= 1, max= 23, avg= 7.84, stdev= 5.00, samples=82 write: IOPS=9, BW=150KiB/s (153kB/s)(6368KiB/42532msec); 0 zone resets clat (msec): min=11, max=257, avg=65.19, stdev=39.48 lat (msec): min=11, max=257, avg=65.19, stdev=39.48 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 78], 80.00th=[ 96], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 197], 99.50th=[ 207], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 349, per=25.18%, avg=148.30, stdev=77.89, samples=83 iops : min= 1, max= 21, avg= 8.52, stdev= 4.93, samples=83 lat (msec) : 10=0.39%, 20=11.46%, 50=46.88%, 100=27.73%, 250=13.41% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.44%, ctx=1302, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183497: Thu May 28 11:25:34 2026 read: IOPS=8, BW=134KiB/s (138kB/s)(5744KiB/42774msec) clat (msec): min=9, max=225, avg=46.85, stdev=38.34 lat (msec): min=9, max=225, avg=46.85, stdev=38.34 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 109], 95.00th=[ 131], | 99.00th=[ 184], 99.50th=[ 197], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 381, per=24.45%, avg=136.67, stdev=80.94, samples=82 iops : min= 1, max= 23, avg= 7.78, stdev= 5.16, samples=82 write: IOPS=9, BW=153KiB/s (157kB/s)(6544KiB/42774msec); 0 zone resets clat (msec): min=12, max=212, avg=63.25, stdev=38.94 lat (msec): min=12, max=212, avg=63.26, stdev=38.94 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 144], | 99.00th=[ 197], 99.50th=[ 211], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 447, per=25.90%, avg=152.54, stdev=83.73, samples=84 iops : min= 1, max= 27, avg= 8.77, stdev= 5.30, samples=84 lat (msec) : 10=0.13%, 20=11.46%, 50=48.44%, 100=25.52%, 250=14.45% cpu : usr=0.05%, sys=2.45%, ctx=1313, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183498: Thu May 28 11:25:34 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(6256KiB/42542msec) clat (msec): min=7, max=207, avg=46.72, stdev=37.64 lat (msec): min=7, max=207, avg=46.72, stdev=37.64 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 97], 95.00th=[ 129], | 99.00th=[ 199], 99.50th=[ 203], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 442, per=26.02%, avg=145.46, stdev=92.00, samples=83 iops : min= 1, max= 27, avg= 8.34, stdev= 5.85, samples=83 write: IOPS=8, BW=142KiB/s (145kB/s)(6032KiB/42542msec); 0 zone resets clat (msec): min=14, max=261, avg=63.85, stdev=37.72 lat (msec): min=14, max=261, avg=63.85, stdev=37.72 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 74], 80.00th=[ 88], 90.00th=[ 112], 95.00th=[ 140], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 384, per=23.56%, avg=138.77, stdev=70.24, samples=83 iops : min= 1, max= 24, avg= 7.90, stdev= 4.48, samples=83 lat (msec) : 10=0.91%, 20=10.16%, 50=46.61%, 100=29.69%, 250=12.50% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.45%, ctx=1276, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183499: Thu May 28 11:25:34 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(6032KiB/42509msec) clat (msec): min=7, max=241, avg=44.16, stdev=33.90 lat (msec): min=7, max=241, avg=44.16, stdev=33.89 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 60], 90.00th=[ 87], 95.00th=[ 112], | 99.00th=[ 190], 99.50th=[ 209], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 384, per=25.72%, avg=143.77, stdev=84.01, samples=81 iops : min= 1, max= 24, avg= 8.22, stdev= 5.37, samples=81 write: IOPS=9, BW=147KiB/s (151kB/s)(6256KiB/42509msec); 0 zone resets clat (msec): min=14, max=257, avg=65.39, stdev=40.46 lat (msec): min=14, max=257, avg=65.41, stdev=40.46 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 215], 99.50th=[ 241], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 349, per=24.64%, avg=145.14, stdev=70.03, samples=83 iops : min= 1, max= 21, avg= 8.31, stdev= 4.43, samples=83 lat (msec) : 10=0.78%, 20=9.64%, 50=51.30%, 100=25.91%, 250=12.24% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.37%, ctx=1236, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=560KiB/s (573kB/s), 134KiB/s-147KiB/s (138kB/s-151kB/s), io=23.4MiB (24.5MB), run=42509-42774msec WRITE: bw=589KiB/s (603kB/s), 142KiB/s-153KiB/s (145kB/s-157kB/s), io=24.6MiB (25.8MB), run=42509-42774msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183511: Thu May 28 11:25:52 2026 read: IOPS=1, BW=1195KiB/s (1224kB/s)(7168KiB/5998msec) clat (msec): min=130, max=2932, avg=632.19, stdev=1022.00 lat (msec): min=130, max=2932, avg=632.19, stdev=1022.00 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 132], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 215], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 472], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1954, max= 4087, per=94.49%, avg=2742.00, stdev=992.02, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=854KiB/s (874kB/s)(5120KiB/5998msec); 0 zone resets clat (msec): min=160, max=475, avg=297.62, stdev=135.71 lat (msec): min=160, max=475, avg=297.71, stdev=135.71 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1954, max= 3690, per=59.72%, avg=2426.50, stdev=843.17, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.26%, ctx=692, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183512: Thu May 28 11:25:52 2026 read: IOPS=0, BW=318KiB/s (326kB/s)(2048KiB/6432msec) clat (usec): min=1041, max=136106, avg=68574.01, stdev=95504.95 lat (usec): min=1043, max=136108, avg=68576.02, stdev=95505.90 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[135267], | 70.00th=[135267], 80.00th=[135267], 90.00th=[135267], 95.00th=[135267], | 99.00th=[135267], 99.50th=[135267], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 1440, max= 1954, per=58.48%, avg=1697.00, stdev=363.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1592KiB/s (1630kB/s)(10.0MiB/6432msec); 0 zone resets clat (msec): min=53, max=3405, avg=625.65, stdev=994.35 lat (msec): min=53, max=3405, avg=626.57, stdev=993.97 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 150], | 30.00th=[ 171], 40.00th=[ 184], 50.00th=[ 239], 60.00th=[ 430], | 70.00th=[ 477], 80.00th=[ 550], 90.00th=[ 600], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1954, max= 4071, per=89.54%, avg=3638.00, stdev=941.48, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.52%, ctx=133, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183513: Thu May 28 11:25:52 2026 read: IOPS=0, BW=871KiB/s (892kB/s)(6144KiB/7056msec) clat (msec): min=2, max=710, avg=220.45, stdev=262.13 lat (msec): min=2, max=710, avg=220.45, stdev=262.13 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 167], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2015, max= 4055, per=100.00%, avg=3253.33, stdev=1087.85, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=871KiB/s (892kB/s)(6144KiB/7056msec); 0 zone resets clat (msec): min=224, max=3541, avg=939.74, stdev=1282.71 lat (msec): min=224, max=3541, avg=940.20, stdev=1282.51 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 456], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1430, max= 2035, per=45.68%, avg=1855.80, stdev=249.26, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 4=8.33%, 10=8.33%, 250=25.00%, 500=33.33%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=7.46%, ctx=255, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183514: Thu May 28 11:25:52 2026 read: IOPS=0, BW=920KiB/s (942kB/s)(5120KiB/5567msec) clat (usec): min=1033, max=246159, avg=132327.43, stdev=120587.34 lat (usec): min=1035, max=246160, avg=132328.77, stdev=120587.17 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1037], 10.00th=[ 1037], 20.00th=[ 1037], | 30.00th=[ 1893], 40.00th=[ 1893], 50.00th=[202376], 60.00th=[202376], | 70.00th=[208667], 80.00th=[208667], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 2035, max= 5535, per=100.00%, avg=3785.00, stdev=2474.87, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1288KiB/s (1318kB/s)(7168KiB/5567msec); 0 zone resets clat (msec): min=163, max=2980, avg=691.20, stdev=1017.39 lat (msec): min=163, max=2980, avg=691.66, stdev=1017.20 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 165], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 376], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 481], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1486, max= 4087, per=70.86%, avg=2879.00, stdev=1312.87, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 2=16.67%, 250=50.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=9.90%, ctx=146, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2902KiB/s (2972kB/s), 318KiB/s-1195KiB/s (326kB/s-1224kB/s), io=20.0MiB (20.0MB), run=5567-7056msec WRITE: bw=4063KiB/s (4161kB/s), 854KiB/s-1592KiB/s (874kB/s-1630kB/s), io=28.0MiB (29.4MB), run=5567-7056msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183516: Thu May 28 11:25:52 2026 read: IOPS=0, BW=970KiB/s (993kB/s)(7168KiB/7391msec) clat (msec): min=96, max=3424, avg=832.00, stdev=1185.39 lat (msec): min=96, max=3424, avg=832.00, stdev=1185.39 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 124], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 447], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 885], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1542, max= 2043, per=69.82%, avg=1934.00, stdev=219.49, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=693KiB/s (709kB/s)(5120KiB/7391msec); 0 zone resets clat (msec): min=44, max=663, avg=263.38, stdev=246.85 lat (msec): min=44, max=663, avg=263.49, stdev=246.85 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2043, max= 6059, per=100.00%, avg=4051.00, stdev=2839.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=16.67% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=3.41%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183517: Thu May 28 11:25:52 2026 read: IOPS=0, BW=293KiB/s (300kB/s)(2048KiB/6989msec) clat (msec): min=328, max=471, avg=399.94, stdev=100.85 lat (msec): min=328, max=471, avg=399.94, stdev=100.85 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1508, max= 2048, per=64.19%, avg=1778.00, stdev=381.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1465KiB/s (1500kB/s)(10.0MiB/6989msec); 0 zone resets clat (msec): min=141, max=3509, avg=601.70, stdev=1025.80 lat (msec): min=141, max=3509, avg=601.93, stdev=1025.76 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 186], | 30.00th=[ 215], 40.00th=[ 218], 50.00th=[ 275], 60.00th=[ 300], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 409], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 2043, max= 4087, per=84.16%, avg=3264.60, stdev=1115.18, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=33.33%, 500=58.33%, >=2000=8.33% cpu : usr=0.03%, sys=4.48%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183518: Thu May 28 11:25:52 2026 read: IOPS=0, BW=867KiB/s (888kB/s)(6144KiB/7084msec) clat (msec): min=70, max=402, avg=179.56, stdev=123.30 lat (msec): min=70, max=402, avg=179.56, stdev=123.30 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 148], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2043, max= 4071, per=98.22%, avg=2720.67, stdev=1169.43, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=867KiB/s (888kB/s)(6144KiB/7084msec); 0 zone resets clat (msec): min=201, max=4486, avg=959.17, stdev=1728.36 lat (msec): min=201, max=4486, avg=959.28, stdev=1728.39 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1526, max= 2048, per=49.99%, avg=1939.00, stdev=230.92, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.70%, ctx=104, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183519: Thu May 28 11:25:52 2026 read: IOPS=0, BW=712KiB/s (729kB/s)(5120KiB/7192msec) clat (msec): min=64, max=176, avg=103.50, stdev=43.72 lat (msec): min=64, max=176, avg=103.51, stdev=43.72 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 90], 60.00th=[ 90], | 70.00th=[ 109], 80.00th=[ 109], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 4071, max= 4071, per=100.00%, avg=4071.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 write: IOPS=0, BW=997KiB/s (1021kB/s)(7168KiB/7192msec); 0 zone resets clat (msec): min=84, max=4426, avg=917.21, stdev=1582.58 lat (msec): min=84, max=4426, avg=917.35, stdev=1582.65 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 236], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 1003], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 2035, max= 2043, per=52.62%, avg=2041.00, stdev= 4.00, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=50.00%, 250=25.00%, 500=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.18%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2771KiB/s (2837kB/s), 293KiB/s-970KiB/s (300kB/s-993kB/s), io=20.0MiB (20.0MB), run=6989-7391msec WRITE: bw=3879KiB/s (3972kB/s), 693KiB/s-1465KiB/s (709kB/s-1500kB/s), io=28.0MiB (29.4MB), run=6989-7391msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183527: Thu May 28 11:26:07 2026 read: IOPS=1, BW=4237KiB/s (4339kB/s)(12.0MiB/2900msec) clat (msec): min=861, max=1016, avg=946.46, stdev=78.68 lat (msec): min=861, max=1016, avg=946.46, stdev=78.68 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8078, max= 8110, per=100.00%, avg=8094.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.04%, ctx=227, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183528: Thu May 28 11:26:07 2026 read: IOPS=0, BW=1396KiB/s (1429kB/s)(4096KiB/2935msec) clat (nsec): min=1128.6M, max=1128.6M, avg=1128639727.00, stdev= 0.00 lat (nsec): min=1128.6M, max=1128.6M, avg=1128642269.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2791KiB/s (2858kB/s)(8192KiB/2935msec); 0 zone resets clat (msec): min=810, max=878, avg=844.44, stdev=48.63 lat (msec): min=813, max=879, avg=846.33, stdev=46.63 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8062, max= 8062, per=78.29%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=6.71%, ctx=99, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183529: Thu May 28 11:26:07 2026 write: IOPS=2, BW=9069KiB/s (9286kB/s)(12.0MiB/1355msec); 0 zone resets clat (msec): min=200, max=852, avg=438.57, stdev=360.15 lat (msec): min=200, max=855, avg=439.99, stdev=361.40 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min=11130, max=11130, per=100.00%, avg=11130.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.15%, sys=10.34%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183531: Thu May 28 11:26:07 2026 write: IOPS=0, BW=3862KiB/s (3954kB/s)(12.0MiB/3182msec); 0 zone resets clat (msec): min=490, max=1988, avg=1004.04, stdev=853.21 lat (msec): min=492, max=1992, avg=1006.84, stdev=853.74 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 7937, max= 8110, per=77.92%, avg=8023.50, stdev=122.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.18%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5582KiB/s (5716kB/s), 1396KiB/s-4237KiB/s (1429kB/s-4339kB/s), io=16.0MiB (16.8MB), run=2900-2935msec WRITE: bw=10.1MiB/s (10.5MB/s), 2791KiB/s-9069KiB/s (2858kB/s-9286kB/s), io=32.0MiB (33.6MB), run=1355-3182msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183530: Thu May 28 11:26:08 2026 read: IOPS=0, BW=3884KiB/s (3977kB/s)(12.0MiB/3164msec) clat (msec): min=775, max=1257, avg=1033.77, stdev=243.13 lat (msec): min=775, max=1257, avg=1033.77, stdev=243.13 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7713, max= 8159, per=100.00%, avg=7936.00, stdev=315.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.19%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183532: Thu May 28 11:26:08 2026 read: IOPS=0, BW=1284KiB/s (1315kB/s)(4096KiB/3190msec) clat (nsec): min=1549.3M, max=1549.3M, avg=1549317152.00, stdev= 0.00 lat (nsec): min=1549.3M, max=1549.3M, avg=1549320534.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1552], 5.00th=[ 1552], 10.00th=[ 1552], 20.00th=[ 1552], | 30.00th=[ 1552], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2568KiB/s (2630kB/s)(8192KiB/3190msec); 0 zone resets clat (msec): min=766, max=776, avg=771.62, stdev= 7.42 lat (msec): min=766, max=777, avg=771.97, stdev= 7.43 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.17%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183533: Thu May 28 11:26:08 2026 write: IOPS=0, BW=2992KiB/s (3064kB/s)(12.0MiB/4107msec); 0 zone resets clat (msec): min=208, max=3476, avg=1320.34, stdev=1867.39 lat (msec): min=208, max=3476, avg=1320.90, stdev=1867.42 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 7937, max= 7937, per=99.49%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=2.65%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183534: Thu May 28 11:26:08 2026 write: IOPS=1, BW=4536KiB/s (4645kB/s)(12.0MiB/2709msec); 0 zone resets clat (msec): min=244, max=2017, avg=882.61, stdev=985.05 lat (msec): min=246, max=2017, avg=883.41, stdev=984.53 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 6068, max= 8175, per=89.26%, avg=7121.50, stdev=1489.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.32%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5136KiB/s (5259kB/s), 1284KiB/s-3884KiB/s (1315kB/s-3977kB/s), io=16.0MiB (16.8MB), run=3164-3190msec WRITE: bw=7979KiB/s (8170kB/s), 2568KiB/s-4536KiB/s (2630kB/s-4645kB/s), io=32.0MiB (33.6MB), run=2709-4107msec