== sanity test 398b: DIO and buffer IO race ============== 16:50:28 (1781211028) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.98201 s, 16.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154159: Thu Jun 11 16:52:26 2026 read: IOPS=13, BW=55.6KiB/s (56.0kB/s)(5992KiB/107731msec) clat (usec): min=33, max=611618, avg=18238.42, stdev=19311.28 lat (usec): min=33, max=611620, avg=18239.31, stdev=19311.28 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 113], 10.00th=[ 7635], 20.00th=[ 10028], | 30.00th=[ 11731], 40.00th=[ 13435], 50.00th=[ 15401], 60.00th=[ 18482], | 70.00th=[ 21627], 80.00th=[ 25297], 90.00th=[ 31065], 95.00th=[ 36963], | 99.00th=[ 63177], 99.50th=[ 74974], 99.90th=[145753], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 16, max= 175, per=48.76%, avg=108.24, stdev=29.58, samples=109 iops : min= 4, max= 43, avg=26.57, stdev= 7.38, samples=109 write: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6296KiB/107731msec); 0 zone resets clat (usec): min=780, max=52907k, avg=51044.24, stdev=1333243.68 lat (usec): min=781, max=52907k, avg=51045.75, stdev=1333243.68 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2024], 10.00th=[ 2606], | 20.00th=[ 3556], 30.00th=[ 5735], 40.00th=[ 10159], | 50.00th=[ 13960], 60.00th=[ 17695], 70.00th=[ 21365], | 80.00th=[ 26870], 90.00th=[ 37487], 95.00th=[ 46924], | 99.00th=[ 80217], 99.50th=[ 106431], 99.90th=[ 278922], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 5, max= 199, per=48.88%, avg=113.90, stdev=31.31, samples=109 iops : min= 1, max= 49, avg=27.99, stdev= 7.81, samples=109 lat (usec) : 50=0.36%, 100=1.46%, 250=1.53%, 500=0.03%, 1000=0.20% lat (msec) : 2=2.12%, 4=9.80%, 10=14.55%, 20=36.07%, 50=31.05% lat (msec) : 100=2.51%, 250=0.23%, 500=0.03%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=9.56%, ctx=8197, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154160: Thu Jun 11 16:52:26 2026 read: IOPS=13, BW=55.1KiB/s (56.4kB/s)(5940KiB/107896msec) clat (usec): min=36, max=588718, avg=18413.56, stdev=19166.74 lat (usec): min=37, max=588719, avg=18414.39, stdev=19166.72 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 111], 10.00th=[ 7635], 20.00th=[ 10028], | 30.00th=[ 11994], 40.00th=[ 13698], 50.00th=[ 15664], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25560], 90.00th=[ 31327], 95.00th=[ 35914], | 99.00th=[ 56886], 99.50th=[ 82314], 99.90th=[154141], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 5, max= 200, per=48.20%, avg=107.01, stdev=30.45, samples=109 iops : min= 1, max= 50, avg=26.27, stdev= 7.65, samples=109 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6348KiB/107896msec); 0 zone resets clat (usec): min=835, max=52918k, avg=50711.34, stdev=1328007.88 lat (usec): min=836, max=52918k, avg=50712.79, stdev=1328007.88 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1942], 10.00th=[ 2507], | 20.00th=[ 3654], 30.00th=[ 5997], 40.00th=[ 10290], | 50.00th=[ 14484], 60.00th=[ 18220], 70.00th=[ 22414], | 80.00th=[ 27395], 90.00th=[ 36963], 95.00th=[ 45351], | 99.00th=[ 72877], 99.50th=[ 87557], 99.90th=[ 133694], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 10, max= 199, per=48.81%, avg=113.73, stdev=33.26, samples=109 iops : min= 2, max= 49, avg=27.94, stdev= 8.34, samples=109 lat (usec) : 50=0.46%, 100=1.63%, 250=1.27%, 500=0.10%, 1000=0.03% lat (msec) : 2=2.80%, 4=9.08%, 10=14.75%, 20=34.73%, 50=32.39% lat (msec) : 100=2.51%, 250=0.20%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=9.61%, ctx=8274, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154161: Thu Jun 11 16:52:26 2026 read: IOPS=14, BW=56.1KiB/s (57.4kB/s)(6028KiB/107466msec) clat (usec): min=31, max=52899k, avg=52821.89, stdev=1362279.35 lat (usec): min=32, max=52899k, avg=52823.85, stdev=1362279.33 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 95], 10.00th=[ 6783], | 20.00th=[ 9765], 30.00th=[ 11731], 40.00th=[ 13566], | 50.00th=[ 15795], 60.00th=[ 18482], 70.00th=[ 21365], | 80.00th=[ 25035], 90.00th=[ 30278], 95.00th=[ 35390], | 99.00th=[ 57410], 99.50th=[ 78119], 99.90th=[ 158335], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 5, max= 191, per=49.55%, avg=110.00, stdev=31.37, samples=108 iops : min= 1, max= 47, avg=27.02, stdev= 7.80, samples=108 write: IOPS=14, BW=58.3KiB/s (59.6kB/s)(6260KiB/107466msec); 0 zone resets clat (usec): min=712, max=601912, avg=17766.79, stdev=21608.33 lat (usec): min=713, max=601914, avg=17767.98, stdev=21608.30 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1827], 10.00th=[ 2409], 20.00th=[ 3458], | 30.00th=[ 5735], 40.00th=[ 10290], 50.00th=[ 13960], 60.00th=[ 17957], | 70.00th=[ 22938], 80.00th=[ 28181], 90.00th=[ 37487], 95.00th=[ 46400], | 99.00th=[ 66323], 99.50th=[ 88605], 99.90th=[198181], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 16, max= 192, per=48.97%, avg=114.10, stdev=35.03, samples=108 iops : min= 4, max= 48, avg=28.05, stdev= 8.82, samples=108 lat (usec) : 50=0.23%, 100=2.47%, 250=1.33%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.06%, 4=9.11%, 10=14.10%, 20=34.44%, 50=32.10% lat (msec) : 100=2.67%, 250=0.20%, 750=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=9.51%, ctx=8091, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154162: Thu Jun 11 16:52:26 2026 read: IOPS=14, BW=56.2KiB/s (57.6kB/s)(6052KiB/107677msec) clat (usec): min=26, max=52998k, avg=52647.35, stdev=1362107.28 lat (usec): min=27, max=52998k, avg=52648.27, stdev=1362107.28 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 103], 10.00th=[ 6980], | 20.00th=[ 9634], 30.00th=[ 11207], 40.00th=[ 12911], | 50.00th=[ 15139], 60.00th=[ 17957], 70.00th=[ 21103], | 80.00th=[ 25035], 90.00th=[ 31065], 95.00th=[ 36963], | 99.00th=[ 62653], 99.50th=[ 79168], 99.90th=[ 145753], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 39, max= 208, per=49.90%, avg=110.77, stdev=29.99, samples=108 iops : min= 9, max= 52, avg=27.20, stdev= 7.55, samples=108 write: IOPS=14, BW=57.9KiB/s (59.3kB/s)(6236KiB/107677msec); 0 zone resets clat (usec): min=948, max=604534, avg=17931.43, stdev=21696.13 lat (usec): min=949, max=604536, avg=17933.73, stdev=21696.72 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1909], 10.00th=[ 2540], 20.00th=[ 3621], | 30.00th=[ 5669], 40.00th=[ 10683], 50.00th=[ 14484], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 28443], 90.00th=[ 36963], 95.00th=[ 45876], | 99.00th=[ 68682], 99.50th=[ 92799], 99.90th=[181404], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 16, max= 191, per=48.45%, avg=112.89, stdev=33.14, samples=109 iops : min= 4, max= 47, avg=27.74, stdev= 8.28, samples=109 lat (usec) : 50=0.29%, 100=2.02%, 250=1.50%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=2.86%, 4=8.59%, 10=14.75%, 20=34.60%, 50=32.49% lat (msec) : 100=2.31%, 250=0.23%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=9.48%, ctx=8159, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=223KiB/s (228kB/s), 55.1KiB/s-56.2KiB/s (56.4kB/s-57.6kB/s), io=23.4MiB (24.6MB), run=107466-107896msec WRITE: bw=233KiB/s (239kB/s), 57.9KiB/s-58.8KiB/s (59.3kB/s-60.2kB/s), io=24.6MiB (25.7MB), run=107466-107896msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154154: Thu Jun 11 16:53:12 2026 read: IOPS=9, BW=38.8KiB/s (39.7kB/s)(5992KiB/154606msec) clat (msec): min=3, max=701, avg=14.72, stdev=21.29 lat (msec): min=3, max=701, avg=14.73, stdev=21.29 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 14], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 41], | 99.00th=[ 59], 99.50th=[ 69], 99.90th=[ 78], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 168, per=38.11%, avg=59.07, stdev=34.13, samples=201 iops : min= 1, max= 42, avg=14.37, stdev= 8.60, samples=201 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6296KiB/154606msec); 0 zone resets clat (msec): min=19, max=53016, avg=84.06, stdev=1335.25 lat (msec): min=19, max=53017, avg=84.07, stdev=1335.25 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 50], | 70.00th=[ 56], 80.00th=[ 65], 90.00th=[ 79], 95.00th=[ 92], | 99.00th=[ 133], 99.50th=[ 161], 99.90th=[ 224], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 16, max= 119, per=38.07%, avg=61.68, stdev=24.01, samples=202 iops : min= 4, max= 29, avg=15.02, stdev= 6.05, samples=202 lat (msec) : 4=0.03%, 10=26.60%, 20=12.24%, 50=40.04%, 100=19.27% lat (msec) : 250=1.76%, 750=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.27%, ctx=5568, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154155: Thu Jun 11 16:53:12 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(5940KiB/154725msec) clat (msec): min=3, max=637, avg=14.91, stdev=20.75 lat (msec): min=3, max=637, avg=14.91, stdev=20.75 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 42], | 99.00th=[ 65], 99.50th=[ 74], 99.90th=[ 125], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 144, per=37.90%, avg=58.74, stdev=32.48, samples=200 iops : min= 1, max= 36, avg=14.29, stdev= 8.19, samples=200 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6348KiB/154725msec); 0 zone resets clat (msec): min=19, max=52942, avg=83.40, stdev=1327.93 lat (msec): min=19, max=52942, avg=83.40, stdev=1327.93 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 50], | 70.00th=[ 56], 80.00th=[ 65], 90.00th=[ 81], 95.00th=[ 93], | 99.00th=[ 133], 99.50th=[ 161], 99.90th=[ 305], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 16, max= 120, per=38.32%, avg=62.07, stdev=24.95, samples=202 iops : min= 4, max= 30, avg=15.12, stdev= 6.28, samples=202 lat (msec) : 4=0.07%, 10=26.27%, 20=12.30%, 50=40.30%, 100=19.04% lat (msec) : 250=1.89%, 500=0.07%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.21%, ctx=5650, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154156: Thu Jun 11 16:53:12 2026 read: IOPS=9, BW=39.1KiB/s (40.1kB/s)(6028KiB/154101msec) clat (msec): min=3, max=149, avg=14.97, stdev=13.97 lat (msec): min=3, max=149, avg=14.97, stdev=13.97 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 33], 95.00th=[ 43], | 99.00th=[ 68], 99.50th=[ 84], 99.90th=[ 132], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 7, max= 165, per=38.29%, avg=59.35, stdev=32.41, samples=201 iops : min= 1, max= 41, avg=14.44, stdev= 8.14, samples=201 write: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6260KiB/154101msec); 0 zone resets clat (msec): min=16, max=53002, avg=83.91, stdev=1338.81 lat (msec): min=16, max=53002, avg=83.91, stdev=1338.81 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 51], | 70.00th=[ 56], 80.00th=[ 64], 90.00th=[ 78], 95.00th=[ 90], | 99.00th=[ 123], 99.50th=[ 169], 99.90th=[ 684], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 15, max= 112, per=38.04%, avg=61.63, stdev=25.07, samples=201 iops : min= 3, max= 28, avg=15.00, stdev= 6.32, samples=201 lat (msec) : 4=0.10%, 10=25.65%, 20=13.18%, 50=39.32%, 100=20.12% lat (msec) : 250=1.50%, 500=0.07%, 750=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.26%, ctx=5604, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154157: Thu Jun 11 16:53:12 2026 read: IOPS=9, BW=39.1KiB/s (40.1kB/s)(6052KiB/154621msec) clat (msec): min=3, max=150, avg=14.89, stdev=14.21 lat (msec): min=3, max=150, avg=14.89, stdev=14.21 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 68], 99.50th=[ 99], 99.90th=[ 118], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 7, max= 184, per=38.48%, avg=59.64, stdev=32.52, samples=201 iops : min= 1, max= 46, avg=14.51, stdev= 8.19, samples=201 write: IOPS=10, BW=40.3KiB/s (41.3kB/s)(6236KiB/154621msec); 0 zone resets clat (msec): min=18, max=52992, avg=84.58, stdev=1341.12 lat (msec): min=18, max=52992, avg=84.58, stdev=1341.12 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 51], | 70.00th=[ 57], 80.00th=[ 65], 90.00th=[ 79], 95.00th=[ 94], | 99.00th=[ 128], 99.50th=[ 142], 99.90th=[ 684], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 8, max= 112, per=37.71%, avg=61.08, stdev=23.87, samples=202 iops : min= 2, max= 28, avg=14.87, stdev= 6.02, samples=202 lat (msec) : 4=0.13%, 10=25.85%, 20=13.51%, 50=38.38%, 100=19.99% lat (msec) : 250=2.08%, 750=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.22%, ctx=5542, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 38.4KiB/s-39.1KiB/s (39.3kB/s-40.1kB/s), io=23.4MiB (24.6MB), run=154101-154725msec WRITE: bw=162KiB/s (166kB/s), 40.3KiB/s-41.0KiB/s (41.3kB/s-42.0kB/s), io=24.6MiB (25.7MB), run=154101-154725msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154203: Thu Jun 11 16:53:34 2026 read: IOPS=24, BW=398KiB/s (407kB/s)(5920KiB/14886msec) clat (usec): min=37, max=110787, avg=20519.72, stdev=15298.34 lat (usec): min=37, max=110788, avg=20520.67, stdev=15298.31 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 93], 20.00th=[ 9896], | 30.00th=[ 13173], 40.00th=[ 15926], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 25822], 80.00th=[ 31851], 90.00th=[ 39584], 95.00th=[ 45351], | 99.00th=[ 71828], 99.50th=[ 77071], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 192, max= 638, per=26.04%, avg=394.03, stdev=113.61, samples=29 iops : min= 12, max= 39, avg=24.10, stdev= 7.06, samples=29 write: IOPS=26, BW=428KiB/s (438kB/s)(6368KiB/14886msec); 0 zone resets clat (usec): min=1383, max=298493, avg=18134.30, stdev=22799.46 lat (usec): min=1385, max=298494, avg=18136.34, stdev=22799.80 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2008], 10.00th=[ 2802], 20.00th=[ 4080], | 30.00th=[ 5407], 40.00th=[ 7373], 50.00th=[ 11207], 60.00th=[ 14222], | 70.00th=[ 20579], 80.00th=[ 28967], 90.00th=[ 43254], 95.00th=[ 53216], | 99.00th=[ 89654], 99.50th=[114820], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 127, max= 702, per=26.84%, avg=427.34, stdev=115.22, samples=29 iops : min= 7, max= 43, avg=26.21, stdev= 7.15, samples=29 lat (usec) : 50=0.39%, 100=4.95%, 250=2.60%, 500=0.52% lat (msec) : 2=2.47%, 4=7.55%, 10=16.02%, 20=26.95%, 50=33.72% lat (msec) : 100=4.30%, 250=0.39%, 500=0.13% cpu : usr=0.09%, sys=16.53%, ctx=1820, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154204: Thu Jun 11 16:53:34 2026 read: IOPS=22, BW=363KiB/s (372kB/s)(5744KiB/15824msec) clat (usec): min=40, max=346468, avg=23133.65, stdev=25832.64 lat (usec): min=40, max=346469, avg=23134.59, stdev=25832.61 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 105], 20.00th=[ 11600], | 30.00th=[ 14353], 40.00th=[ 16712], 50.00th=[ 20055], 60.00th=[ 22938], | 70.00th=[ 26870], 80.00th=[ 31589], 90.00th=[ 40633], 95.00th=[ 48497], | 99.00th=[114820], 99.50th=[221250], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 52, max= 640, per=23.94%, avg=362.19, stdev=135.57, samples=31 iops : min= 3, max= 40, avg=22.13, stdev= 8.49, samples=31 write: IOPS=25, BW=414KiB/s (423kB/s)(6544KiB/15824msec); 0 zone resets clat (usec): min=1521, max=113895, avg=18284.23, stdev=18211.43 lat (usec): min=1523, max=113896, avg=18286.27, stdev=18211.61 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2311], 10.00th=[ 3032], 20.00th=[ 4113], | 30.00th=[ 5800], 40.00th=[ 7767], 50.00th=[ 11731], 60.00th=[ 15664], | 70.00th=[ 22938], 80.00th=[ 30540], 90.00th=[ 43779], 95.00th=[ 55313], | 99.00th=[ 77071], 99.50th=[ 84411], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 96, max= 672, per=25.92%, avg=412.61, stdev=155.42, samples=31 iops : min= 6, max= 42, avg=25.26, stdev= 9.79, samples=31 lat (usec) : 50=0.52%, 100=3.91%, 250=1.82%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.43%, 4=8.72%, 10=14.71%, 20=27.60%, 50=34.90% lat (msec) : 100=5.08%, 250=0.65%, 500=0.13% cpu : usr=0.08%, sys=16.34%, ctx=1942, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154205: Thu Jun 11 16:53:34 2026 read: IOPS=24, BW=397KiB/s (407kB/s)(6256KiB/15757msec) clat (usec): min=39, max=141538, avg=21686.82, stdev=18381.43 lat (usec): min=39, max=141539, avg=21687.77, stdev=18381.45 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 76], 20.00th=[ 8356], | 30.00th=[ 13566], 40.00th=[ 16188], 50.00th=[ 19530], 60.00th=[ 23200], | 70.00th=[ 27395], 80.00th=[ 32637], 90.00th=[ 42206], 95.00th=[ 51119], | 99.00th=[ 88605], 99.50th=[128451], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 95, max= 672, per=26.35%, avg=398.71, stdev=122.02, samples=31 iops : min= 5, max= 42, avg=24.39, stdev= 7.75, samples=31 write: IOPS=23, BW=383KiB/s (392kB/s)(6032KiB/15757msec); 0 zone resets clat (usec): min=1533, max=182347, avg=18979.31, stdev=20191.36 lat (usec): min=1534, max=182348, avg=18981.32, stdev=20191.17 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2474], 10.00th=[ 3490], 20.00th=[ 4555], | 30.00th=[ 6128], 40.00th=[ 8717], 50.00th=[ 12649], 60.00th=[ 16909], | 70.00th=[ 22414], 80.00th=[ 29230], 90.00th=[ 42206], 95.00th=[ 55837], | 99.00th=[ 94897], 99.50th=[117965], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 158, max= 736, per=23.81%, avg=379.00, stdev=141.71, samples=31 iops : min= 9, max= 46, avg=23.16, stdev= 9.02, samples=31 lat (usec) : 50=0.39%, 100=7.03%, 250=2.08%, 750=0.26% lat (msec) : 2=1.43%, 4=6.51%, 10=14.97%, 20=26.56%, 50=34.38% lat (msec) : 100=5.60%, 250=0.78% cpu : usr=0.07%, sys=16.10%, ctx=1976, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154206: Thu Jun 11 16:53:34 2026 read: IOPS=25, BW=412KiB/s (422kB/s)(6032KiB/14635msec) clat (usec): min=39, max=170134, avg=20425.06, stdev=18316.51 lat (usec): min=39, max=170135, avg=20426.01, stdev=18316.50 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 90], 20.00th=[ 7898], | 30.00th=[ 13435], 40.00th=[ 16188], 50.00th=[ 18482], 60.00th=[ 20841], | 70.00th=[ 24249], 80.00th=[ 29492], 90.00th=[ 39060], 95.00th=[ 46400], | 99.00th=[111674], 99.50th=[112722], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 95, max= 704, per=27.66%, avg=418.57, stdev=140.15, samples=28 iops : min= 5, max= 44, avg=25.64, stdev= 8.85, samples=28 write: IOPS=26, BW=427KiB/s (438kB/s)(6256KiB/14635msec); 0 zone resets clat (usec): min=1455, max=170969, avg=17549.76, stdev=18678.86 lat (usec): min=1456, max=170970, avg=17552.27, stdev=18679.29 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2507], 10.00th=[ 3195], 20.00th=[ 4080], | 30.00th=[ 5342], 40.00th=[ 7111], 50.00th=[ 10290], 60.00th=[ 14877], | 70.00th=[ 20841], 80.00th=[ 30278], 90.00th=[ 42206], 95.00th=[ 50070], | 99.00th=[ 86508], 99.50th=[112722], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 224, max= 672, per=27.18%, avg=432.68, stdev=116.84, samples=28 iops : min= 14, max= 42, avg=26.54, stdev= 7.39, samples=28 lat (usec) : 50=0.26%, 100=6.12%, 250=2.73%, 500=0.13%, 750=0.13% lat (msec) : 2=0.91%, 4=9.24%, 10=16.80%, 20=26.17%, 50=32.55% lat (msec) : 100=4.17%, 250=0.78% cpu : usr=0.12%, sys=16.50%, ctx=1835, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1514KiB/s (1550kB/s), 363KiB/s-412KiB/s (372kB/s-422kB/s), io=23.4MiB (24.5MB), run=14635-15824msec WRITE: bw=1593KiB/s (1631kB/s), 383KiB/s-428KiB/s (392kB/s-438kB/s), io=24.6MiB (25.8MB), run=14635-15824msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154198: Thu Jun 11 16:53:50 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5920KiB/31883msec) clat (msec): min=4, max=110, avg=19.40, stdev=17.69 lat (msec): min=4, max=110, avg=19.40, stdev=17.69 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 45], 95.00th=[ 60], | 99.00th=[ 99], 99.50th=[ 104], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 31, max= 447, per=24.96%, avg=186.92, stdev=95.73, samples=62 iops : min= 1, max= 27, avg=11.08, stdev= 6.10, samples=62 write: IOPS=12, BW=200KiB/s (205kB/s)(6368KiB/31883msec); 0 zone resets clat (msec): min=23, max=339, avg=62.00, stdev=32.20 lat (msec): min=23, max=339, avg=62.00, stdev=32.20 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 41], | 30.00th=[ 45], 40.00th=[ 50], 50.00th=[ 54], 60.00th=[ 59], | 70.00th=[ 67], 80.00th=[ 77], 90.00th=[ 100], 95.00th=[ 125], | 99.00th=[ 178], 99.50th=[ 220], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 351, per=25.23%, avg=198.83, stdev=83.95, samples=63 iops : min= 1, max= 21, avg=11.83, stdev= 5.31, samples=63 lat (msec) : 10=15.10%, 20=20.18%, 50=31.77%, 100=27.60%, 250=5.21% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=4.02%, ctx=1506, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154199: Thu Jun 11 16:53:50 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5744KiB/31962msec) clat (usec): min=4322, max=94977, avg=18078.71, stdev=16539.40 lat (usec): min=4323, max=94978, avg=18079.67, stdev=16539.36 clat percentiles (usec): | 1.00th=[ 5145], 5.00th=[ 6259], 10.00th=[ 6980], 20.00th=[ 8094], | 30.00th=[ 9110], 40.00th=[10159], 50.00th=[11469], 60.00th=[13435], | 70.00th=[17433], 80.00th=[23725], 90.00th=[37487], 95.00th=[61604], | 99.00th=[83362], 99.50th=[92799], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 31, max= 510, per=23.74%, avg=177.79, stdev=108.15, samples=63 iops : min= 1, max= 31, avg=10.51, stdev= 6.78, samples=63 write: IOPS=12, BW=205KiB/s (210kB/s)(6544KiB/31962msec); 0 zone resets clat (msec): min=20, max=257, avg=62.11, stdev=33.36 lat (msec): min=20, max=257, avg=62.11, stdev=33.36 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 54], 60.00th=[ 59], | 70.00th=[ 68], 80.00th=[ 79], 90.00th=[ 101], 95.00th=[ 133], | 99.00th=[ 201], 99.50th=[ 205], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 63, max= 352, per=25.66%, avg=202.21, stdev=84.28, samples=63 iops : min= 3, max= 22, avg=12.03, stdev= 5.37, samples=63 lat (msec) : 10=17.97%, 20=17.19%, 50=31.38%, 100=28.13%, 250=5.21% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=4.09%, ctx=1538, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154200: Thu Jun 11 16:53:50 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31394msec) clat (msec): min=5, max=198, avg=19.38, stdev=20.22 lat (msec): min=5, max=198, avg=19.39, stdev=20.22 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 41], 95.00th=[ 60], | 99.00th=[ 107], 99.50th=[ 113], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 512, per=27.14%, avg=203.30, stdev=120.39, samples=61 iops : min= 1, max= 32, avg=12.08, stdev= 7.57, samples=61 write: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31394msec); 0 zone resets clat (msec): min=22, max=259, avg=62.98, stdev=32.26 lat (msec): min=22, max=259, avg=62.99, stdev=32.26 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 61], | 70.00th=[ 68], 80.00th=[ 80], 90.00th=[ 104], 95.00th=[ 131], | 99.00th=[ 180], 99.50th=[ 245], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 352, per=24.27%, avg=191.24, stdev=85.39, samples=62 iops : min= 1, max= 22, avg=11.34, stdev= 5.45, samples=62 lat (msec) : 10=17.97%, 20=19.79%, 50=30.86%, 100=25.26%, 250=5.99% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=3.97%, ctx=1566, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154201: Thu Jun 11 16:53:50 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(6032KiB/31789msec) clat (msec): min=5, max=127, avg=19.90, stdev=19.30 lat (msec): min=5, max=127, avg=19.90, stdev=19.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 48], 95.00th=[ 61], | 99.00th=[ 96], 99.50th=[ 107], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 31, max= 446, per=25.14%, avg=188.27, stdev=104.33, samples=63 iops : min= 1, max= 27, avg=11.16, stdev= 6.66, samples=63 write: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31789msec); 0 zone resets clat (msec): min=20, max=345, avg=61.96, stdev=31.82 lat (msec): min=20, max=345, avg=61.96, stdev=31.81 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 32], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 45], 40.00th=[ 49], 50.00th=[ 55], 60.00th=[ 60], | 70.00th=[ 67], 80.00th=[ 80], 90.00th=[ 100], 95.00th=[ 126], | 99.00th=[ 171], 99.50th=[ 182], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 63, max= 348, per=24.90%, avg=196.22, stdev=85.19, samples=63 iops : min= 3, max= 21, avg=11.67, stdev= 5.40, samples=63 lat (msec) : 10=15.89%, 20=21.09%, 50=29.56%, 100=28.26%, 250=5.08% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=3.90%, ctx=1523, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=749KiB/s (767kB/s), 180KiB/s-199KiB/s (184kB/s-204kB/s), io=23.4MiB (24.5MB), run=31394-31962msec WRITE: bw=788KiB/s (807kB/s), 192KiB/s-205KiB/s (197kB/s-210kB/s), io=24.6MiB (25.8MB), run=31394-31962msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154219: Thu Jun 11 16:54:00 2026 read: IOPS=1, BW=1911KiB/s (1957kB/s)(7168KiB/3750msec) clat (usec): min=534, max=1714.4k, avg=336930.20, stdev=609806.00 lat (usec): min=535, max=1714.4k, avg=336931.45, stdev=609805.96 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 88605], 30.00th=[ 104334], 40.00th=[ 104334], | 50.00th=[ 137364], 60.00th=[ 147850], 70.00th=[ 147850], | 80.00th=[ 164627], 90.00th=[1719665], 95.00th=[1719665], | 99.00th=[1719665], 99.50th=[1719665], 99.90th=[1719665], | 99.95th=[1719665], 99.99th=[1719665] bw ( KiB/s): min= 1865, max= 4079, per=61.42%, avg=3009.50, stdev=1232.03, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1365KiB/s (1398kB/s)(5120KiB/3750msec); 0 zone resets clat (msec): min=145, max=445, avg=268.25, stdev=126.68 lat (msec): min=145, max=445, avg=268.31, stdev=126.67 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1961, max= 4047, per=39.08%, avg=2681.00, stdev=1183.57, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=24.59%, ctx=746, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154220: Thu Jun 11 16:54:00 2026 read: IOPS=0, BW=490KiB/s (502kB/s)(2048KiB/4179msec) clat (msec): min=86, max=178, avg=132.52, stdev=64.59 lat (msec): min=86, max=178, avg=132.52, stdev=64.59 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 178], 90.00th=[ 178], 95.00th=[ 178], | 99.00th=[ 178], 99.50th=[ 178], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 1838, max= 1961, per=38.77%, avg=1899.50, stdev=86.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2450KiB/s (2509kB/s)(10.0MiB/4179msec); 0 zone resets clat (msec): min=114, max=1922, avg=389.18, stdev=555.41 lat (msec): min=114, max=1922, avg=389.26, stdev=555.41 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 132], | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 176], | 70.00th=[ 186], 80.00th=[ 334], 90.00th=[ 558], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1961, max= 6144, per=53.28%, avg=3654.80, stdev=2255.66, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.49, samples=5 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=27.14%, ctx=256, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154221: Thu Jun 11 16:54:00 2026 read: IOPS=1, BW=1553KiB/s (1590kB/s)(6144KiB/3956msec) clat (usec): min=497, max=255690, avg=103203.67, stdev=116261.13 lat (usec): min=499, max=255692, avg=103204.80, stdev=116261.10 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 865], 50.00th=[ 865], 60.00th=[162530], | 70.00th=[200279], 80.00th=[200279], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 2023, max= 4071, per=68.14%, avg=3339.00, stdev=1142.09, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1553KiB/s (1590kB/s)(6144KiB/3956msec); 0 zone resets clat (msec): min=125, max=1797, avg=546.81, stdev=634.08 lat (msec): min=125, max=1797, avg=546.86, stdev=634.09 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 376], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1961, max= 3778, per=35.70%, avg=2449.25, stdev=886.43, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=20.73%, ctx=210, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154222: Thu Jun 11 16:54:00 2026 read: IOPS=1, BW=1370KiB/s (1403kB/s)(5120KiB/3737msec) clat (usec): min=379, max=213228, avg=63874.88, stdev=94904.03 lat (usec): min=379, max=213229, avg=63875.70, stdev=94904.07 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 379], 10.00th=[ 379], 20.00th=[ 379], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[ 537], | 70.00th=[104334], 80.00th=[104334], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1918KiB/s (1964kB/s)(7168KiB/3737msec); 0 zone resets clat (msec): min=72, max=1795, avg=480.33, stdev=612.61 lat (msec): min=72, max=1795, avg=480.41, stdev=612.61 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 133], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 194], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 651], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1892, max= 4047, per=36.49%, avg=2503.25, stdev=1031.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=17.72%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4901KiB/s (5018kB/s), 490KiB/s-1911KiB/s (502kB/s-1957kB/s), io=20.0MiB (20.0MB), run=3737-4179msec WRITE: bw=6861KiB/s (7026kB/s), 1365KiB/s-2450KiB/s (1398kB/s-2509kB/s), io=28.0MiB (29.4MB), run=3737-4179msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154224: Thu Jun 11 16:54:01 2026 read: IOPS=1, BW=1544KiB/s (1581kB/s)(7168KiB/4643msec) clat (msec): min=57, max=1629, avg=452.44, stdev=580.74 lat (msec): min=57, max=1629, avg=452.44, stdev=580.74 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 74], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 155], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 785], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 2027, max= 3968, per=55.97%, avg=2425.80, stdev=862.15, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1103KiB/s (1129kB/s)(5120KiB/4643msec); 0 zone resets clat (msec): min=103, max=587, avg=288.82, stdev=187.13 lat (msec): min=103, max=587, avg=288.89, stdev=187.12 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2027, max= 4096, per=44.84%, avg=2720.67, stdev=1191.09, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=5.15%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154225: Thu Jun 11 16:54:01 2026 read: IOPS=0, BW=447KiB/s (457kB/s)(2048KiB/4584msec) clat (msec): min=62, max=287, avg=175.01, stdev=158.64 lat (msec): min=62, max=287, avg=175.01, stdev=158.64 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1969, max= 2039, per=46.24%, avg=2004.00, stdev=49.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2234KiB/s (2287kB/s)(10.0MiB/4584msec); 0 zone resets clat (msec): min=134, max=1877, avg=418.56, stdev=527.67 lat (msec): min=135, max=1877, avg=418.65, stdev=527.67 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 146], 40.00th=[ 157], 50.00th=[ 184], 60.00th=[ 292], | 70.00th=[ 372], 80.00th=[ 422], 90.00th=[ 464], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 2027, max= 6144, per=60.01%, avg=3641.20, stdev=2198.60, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.49, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=6.81%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154226: Thu Jun 11 16:54:01 2026 read: IOPS=1, BW=1410KiB/s (1444kB/s)(6144KiB/4357msec) clat (msec): min=77, max=281, avg=177.45, stdev=91.68 lat (msec): min=77, max=281, avg=177.45, stdev=91.68 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 224], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 4055, max= 6119, per=100.00%, avg=5087.00, stdev=1459.47, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1410KiB/s (1444kB/s)(6144KiB/4357msec); 0 zone resets clat (msec): min=65, max=1879, avg=542.05, stdev=678.69 lat (msec): min=65, max=1879, avg=542.18, stdev=678.65 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 359], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 1984, max= 4015, per=41.53%, avg=2520.25, stdev=996.86, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.18%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154227: Thu Jun 11 16:54:01 2026 read: IOPS=1, BW=1084KiB/s (1110kB/s)(5120KiB/4725msec) clat (msec): min=39, max=423, avg=194.24, stdev=154.17 lat (msec): min=39, max=423, avg=194.24, stdev=154.17 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1984, max= 4079, per=62.38%, avg=2703.67, stdev=1191.50, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1517KiB/s (1553kB/s)(7168KiB/4725msec); 0 zone resets clat (msec): min=132, max=1878, avg=527.85, stdev=611.42 lat (msec): min=132, max=1878, avg=527.93, stdev=611.42 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 138], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 334], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 489], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1914, max= 4096, per=39.76%, avg=2412.80, stdev=942.26, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=50.00%, 2000=8.33% cpu : usr=0.02%, sys=8.38%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4334KiB/s (4438kB/s), 447KiB/s-1544KiB/s (457kB/s-1581kB/s), io=20.0MiB (20.0MB), run=4357-4725msec WRITE: bw=6068KiB/s (6214kB/s), 1103KiB/s-2234KiB/s (1129kB/s-2287kB/s), io=28.0MiB (29.4MB), run=4357-4725msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154232: Thu Jun 11 16:54:10 2026 read: IOPS=2, BW=9615KiB/s (9846kB/s)(12.0MiB/1278msec) clat (msec): min=288, max=586, avg=415.46, stdev=153.38 lat (msec): min=288, max=586, avg=415.46, stdev=153.38 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 5801, max= 8192, per=54.57%, avg=6996.50, stdev=1690.69, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=11.28%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154233: Thu Jun 11 16:54:10 2026 read: IOPS=0, BW=3436KiB/s (3519kB/s)(4096KiB/1192msec) clat (nsec): min=161904k, max=161904k, avg=161904197.00, stdev= 0.00 lat (nsec): min=161907k, max=161907k, avg=161906510.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 7861, max= 7861, per=61.32%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6872KiB/s (7037kB/s)(8192KiB/1192msec); 0 zone resets clat (msec): min=423, max=553, avg=488.65, stdev=92.04 lat (msec): min=423, max=554, avg=489.00, stdev=91.99 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 8175, max= 8175, per=55.39%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=13.10%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154234: Thu Jun 11 16:54:10 2026 write: IOPS=1, BW=5535KiB/s (5668kB/s)(12.0MiB/2220msec); 0 zone resets clat (msec): min=575, max=931, avg=725.77, stdev=184.81 lat (msec): min=575, max=932, avg=726.25, stdev=184.78 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 5910, max= 8126, per=47.55%, avg=7018.00, stdev=1566.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.37%, ctx=36, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154235: Thu Jun 11 16:54:10 2026 write: IOPS=3, BW=13.6MiB/s (14.3MB/s)(12.0MiB/881msec); 0 zone resets clat (msec): min=236, max=335, avg=284.42, stdev=49.93 lat (msec): min=237, max=336, avg=285.16, stdev=49.35 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min=11521, max=11521, per=78.06%, avg=11521.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=13.07%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=12.5MiB/s (13.1MB/s), 3436KiB/s-9615KiB/s (3519kB/s-9846kB/s), io=16.0MiB (16.8MB), run=1192-1278msec WRITE: bw=14.4MiB/s (15.1MB/s), 5535KiB/s-13.6MiB/s (5668kB/s-14.3MB/s), io=32.0MiB (33.6MB), run=881-2220msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154237: Thu Jun 11 16:54:11 2026 read: IOPS=1, BW=5498KiB/s (5630kB/s)(12.0MiB/2235msec) clat (msec): min=657, max=908, avg=744.69, stdev=142.14 lat (msec): min=657, max=908, avg=744.70, stdev=142.14 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 5988, max= 8126, per=100.00%, avg=7057.00, stdev=1511.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.35%, ctx=303, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154238: Thu Jun 11 16:54:11 2026 read: IOPS=0, BW=1715KiB/s (1756kB/s)(4096KiB/2389msec) clat (nsec): min=647076k, max=647076k, avg=647076253.00, stdev= 0.00 lat (nsec): min=647078k, max=647078k, avg=647077637.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 6159, max= 6159, per=89.81%, avg=6159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3429KiB/s (3511kB/s)(8192KiB/2389msec); 0 zone resets clat (msec): min=567, max=1172, avg=870.18, stdev=428.15 lat (msec): min=567, max=1173, avg=870.46, stdev=428.18 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8126, max= 8126, per=60.01%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.57%, ctx=201, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154239: Thu Jun 11 16:54:11 2026 write: IOPS=1, BW=5078KiB/s (5200kB/s)(12.0MiB/2420msec); 0 zone resets clat (msec): min=624, max=930, avg=805.97, stdev=160.47 lat (msec): min=625, max=930, avg=806.32, stdev=160.39 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8015, max= 8126, per=59.60%, avg=8070.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.08%, sys=8.93%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154240: Thu Jun 11 16:54:11 2026 write: IOPS=1, BW=5299KiB/s (5426kB/s)(12.0MiB/2319msec); 0 zone resets clat (msec): min=280, max=1742, avg=770.07, stdev=842.57 lat (msec): min=281, max=1743, avg=770.43, stdev=842.55 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 6050, max= 8126, per=52.35%, avg=7088.00, stdev=1467.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.99%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6858KiB/s (7023kB/s), 1715KiB/s-5498KiB/s (1756kB/s-5630kB/s), io=16.0MiB (16.8MB), run=2235-2389msec WRITE: bw=13.2MiB/s (13.9MB/s), 3429KiB/s-5299KiB/s (3511kB/s-5426kB/s), io=32.0MiB (33.6MB), run=2319-2420msec