== sanity test 398b: DIO and buffer IO race ============== 11:12:46 (1788275566) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.66294 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145761: Tue Sep 1 11:15:34 2026 read: IOPS=10, BW=40.0KiB/s (41.0kB/s)(5992KiB/146257msec) clat (usec): min=31, max=1072.6k, avg=47860.03, stdev=47525.53 lat (usec): min=31, max=1072.6k, avg=47864.11, stdev=47527.12 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 68], | 20.00th=[ 18220], 30.00th=[ 24773], 40.00th=[ 31851], | 50.00th=[ 40109], 60.00th=[ 47449], 70.00th=[ 58983], | 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[ 117965], | 99.00th=[ 187696], 99.50th=[ 217056], 99.90th=[ 450888], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 119, per=25.14%, avg=40.98, stdev=19.38, samples=284 iops : min= 1, max= 29, avg= 9.61, stdev= 4.90, samples=284 write: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6296KiB/146257msec); 0 zone resets clat (usec): min=767, max=682749, avg=47044.14, stdev=53764.89 lat (usec): min=768, max=682750, avg=47045.57, stdev=53764.88 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 3326], | 30.00th=[ 8979], 40.00th=[ 20317], 50.00th=[ 34341], 60.00th=[ 45876], | 70.00th=[ 61080], 80.00th=[ 78119], 90.00th=[108528], 95.00th=[137364], | 99.00th=[242222], 99.50th=[283116], 99.90th=[413139], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 112, per=25.25%, avg=42.92, stdev=20.94, samples=285 iops : min= 1, max= 28, avg=10.10, stdev= 5.29, samples=285 lat (usec) : 50=0.98%, 100=4.46%, 250=0.16%, 500=0.13%, 1000=0.29% lat (msec) : 2=7.71%, 4=3.39%, 10=4.85%, 20=9.44%, 50=30.92% lat (msec) : 100=27.25%, 250=9.83%, 500=0.52%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.64%, ctx=6080, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145763: Tue Sep 1 11:15:34 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(5940KiB/145556msec) clat (usec): min=29, max=377175, avg=45065.96, stdev=36953.93 lat (usec): min=30, max=377176, avg=45068.31, stdev=36953.57 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 74], 20.00th=[ 17433], | 30.00th=[ 24511], 40.00th=[ 30278], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[113771], | 99.00th=[149947], 99.50th=[177210], 99.90th=[333448], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 111, per=25.34%, avg=41.30, stdev=20.01, samples=279 iops : min= 1, max= 27, avg= 9.69, stdev= 5.08, samples=279 write: IOPS=10, BW=43.6KiB/s (44.7kB/s)(6348KiB/145556msec); 0 zone resets clat (usec): min=827, max=1016.3k, avg=49206.94, stdev=58727.60 lat (usec): min=827, max=1016.3k, avg=49209.43, stdev=58727.54 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1254], | 20.00th=[ 3720], 30.00th=[ 9241], 40.00th=[ 20579], | 50.00th=[ 34341], 60.00th=[ 48497], 70.00th=[ 64226], | 80.00th=[ 82314], 90.00th=[ 114820], 95.00th=[ 149947], | 99.00th=[ 225444], 99.50th=[ 283116], 99.90th=[ 566232], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 119, per=25.45%, avg=43.26, stdev=20.76, samples=284 iops : min= 1, max= 29, avg=10.19, stdev= 5.24, samples=284 lat (usec) : 50=0.94%, 100=4.30%, 250=0.20%, 500=0.03%, 1000=0.52% lat (msec) : 2=7.45%, 4=3.06%, 10=5.83%, 20=9.24%, 50=31.15% lat (msec) : 100=26.37%, 250=10.42%, 500=0.39%, 750=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.52%, ctx=6137, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145765: Tue Sep 1 11:15:34 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6028KiB/145429msec) clat (usec): min=34, max=404040, avg=45231.14, stdev=37717.21 lat (usec): min=34, max=404041, avg=45234.76, stdev=37718.10 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 71], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 30802], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[175113], 99.50th=[198181], 99.90th=[358613], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 118, per=25.68%, avg=41.86, stdev=20.42, samples=280 iops : min= 1, max= 29, avg= 9.83, stdev= 5.15, samples=280 write: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6260KiB/145429msec); 0 zone resets clat (usec): min=922, max=1013.3k, avg=49032.20, stdev=59034.20 lat (usec): min=923, max=1013.3k, avg=49034.58, stdev=59034.16 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1205], | 20.00th=[ 3359], 30.00th=[ 9372], 40.00th=[ 20317], | 50.00th=[ 33817], 60.00th=[ 46924], 70.00th=[ 63177], | 80.00th=[ 85459], 90.00th=[ 120062], 95.00th=[ 149947], | 99.00th=[ 240124], 99.50th=[ 267387], 99.90th=[ 599786], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=42.96, stdev=21.01, samples=283 iops : min= 1, max= 29, avg=10.11, stdev= 5.30, samples=283 lat (usec) : 50=1.07%, 100=4.69%, 250=0.29%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=8.11%, 4=2.70%, 10=4.95%, 20=9.31%, 50=31.45% lat (msec) : 100=26.27%, 250=10.19%, 500=0.42%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=4.62%, ctx=6144, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145766: Tue Sep 1 11:15:34 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6052KiB/147280msec) clat (usec): min=21, max=1225.6k, avg=46622.89, stdev=49496.81 lat (usec): min=21, max=1225.6k, avg=46624.03, stdev=49496.81 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 85], | 20.00th=[ 18220], 30.00th=[ 24773], 40.00th=[ 31065], | 50.00th=[ 38536], 60.00th=[ 46400], 70.00th=[ 54789], | 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[ 119014], | 99.00th=[ 175113], 99.50th=[ 244319], 99.90th=[ 425722], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 119, per=25.63%, avg=41.78, stdev=19.85, samples=282 iops : min= 1, max= 29, avg= 9.80, stdev= 5.01, samples=282 write: IOPS=10, BW=42.3KiB/s (43.4kB/s)(6236KiB/147280msec); 0 zone resets clat (usec): min=615, max=364484, avg=48909.25, stdev=52344.81 lat (usec): min=616, max=364486, avg=48913.84, stdev=52344.07 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1106], 10.00th=[ 1188], 20.00th=[ 3720], | 30.00th=[ 8717], 40.00th=[ 20841], 50.00th=[ 35914], 60.00th=[ 48497], | 70.00th=[ 63701], 80.00th=[ 85459], 90.00th=[119014], 95.00th=[152044], | 99.00th=[229639], 99.50th=[258999], 99.90th=[341836], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 119, per=24.84%, avg=42.23, stdev=20.51, samples=287 iops : min= 1, max= 29, avg= 9.91, stdev= 5.17, samples=287 lat (usec) : 50=1.04%, 100=4.07%, 250=0.23%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.49% lat (msec) : 2=7.65%, 4=2.73%, 10=5.47%, 20=9.28%, 50=31.84% lat (msec) : 100=25.98%, 250=10.64%, 500=0.42%, 2000=0.03% cpu : usr=0.07%, sys=4.64%, ctx=6210, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 40.8KiB/s-41.4KiB/s (41.8kB/s-42.4kB/s), io=23.4MiB (24.6MB), run=145429-147280msec WRITE: bw=171KiB/s (175kB/s), 42.3KiB/s-43.6KiB/s (43.4kB/s-44.7kB/s), io=24.6MiB (25.7MB), run=145429-147280msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145759: Tue Sep 1 11:18:19 2026 read: IOPS=4, BW=19.2KiB/s (19.7kB/s)(5992KiB/312029msec) clat (msec): min=5, max=1083, avg=40.88, stdev=48.77 lat (msec): min=5, max=1083, avg=40.88, stdev=48.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 116], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 393], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 111, per=30.10%, avg=22.87, stdev=15.87, samples=504 iops : min= 1, max= 27, avg= 5.06, stdev= 4.01, samples=504 write: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6296KiB/312029msec); 0 zone resets clat (msec): min=21, max=1031, avg=158.99, stdev=95.14 lat (msec): min=21, max=1031, avg=158.99, stdev=95.14 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 86], | 30.00th=[ 104], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 180], 80.00th=[ 218], 90.00th=[ 284], 95.00th=[ 342], | 99.00th=[ 493], 99.50th=[ 531], 99.90th=[ 768], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 71, per=25.28%, avg=20.22, stdev=10.65, samples=595 iops : min= 1, max= 17, avg= 4.40, stdev= 2.72, samples=595 lat (msec) : 10=3.35%, 20=13.74%, 50=21.74%, 100=21.19%, 250=32.68% lat (msec) : 500=6.80%, 750=0.39%, 1000=0.03%, 2000=0.07% cpu : usr=0.03%, sys=0.94%, ctx=5080, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145760: Tue Sep 1 11:18:19 2026 read: IOPS=4, BW=19.1KiB/s (19.5kB/s)(5940KiB/311661msec) clat (msec): min=4, max=999, avg=40.56, stdev=50.76 lat (msec): min=4, max=999, avg=40.56, stdev=50.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 85], 95.00th=[ 114], | 99.00th=[ 192], 99.50th=[ 236], 99.90th=[ 969], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 104, per=30.27%, avg=23.00, stdev=16.44, samples=496 iops : min= 1, max= 26, avg= 5.10, stdev= 4.15, samples=496 write: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6348KiB/311661msec); 0 zone resets clat (msec): min=31, max=711, avg=158.10, stdev=89.61 lat (msec): min=31, max=711, avg=158.10, stdev=89.61 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 88], | 30.00th=[ 103], 40.00th=[ 118], 50.00th=[ 136], 60.00th=[ 159], | 70.00th=[ 184], 80.00th=[ 218], 90.00th=[ 279], 95.00th=[ 338], | 99.00th=[ 456], 99.50th=[ 527], 99.90th=[ 701], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 63, per=25.24%, avg=20.19, stdev=11.05, samples=601 iops : min= 1, max= 15, avg= 4.39, stdev= 2.82, samples=601 lat (msec) : 10=4.00%, 20=12.70%, 50=21.55%, 100=21.29%, 250=32.88% lat (msec) : 500=7.19%, 750=0.33%, 1000=0.07% cpu : usr=0.04%, sys=1.00%, ctx=5293, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145762: Tue Sep 1 11:18:19 2026 read: IOPS=4, BW=19.4KiB/s (19.8kB/s)(6028KiB/310988msec) clat (msec): min=4, max=563, avg=43.42, stdev=44.98 lat (msec): min=4, max=563, avg=43.43, stdev=44.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 124], | 99.00th=[ 209], 99.50th=[ 271], 99.90th=[ 477], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 127, per=29.54%, avg=22.45, stdev=15.89, samples=516 iops : min= 1, max= 31, avg= 4.96, stdev= 4.02, samples=516 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6260KiB/310988msec); 0 zone resets clat (msec): min=22, max=1288, avg=156.56, stdev=93.92 lat (msec): min=22, max=1288, avg=156.57, stdev=93.92 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 86], | 30.00th=[ 102], 40.00th=[ 117], 50.00th=[ 134], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 213], 90.00th=[ 279], 95.00th=[ 334], | 99.00th=[ 443], 99.50th=[ 493], 99.90th=[ 1062], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 55, per=25.08%, avg=20.07, stdev=10.97, samples=596 iops : min= 1, max= 13, avg= 4.36, stdev= 2.79, samples=596 lat (msec) : 10=3.26%, 20=12.01%, 50=22.30%, 100=22.17%, 250=32.81% lat (msec) : 500=7.19%, 750=0.20%, 2000=0.07% cpu : usr=0.03%, sys=1.03%, ctx=5410, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145764: Tue Sep 1 11:18:19 2026 read: IOPS=4, BW=19.5KiB/s (19.9kB/s)(6052KiB/310728msec) clat (msec): min=4, max=958, avg=41.91, stdev=50.32 lat (msec): min=4, max=958, avg=41.92, stdev=50.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 118], | 99.00th=[ 230], 99.50th=[ 288], 99.90th=[ 485], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 95, per=30.80%, avg=23.41, stdev=16.43, samples=498 iops : min= 1, max= 23, avg= 5.20, stdev= 4.15, samples=498 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6236KiB/310728msec); 0 zone resets clat (msec): min=30, max=1278, avg=158.30, stdev=92.78 lat (msec): min=30, max=1278, avg=158.30, stdev=92.78 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 87], | 30.00th=[ 102], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 182], 80.00th=[ 213], 90.00th=[ 279], 95.00th=[ 338], | 99.00th=[ 468], 99.50th=[ 518], 99.90th=[ 609], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 63, per=25.03%, avg=20.03, stdev=11.01, samples=596 iops : min= 1, max= 15, avg= 4.35, stdev= 2.82, samples=596 lat (msec) : 10=4.00%, 20=13.35%, 50=21.26%, 100=21.58%, 250=32.62% lat (msec) : 500=6.87%, 750=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=0.96%, ctx=5116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=76.0KiB/s (78.8kB/s), 19.1KiB/s-19.5KiB/s (19.5kB/s-19.9kB/s), io=23.4MiB (24.6MB), run=310728-312029msec WRITE: bw=80.6KiB/s (82.5kB/s), 20.1KiB/s-20.4KiB/s (20.6kB/s-20.9kB/s), io=24.6MiB (25.7MB), run=310728-312029msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145826: Tue Sep 1 11:19:01 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5920KiB/29317msec) clat (usec): min=32, max=335210, avg=40361.56, stdev=39501.77 lat (usec): min=32, max=335211, avg=40362.88, stdev=39501.73 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 76], | 30.00th=[ 20055], 40.00th=[ 29230], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[200279], 99.50th=[263193], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 62, max= 534, per=25.28%, avg=203.23, stdev=95.37, samples=57 iops : min= 3, max= 33, avg=11.96, stdev= 5.98, samples=57 write: IOPS=13, BW=217KiB/s (222kB/s)(6368KiB/29317msec); 0 zone resets clat (usec): min=1098, max=192794, avg=35579.95, stdev=39699.42 lat (usec): min=1099, max=192796, avg=35582.07, stdev=39699.43 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1614], 10.00th=[ 1876], 20.00th=[ 4686], | 30.00th=[ 7635], 40.00th=[ 13042], 50.00th=[ 20841], 60.00th=[ 32375], | 70.00th=[ 40109], 80.00th=[ 62129], 90.00th=[ 92799], 95.00th=[125305], | 99.00th=[173016], 99.50th=[177210], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 510, per=25.83%, avg=218.51, stdev=105.09, samples=57 iops : min= 1, max= 31, avg=12.91, stdev= 6.59, samples=57 lat (usec) : 50=1.43%, 100=9.64%, 250=0.78%, 500=0.13%, 750=0.13% lat (msec) : 2=5.47%, 4=3.52%, 10=9.77%, 20=8.72%, 50=32.03% lat (msec) : 100=21.61%, 250=6.51%, 500=0.26% cpu : usr=0.11%, sys=5.54%, ctx=1374, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145827: Tue Sep 1 11:19:01 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(5744KiB/29763msec) clat (usec): min=37, max=233370, avg=41218.38, stdev=36644.56 lat (usec): min=37, max=233371, avg=41219.82, stdev=36644.58 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 135], | 30.00th=[ 21890], 40.00th=[ 29230], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[179307], 99.50th=[198181], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 58, max= 477, per=23.87%, avg=191.91, stdev=88.90, samples=58 iops : min= 3, max= 29, avg=11.24, stdev= 5.65, samples=58 write: IOPS=13, BW=220KiB/s (225kB/s)(6544KiB/29763msec); 0 zone resets clat (usec): min=1453, max=389138, avg=36423.06, stdev=42537.31 lat (usec): min=1456, max=389140, avg=36431.26, stdev=42534.68 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1680], 10.00th=[ 2089], 20.00th=[ 5538], | 30.00th=[ 8356], 40.00th=[ 12780], 50.00th=[ 20317], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 63701], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[143655], 99.50th=[231736], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 63, max= 413, per=25.89%, avg=219.03, stdev=85.44, samples=58 iops : min= 3, max= 25, avg=12.95, stdev= 5.40, samples=58 lat (usec) : 50=1.82%, 100=7.03%, 250=0.91%, 500=0.26% lat (msec) : 2=5.60%, 4=3.52%, 10=9.64%, 20=9.90%, 50=31.64% lat (msec) : 100=22.66%, 250=6.77%, 500=0.26% cpu : usr=0.08%, sys=5.56%, ctx=1370, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145828: Tue Sep 1 11:19:01 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6256KiB/28939msec) clat (usec): min=35, max=413280, avg=40834.69, stdev=40678.25 lat (usec): min=35, max=413282, avg=40836.35, stdev=40678.29 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 76], | 30.00th=[ 21365], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[191890], 99.50th=[258999], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 29, max= 479, per=26.91%, avg=216.35, stdev=99.18, samples=57 iops : min= 1, max= 29, avg=12.79, stdev= 6.28, samples=57 write: IOPS=13, BW=208KiB/s (213kB/s)(6032KiB/28939msec); 0 zone resets clat (usec): min=1364, max=298528, avg=34008.37, stdev=39277.24 lat (usec): min=1367, max=298530, avg=34010.53, stdev=39277.15 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1647], 10.00th=[ 2180], 20.00th=[ 4883], | 30.00th=[ 8225], 40.00th=[ 12125], 50.00th=[ 19530], 60.00th=[ 30540], | 70.00th=[ 42206], 80.00th=[ 58459], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[181404], 99.50th=[261096], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 508, per=24.58%, avg=207.93, stdev=94.29, samples=57 iops : min= 1, max= 31, avg=12.26, stdev= 5.94, samples=57 lat (usec) : 50=2.21%, 100=9.11%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=4.30%, 4=4.56%, 10=8.72%, 20=9.64%, 50=32.29% lat (msec) : 100=22.66%, 250=4.95%, 500=0.52% cpu : usr=0.07%, sys=5.54%, ctx=1317, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145829: Tue Sep 1 11:19:01 2026 read: IOPS=13, BW=213KiB/s (219kB/s)(6032KiB/28266msec) clat (usec): min=23, max=175309, avg=39806.60, stdev=34254.91 lat (usec): min=24, max=175311, avg=39807.87, stdev=34254.96 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 51], 10.00th=[ 59], 20.00th=[ 82], | 30.00th=[ 20055], 40.00th=[ 28705], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[110625], | 99.00th=[145753], 99.50th=[160433], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 479, per=26.43%, avg=212.49, stdev=82.91, samples=55 iops : min= 1, max= 29, avg=12.56, stdev= 5.19, samples=55 write: IOPS=13, BW=221KiB/s (227kB/s)(6256KiB/28266msec); 0 zone resets clat (usec): min=1349, max=185247, avg=33463.16, stdev=37285.16 lat (usec): min=1351, max=185251, avg=33477.99, stdev=37298.66 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1582], 10.00th=[ 1778], 20.00th=[ 3982], | 30.00th=[ 6390], 40.00th=[ 11076], 50.00th=[ 20317], 60.00th=[ 28967], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[173016], 99.50th=[181404], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 542, per=26.23%, avg=221.87, stdev=107.29, samples=55 iops : min= 1, max= 33, avg=13.13, stdev= 6.72, samples=55 lat (usec) : 50=2.34%, 100=8.33%, 250=0.39%, 500=0.39%, 750=0.13% lat (msec) : 2=7.16%, 4=3.52%, 10=8.98%, 20=8.85%, 50=30.60% lat (msec) : 100=22.40%, 250=6.90% cpu : usr=0.08%, sys=5.93%, ctx=1340, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=805KiB/s (824kB/s), 193KiB/s-216KiB/s (198kB/s-221kB/s), io=23.4MiB (24.5MB), run=28266-29763msec WRITE: bw=847KiB/s (867kB/s), 208KiB/s-221KiB/s (213kB/s-227kB/s), io=24.6MiB (25.8MB), run=28266-29763msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145830: Tue Sep 1 11:19:50 2026 read: IOPS=4, BW=75.0KiB/s (77.8kB/s)(5920KiB/77903msec) clat (msec): min=5, max=327, avg=45.78, stdev=37.53 lat (msec): min=5, max=327, avg=45.78, stdev=37.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 60], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 213], 99.50th=[ 288], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 318, per=28.79%, avg=86.95, stdev=55.82, samples=134 iops : min= 1, max= 19, avg= 4.62, stdev= 3.52, samples=134 write: IOPS=5, BW=81.7KiB/s (83.7kB/s)(6368KiB/77903msec); 0 zone resets clat (msec): min=47, max=466, avg=152.81, stdev=66.04 lat (msec): min=47, max=466, avg=152.81, stdev=66.04 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 77], 10.00th=[ 83], 20.00th=[ 97], | 30.00th=[ 113], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 205], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 368], 99.50th=[ 464], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 23, max= 160, per=25.93%, avg=82.45, stdev=33.98, samples=152 iops : min= 1, max= 10, avg= 4.33, stdev= 2.20, samples=152 lat (msec) : 10=1.30%, 20=7.16%, 50=25.00%, 100=23.44%, 250=38.41% lat (msec) : 500=4.69% cpu : usr=0.05%, sys=1.24%, ctx=1468, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145831: Tue Sep 1 11:19:50 2026 read: IOPS=4, BW=72.6KiB/s (74.4kB/s)(5744KiB/79069msec) clat (msec): min=7, max=301, avg=47.75, stdev=37.70 lat (msec): min=7, max=301, avg=47.75, stdev=37.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 68], 90.00th=[ 87], 95.00th=[ 127], | 99.00th=[ 199], 99.50th=[ 230], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 23, max= 285, per=29.46%, avg=88.98, stdev=51.33, samples=126 iops : min= 1, max= 17, avg= 4.75, stdev= 3.24, samples=126 write: IOPS=5, BW=82.8KiB/s (84.7kB/s)(6544KiB/79069msec); 0 zone resets clat (msec): min=40, max=564, avg=150.77, stdev=74.45 lat (msec): min=40, max=564, avg=150.78, stdev=74.45 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 117], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 201], 90.00th=[ 243], 95.00th=[ 305], | 99.00th=[ 380], 99.50th=[ 414], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 23, max= 256, per=26.62%, avg=84.66, stdev=38.15, samples=151 iops : min= 1, max= 16, avg= 4.48, stdev= 2.46, samples=151 lat (msec) : 10=0.65%, 20=6.77%, 50=25.65%, 100=23.05%, 250=38.80% lat (msec) : 500=4.82%, 750=0.26% cpu : usr=0.05%, sys=1.27%, ctx=1432, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145832: Tue Sep 1 11:19:50 2026 read: IOPS=5, BW=82.8KiB/s (84.8kB/s)(6256KiB/75520msec) clat (msec): min=6, max=286, avg=46.79, stdev=37.53 lat (msec): min=6, max=286, avg=46.79, stdev=37.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 92], 95.00th=[ 121], | 99.00th=[ 197], 99.50th=[ 257], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 287, per=30.28%, avg=91.46, stdev=63.16, samples=135 iops : min= 1, max= 17, avg= 4.90, stdev= 3.97, samples=135 write: IOPS=4, BW=79.9KiB/s (81.8kB/s)(6032KiB/75520msec); 0 zone resets clat (msec): min=49, max=562, avg=150.96, stdev=69.99 lat (msec): min=49, max=562, avg=150.96, stdev=69.99 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 74], 10.00th=[ 83], 20.00th=[ 95], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 148], | 70.00th=[ 163], 80.00th=[ 192], 90.00th=[ 236], 95.00th=[ 309], | 99.00th=[ 384], 99.50th=[ 443], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 23, max= 160, per=25.38%, avg=80.69, stdev=35.75, samples=147 iops : min= 1, max= 10, avg= 4.22, stdev= 2.29, samples=147 lat (msec) : 10=1.17%, 20=7.16%, 50=28.26%, 100=21.88%, 250=37.37% lat (msec) : 500=4.04%, 750=0.13% cpu : usr=0.03%, sys=1.21%, ctx=1442, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145833: Tue Sep 1 11:19:50 2026 read: IOPS=4, BW=78.1KiB/s (79.0kB/s)(6032KiB/77235msec) clat (msec): min=7, max=273, avg=46.90, stdev=39.18 lat (msec): min=7, max=273, avg=46.91, stdev=39.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 83], 95.00th=[ 132], | 99.00th=[ 230], 99.50th=[ 257], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 351, per=28.60%, avg=86.36, stdev=60.26, samples=136 iops : min= 1, max= 21, avg= 4.56, stdev= 3.80, samples=136 write: IOPS=5, BW=80.0KiB/s (82.9kB/s)(6256KiB/77235msec); 0 zone resets clat (msec): min=50, max=502, avg=151.41, stdev=68.08 lat (msec): min=50, max=502, avg=151.42, stdev=68.07 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 99], | 30.00th=[ 112], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 194], 90.00th=[ 236], 95.00th=[ 288], | 99.00th=[ 418], 99.50th=[ 443], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 23, max= 160, per=25.73%, avg=81.83, stdev=33.39, samples=150 iops : min= 1, max= 10, avg= 4.29, stdev= 2.14, samples=150 lat (msec) : 10=0.91%, 20=7.16%, 50=25.91%, 100=22.79%, 250=38.80% lat (msec) : 500=4.30%, 750=0.13% cpu : usr=0.04%, sys=1.17%, ctx=1409, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=303KiB/s (310kB/s), 72.6KiB/s-82.8KiB/s (74.4kB/s-84.8kB/s), io=23.4MiB (24.5MB), run=75520-79069msec WRITE: bw=319KiB/s (326kB/s), 79.9KiB/s-82.8KiB/s (81.8kB/s-84.7kB/s), io=24.6MiB (25.8MB), run=75520-79069msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145853: Tue Sep 1 11:20:09 2026 read: IOPS=0, BW=1014KiB/s (1038kB/s)(7168KiB/7071msec) clat (msec): min=119, max=532, avg=265.36, stdev=157.09 lat (msec): min=119, max=532, avg=265.36, stdev=157.09 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 140], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 186], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 401], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1973, max= 4219, per=98.82%, avg=2563.50, stdev=1104.02, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=724KiB/s (741kB/s)(5120KiB/7071msec); 0 zone resets clat (msec): min=286, max=3035, avg=1034.78, stdev=1135.26 lat (msec): min=286, max=3035, avg=1034.87, stdev=1135.25 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1976, max= 3908, per=72.53%, avg=2634.33, stdev=1103.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.85%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145854: Tue Sep 1 11:20:09 2026 read: IOPS=0, BW=259KiB/s (266kB/s)(2048KiB/7894msec) clat (msec): min=139, max=331, avg=235.46, stdev=135.38 lat (msec): min=139, max=331, avg=235.47, stdev=135.38 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1467, max= 1825, per=63.45%, avg=1646.00, stdev=253.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1297KiB/s (1328kB/s)(10.0MiB/7894msec); 0 zone resets clat (msec): min=186, max=3849, avg=727.73, stdev=1139.68 lat (msec): min=186, max=3849, avg=728.07, stdev=1139.83 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 192], | 30.00th=[ 203], 40.00th=[ 226], 50.00th=[ 284], 60.00th=[ 359], | 70.00th=[ 372], 80.00th=[ 380], 90.00th=[ 1234], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 1467, max= 4055, per=59.85%, avg=2173.62, stdev=783.84, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=41.67%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.89%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145855: Tue Sep 1 11:20:09 2026 read: IOPS=0, BW=787KiB/s (806kB/s)(6144KiB/7804msec) clat (msec): min=73, max=3233, avg=814.62, stdev=1200.00 lat (msec): min=73, max=3233, avg=814.62, stdev=1200.00 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 527], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1825, max= 4055, per=95.90%, avg=2487.75, stdev=1049.58, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=787KiB/s (806kB/s)(6144KiB/7804msec); 0 zone resets clat (msec): min=232, max=725, avg=465.96, stdev=213.31 lat (msec): min=232, max=725, avg=466.24, stdev=213.58 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 460], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1501, max= 2048, per=52.71%, avg=1914.40, stdev=232.73, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.79%, ctx=75, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145856: Tue Sep 1 11:20:09 2026 read: IOPS=0, BW=770KiB/s (788kB/s)(5120KiB/6652msec) clat (msec): min=103, max=532, avg=222.80, stdev=174.62 lat (msec): min=103, max=532, avg=222.80, stdev=174.62 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1954, max= 4071, per=100.00%, avg=2691.00, stdev=1196.04, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1078KiB/s (1103kB/s)(7168KiB/6652msec); 0 zone resets clat (msec): min=216, max=2504, avg=765.49, stdev=800.10 lat (msec): min=216, max=2504, avg=766.15, stdev=799.94 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 550], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 802], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1473, max= 2043, per=52.79%, avg=1917.50, stdev=220.74, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.36%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2594KiB/s (2657kB/s), 259KiB/s-1014KiB/s (266kB/s-1038kB/s), io=20.0MiB (20.0MB), run=6652-7894msec WRITE: bw=3632KiB/s (3719kB/s), 724KiB/s-1297KiB/s (741kB/s-1328kB/s), io=28.0MiB (29.4MB), run=6652-7894msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145858: Tue Sep 1 11:20:09 2026 read: IOPS=1, BW=1159KiB/s (1187kB/s)(7168KiB/6186msec) clat (usec): min=1071, max=339728, avg=223591.76, stdev=117006.85 lat (usec): min=1073, max=339729, avg=223593.07, stdev=117006.93 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1074], 10.00th=[ 1074], 20.00th=[149947], | 30.00th=[206570], 40.00th=[206570], 50.00th=[274727], 60.00th=[283116], | 70.00th=[283116], 80.00th=[312476], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 1831, max= 3806, per=86.68%, avg=2329.20, stdev=829.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=828KiB/s (848kB/s)(5120KiB/6186msec); 0 zone resets clat (msec): min=224, max=2934, avg=923.35, stdev=1143.12 lat (msec): min=224, max=2935, avg=923.49, stdev=1143.12 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1831, max= 4039, per=68.87%, avg=2591.00, stdev=1254.52, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.45%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145859: Tue Sep 1 11:20:09 2026 read: IOPS=0, BW=269KiB/s (275kB/s)(2048KiB/7621msec) clat (msec): min=291, max=312, avg=301.94, stdev=15.30 lat (msec): min=291, max=312, avg=301.94, stdev=15.30 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1838, max= 1954, per=70.56%, avg=1896.00, stdev=82.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1344KiB/s (1376kB/s)(10.0MiB/7621msec); 0 zone resets clat (msec): min=195, max=3669, avg=700.73, stdev=1052.38 lat (msec): min=195, max=3669, avg=701.29, stdev=1052.29 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 228], | 30.00th=[ 251], 40.00th=[ 342], 50.00th=[ 347], 60.00th=[ 380], | 70.00th=[ 426], 80.00th=[ 510], 90.00th=[ 667], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 1831, max= 4055, per=59.52%, avg=2239.14, stdev=805.23, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=6.65%, ctx=133, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145860: Tue Sep 1 11:20:09 2026 read: IOPS=1, BW=1097KiB/s (1124kB/s)(6144KiB/5599msec) clat (usec): min=512, max=2902.5k, avg=529604.08, stdev=1167449.21 lat (usec): min=513, max=2902.5k, avg=529605.37, stdev=1167449.27 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], | 20.00th=[ 611], 30.00th=[ 611], 40.00th=[ 668], | 50.00th=[ 668], 60.00th=[ 2802], 70.00th=[ 270533], | 80.00th=[ 270533], 90.00th=[2902459], 95.00th=[2902459], | 99.00th=[2902459], 99.50th=[2902459], 99.90th=[2902459], | 99.95th=[2902459], 99.99th=[2902459] bw ( KiB/s): min= 3984, max= 4039, per=100.00%, avg=4011.50, stdev=38.89, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1097KiB/s (1124kB/s)(6144KiB/5599msec); 0 zone resets clat (msec): min=129, max=827, avg=401.97, stdev=293.04 lat (msec): min=129, max=827, avg=402.09, stdev=293.02 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 253], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1363, max= 4039, per=62.71%, avg=2359.25, stdev=1161.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=25.00% lat (msec) : 4=8.33%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.43%, ctx=514, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145861: Tue Sep 1 11:20:09 2026 read: IOPS=0, BW=762KiB/s (780kB/s)(5120KiB/6719msec) clat (usec): min=528, max=263786, avg=194787.17, stdev=109994.96 lat (usec): min=530, max=263788, avg=194790.73, stdev=109995.73 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[221250], 40.00th=[221250], 50.00th=[231736], 60.00th=[231736], | 70.00th=[256902], 80.00th=[256902], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 3992, max= 4087, per=100.00%, avg=4039.50, stdev=67.18, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1067KiB/s (1092kB/s)(7168KiB/6719msec); 0 zone resets clat (msec): min=192, max=2767, avg=820.35, stdev=893.03 lat (msec): min=192, max=2767, avg=820.47, stdev=893.04 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 215], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 617], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 860], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1903, max= 2043, per=53.37%, avg=2007.80, stdev=59.29, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=6.88%, ctx=174, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2687KiB/s (2752kB/s), 269KiB/s-1159KiB/s (275kB/s-1187kB/s), io=20.0MiB (20.0MB), run=5599-7621msec WRITE: bw=3762KiB/s (3853kB/s), 828KiB/s-1344KiB/s (848kB/s-1376kB/s), io=28.0MiB (29.4MB), run=5599-7621msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145868: Tue Sep 1 11:20:27 2026 read: IOPS=0, BW=2166KiB/s (2218kB/s)(12.0MiB/5673msec) clat (msec): min=838, max=3712, avg=1856.66, stdev=1609.61 lat (msec): min=838, max=3712, avg=1856.67, stdev=1609.61 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 3708], 80.00th=[ 3708], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.47%, ctx=629, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145869: Tue Sep 1 11:20:27 2026 read: IOPS=0, BW=740KiB/s (758kB/s)(4096KiB/5535msec) clat (nsec): min=3721.5M, max=3721.5M, avg=3721536598.00, stdev= 0.00 lat (nsec): min=3721.5M, max=3721.5M, avg=3721537623.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3708], 5.00th=[ 3708], 10.00th=[ 3708], 20.00th=[ 3708], | 30.00th=[ 3708], 40.00th=[ 3708], 50.00th=[ 3708], 60.00th=[ 3708], | 70.00th=[ 3708], 80.00th=[ 3708], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1480KiB/s (1516kB/s)(8192KiB/5535msec); 0 zone resets clat (msec): min=366, max=1374, avg=870.34, stdev=712.50 lat (msec): min=366, max=1374, avg=870.66, stdev=712.39 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=5.11%, ctx=421, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145870: Tue Sep 1 11:20:27 2026 write: IOPS=0, BW=1773KiB/s (1816kB/s)(12.0MiB/6930msec); 0 zone resets clat (msec): min=457, max=4076, avg=2294.08, stdev=1810.53 lat (msec): min=457, max=4077, avg=2294.32, stdev=1810.53 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 8078, max= 8110, per=100.00%, avg=8094.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.79%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145871: Tue Sep 1 11:20:27 2026 write: IOPS=0, BW=2207KiB/s (2259kB/s)(12.0MiB/5569msec); 0 zone resets clat (msec): min=347, max=4691, avg=1801.75, stdev=2502.76 lat (msec): min=349, max=4692, avg=1802.87, stdev=2502.43 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 7641, max= 8143, per=100.00%, avg=7892.00, stdev=354.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.08%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2888KiB/s (2957kB/s), 740KiB/s-2166KiB/s (758kB/s-2218kB/s), io=16.0MiB (16.8MB), run=5535-5673msec WRITE: bw=4728KiB/s (4842kB/s), 1480KiB/s-2207KiB/s (1516kB/s-2259kB/s), io=32.0MiB (33.6MB), run=5535-6930msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145873: Tue Sep 1 11:20:27 2026 read: IOPS=0, BW=2118KiB/s (2169kB/s)(12.0MiB/5802msec) clat (msec): min=264, max=4211, avg=1933.57, stdev=2042.39 lat (msec): min=264, max=4211, avg=1933.57, stdev=2042.39 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 4212], 80.00th=[ 4212], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 7984, max= 8078, per=100.00%, avg=8031.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.79%, ctx=32, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145874: Tue Sep 1 11:20:27 2026 read: IOPS=0, BW=649KiB/s (664kB/s)(4096KiB/6312msec) clat (nsec): min=4503.7M, max=4503.7M, avg=4503679471.00, stdev= 0.00 lat (nsec): min=4503.7M, max=4503.7M, avg=4503682473.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4530], 5.00th=[ 4530], 10.00th=[ 4530], 20.00th=[ 4530], | 30.00th=[ 4530], 40.00th=[ 4530], 50.00th=[ 4530], 60.00th=[ 4530], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1298KiB/s (1329kB/s)(8192KiB/6312msec); 0 zone resets clat (msec): min=703, max=1082, avg=892.71, stdev=268.11 lat (msec): min=704, max=1082, avg=893.40, stdev=267.80 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.93%, ctx=32, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145875: Tue Sep 1 11:20:27 2026 write: IOPS=0, BW=2187KiB/s (2239kB/s)(12.0MiB/5619msec); 0 zone resets clat (msec): min=273, max=3984, avg=1870.86, stdev=1908.44 lat (msec): min=273, max=3986, avg=1872.07, stdev=1909.73 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.60%, ctx=38, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145876: Tue Sep 1 11:20:27 2026 write: IOPS=0, BW=2423KiB/s (2481kB/s)(12.0MiB/5071msec); 0 zone resets clat (msec): min=209, max=4573, avg=1679.72, stdev=2505.86 lat (msec): min=210, max=4573, avg=1680.14, stdev=2505.93 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min=10922, max=10922, per=100.00%, avg=10922.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.81%, ctx=33, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2596KiB/s (2658kB/s), 649KiB/s-2118KiB/s (664kB/s-2169kB/s), io=16.0MiB (16.8MB), run=5802-6312msec WRITE: bw=5191KiB/s (5316kB/s), 1298KiB/s-2423KiB/s (1329kB/s-2481kB/s), io=32.0MiB (33.6MB), run=5071-6312msec