== sanity test 398b: DIO and buffer IO race ============== 05:44:31 (1787910271) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.08702 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144278: Fri Aug 28 05:47:32 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(5992KiB/159396msec) clat (usec): min=30, max=937930, avg=52245.67, stdev=47090.79 lat (usec): min=30, max=937933, avg=52267.30, stdev=47094.02 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 11076], 20.00th=[ 22938], | 30.00th=[ 29754], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 62653], 80.00th=[ 77071], 90.00th=[102237], 95.00th=[120062], | 99.00th=[183501], 99.50th=[208667], 99.90th=[530580], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 103, per=25.42%, avg=37.88, stdev=17.37, samples=307 iops : min= 1, max= 25, avg= 8.81, stdev= 4.37, samples=307 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6296KiB/159396msec); 0 zone resets clat (usec): min=940, max=634272, avg=51402.22, stdev=54485.34 lat (usec): min=941, max=634275, avg=51406.29, stdev=54486.26 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1287], 10.00th=[ 1926], 20.00th=[ 5014], | 30.00th=[ 10552], 40.00th=[ 25822], 50.00th=[ 38011], 60.00th=[ 51643], | 70.00th=[ 68682], 80.00th=[ 87557], 90.00th=[114820], 95.00th=[154141], | 99.00th=[231736], 99.50th=[265290], 99.90th=[396362], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 111, per=24.96%, avg=39.18, stdev=19.85, samples=312 iops : min= 1, max= 27, avg= 9.13, stdev= 5.00, samples=312 lat (usec) : 50=0.39%, 100=3.39%, 250=0.55%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.44%, 4=3.45%, 10=6.45%, 20=6.15%, 50=32.45% lat (msec) : 100=28.87%, 250=12.14%, 500=0.49%, 750=0.07%, 1000=0.03% cpu : usr=0.06%, sys=4.24%, ctx=6554, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144279: Fri Aug 28 05:47:32 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(5940KiB/160085msec) clat (usec): min=45, max=887419, avg=51364.72, stdev=44290.02 lat (usec): min=45, max=887422, avg=51368.01, stdev=44292.63 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 12780], 20.00th=[ 22938], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 61080], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[193987], 99.50th=[219153], 99.90th=[421528], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 119, per=25.32%, avg=37.72, stdev=18.57, samples=306 iops : min= 1, max= 29, avg= 8.76, stdev= 4.68, samples=306 write: IOPS=9, BW=39.7KiB/s (40.6kB/s)(6348KiB/160085msec); 0 zone resets clat (usec): min=980, max=555589, avg=52630.33, stdev=58589.13 lat (usec): min=981, max=555589, avg=52632.47, stdev=58588.76 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1303], 10.00th=[ 2114], 20.00th=[ 4817], | 30.00th=[ 10028], 40.00th=[ 23462], 50.00th=[ 36963], 60.00th=[ 51643], | 70.00th=[ 67634], 80.00th=[ 87557], 90.00th=[123208], 95.00th=[164627], | 99.00th=[254804], 99.50th=[308282], 99.90th=[497026], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 120, per=25.38%, avg=39.85, stdev=20.86, samples=310 iops : min= 1, max= 30, avg= 9.30, stdev= 5.27, samples=310 lat (usec) : 50=0.13%, 100=3.45%, 250=0.42%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.10% lat (msec) : 2=4.95%, 4=3.78%, 10=7.00%, 20=7.13%, 50=31.51% lat (msec) : 100=28.94%, 250=11.72%, 500=0.59%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.23%, ctx=6617, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144280: Fri Aug 28 05:47:32 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6028KiB/159844msec) clat (usec): min=34, max=568363, avg=50726.26, stdev=39421.96 lat (usec): min=34, max=568365, avg=50727.98, stdev=39422.19 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 13435], 20.00th=[ 23987], | 30.00th=[ 29754], 40.00th=[ 34866], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 61080], 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[173016], 99.50th=[200279], 99.90th=[299893], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 95, per=25.38%, avg=37.81, stdev=19.57, samples=309 iops : min= 1, max= 23, avg= 8.79, stdev= 4.92, samples=309 write: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6260KiB/159844msec); 0 zone resets clat (usec): min=980, max=1000.8k, avg=53184.56, stdev=62752.81 lat (usec): min=982, max=1000.8k, avg=53187.41, stdev=62754.80 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 2114], | 20.00th=[ 5866], 30.00th=[ 12649], 40.00th=[ 26346], | 50.00th=[ 39060], 60.00th=[ 51119], 70.00th=[ 67634], | 80.00th=[ 90702], 90.00th=[ 123208], 95.00th=[ 152044], | 99.00th=[ 246416], 99.50th=[ 299893], 99.90th=[ 876610], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 118, per=24.84%, avg=39.00, stdev=18.78, samples=311 iops : min= 1, max= 29, avg= 9.09, stdev= 4.73, samples=311 lat (usec) : 50=0.36%, 100=3.45%, 250=0.29%, 500=0.10%, 1000=0.13% lat (msec) : 2=4.98%, 4=3.22%, 10=5.96%, 20=6.84%, 50=33.89% lat (msec) : 100=27.47%, 250=12.76%, 500=0.42%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.08%, sys=4.27%, ctx=6642, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144281: Fri Aug 28 05:47:32 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6052KiB/159964msec) clat (usec): min=31, max=424249, avg=50364.86, stdev=40366.08 lat (usec): min=31, max=424250, avg=50370.92, stdev=40366.47 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 251], 20.00th=[ 22152], | 30.00th=[ 28181], 40.00th=[ 34866], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 62129], 80.00th=[ 76022], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[177210], 99.50th=[225444], 99.90th=[417334], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 96, per=25.37%, avg=37.81, stdev=18.22, samples=308 iops : min= 1, max= 24, avg= 8.79, stdev= 4.59, samples=308 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6236KiB/159964msec); 0 zone resets clat (usec): min=993, max=999616, avg=53575.51, stdev=60571.91 lat (usec): min=993, max=999619, avg=53584.05, stdev=60569.12 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1352], 10.00th=[ 2180], | 20.00th=[ 5473], 30.00th=[ 11207], 40.00th=[ 23725], | 50.00th=[ 37487], 60.00th=[ 51119], 70.00th=[ 69731], | 80.00th=[ 90702], 90.00th=[ 128451], 95.00th=[ 162530], | 99.00th=[ 244319], 99.50th=[ 283116], 99.90th=[ 396362], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 103, per=24.49%, avg=38.45, stdev=20.07, samples=313 iops : min= 1, max= 25, avg= 8.95, stdev= 5.05, samples=313 lat (usec) : 50=0.46%, 100=4.10%, 250=0.36%, 500=0.10%, 1000=0.03% lat (msec) : 2=4.75%, 4=3.06%, 10=7.03%, 20=7.68%, 50=31.74% lat (msec) : 100=27.21%, 250=12.83%, 500=0.62%, 1000=0.03% cpu : usr=0.07%, sys=4.15%, ctx=6545, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=150KiB/s (154kB/s), 37.1KiB/s-37.8KiB/s (37.0kB/s-38.7kB/s), io=23.4MiB (24.6MB), run=159396-160085msec WRITE: bw=157KiB/s (161kB/s), 38.0KiB/s-39.7KiB/s (39.9kB/s-40.6kB/s), io=24.6MiB (25.7MB), run=159396-160085msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144273: Fri Aug 28 05:49:58 2026 read: IOPS=4, BW=19.7KiB/s (20.1kB/s)(5992KiB/304741msec) clat (msec): min=5, max=1036, avg=40.20, stdev=53.40 lat (msec): min=5, max=1036, avg=40.20, stdev=53.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 55], 90.00th=[ 91], 95.00th=[ 125], | 99.00th=[ 224], 99.50th=[ 296], 99.90th=[ 726], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 118, per=29.17%, avg=22.75, stdev=16.99, samples=506 iops : min= 1, max= 29, avg= 5.05, stdev= 4.28, samples=506 write: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6296KiB/304741msec); 0 zone resets clat (msec): min=39, max=705, avg=155.03, stdev=89.22 lat (msec): min=39, max=705, avg=155.04, stdev=89.22 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 102], 40.00th=[ 114], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 174], 80.00th=[ 211], 90.00th=[ 275], 95.00th=[ 334], | 99.00th=[ 477], 99.50th=[ 502], 99.90th=[ 676], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 55, per=25.33%, avg=20.52, stdev=11.17, samples=587 iops : min= 1, max= 13, avg= 4.48, stdev= 2.86, samples=587 lat (msec) : 10=3.35%, 20=17.09%, 50=18.29%, 100=21.19%, 250=33.07% lat (msec) : 500=6.61%, 750=0.36%, 2000=0.03% cpu : usr=0.04%, sys=1.01%, ctx=5061, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144274: Fri Aug 28 05:49:58 2026 read: IOPS=4, BW=19.4KiB/s (19.8kB/s)(5940KiB/306785msec) clat (msec): min=5, max=1015, avg=40.21, stdev=53.91 lat (msec): min=5, max=1015, avg=40.21, stdev=53.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 55], 90.00th=[ 92], 95.00th=[ 126], | 99.00th=[ 211], 99.50th=[ 300], 99.90th=[ 676], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 104, per=29.96%, avg=23.37, stdev=16.92, samples=489 iops : min= 1, max= 26, avg= 5.22, stdev= 4.29, samples=489 write: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6348KiB/306785msec); 0 zone resets clat (msec): min=38, max=685, avg=155.39, stdev=85.09 lat (msec): min=38, max=685, avg=155.39, stdev=85.09 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 134], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 207], 90.00th=[ 275], 95.00th=[ 330], | 99.00th=[ 443], 99.50th=[ 502], 99.90th=[ 634], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 56, per=25.44%, avg=20.61, stdev=10.59, samples=588 iops : min= 1, max= 14, avg= 4.51, stdev= 2.70, samples=588 lat (msec) : 10=3.91%, 20=17.06%, 50=17.06%, 100=20.38%, 250=34.93% lat (msec) : 500=6.32%, 750=0.33%, 2000=0.03% cpu : usr=0.04%, sys=1.01%, ctx=5098, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144275: Fri Aug 28 05:49:58 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6028KiB/304131msec) clat (msec): min=5, max=418, avg=39.97, stdev=44.29 lat (msec): min=5, max=418, avg=39.97, stdev=44.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 57], 90.00th=[ 92], 95.00th=[ 123], | 99.00th=[ 218], 99.50th=[ 275], 99.90th=[ 384], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 95, per=29.41%, avg=22.94, stdev=16.06, samples=505 iops : min= 1, max= 23, avg= 5.10, stdev= 4.06, samples=505 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6260KiB/304131msec); 0 zone resets clat (msec): min=35, max=1088, avg=155.54, stdev=92.85 lat (msec): min=35, max=1088, avg=155.55, stdev=92.85 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 117], 50.00th=[ 130], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 264], 95.00th=[ 326], | 99.00th=[ 506], 99.50th=[ 592], 99.90th=[ 919], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 55, per=25.55%, avg=20.70, stdev=10.78, samples=579 iops : min= 1, max= 13, avg= 4.53, stdev= 2.75, samples=579 lat (msec) : 10=3.58%, 20=16.73%, 50=17.97%, 100=21.78%, 250=33.59% lat (msec) : 500=5.83%, 750=0.46%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.03%, ctx=5092, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144276: Fri Aug 28 05:49:58 2026 read: IOPS=4, BW=19.9KiB/s (20.3kB/s)(6052KiB/304599msec) clat (msec): min=5, max=416, avg=39.87, stdev=45.39 lat (msec): min=5, max=416, avg=39.88, stdev=45.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 55], 90.00th=[ 93], 95.00th=[ 130], | 99.00th=[ 226], 99.50th=[ 266], 99.90th=[ 397], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 93, per=30.01%, avg=23.41, stdev=16.97, samples=498 iops : min= 1, max= 23, avg= 5.21, stdev= 4.30, samples=498 write: IOPS=5, BW=20.5KiB/s (20.0kB/s)(6236KiB/304599msec); 0 zone resets clat (msec): min=32, max=1084, avg=156.38, stdev=92.04 lat (msec): min=32, max=1084, avg=156.38, stdev=92.04 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 131], 60.00th=[ 150], | 70.00th=[ 174], 80.00th=[ 207], 90.00th=[ 275], 95.00th=[ 334], | 99.00th=[ 477], 99.50th=[ 514], 99.90th=[ 919], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 55, per=25.23%, avg=20.44, stdev=10.87, samples=584 iops : min= 1, max= 13, avg= 4.46, stdev= 2.77, samples=584 lat (msec) : 10=3.78%, 20=16.93%, 50=18.46%, 100=20.15%, 250=33.72% lat (msec) : 500=6.64%, 750=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.03%, ctx=5174, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=78.3KiB/s (80.1kB/s), 19.4KiB/s-19.9KiB/s (19.8kB/s-20.3kB/s), io=23.4MiB (24.6MB), run=304131-306785msec WRITE: bw=81.9KiB/s (83.9kB/s), 20.5KiB/s-20.7KiB/s (20.0kB/s-21.2kB/s), io=24.6MiB (25.7MB), run=304131-306785msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144346: Fri Aug 28 05:50:40 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5920KiB/28673msec) clat (usec): min=34, max=240116, avg=38825.35, stdev=34512.98 lat (usec): min=34, max=240117, avg=38827.19, stdev=34513.24 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 84], | 30.00th=[ 20841], 40.00th=[ 30278], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 62129], 90.00th=[ 80217], 95.00th=[ 93848], | 99.00th=[149947], 99.50th=[214959], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 64, max= 410, per=26.03%, avg=206.95, stdev=80.31, samples=56 iops : min= 4, max= 25, avg=12.16, stdev= 5.06, samples=56 write: IOPS=13, BW=222KiB/s (227kB/s)(6368KiB/28673msec); 0 zone resets clat (usec): min=1484, max=243075, avg=35710.81, stdev=39352.30 lat (usec): min=1486, max=243077, avg=35728.12, stdev=39343.27 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1876], 10.00th=[ 2868], 20.00th=[ 4948], | 30.00th=[ 7963], 40.00th=[ 11338], 50.00th=[ 20579], 60.00th=[ 30802], | 70.00th=[ 46924], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[181404], 99.50th=[206570], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 415, per=26.65%, avg=223.09, stdev=94.21, samples=56 iops : min= 1, max= 25, avg=13.18, stdev= 5.92, samples=56 lat (usec) : 50=1.43%, 100=8.85%, 250=0.91%, 500=0.39%, 750=0.13% lat (msec) : 2=2.99%, 4=5.34%, 10=11.98%, 20=7.81%, 50=31.12% lat (msec) : 100=22.79%, 250=6.25% cpu : usr=0.09%, sys=5.08%, ctx=1372, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144347: Fri Aug 28 05:50:40 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5744KiB/29454msec) clat (usec): min=40, max=373622, avg=40287.27, stdev=38326.28 lat (usec): min=40, max=373623, avg=40288.56, stdev=38326.22 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 85], | 30.00th=[ 15926], 40.00th=[ 28443], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 54264], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[139461], 99.50th=[147850], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 62, max= 415, per=24.51%, avg=194.82, stdev=84.57, samples=57 iops : min= 3, max= 25, avg=11.39, stdev= 5.32, samples=57 write: IOPS=13, BW=222KiB/s (228kB/s)(6544KiB/29454msec); 0 zone resets clat (usec): min=1527, max=345465, avg=36185.28, stdev=41514.73 lat (usec): min=1531, max=345467, avg=36188.11, stdev=41515.24 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2147], 10.00th=[ 3589], 20.00th=[ 5997], | 30.00th=[ 7701], 40.00th=[ 11076], 50.00th=[ 18220], 60.00th=[ 31065], | 70.00th=[ 45351], 80.00th=[ 65799], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[164627], 99.50th=[200279], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 63, max= 414, per=26.93%, avg=225.37, stdev=91.31, samples=56 iops : min= 3, max= 25, avg=13.32, stdev= 5.76, samples=56 lat (usec) : 50=1.30%, 100=8.98%, 250=0.91%, 500=0.65%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.34%, 4=4.30%, 10=14.06%, 20=9.11%, 50=26.43% lat (msec) : 100=24.61%, 250=6.64%, 500=0.26% cpu : usr=0.06%, sys=5.29%, ctx=1420, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144348: Fri Aug 28 05:50:40 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(6256KiB/30106msec) clat (usec): min=37, max=269201, avg=40781.33, stdev=37541.82 lat (usec): min=37, max=269204, avg=40782.90, stdev=37541.75 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 87], | 30.00th=[ 19792], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[ 83362], 95.00th=[ 96994], | 99.00th=[198181], 99.50th=[223347], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 446, per=26.04%, avg=207.00, stdev=85.32, samples=59 iops : min= 3, max= 27, avg=12.17, stdev= 5.31, samples=59 write: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30106msec); 0 zone resets clat (usec): min=1420, max=221777, avg=37041.90, stdev=36059.91 lat (usec): min=1420, max=221780, avg=37046.65, stdev=36059.52 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1844], 10.00th=[ 2999], 20.00th=[ 5997], | 30.00th=[ 8717], 40.00th=[ 14091], 50.00th=[ 25560], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[105382], | 99.00th=[145753], 99.50th=[200279], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 63, max= 382, per=23.53%, avg=196.95, stdev=70.70, samples=59 iops : min= 3, max= 23, avg=11.54, stdev= 4.49, samples=59 lat (usec) : 50=1.30%, 100=9.64%, 250=1.43%, 500=0.26%, 750=0.39% lat (msec) : 2=3.39%, 4=3.78%, 10=9.51%, 20=8.59%, 50=28.52% lat (msec) : 100=28.39%, 250=4.69%, 500=0.13% cpu : usr=0.07%, sys=5.14%, ctx=1439, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144349: Fri Aug 28 05:50:40 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28884msec) clat (usec): min=41, max=274476, avg=41120.22, stdev=33596.37 lat (usec): min=41, max=274477, avg=41123.75, stdev=33596.50 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 112], | 30.00th=[ 25822], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 46924], | 70.00th=[ 54789], 80.00th=[ 68682], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[120062], 99.50th=[166724], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 62, max= 475, per=26.06%, avg=207.20, stdev=81.38, samples=56 iops : min= 3, max= 29, avg=12.16, stdev= 5.17, samples=56 write: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28884msec); 0 zone resets clat (usec): min=1376, max=197706, avg=33747.26, stdev=37752.91 lat (usec): min=1376, max=197706, avg=33750.12, stdev=37752.70 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1958], 10.00th=[ 2835], 20.00th=[ 5145], | 30.00th=[ 7635], 40.00th=[ 10159], 50.00th=[ 16712], 60.00th=[ 28967], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[177210], 99.50th=[185598], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 62, max= 473, per=25.80%, avg=215.96, stdev=80.28, samples=56 iops : min= 3, max= 29, avg=12.73, stdev= 5.10, samples=56 lat (usec) : 50=1.17%, 100=8.46%, 250=0.65%, 500=0.52%, 750=0.13% lat (msec) : 2=3.39%, 4=4.82%, 10=13.02%, 20=7.42%, 50=30.73% lat (msec) : 100=23.44%, 250=6.12%, 500=0.13% cpu : usr=0.09%, sys=5.31%, ctx=1432, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=796KiB/s (815kB/s), 195KiB/s-209KiB/s (200kB/s-214kB/s), io=23.4MiB (24.5MB), run=28673-30106msec WRITE: bw=837KiB/s (857kB/s), 200KiB/s-222KiB/s (205kB/s-228kB/s), io=24.6MiB (25.8MB), run=28673-30106msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144351: Fri Aug 28 05:51:25 2026 read: IOPS=5, BW=81.8KiB/s (83.7kB/s)(5920KiB/72405msec) clat (msec): min=7, max=180, avg=39.40, stdev=33.78 lat (msec): min=7, max=180, avg=39.40, stdev=33.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 123], | 99.00th=[ 161], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 30, max= 315, per=28.99%, avg=93.06, stdev=57.12, samples=125 iops : min= 1, max= 19, avg= 5.07, stdev= 3.62, samples=125 write: IOPS=5, BW=87.9KiB/s (90.1kB/s)(6368KiB/72405msec); 0 zone resets clat (msec): min=36, max=551, avg=145.12, stdev=64.73 lat (msec): min=36, max=551, avg=145.12, stdev=64.73 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 108], 40.00th=[ 117], 50.00th=[ 129], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 199], 90.00th=[ 230], 95.00th=[ 266], | 99.00th=[ 326], 99.50th=[ 355], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 22, max= 192, per=26.31%, avg=88.94, stdev=39.11, samples=141 iops : min= 1, max= 12, avg= 4.79, stdev= 2.53, samples=141 lat (msec) : 10=1.82%, 20=12.89%, 50=22.79%, 100=20.31%, 250=38.93% lat (msec) : 500=3.12%, 750=0.13% cpu : usr=0.04%, sys=1.07%, ctx=1275, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144352: Fri Aug 28 05:51:25 2026 read: IOPS=4, BW=77.2KiB/s (79.0kB/s)(5744KiB/74449msec) clat (msec): min=6, max=284, avg=40.86, stdev=41.29 lat (msec): min=6, max=284, avg=40.87, stdev=41.29 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 83], 95.00th=[ 127], | 99.00th=[ 239], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 22, max= 351, per=28.74%, avg=92.27, stdev=62.50, samples=123 iops : min= 1, max= 21, avg= 5.02, stdev= 3.93, samples=123 write: IOPS=5, BW=87.9KiB/s (90.0kB/s)(6544KiB/74449msec); 0 zone resets clat (msec): min=40, max=449, avg=145.93, stdev=66.49 lat (msec): min=40, max=449, avg=145.95, stdev=66.49 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 95], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 133], 60.00th=[ 148], | 70.00th=[ 163], 80.00th=[ 197], 90.00th=[ 228], 95.00th=[ 279], | 99.00th=[ 355], 99.50th=[ 426], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 31, max= 192, per=26.40%, avg=89.22, stdev=38.13, samples=144 iops : min= 1, max= 12, avg= 4.83, stdev= 2.46, samples=144 lat (msec) : 10=1.69%, 20=14.19%, 50=20.31%, 100=19.92%, 250=39.84% lat (msec) : 500=4.04% cpu : usr=0.05%, sys=1.21%, ctx=1331, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144353: Fri Aug 28 05:51:25 2026 read: IOPS=5, BW=88.9KiB/s (91.0kB/s)(6256KiB/70368msec) clat (msec): min=8, max=238, avg=40.54, stdev=36.34 lat (msec): min=8, max=238, avg=40.54, stdev=36.34 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 78], 95.00th=[ 118], | 99.00th=[ 205], 99.50th=[ 211], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 30, max= 320, per=30.32%, avg=97.32, stdev=67.91, samples=127 iops : min= 1, max= 20, avg= 5.32, stdev= 4.31, samples=127 write: IOPS=5, BW=85.7KiB/s (87.8kB/s)(6032KiB/70368msec); 0 zone resets clat (msec): min=42, max=463, avg=144.39, stdev=68.28 lat (msec): min=42, max=463, avg=144.44, stdev=68.29 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 104], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 192], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 372], 99.50th=[ 426], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 31, max= 189, per=25.44%, avg=85.97, stdev=36.20, samples=138 iops : min= 1, max= 11, avg= 4.60, stdev= 2.30, samples=138 lat (msec) : 10=0.78%, 20=12.37%, 50=26.30%, 100=21.88%, 250=34.64% lat (msec) : 500=4.04% cpu : usr=0.04%, sys=1.14%, ctx=1386, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144354: Fri Aug 28 05:51:25 2026 read: IOPS=5, BW=83.6KiB/s (85.6kB/s)(6032KiB/72125msec) clat (msec): min=7, max=266, avg=39.33, stdev=37.03 lat (msec): min=7, max=266, avg=39.33, stdev=37.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 117], | 99.00th=[ 211], 99.50th=[ 243], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 30, max= 286, per=30.19%, avg=96.92, stdev=58.92, samples=121 iops : min= 1, max= 17, avg= 5.30, stdev= 3.73, samples=121 write: IOPS=5, BW=86.7KiB/s (88.8kB/s)(6256KiB/72125msec); 0 zone resets clat (msec): min=40, max=564, avg=146.39, stdev=68.51 lat (msec): min=40, max=564, avg=146.40, stdev=68.50 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 116], 50.00th=[ 128], 60.00th=[ 144], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 234], 95.00th=[ 288], | 99.00th=[ 376], 99.50th=[ 401], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 31, max= 192, per=26.05%, avg=88.06, stdev=37.85, samples=139 iops : min= 1, max= 12, avg= 4.73, stdev= 2.43, samples=139 lat (msec) : 10=1.95%, 20=14.32%, 50=22.66%, 100=19.66%, 250=36.98% lat (msec) : 500=4.30%, 750=0.13% cpu : usr=0.05%, sys=1.10%, ctx=1251, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=322KiB/s (329kB/s), 77.2KiB/s-88.9KiB/s (79.0kB/s-91.0kB/s), io=23.4MiB (24.5MB), run=70368-74449msec WRITE: bw=338KiB/s (347kB/s), 85.7KiB/s-87.9KiB/s (87.8kB/s-90.1kB/s), io=24.6MiB (25.8MB), run=70368-74449msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144377: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=991KiB/s (1015kB/s)(7168KiB/7235msec) clat (usec): min=963, max=345880, avg=228889.00, stdev=110070.24 lat (usec): min=965, max=345881, avg=228890.88, stdev=110070.30 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], 20.00th=[210764], | 30.00th=[231736], 40.00th=[231736], 50.00th=[246416], 60.00th=[267387], | 70.00th=[267387], 80.00th=[299893], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1560, max= 4096, per=100.00%, avg=2930.50, stdev=1318.82, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=708KiB/s (725kB/s)(5120KiB/7235msec); 0 zone resets clat (msec): min=191, max=4450, avg=1092.52, stdev=1877.64 lat (msec): min=192, max=4450, avg=1092.62, stdev=1877.64 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 2027, max= 4023, per=99.14%, avg=2697.67, stdev=1147.80, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.55%, ctx=195, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144378: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=201KiB/s (206kB/s)(2048KiB/10191msec) clat (usec): min=632, max=4911.7k, avg=2456169.27, stdev=3472653.67 lat (usec): min=633, max=4911.7k, avg=2456171.52, stdev=3472654.55 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], | 20.00th=[ 635], 30.00th=[ 635], 40.00th=[ 635], | 50.00th=[ 635], 60.00th=[4932502], 70.00th=[4932502], | 80.00th=[4932502], 90.00th=[4932502], 95.00th=[4932502], | 99.00th=[4932502], 99.50th=[4932502], 99.90th=[4932502], | 99.95th=[4932502], 99.99th=[4932502] bw ( KiB/s): min= 1903, max= 2035, per=100.00%, avg=1969.00, stdev=93.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1005KiB/s (1029kB/s)(10.0MiB/10191msec); 0 zone resets clat (msec): min=159, max=954, avg=513.65, stdev=308.32 lat (msec): min=159, max=954, avg=513.81, stdev=308.41 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 211], | 30.00th=[ 215], 40.00th=[ 338], 50.00th=[ 393], 60.00th=[ 414], | 70.00th=[ 701], 80.00th=[ 852], 90.00th=[ 902], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2011, max= 5976, per=100.00%, avg=3167.00, stdev=1750.85, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=8.33%, 1000=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=7.20%, ctx=697, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144379: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=583KiB/s (597kB/s)(6144KiB/10536msec) clat (msec): min=245, max=549, avg=329.60, stdev=114.94 lat (msec): min=245, max=549, avg=329.60, stdev=114.94 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 317], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1835, max= 4039, per=100.00%, avg=2461.50, stdev=1054.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=583KiB/s (597kB/s)(6144KiB/10536msec); 0 zone resets clat (msec): min=380, max=5212, avg=1374.99, stdev=1898.66 lat (msec): min=380, max=5212, avg=1375.18, stdev=1898.62 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 760], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 1835, max= 2043, per=73.04%, avg=1987.33, stdev=80.04, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.00%, ctx=218, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144381: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=587KiB/s (601kB/s)(5120KiB/8720msec) clat (usec): min=617, max=358416, avg=222325.83, stdev=156836.25 lat (usec): min=619, max=358417, avg=222327.48, stdev=156836.13 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[114820], 40.00th=[114820], 50.00th=[299893], 60.00th=[299893], | 70.00th=[337642], 80.00th=[337642], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 2043, max= 6059, per=100.00%, avg=4051.00, stdev=2839.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=822KiB/s (842kB/s)(7168KiB/8720msec); 0 zone resets clat (msec): min=158, max=4896, avg=1037.87, stdev=1717.47 lat (msec): min=158, max=4896, avg=1038.00, stdev=1717.52 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 194], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 347], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 844], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 2011, max= 3676, per=86.62%, avg=2356.80, stdev=737.63, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.03%, ctx=140, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1944KiB/s (1990kB/s), 201KiB/s-991KiB/s (206kB/s-1015kB/s), io=20.0MiB (20.0MB), run=7235-10536msec WRITE: bw=2721KiB/s (2787kB/s), 583KiB/s-1005KiB/s (597kB/s-1029kB/s), io=28.0MiB (29.4MB), run=7235-10536msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144374: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=738KiB/s (755kB/s)(7168KiB/9716msec) clat (msec): min=166, max=569, avg=318.33, stdev=138.02 lat (msec): min=166, max=569, avg=318.33, stdev=138.02 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 215], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 317], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 414], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1370, max= 4079, per=100.00%, avg=2305.40, stdev=1031.45, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=527KiB/s (540kB/s)(5120KiB/9716msec); 0 zone resets clat (msec): min=398, max=4891, avg=1439.35, stdev=1933.25 lat (msec): min=398, max=4891, avg=1439.48, stdev=1933.22 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 1939, max= 2023, per=75.32%, avg=1999.00, stdev=40.40, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=25.00%, 500=33.33%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.02%, ctx=106, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144375: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=190KiB/s (194kB/s)(2048KiB/10803msec) clat (msec): min=304, max=4873, avg=2588.71, stdev=3230.77 lat (msec): min=304, max=4873, avg=2588.71, stdev=3230.77 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 4866], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 2007, max= 2048, per=100.00%, avg=2027.50, stdev=28.99, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=0, BW=948KiB/s (971kB/s)(10.0MiB/10803msec); 0 zone resets clat (msec): min=224, max=1528, avg=532.91, stdev=386.41 lat (msec): min=224, max=1528, avg=533.03, stdev=386.41 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 236], | 30.00th=[ 262], 40.00th=[ 342], 50.00th=[ 409], 60.00th=[ 439], | 70.00th=[ 558], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 2019, max= 4047, per=97.12%, avg=2577.57, stdev=937.94, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=1.88%, ctx=89, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144376: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=629KiB/s (644kB/s)(6144KiB/9771msec) clat (msec): min=106, max=434, avg=259.21, stdev=137.18 lat (msec): min=106, max=434, avg=259.21, stdev=137.18 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 313], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1924, max= 2048, per=100.00%, avg=2012.20, stdev=50.45, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=629KiB/s (644kB/s)(6144KiB/9771msec); 0 zone resets clat (msec): min=298, max=5215, avg=1352.89, stdev=1903.99 lat (msec): min=298, max=5215, avg=1353.98, stdev=1903.57 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 709], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 1924, max= 4079, per=90.70%, avg=2407.20, stdev=935.34, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.36%, ctx=68, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144380: Fri Aug 28 05:51:47 2026 read: IOPS=0, BW=484KiB/s (495kB/s)(5120KiB/10589msec) clat (msec): min=112, max=793, avg=344.30, stdev=290.07 lat (msec): min=112, max=793, avg=344.30, stdev=290.07 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1939, max= 4096, per=100.00%, avg=2686.00, stdev=1221.82, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=0, BW=677KiB/s (693kB/s)(7168KiB/10589msec); 0 zone resets clat (msec): min=193, max=5287, avg=1214.62, stdev=1815.40 lat (msec): min=193, max=5287, avg=1214.80, stdev=1815.42 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 201], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 709], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 827], 90.00th=[ 5269], 95.00th=[ 5269], | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], | 99.99th=[ 5269] bw ( KiB/s): min= 1992, max= 2043, per=76.14%, avg=2020.80, stdev=18.50, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=16.67%, 750=8.33%, 1000=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=2.48%, ctx=163, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1896KiB/s (1941kB/s), 190KiB/s-738KiB/s (194kB/s-755kB/s), io=20.0MiB (20.0MB), run=9716-10803msec WRITE: bw=2654KiB/s (2718kB/s), 527KiB/s-948KiB/s (540kB/s-971kB/s), io=28.0MiB (29.4MB), run=9716-10803msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144388: Fri Aug 28 05:52:07 2026 read: IOPS=0, BW=1691KiB/s (1732kB/s)(12.0MiB/7266msec) clat (msec): min=804, max=5115, avg=2384.09, stdev=2374.96 lat (msec): min=804, max=5115, avg=2384.09, stdev=2374.96 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 5134], 80.00th=[ 5134], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 8078, max= 8143, per=100.00%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.46%, ctx=350, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144390: Fri Aug 28 05:52:07 2026 read: IOPS=0, BW=499KiB/s (511kB/s)(4096KiB/8210msec) clat (nsec): min=5200.2M, max=5200.2M, avg=5200176446.00, stdev= 0.00 lat (nsec): min=5200.2M, max=5200.2M, avg=5200179659.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 5201], 5.00th=[ 5201], 10.00th=[ 5201], 20.00th=[ 5201], | 30.00th=[ 5201], 40.00th=[ 5201], 50.00th=[ 5201], 60.00th=[ 5201], | 70.00th=[ 5201], 80.00th=[ 5201], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=998KiB/s (1022kB/s)(8192KiB/8210msec); 0 zone resets clat (msec): min=442, max=2369, avg=1406.36, stdev=1362.61 lat (msec): min=443, max=2370, avg=1406.77, stdev=1362.49 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 2366], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.07%, sys=4.52%, ctx=620, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144391: Fri Aug 28 05:52:07 2026 write: IOPS=0, BW=1526KiB/s (1562kB/s)(12.0MiB/8055msec); 0 zone resets clat (msec): min=1138, max=4871, avg=2651.12, stdev=1964.79 lat (msec): min=1139, max=4878, avg=2653.86, stdev=1968.16 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.04%, sys=2.78%, ctx=93, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144392: Fri Aug 28 05:52:07 2026 write: IOPS=0, BW=1841KiB/s (1885kB/s)(12.0MiB/6675msec); 0 zone resets clat (msec): min=662, max=4651, avg=2187.10, stdev=2153.81 lat (msec): min=662, max=4652, avg=2188.00, stdev=2154.36 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.81%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1996KiB/s (2044kB/s), 499KiB/s-1691KiB/s (511kB/s-1732kB/s), io=16.0MiB (16.8MB), run=7266-8210msec WRITE: bw=3991KiB/s (4087kB/s), 998KiB/s-1841KiB/s (1022kB/s-1885kB/s), io=32.0MiB (33.6MB), run=6675-8210msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144393: Fri Aug 28 05:52:08 2026 read: IOPS=0, BW=1447KiB/s (1482kB/s)(12.0MiB/8491msec) clat (msec): min=274, max=5783, avg=2770.47, stdev=2790.52 lat (msec): min=274, max=5783, avg=2770.47, stdev=2790.52 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 2265], 50.00th=[ 2265], 60.00th=[ 2265], | 70.00th=[ 5805], 80.00th=[ 5805], 90.00th=[ 5805], 95.00th=[ 5805], | 99.00th=[ 5805], 99.50th=[ 5805], 99.90th=[ 5805], 99.95th=[ 5805], | 99.99th=[ 5805] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.63%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144394: Fri Aug 28 05:52:08 2026 read: IOPS=0, BW=475KiB/s (487kB/s)(4096KiB/8616msec) clat (nsec): min=5423.0M, max=5423.0M, avg=5423962164.00, stdev= 0.00 lat (nsec): min=5423.0M, max=5423.0M, avg=5423965214.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 5403], 5.00th=[ 5403], 10.00th=[ 5403], 20.00th=[ 5403], | 30.00th=[ 5403], 40.00th=[ 5403], 50.00th=[ 5403], 60.00th=[ 5403], | 70.00th=[ 5403], 80.00th=[ 5403], 90.00th=[ 5403], 95.00th=[ 5403], | 99.00th=[ 5403], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], | 99.99th=[ 5403] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=951KiB/s (974kB/s)(8192KiB/8616msec); 0 zone resets clat (msec): min=543, max=2427, avg=1485.79, stdev=1331.92 lat (msec): min=544, max=2428, avg=1486.43, stdev=1331.79 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 2433], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.30%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144395: Fri Aug 28 05:52:08 2026 write: IOPS=0, BW=1501KiB/s (1538kB/s)(12.0MiB/8184msec); 0 zone resets clat (msec): min=687, max=5333, avg=2696.79, stdev=2385.49 lat (msec): min=687, max=5333, avg=2698.04, stdev=2385.16 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 2072], 50.00th=[ 2072], 60.00th=[ 2072], | 70.00th=[ 5336], 80.00th=[ 5336], 90.00th=[ 5336], 95.00th=[ 5336], | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], | 99.99th=[ 5336] bw ( KiB/s): min= 7984, max= 8159, per=100.00%, avg=8071.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.04%, sys=2.59%, ctx=105, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144396: Fri Aug 28 05:52:08 2026 write: IOPS=0, BW=1642KiB/s (1681kB/s)(12.0MiB/7485msec); 0 zone resets clat (msec): min=383, max=4798, avg=2404.58, stdev=2230.62 lat (msec): min=384, max=4798, avg=2405.50, stdev=2230.47 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 2039], 50.00th=[ 2039], 60.00th=[ 2039], | 70.00th=[ 4799], 80.00th=[ 4799], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 7968, max= 8159, per=100.00%, avg=8063.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.07%, sys=1.79%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1902KiB/s (1947kB/s), 475KiB/s-1447KiB/s (487kB/s-1482kB/s), io=16.0MiB (16.8MB), run=8491-8616msec WRITE: bw=3803KiB/s (3894kB/s), 951KiB/s-1642KiB/s (974kB/s-1681kB/s), io=32.0MiB (33.6MB), run=7485-8616msec